Remote Data Engineer

Description:

• Buyers Edge Platform is revolutionizing the foodservice industry through technology, purchasing power, and partnerships.
• The company aims to empower stakeholders across the foodservice ecosystem with efficiency and visibility.
• The data engineering mission is to make data quickly and easily accessible with scalable, secure, and cost-effective solutions.
• The Data Engineer will support and improve existing data infrastructure and create and modify ETL processes within the AWS Data Ecosystem.
• Responsibilities include collaborating with the DevOps team, assisting developers and analysts with data performance improvements, and responding to service issues and requests.
• The role may require occasional after-hours work and testing new technology to solve business problems.

Requirements:

• Candidates must be experts with AWS data platforms and integrations, including Data Lakes, pyspark, Glue, and Athens.
• A solid understanding of at least one scripting language such as Python, Golang, NodeJS, or TypeScript is required.
• Basic knowledge of an orchestrator tool like Terraform or Cloud Formation is necessary.
• Proficiency in Git version control is essential.
• Experience with monitoring tools, APM, logging, and infrastructure is required.
• A solid understanding of RDMS schema and performance, particularly with MySQL, Amazon Aurora, and Postgres, is needed; MSSQL knowledge is a plus.
• Familiarity with data warehousing technologies like Redshift and Snowflake is expected.
• Candidates should have a high-level understanding of data storage systems, including NoSQL, Time Series, Document, and RDMS.
• A high-level understanding of messaging queue and data streaming technology is required.
• Thorough understanding of Apache Hudi or Iceberg is necessary.
• Effective written and oral communication skills are essential.

Benefits:

• The position offers comprehensive medical, dental, and vision coverages, along with ancillary plans such as flexible spending accounts, critical illness, accident, and voluntary life insurance.
• Company-paid life and long-term disability plans are included, as well as a 401(k) plan with company match.
• A thorough training and development program will be provided, along with competitive compensation.
• The Personal Responsibility Paid Time Off policy allows employees to take time off without accruing it, and half-day Summer Fridays are also offered.