Remote Senior Data Engineer

Description:

• Zingtree is seeking a Senior Data Engineer to design, build, and maintain scalable data processing systems and analytics platforms.
• The role involves leading efforts to create robust, in-house data infrastructure solutions to support growing data needs and business intelligence requirements.
• Responsibilities include designing and implementing efficient data storage and processing solutions for large-scale datasets, and architecting a new data processing framework to replace existing third-party solutions.
• The engineer will develop and optimize data pipelines for event data ingestion and processing, and implement real-time analytics capabilities for clickstream data.
• The position requires evaluating and integrating open-source technologies like Apache Druid and Spark based on project requirements and performance needs.
• Collaboration with backend engineering teams using Go in a Kubernetes environment is essential, along with participation in architectural decisions for scalable data systems.
• The engineer will optimize query performance and data access patterns for analytics platforms, ensuring systems scale efficiently with growing data volumes.
• Data modeling to support business intelligence needs and facilitate efficient reporting capabilities is also a key responsibility.
• The role includes creating comprehensive documentation and establishing best practices for data engineering across the organization.
• The Senior Data Engineer will provide architectural direction for data systems and mentor junior engineers on data engineering best practices.

Requirements:

• Candidates must have 5+ years of experience in data engineering, with expertise in large-scale systems and data infrastructure design.
• A strong background in database technologies and SQL optimization is required, along with experience designing data warehousing solutions.
• Proficiency in building and optimizing data pipelines, and knowledge of distributed computing platforms such as Spark or Flink is necessary.
• Experience with columnar databases and OLAP systems, particularly Apache Druid, is essential.
• Familiarity with cloud infrastructure, especially AWS, and understanding of container orchestration with Kubernetes is required.
• Candidates should have experience with stream processing and real-time analytics frameworks, and knowledge of Go programming is a plus.
• A background in event data processing and analytics, as well as familiarity with Kafka or similar message queuing systems, is preferred.
• Strong problem-solving abilities and experience troubleshooting complex data systems are necessary.
• Candidates must possess the ability to explain complex technical concepts to various stakeholders and experience collaborating with cross-functional engineering teams.
• Self-motivation, a proactive approach to identifying and addressing technical challenges, and experience mentoring junior engineers on data best practices are important.
• Organizational skills to manage multiple projects and priorities, along with adaptability to evolving technical requirements and business needs, are required.

Benefits:

• Zingtree offers competitive compensation packages to its employees.
• Employees are provided with equity stock options.
• Comprehensive health insurance is available for employees and their dependents.
• Provident Fund contributions are made in compliance with EPF guidelines.
• The company provides generous paid parental leave for parents to spend time with their new child.
• Unlimited paid time off (PTO) is offered, allowing employees to take the time they need to recharge.
• Flexible remote work options are available, enabling employees to work from anywhere.
• A home office stipend of up to $500 is provided to create a great work environment at home, along with $100 a month for Internet and phone expenses.
• Co-working space reimbursement of up to $200 a month is available for employees who choose to work in co-working spaces.