This job post is closed and the position is probably filled. Please do not apply.
🤖 Automatically closed by a robot after apply link
was detected as broken.
Description:
We are seeking an experienced Senior Data Engineer to join our team and take a leadership role in designing, building, and optimizing advanced data solutions.
The ideal candidate should be passionate about leveraging data to drive business insights and have a strong background in cloud computing and machine learning.
Responsibilities include analyzing datasets from platform and business systems, designing and implementing frameworks for seamless data integration, and determining data lake requirements.
The role involves acquiring, cleaning, and transforming datasets to align with business needs, ensuring data quality and consistency while building, testing, and maintaining scalable and efficient data pipeline architectures.
The Senior Data Engineer will develop tools, systems, and algorithms for data analysis and processing, enabling stakeholders to identify patterns, trends, and insights from raw data.
The position requires deploying and managing scalable data solutions on AWS, ensuring optimal performance, security, and cost-efficiency.
Collaboration with ML engineers is essential to create required datasets, feature stores, and prompts, developing new features from existing data to support machine learning initiatives.
The role includes providing technical leadership and mentorship to junior team members, fostering a culture of innovation and continuous improvement.
Continuous monitoring and optimization of data pipelines and architectures for performance, reliability, and scalability is expected.
The Senior Data Engineer will maintain clear and comprehensive documentation of data processes, pipelines, and architectures.
Requirements:
Candidates must have 6+ years of experience in data engineering or a related field.
Proficiency in programming languages such as Python, Clojure, SQL, and SparkSQL is required.
A strong understanding of database systems and database design principles is necessary.
Hands-on experience with big data processing frameworks such as Kafka, EKS, and Delta Live Tables is essential.
Expertise in deploying and managing scalable data solutions on AWS Cloud computing platforms (e.g., S3, Redshift, Glue, EMR) is required.
Experience working with machine learning teams to create datasets, feature stores, and prompts is necessary.
A strong knowledge of Enterprise Data Architecture and Data Analytics, including technology evaluations and solution design, is required.
Familiarity with data best practices, compliance, and regulatory requirements is essential.
A Bachelor’s Degree in Computer Science, Data Engineering, or a related field is required, with a Master’s Degree preferred.
Strong problem-solving skills and the ability to lead complex technical projects are necessary.
Excellent communication skills to collaborate effectively with technical and non-technical stakeholders are required.
US Citizenship is required for this position.
Benefits:
Candidates can choose their contract type: Contract(1099) or B2B/C2C.
The company offers an unlimited working-from-anywhere policy.
Referral bonuses are available for employees.
Employees will have the opportunity to work on international projects.