This job post is closed and the position is probably filled. Please do not apply.
π€ Automatically closed by a robot after apply link
was detected as broken.
Description:
Design, build, and maintain scalable and reliable data pipelines for ingesting, processing, and transforming large volumes of data from diverse sources.
Implement data models and schemas to support analytics, reporting, and machine learning applications, ensuring data quality, consistency, and performance.
Integrate data from internal and external sources, including databases, APIs, and streaming platforms, ensuring data consistency and integrity across systems.
Implement data transformation and cleansing processes to standardize and enrich data for analysis and modeling, using tools and frameworks such as Apache Spark or Apache Beam.
Manage data storage solutions, including data lakes, data warehouses, and NoSQL databases, optimizing for performance, cost, and scalability.
Implement data governance policies and security controls to ensure compliance with regulatory requirements and protect sensitive data.
Monitor data pipelines and systems for performance, reliability, and efficiency, proactively identifying and addressing issues to minimize downtime and optimize resource utilization.
Document data infrastructure and processes, including data dictionaries, data lineage, and workflow diagrams, and collaborate with cross-functional teams to ensure alignment and transparency.
Requirements:
Bachelor's degree or higher in Computer Science, Engineering, or related field.
Strong background in data engineering, with hands-on experience in designing, building, and maintaining data pipelines and systems.
Proficiency in programming languages such as Python, Java, or Scala, and experience with data processing frameworks such as Apache Spark or Apache Beam.
Experience with data modeling and database design, including relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra).
Familiarity with data integration tools and technologies, such as Apache Kafka, AWS Glue, or Google Dataflow.
Strong problem-solving abilities and analytical thinking, with a keen attention to detail and a passion for tackling complex technical challenges.
Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders.
Benefits:
Competitive salary: The industry standard salary for Data Engineers typically ranges from $140,000 to $210,000 per year, depending on experience and qualifications. Exceptional candidates may be eligible for higher compensation packages.
Comprehensive health, dental, and vision insurance plans.
Flexible work hours and remote work options.
Generous vacation and paid time off.
Professional development opportunities, including access to training programs, conferences, and workshops.
State-of-the-art technology environment with access to cutting-edge tools and resources.
Vibrant and inclusive company culture with team-building activities and social events.
Opportunities for career growth and advancement within the company.
Exciting projects with real-world impact across diverse industries.
Chance to work alongside top talent and industry experts in the field of data engineering.