This position is for a Data Engineer at J.D. Power, located in Canada, and is fully remote.
The role involves designing and optimizing scalable ETL pipelines and data architectures.
You will work with vast datasets using technologies like SQL, Python, and Spark.
Collaboration with cross-functional teams is essential to ensure efficient data flows and high-quality integration.
You will play a key role in building the foundation for advanced analytics.
Responsibilities include developing and maintaining robust ETL pipelines, building scalable data architectures, and partnering with analysts and stakeholders to deliver optimal data solutions.
You will monitor, troubleshoot, and enhance data workflows to ensure reliability and performance.
The role requires working with large-scale datasets and ensuring efficient distributed processing with tools like Spark.
Upholding data quality, integrity, and compliance through strong documentation and security best practices is crucial.
You will contribute to continuous improvements in the data ecosystem, including CI/CD pipeline integration.
Requirements:
A minimum of 5 years of experience as a Data Engineer, focusing on ETL development using SQL and Python is required.
Proficiency in writing scalable and maintainable SQL for complex data transformations and logic is necessary.
Strong Python programming skills with an understanding of modular, object-oriented design and integration with cloud and relational databases (e.g., Snowflake, BigQuery, PostgreSQL) are essential.
Experience working with Spark for large-scale, distributed data processing is required.
Skills in performance tuning, debugging, and working with JSON and APIs are necessary.
A solid knowledge of data warehousing concepts and dimensional modeling is required.
Familiarity with CI/CD pipelines and platforms like Palantir is a plus.
Strong communication and problem-solving skills are essential, along with the ability to work collaboratively in remote-first environments.
A Bachelor’s degree or higher in Computer Science, Engineering, or a related field is required.
Benefits:
The position offers a fully remote work structure with flexible scheduling.
Performance-based rewards and clear leadership support are provided.
A generous paid time off policy is included.
Health and wellness support, including healthcare coverage, is offered.
There are professional growth and development opportunities in a mission-driven, values-led company.