Description:

Blue Coding is seeking a Senior Data Engineer to join a global leader in government technology.
The role involves leveraging various data sources to assist stakeholders in creating products and answering business questions.
Daily responsibilities include working with business stakeholders to understand their goals, building standardized data solutions, incorporating observability and testing best practices, and developing processes for trusted and well-documented data.
The engineer will collaborate with data analysts to refine data models for reporting and analytical purposes, improve data availability and consistency, and establish a reporting system in BigQuery from scratch.
Additional tasks include revamping orchestration and execution to reduce data delivery times and managing database archiving.

Requirements:

Candidates must have strong hands-on experience with Python and core Python Data Processing tools such as pandas, numpy, scipy, and scikit.
Experience with cloud tools and environments like Docker, Kubernetes, GCP, and/or Azure is required.
Proficiency in Spark/PySpark, Data Lineage, and Data Cataloging is necessary.
Applicants should have experience with relational and non-relational databases, as well as Data Warehouses and Lakes like Bigquery, Databricks, or Snowflake.
The ability to design and build scalable data pipelines is essential.
Strong communication skills are required to convey technical solutions to both technical and non-technical stakeholders.
Experience in a fast-paced, agile environment and the ability to work independently and collaboratively is important.
A willingness to learn new technologies and tackle challenging problems is expected.
Familiarity with Infrastructure as Code tools like Terraform and advanced SQL expertise, including complex queries and query optimization, is necessary.