Description:

The Data Engineer (The Data Pipeline Architect) will design, build, and maintain data pipelines that support robust data architectures and facilitate seamless data flow.
This role involves creating scalable solutions that empower data-driven decision-making and optimizing data systems for impactful analytics.
The Data Engineer will collaborate with data scientists, analysts, and software engineers to construct efficient and secure data pipelines and storage solutions.
Key responsibilities include developing and maintaining data pipelines for data ingestion, transformation, and integration using cloud technologies.
The role requires managing and optimizing data storage solutions, architecting data lakes and warehouses using platforms like BigQuery, Redshift, or Snowflake.
The Data Engineer will work closely with data teams to understand data requirements and align solutions with business goals.
Ensuring data quality and reliability through validation, error handling, and consistency checks is a critical part of the job.
The position involves developing and automating ETL processes to handle complex data transformations and monitoring data infrastructure performance.
The Data Engineer will implement strategies for efficient resource allocation and cost-effective data processing.

Requirements:

Candidates must have expertise in cloud data platforms such as AWS, GCP, or Azure, with proficiency in handling cloud-based data solutions.
Proficiency in programming and scripting languages like Python, Java, or Scala is required for building data pipelines and processing tasks.
A proven ability to develop, maintain, and optimize ETL processes that handle large volumes of data is essential, along with experience using orchestration tools like Apache Airflow or Luigi.
Strong SQL skills and experience with relational and NoSQL databases are necessary.
Excellent problem-solving skills and a proactive approach to resolving data-related challenges are required.
A Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field is required, with equivalent experience considered.
Certifications in cloud data engineering are a plus.
Candidates should have 3+ years of experience in data engineering, with a track record of building and managing cloud-based data systems.
Experience with real-time data processing frameworks and familiarity with containerization and microservices architecture is advantageous.

The position offers comprehensive medical, dental, and vision insurance plans with low co-pays and premiums.
Employees receive competitive vacation, sick leave, and 20 paid holidays per year.
Flexible work schedules and telecommuting options promote work-life balance.
Opportunities for training, certification reimbursement, and career advancement programs are available for professional development.
Access to wellness programs, including gym memberships, health screenings, and mental health resources, is provided.
Life insurance and short-term/long-term disability coverage are included in the benefits package.
Employees can utilize the Employee Assistance Program (EAP) for confidential counseling and support services.
Tuition reimbursement is offered for continuing education and professional development.
Opportunities to participate in community service and volunteer activities are available.
Employee recognition programs celebrate achievements and milestones.