Description:

Allata is a fast-growing technology strategy and data development consulting firm delivering scalable solutions to enterprise clients.
The company aims to inspire clients to achieve strategic goals through uncompromised delivery, active listening, and personal accountability.
The Data Engineer will contribute to transformative enterprise data platform projects focused on developing data pipelines and logic engines.
Responsibilities include managing ingest, staging, and multi-tier data product modeling, as well as data enrichment using various OEM-specific data warehouse and data lake house platform implementations.
The role involves full life cycle design, build, deployment, and optimization of data products for multiple large enterprise industry vertical-specific implementations.
The Data Engineer will process datasets through a defined series of logically conformed layers, models, and views.

Requirements:

Candidates must have current knowledge of modern data tools such as Databricks, FiveTran, and Data Fabric, along with core experience in data architecture, data integrations, data warehousing, and ETL/ELT processes.
Applied experience in developing and deploying custom whl and/or in-session notebook scripts for execution across parallel executor and worker nodes is required.
Proficiency in SQL, Stored Procedures, and Pyspark is essential based on the area of data platform specialization.
Strong knowledge of cloud and hybrid relational database systems, including MS SQL Server, PostgresSQL, Oracle, Azure SQL, AWS RDS, or Aurora is necessary.
Candidates should have strong experience with batch and streaming data processing techniques and file compactization strategies.
Automation experience with CI/CD pipelines to support deployment and integration workflows is a plus, including trunk-based development using Azure DevOps, Jenkins, or Octopus.
Advanced proficiency in Pyspark and spark workflow optimization and orchestration using tools such as Asset Bundles or DAG orchestration is desirable.
Strong teamwork, communication skills, and intellectual curiosity to work collaboratively with cross-functional teams are essential.
A commitment to delivering high-quality, accurate, and reliable data product solutions is required.
Candidates should be willing to embrace new tools, technologies, and methodologies and possess an innovative mindset to overcome challenges.

Allata values differences and is committed to creating an inclusive environment for all employees.
The company is an equal opportunity employer and celebrates diversity in the workplace.
Employment decisions are made without regard to race, color, creed, religion, age, ancestry, national origin, veteran status, sex, sexual orientation, gender, gender identity, gender expression, marital status, disability, or any other legally protected category.
This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.