A
Atta Ur Rehman
From Pakistan
12:31 AM
(GMT+05:00)
$50/hr
or
$85,000/yr
Active 4 minutes ago
Senior Data Engineer | Databricks, Azure, Fabric, Snowflake
Data Engineer
Available for hire
Years of
experience
8+ years
Experience
level
Senior
Available
for
Full-time, Contract, Freelance
Available from
12 Oct 2026
Senior Data Engineer with 8+ years building lakehouse platforms and production pipelines on Azure, AWS, Databricks, Microsoft Fabric, and Snowflake. Databricks Certified Data Engineer Associate.
What I deliver
- Delta Lakehouse platforms on medallion architecture, governed with Unity Catalog and role-based access control
- Reusable PySpark ingestion, transformation, and validation frameworks
- Pipeline performance tuning: cut large-scale financial pipeline runtimes by 50%+ with matching infrastructure savings
- Legacy SQL Server and SSIS migrations to Databricks and Fabric Lakehouse
- Power BI semantic models and reporting layers on curated data
- CI/CD for Databricks notebooks and SQL with Azure DevOps
Industries: Retail, Finance, Healthcare, E-commerce, Travel.
Looking for: remote contract or full-time Data Engineering roles. Based in GMT+5 and flexible across time zones.
Employment History
Senior Data Engineer at
Authority Partners
2025
-
2026
Designed and delivered scalable pipelines on Azure Databricks, Microsoft Fabric, and Azure Data Factory, unifying multiple enterprise systems into one governed platform. Built a Delta Lakehouse on medallion architecture, developed reusable PySpark ingestion, transformation, and validation frameworks, and migrated legacy SQL and SSIS workflows to Databricks and Fabric. Implemented Unity Catalog governance with role-based access control, delivered Power BI and Synapse reporting layers, and set up CI/CD for notebooks and SQL with Azure DevOps.
Principal Consultant (previously Senior Data Engineer, Data Engineer) at
Systems Limited
2021
-
2025
Led performance optimization of large-scale financial data pipelines, reducing runtimes by 50%+ and driving significant annual infrastructure cost savings. Built multi-cloud pipelines and data marts across Azure, AWS, Databricks, Snowflake, Synapse, Microsoft Fabric, and Azure Data Factory, including near real-time ETL and ingestion from SQL Server and Oracle. Designed policy-level and customer-level data models as a single source of truth, owned Power BI dashboard development end to end, and defined data validation and quality monitoring across systems. Recognized as Star of the Quarter.
Software Developer | Business Intelligence Developer at
Global Rescue LLC
2018
-
2020
Built data ingestion pipelines with SSIS and SQL Server, and delivered reporting and dashboard modules for Sales, Operations, Marketing, and Accounting using SSRS, Power BI, C#, .NET, and Python. Designed standardized databases on top of the Microsoft Dynamics CRM database, supported Dynamics CRM version migrations, and optimized existing SQL queries, reports, and dashboards.
Education
Databricks Certified Data Engineer Associate at
Databricks Academy
2026
-
2026