S
sai challagondla
From India 08:39 AM (GMT+05:30)
$40/hr or $76,800/yr

Active 5 days ago


Member since May 2026

Share this profile:

Senior Data Engineer | Databricks & Spark

Data Engineer
Available for hire
Years of experience
4+ years
Experience level
Senior
Available for
Full-time, Contract, Freelance
Download Resume / CV

Data Engineer with 4 years of experience building scalable cloud data platforms and high-performance ETL/ELT pipelines for healthcare and insurance systems.

Specialized in Apache Spark, Azure Databricks, Delta Lake, and modern lakehouse architectures, with hands-on experience designing Bronze-Silver-Gold data platforms, CDC-based incremental pipelines, and analytics-ready datasets.

I’ve worked on large-scale enterprise data systems processing TB-scale workloads, improving Spark performance, reducing infrastructure costs, and building reliable production-grade data pipelines for distributed teams.

Currently looking for remote opportunities involving modern data engineering, lakehouse platforms, distributed data processing, and cloud-native analytics systems.

Skills

No skills.

Languages

Employment History

Data Engineer at Coforge Current 2022 - Now
Built scalable healthcare and insurance data platforms using Azure Databricks, Apache Spark, Delta Lake, and cloud lakehouse architectures. Designed ETL/ELT pipelines processing TB-scale enterprise datasets, implemented CDC-based incremental ingestion, optimized Spark workloads, and developed Bronze-Silver-Gold medallion architectures for analytics and reporting. Worked on performance optimization, data quality frameworks, Airflow orchestration, schema evolution handling, and governance-ready data platforms supporting large-scale analytics workloads.

Education

Bachelor of Computer Applications (BCA) at ISBM University 2019 - 2022