A
abdulkaderkhouja's photo
Abdulkader Khouja
From Turkey 06:44 PM (GMT+03:00)
$35/hr or $65,000/yr

Active over a week ago


Member since Jan 2026

Share this profile:

Senior Data Engineer

Big Data Engineer
Available for hire
Years of experience
9+ years
Experience level
Senior
Available for
Full-time, Part-time, Contract, Freelance
Available from
27 Sep 2026

Data Engineer with 8+ years of experience designing, optimizing, and deploying large-scale data pipelines and distributed systems in finance, logistics, operations, sales, marketign, and procurement. Expert in Python, Scala, Spark, Kafka, and Azure (Databricks, Synapse, Data Lake, Delta Lake). Skilled in building end-to-end ETL pipelines, SQL optimization, real-time data streaming, Airflow orchestration, Dockerized deployments, and CI/CD automation. Proven ability to mentor teams, assist in complex system deployments, and deliver enterprise solutions that improve performance and cost-efficiency.

Employment History

Senior Data Engineer at Abu Dhabi Securities Exchange 2024 - 2025
• Led Spark pipelines processing 5M transactions/day for national and international traders on the exchange market application (~2 TB) with Python & Scala. • Designed scalable data models (fact/dimension schemas, bronze–silver–gold layers) to support reliable analytics and downstream systems, and produced Balanced Scorecard reports for management. • Optimized SQL queries with partitioning and indexing, improving query performance by 60%. • Architected Azure Databricks/Data Lake pipelines with governance and cost optimization; collaborated with the cybersecurity team to ensure compliance and secure access. • Built real-time Kafka streams with end-to-end latency under 5s, enabling near real-time market data delivery for traders and compliance monitoring.
Data Engineering Consultant at Artefact Current 2023 - Now
• Building data quality rules on Informatica IDQ and metadata structures on Informatica EDC and Informatica Axon. • Building the pipelines for about 200 KPI’s of the Abu Dhabi Government DMT department 30,000 planned KPI’s as the first phase of the project to enable AD entities to have good quality data for AI/ML. • Working on the medallion architecture to ingest data to bronze layer, clean it and move it to silver layer, create the ETL pipeline to move it to the gold layer. • Building AI models for Data Quality & Governance, leveraging RAG and LLM-to-SQL solutions to automate KPI validation, achieving 85% faster metadata cataloging and reducing errors by 40%.
Senior Data Engineer at Al-Futtaim Group 2021 - 2024
• Built Spark pipelines for finance/procurement data merging SAP, SAP Ariba, and other sources, reducing duplicates by 80% using Apache Spark and PySpark. • Implemented batch & streaming ETL with Spark Structured Streaming, Kafka, and Azure Data Factory, structuring data and building scalable models for both transactional and analytical needs. • Optimized SQL for large datasets, cutting query runtime from hours to minutes, and enabled Balanced Scorecard reporting with KPIs and executive dashboards. • Assisted in Airflow DAG deployments, Dockerized workflows, and CI/CD integration, ensuring production-grade ETL pipelines while working with cybersecurity on compliance and secure access. • Directed training on systems and reports for hundreds of users in 570 companies on reports and interfaces and 7-person engineering team, reducing processing time by 50% and improving SLA adherence, through best practices in data modeling, reporting, and governance.
Data Engineer at Kuehne + Nagel 2018 - 2021
• Developed Spark pipelines handling ~500k–1M daily finance and logistics events, enabling timely freight cost analysis, shipment tracking, and financial reconciliations. • Tuned SQL queries (joins, window functions, partitioned aggregations), reducing reporting latency by 40% and improving visibility for finance and supply chain managers. • Built Airflow workflows for production ETL with monitoring and alerts, and assisted in Docker-based deployment and CI/CD, ensuring reliable data delivery across global teams. • Designed and maintained data lake zones (raw, curated, sandbox) with strong governance, and built scalable data models (fact/dimension schemas) to support analytics and reporting.

Education

Bachelor in Economics at Aleppo University 2013 - 2014