Remote Principal Data Engineer (Azure) - Mexico

Description:

• The Principal Data Engineer (Azure) at Tiger Analytics will work on Azure cloud, Databricks, and Data Modelling to build various analytics solutions & platforms.
• Responsibilities include designing and building scalable data ingestion pipelines for batch and streaming datasets, executing high-performance data processing, orchestrating pipelines, and collaborating with multiple teams and stakeholders.
• The role involves making tech stack decisions, handling exception scenarios, and monitoring logs for debugging purposes.
• The ideal candidate will have experience with Azure Data Factory, PySpark, Databricks, Azure SQL Database, Azure Synapse Analytics, Event Hub & Streaming Analytics, Cosmos DB, and Purview.
• They should be proficient in writing high-quality, modular, and scalable code in SQL, Python, or Scala/Java, with knowledge of big data technologies like Hadoop, Spark, Airflow, NiFi, Kafka, Hive, Neo4J, and Elastic Search.
• Understanding of file formats like Delta Lake, Avro, Parquet, JSON, and CSV, building REST APIs, and supporting BI and Data Science teams securely are essential for this role.

Requirements:

• Hands-on experience with Azure cloud, Databricks, and Data Modelling
• Proficiency in Azure Data Factory, PySpark, Databricks, ADLS, Azure SQL Database
• Knowledge of Azure Synapse Analytics, Event Hub & Streaming Analytics, Cosmos DB, and Purview
• Strong programming, unit testing, and debugging skills in SQL, Python, or Scala/Java
• Experience with big data technologies like Hadoop, Spark, Airflow, NiFi, Kafka, Hive, Neo4J, and Elastic Search
• Understanding of file formats such as Delta Lake, Avro, Parquet, JSON, and CSV
• Ability to collaborate with stakeholders, make tech stack decisions, and take ownership of deliverables
• Experience in building REST APIs, supporting BI and Data Science teams securely
• Certifications like Data Engineering on Microsoft Azure (DP-203) or Databricks Certified Developer (DE) are a plus

Benefits:

• Significant career development opportunities in a fast-growing and challenging entrepreneurial environment
• High degree of individual responsibility and autonomy in the role
• Compensation packages among the best in the industry