Commify is a leading provider of business messaging solutions, focused on empowering businesses to connect with their customers in meaningful and effective ways.
The company serves over 60,000 businesses across various industries and is at the forefront of innovation in communications technology.
The Principal Data Engineer will lead data engineering initiatives, responsible for designing and implementing robust data architectures and pipelines.
This role enhances the ability to derive meaningful insights from data and drives data-driven decision making.
The Principal Data Engineer will collaborate closely with cross-functional teams to ensure data is accessible, reliable, and valuable.
Responsibilities include leading the design, development, and implementation of high-performance data pipelines and ETL/ELT processes using Azure Data Factory, Databricks, and other Azure data services.
The role involves architecting and managing data solutions within the Azure ecosystem, including Azure Data Lake Storage and Databricks.
The engineer will drive the adoption of best practices for data governance, quality, security, and lineage.
Collaboration with data scientists, analysts, and engineering teams to understand data requirements and translate them into technical solutions is essential.
The position requires optimizing data processing performance and cost efficiency on Azure Databricks, developing monitoring, alerting, and logging for data pipelines.
Mentoring junior and mid-level data engineers and evaluating new data technologies to enhance data platform capabilities are also key responsibilities.
The engineer will contribute to the overall data strategy and roadmap, ensuring alignment with business objectives and troubleshooting complex data-related issues.
Requirements:
Extensive experience as a Data Engineer, with significant experience in a principal or lead capacity is required.
Deep expertise in Azure data platform services, including Azure Databricks, Azure Data Factory, Azure Data Lake Storage, and Azure SQL Database or Azure Synapse Analytics.
Strong proficiency in SQL and excellent programming skills in Python; Scala is a strong advantage.
Proven experience with data modeling, schema design, and data warehousing concepts is necessary.
A solid understanding of data governance, quality, and security principles is required.
Experience with version control systems, such as Git, is essential.
Strong problem-solving abilities and a methodical approach to complex technical challenges are necessary.
Excellent communication and interpersonal skills are required to articulate complex technical concepts to both technical and non-technical stakeholders.
Proven ability to lead and mentor other engineers is essential.
Desirable qualifications include experience with real-time data streaming technologies, knowledge of CI/CD pipelines, familiarity with containerization technologies, and experience with other cloud platforms like AWS or GCP.
Relevant Microsoft Azure certifications, such as Azure Data Engineer Associate, are a plus.
Benefits:
The position offers a competitive salary ranging from £65,000 to £80,000.
Employees are eligible for a company bonus scheme.
A comprehensive healthcare cash plan is provided.
The role includes a generous 27 days of annual leave in addition to Bank Holidays.
Employees receive 2 Wellbeing leave days and 2 days dedicated to community service.
Employees enjoy their birthday off.
The employer contributes 5% to the pension plan.
A death in service benefit of 4 times the salary is included.
Annual award recognition is part of the benefits package.
Fun monthly and quarterly social events are organized.
Opportunities for training and professional development are available.
