Description:

Kpler is seeking a Senior Data Engineer to join their Market Data team, which is responsible for the ingestion, filtering, enrichment, and distribution of externally sourced data related to maritime trade.
The role involves upgrading data pipelines to enhance quality and reliability, designing and implementing pipelines, and maintaining and optimizing datasets and their schemas.
The Senior Data Engineer will ensure data integrity and availability for consumers and provide state-of-the-art environments and tools to support the development team.
Responsibilities also include reviewing code and mentoring the development team to achieve higher quality standards.

Requirements:

Candidates must have at least 8 years of experience as a Software Engineer, with significant hands-on experience using Python in production, particularly with Spark or Kafka.
Experience with ML, OCR, and NLP models integrated into complex production pipelines is required.
Familiarity with DevOps and Infrastructure as Code practices, especially on AWS, is necessary.
Experience with Data Processing Orchestration tools, such as Airflow, is essential.
Fluency in English and experience working in an international environment are mandatory.
Additional experience with Scala, functional programming frameworks, Big Data Management, Terraform, GitOps, Kubernetes, ElasticSearch, GraphQL, front-end web development, SQL schema, and PostgreSQL optimizations, as well as AWS Well-Architected Framework principles, is preferred.

Kpler is committed to providing a fair, inclusive, and diverse work environment, welcoming individuals from various backgrounds and experiences.
The company fosters a culture of support and accessibility for both colleagues and clients.
Kpler encourages applicants who may not meet every single requirement to apply, emphasizing that different perspectives lead to better ideas and solutions.
Employees will have the opportunity to work in a dynamic company that values customer satisfaction and innovation.