Remote Senior Data Engineer

Description:

• Kpler is dedicated to simplifying global trade information and providing valuable insights to empower organizations in commodities, energy, and maritime sectors.
• The company has over 600 experts from 35+ countries and focuses on delivering top-tier intelligence through user-friendly platforms.
• The Senior Data Engineer will work on the core infrastructure behind MarineTraffic.com, which serves 10 billion requests per month and transfers over 90 terabytes of data monthly.
• The role involves creating the architecture and systems needed to collect, store, transform, and access data, contributing to the largest maritime tracking system in the world.
• Responsibilities include leading the design, execution, and deployment of engineering solutions, collaborating with stakeholders, taking ownership of system performance, and providing technical mentoring to team members.
• The position requires delivering well-documented, maintainable code and ensuring ongoing support and monitoring of developed pipelines and systems.

Requirements:

• Candidates must have 8+ years of experience in a data engineering or backend-focused role.
• Strong expertise in RDBMS databases such as MSSQL and PostgreSQL is required.
• Proficiency in Python, including libraries like pandas and numpy, and adherence to PEP8 standards is necessary.
• Experience with streaming data technologies such as Kafka and batch data processing frameworks is essential.
• Familiarity with CI/CD pipelines and Git best practices is required, along with considerations for testing, logging, monitoring, and alerting.
• Candidates should have experience working with cloud platforms, especially AWS, and a deep understanding of containerization tools.
• Strong collaboration and communication skills are necessary, along with analytical thinking and a problem-solving mindset.
• Candidates should thrive in fast-paced and evolving environments.

Benefits:

• Kpler fosters a dynamic company culture dedicated to nurturing connections and innovating solutions to market challenges.
• The company emphasizes customer satisfaction and values turning ideas into reality.
• Kpler is committed to providing a fair, inclusive, and diverse work environment, welcoming people of different backgrounds, experiences, abilities, and perspectives.
• The company encourages applicants who may not meet every single requirement to apply, promoting a supportive and accessible workplace.