Description:

The Data Engineer will design, implement, and maintain scalable and efficient ETL pipelines using Python and SQL to process and store large volumes of financial data.
The role involves developing and optimizing data models and schemas in PostgreSQL and Clickhouse to support complex queries and analytics.
The engineer will build and maintain real-time data streaming and processing systems using AWS Kinesis and Lambda.
Automating infrastructure management using Terraform for deploying and managing AWS resources is a key responsibility, ensuring a secure and scalable environment.
Collaboration with trading and analytics teams is essential to understand data requirements and ensure the availability and quality of data for decision-making.
The position requires implementing data monitoring and alerting mechanisms to proactively identify and resolve issues in data pipelines.
Writing shell scripts to automate routine data processing tasks and system maintenance is also part of the job.
Ensuring compliance with data governance and security best practices, especially around handling sensitive financial data, is crucial.

Requirements:

Candidates must have 3+ years of experience as a Data Engineer or in a similar role within financial services, ideally with exposure to digital assets or cryptocurrency markets.
Proficiency in Python for data engineering tasks and automation is required.
Strong SQL skills for complex query design, optimization, and data modeling are necessary.
Experience with AWS services, specifically Lambda, Kinesis, RDS, S3, and IAM, is essential.
Hands-on experience with Terraform for infrastructure as code and managing AWS environments is required.
Familiarity with Clickhouse for handling large datasets and real-time analytics is highly desirable.
Experience with PostgreSQL for data warehousing and analytics is necessary.
Proficiency in shell scripting for automation and system operations is required.
Knowledge of best practices in data architecture, data security, and data governance is essential.
Strong problem-solving skills and the ability to work in a fast-paced, dynamic environment are necessary.
Excellent communication skills and the ability to work collaboratively with cross-functional teams are required.

The position offers a competitive salary package, with various benefits depending on the method of engagement (employee or freelancer).
Employees enjoy autonomy in their time management thanks to flexible working hours and the opportunity to work remotely.
The role provides the freedom to create an entrepreneurial experience by being part of a team of people in search of excellence.
Keyrock is committed to building an inclusive, diverse, and non-discriminating work environment, welcoming employees of all backgrounds, ethnicities, genders, creed, and sexual orientation.