Remote Senior Data Engineer

Description:

• At AstroPay, we believe in empowering people to reach their full potential and to be part of an innovative and forward-thinking company.
• Our goal is to provide a cutting-edge online payment solution that goes beyond just a traditional wallet.
• We are dedicated to creating a dynamic and challenging work environment that fosters creativity, innovation, and a strong sense of community among our team.
• The role involves designing, building, and maintaining data pipelines and ETLs/ELTs using tools like AWS DMS, Airflow, and other AWS services.
• You will manage the ingestion of raw transactional and non-transactional data into an S3 data lake.
• The position requires ensuring efficient data flow across various systems within AstroPay, enabling data-driven decision-making.
• As a Lead/Senior Data Engineer, you will be responsible for managing and enhancing our data architecture, integrating a data lake and a relational data warehouse.
• You will ensure seamless integration of raw data into the S3 data lake before applying necessary transformations and delivering clean, structured data to downstream systems.
• The role includes applying transformation, enrichment, and data processing using the most appropriate tools for the workload, following medallion architecture principles.
• You will apply best practices in data engineering, including version control, testing, and documentation.
• Collaboration with cross-functional teams is essential to understand their data needs and deliver solutions that enable data-driven decision-making across the organization.
• You will ensure and implement data governance best practices and establish a secure data environment to comply with regulations in different countries.
• The role involves developing and implementing strategies for creating reusable data assets, promoting efficiency, and reducing redundancy in data processing.
• You will implement measures to enhance data quality and build trust in the accuracy and reliability of our data, including data validation, quality checks, and documentation.

Requirements:

• Proven experience designing, developing, and maintaining data pipelines for diverse workloads using AWS services like DMS, Airflow, Lambda, and Glue is required.
• Experience managing data lakes and relational data warehouses is essential, with familiarity in Apache Iceberg, S3-based data lakes, and Redshift.
• Extensive experience with AWS services, including Redshift, Lambda, Airflow, DMS, and S3, is necessary to build and maintain data solutions.
• Strong communication skills are required to collaborate effectively with cross-functional teams and proactively own data challenges.
• A solid foundation in software engineering principles is necessary to apply software engineering best practices to our data architecture and processes, along with some Python experience.
• Proficiency in English is required to interact with the rest of the company.
• Familiarity with Database Administration, Infrastructure Management, and other AWS services like CodeCommit, SageMaker, CloudWatch, StepFunctions, Athena, and Glue is a valuable addition.
• Experience with BI tools like Looker or similar is a plus.
• Experience building data models and understanding data catalogs, data governance, and data lineage is beneficial.
• Prior experience working in the fintech ecosystem will be considered an advantage.

Benefits:

• We offer flexible hours as we are results-oriented.
• There are opportunities for professional growth, allowing you to explore your passions.
• The position is fully remote, enabling you to work from anywhere.
• You will have the chance to connect with your team and have fun through AstroTeam activities.
• AstroPay House provides opportunities to meet and connect with AstroPayers worldwide.
• Continuous training is available to keep building your knowledge through the EDX platform.