Remote Senior Cloud Data Engineer (AWS and Databricks)

Description:

• Minimum 5 years of IT experience, with at least 3.5 years working with data in AWS cloud (confirmed by commercial projects implemented in production).
• Commercial experience in processing large data using Databricks.
• Commercial experience in processing large data using JSON.
• Proficiency in using the Pandas library.
• Advanced SQL skills and utilization in MS technological solutions and beyond.
• Proficient in Git and CI/CD methodologies.
• Design and optimize data processing solutions (ETL, ELT, etc.) following a technical project and alternative solution approaches.
• Proficient in Python programming.
• Familiarity with AWS technologies such as Glue, Athena, DynamoDB.
• Experience with agile practices and tools used in software development processes, including Azure DevOps.
• Knowledge of secure data storage and processing mechanisms in the cloud.
• Understanding of migrating on-premise solutions to the cloud and basic migration types.
• Intermediate level of proficiency in English (minimum B2).

Requirements:

• Responsibility for all solutions co-created with the team.
• Developing or modifying data processing solutions in the cloud.
• Creating and modifying documentation.
• Analyzing and optimizing solutions within an operational or planned system.
• Analyzing client requirements to deliver optimal business solutions.
• Identifying potential threats.
• Adapting solutions to meet business requirements.
• Analyzing needs and source data (analyzing how CRM data can be used for customer interactions).
• Developing new plugins (creating new plugins or extensions that optimize assessment and prioritization within the CRM system).
• Testing new plugins.
• Developing artificial intelligence and machine learning models and integrating them.

Benefits:

• Hourly rate: 125 – 198 PLN net + VAT (B2B).
• Data Solutions job offer.
• Technologies: SQL, AWS, Glue, Athena, DynamoDB, Databricks, Python, JSON, Git, Pandas.