Remote [Job - 19279] Data Developer

Description:

• The Data Engineer will play a pivotal role in optimizing data infrastructure and ensuring seamless data migration processes.
• Responsibilities include migrating data from PostgreSQL to AWS DynamoDB, enhancing data architecture, and supporting cross-functional teams.
• The role directly impacts the organization's ability to derive insights from data for data-driven decision-making.
• Key responsibilities include implementing data migration processes, utilizing ETL processes and data migration tools, and automating tasks using programming languages like Python and Bash.
• The Data Engineer will optimize data models for DynamoDB, collaborate with cross-functional teams, and create comprehensive documentation for data migration processes.
• Monitoring and optimizing data loading and query performance in both PostgreSQL and DynamoDB is also a key responsibility.

Requirements:

• Proven experience in database management and data migration, specifically with PostgreSQL and AWS DynamoDB is required.
• Familiarity with data migration tools and techniques, including ETL processes and best practices for migrating data between SQL and NoSQL databases is necessary.
• A strong understanding of AWS services, particularly AWS DynamoDB, AWS Lambda, and AWS Data Pipeline, including their architecture, features, and configurations is essential.
• The ability to design and implement efficient data models for DynamoDB, considering its non-relational structure and access patterns is required.
• Proficiency in programming languages such as Python and Bash, along with experience using AWS SDKs to automate data migration tasks is necessary.
• Knowledge of strategies for optimizing data loading and query performance in both PostgreSQL and DynamoDB is important.
• Experience with version control systems like Git and collaborative tools such as JIRA and Confluence to manage project workflows is required.
• Strong analytical and problem-solving abilities to troubleshoot and resolve issues during the migration process are essential.
• The ability to create comprehensive documentation for migration processes, data mappings, and system configurations is necessary.
• Excellent communication skills to collaborate with cross-functional teams, including developers, data scientists, and project managers, ensuring successful project delivery are required.

Benefits:

• The position offers a health plan and dental plan.
• Meal allowances and childcare assistance are provided.
• Extended parenting leave and access to Gympass are included.
• Annual profit-sharing distribution and life insurance are part of the benefits.
• There is a partnership with an online mental health platform and access to CI&T University.
• Employees can benefit from a discount club and a support program that includes financial, psychological guidance, nutritionist services, and more.
• A pregnancy course and responsible parenthood resources are available.
• There is a partnership with online course platforms and a platform for language learning.
• Many other benefits are also offered.