Remote Senior Data Engineer

Description:

• Join 3Pillar as a Senior Data Engineer and embark on an exciting journey in software development.
• Contribute to projects that reshape data analytics for clients, providing them with a competitive advantage.
• Understand business requirements and write code to implement proposed solutions.
• Create and manage data pipelines, including versioning and change management.
• Develop ETL/ELT processes to extract and manipulate data from multiple sources.
• Design, build, and maintain batch or real-time data pipelines in production.
• Automate data workflows such as data ingestion, aggregation, and ETL processing.
• Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.
• Train and mentor junior engineers.

Requirements:

• A minimum of 5+ years of experience as a data engineer or in a similar role is required.
• Advanced SQL skills and experience with relational databases and database design are necessary.
• Experience with cloud Data Warehouse solutions such as Snowflake, Redshift, BigQuery, or Azure Synapse is essential.
• Strong Python skills with hands-on experience in Pandas, NumPy, and other data-related libraries are required.
• Familiarity with Big Data technologies like Spark, Map Reduce, Hadoop, and Hive is important.
• Proficiency in data pipeline and workflow management tools, such as Airflow, is needed.
• Experience with data visualization tools like PowerBI, Tableau, or AWS QuickSight is required.
• Knowledge of AWS, Azure, or GCP data engineering services is necessary, including familiarity with services like S3, Lambda, EMR, and others.
• Excellent problem-solving, communication, and organizational skills are essential.
• Proven ability to work independently and collaboratively with a team is required.
• Ability to guide other data engineers is necessary.

Benefits:

• Medical Insurance benefits are provided as per company policy.
• Life Insurance is available according to company policy.
• Employees receive 15 days of paid vacation plus additional days based on tenure.
• Vacation bonuses are provided as per local law.
• Sick leave and paid holidays are offered according to local law.
• Profit sharing is available as per local law.
• Paternity and maternity leave are provided as per local law.
• Marriage, bereavement, and graduation leaves are available according to company policy.
• Christmas bonuses are provided as per local law.
• A work-from-home allowance is available as per company policy.
• Punctuality and attendance bonuses are offered according to company policy.
• Food tickets are provided as per company policy.
• Direct deposit of payroll is available.
• Paid professional certifications are offered.