Remote Senior Data Engineer

Description:

• Join 3Pillar as a Senior Data Engineer and embark on an exciting journey in software development.
• Contribute to projects that reshape data analytics for clients, providing them with a competitive advantage.
• Understand business requirements and write code to implement proposed solutions.
• Create and manage data pipelines, including versioning and change management.
• Develop ETL/ELT processes to extract and manipulate data from multiple sources.
• Design, build, and maintain batch or real-time data pipelines in production.
• Automate data workflows such as data ingestion, aggregation, and ETL processing.
• Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.
• Train and mentor junior engineers.

Requirements:

• A minimum of 5+ years of experience as a data engineer or in a similar role is required.
• Advanced SQL skills and experience with relational databases and database design are necessary.
• Experience with cloud Data Warehouse solutions such as Snowflake, Redshift, BigQuery, or Azure Synapse is essential.
• Strong Python skills with hands-on experience in Pandas, NumPy, and other data-related libraries are required.
• Familiarity with Big Data technologies like Spark, Map Reduce, Hadoop, and Hive is important.
• Proficiency in data pipeline and workflow management tools, such as Airflow, is needed.
• Experience with data visualization tools like PowerBI, Tableau, or AWS QuickSight is required.
• Knowledge of AWS, Azure, or GCP data engineering services is essential, including familiarity with services like S3, Lambda, EMR, and others.
• Excellent problem-solving, communication, and organizational skills are necessary.
• Proven ability to work independently and collaboratively with a team is required.
• Ability to guide other data engineers is essential.

Benefits:

• Medical Insurance benefits are provided as per company policy.
• Life Insurance is available according to company policy.
• Employees receive 15 days of paid vacation, sick leave, and paid holidays as per local law.
• Paternity and maternity leave are offered in accordance with local law.
• Additional leaves for marriage, bereavement, and graduation are provided as per company policy.
• Christmas and mid-year bonuses are given as per local law.
• A monthly productivity bonus is available as per local law.
• Discounts in local shops are offered to employees.
• Payroll is directly deposited for convenience.
• Paid professional certifications are provided to support career development.