Description:

The Senior Data Engineer position at 3Pillar focuses on leveraging cutting-edge technologies to enable data-driven decision-making.
This role is crucial within a dynamic team, contributing to projects that reshape data analytics for clients.
The position offers the opportunity to work on thrilling projects that provide clients with a competitive advantage in their industries.
Candidates should have a passion for data analytics solutions that create real-world impact.

Requirements:

Candidates must have a minimum of 5+ years of experience as a data engineer or in a similar role.
Advanced SQL skills and experience with relational databases and database design are required.
Experience with cloud Data Warehouse solutions such as Snowflake, Redshift, BigQuery, or Azure Synapse is necessary.
Strong Python skills with hands-on experience using libraries like Pandas and NumPy are essential.
Familiarity with Big Data technologies such as Spark, Map Reduce, Hadoop, and Hive is required.
Proficiency in data pipeline and workflow management tools, particularly Airflow, is necessary.
Experience with AWS data engineering services is required.
Knowledge of various AWS services including S3, Lambda, EMR, GLUE ETL, Athena, RDS, Redshift, EC2, IAM, and AWS Kinesis is essential.
Candidates should have good exposure to working on Data Lakes and Data Warehouses solutions.
Excellent problem-solving, communication, and organizational skills are required.
Proven ability to work independently as well as collaboratively within a team is necessary.
The ability to guide other data engineers is also required.

The position offers the opportunity to work remotely, providing flexibility in work arrangements.
Employees will be part of a dynamic team that is at the forefront of data analytics and engineering.
There is potential for professional growth and development within the company.
The role allows for engagement in exciting projects that have a significant impact on clients' businesses.