Remote GenAI Data Engineer

Description:

• Tiger Analytics is a fast-growing advanced analytics consulting firm recognized by Forrester and Gartner.
• The company is seeking an experienced Data Engineer with expertise in Dataiku to join their data team.
• The Data Engineer will be responsible for designing, building, and maintaining data pipelines, data integration processes, and data infrastructure.
• The role involves collaborating closely with data scientists, analysts, and other stakeholders to ensure efficient data flow and support data-driven decision making across the organization.
• Responsibilities include designing and implementing robust data pipelines that ingest, process, and store unstructured data formats at scale within Snowflake and GCP.
• The Data Engineer will leverage Snowflake’s unstructured data capabilities to make "dark data" queryable and actionable.
• The position requires building and maintaining cloud-native ETL/ELT processes using BigQuery, Cloud Storage, and Dataflow, ensuring seamless integration between GCP and Snowflake.
• The role involves integrating AI tools into the engineering flow to transform unstructured blobs into structured insights.
• The Data Engineer will also tune complex SQL queries and Python-based processing jobs to handle petabyte-scale environments efficiently.
• There are significant career development opportunities as the company grows, offering a unique chance to be part of a small, challenging, and entrepreneurial environment with a high degree of individual responsibility.

Requirements:

• Candidates must have expertise in Dataiku and experience in data engineering.
• A strong understanding of designing and implementing data pipelines is required.
• Proficiency in working with Snowflake and GCP is essential.
• Experience with cloud-native ETL/ELT processes using BigQuery, Cloud Storage, and Dataflow is necessary.
• Candidates should have the ability to integrate AI tools such as OCR, NLP entities, and Document AI into engineering workflows.
• Strong skills in tuning complex SQL queries and Python-based processing jobs are required.
• Candidates should be comfortable working in a fast-paced, entrepreneurial environment.

Benefits:

• The position offers significant career development opportunities as the company continues to grow.
• Employees will have the chance to work in a small, challenging, and entrepreneurial environment.
• The role provides a high degree of individual responsibility, allowing for personal and professional growth.