The Staff Data Engineer is responsible for designing, optimizing, and maintaining scalable data infrastructure and pipelines.
This role ensures efficient data processing and integration across various databases including PostgreSQL, Redshift, and ElasticSearch.
As a technical leader within the Creator Intelligence team, the Senior Data Engineer focuses on building robust data solutions that enable full testability and monitoring.
The position involves close collaboration with Software Engineers, Product, and DevOps to deliver high-performance data solutions.
Key responsibilities include designing and optimizing ETL pipelines for batch and real-time data processing, implementing data processing workflows in AWS cloud environments, and integrating with various data stores.
The role also requires developing and maintaining fully testable and monitorable data pipelines and collaborating with other engineers, product owners, and data scientists to solve business problems.
Requirements:
A Bachelor's degree in Computer Science, Software Engineering, or a related field is required.
Candidates must have 8+ years of experience in data engineering within large-scale production systems.
Strong experience with a variety of OLTP and OLAP databases and related data modeling techniques is necessary.
Proficiency in programming languages such as Python, Java, Scala, Go, or similar for data processing is required.
Hands-on experience with ETL tools and workflow orchestration frameworks, such as Airflow, AWS Glue, or Step Functions, is essential.
An upper-intermediate or higher level of English proficiency (spoken and written) is needed.
Experience with MLOps tooling, such as MLflow or Kubeflow, is preferred.
Familiarity with streaming data architectures and real-time processing is important.
Knowledge of data governance and compliance frameworks is required.
Experience with containerization and Kubernetes for data workloads is necessary.
Benefits:
CreatorIQ offers a comprehensive benefits package that plays a significant role in overall compensation.
The company promotes a flexible work model that combines both in-person and remote work to enhance collaboration and innovation.
CreatorIQ is committed to fostering an inclusive, equitable, and empowering work environment where everyone can thrive.
Employees are encouraged to celebrate differences and innovate together, contributing to a business that is disrupting the marketing industry.
