Remote Senior Data Engineer at NielsenIQ

Description:

The Senior Data Engineer will be responsible for leading data onboarding workstreams with new customers/pilots/POCs.
They will work directly with customers’ data teams on data interfaces, specifications, and integration projects.
Design, implement, and maintain performance of reliable data pipelines and interfaces feeding various analytics applications.
Develop ETL from various data streams via multiple consumption methods (e.g., Blob, Kafka, SFTP, SQL connectors, REST API).
Implement new and existing data processing solutions to enable teams to analyze data efficiently and get insights faster.
Create, implement, and maintain data transformation and validation processes.
Perform data validation activities, normalize and explore datasets, investigate and solve data-related problems.
Support data architecture efforts for key analytics innovations involving multiple internal and/or external stakeholders.

5+ years of experience working as a data engineer in ETL and data integration.
5+ years of experience in a client-facing consultation role, project management expertise, managing customer expectations and deadlines, and excellent communication skills.
Strong Python – Pyspark development experience.
Strong SQL with experience in querying large, complex data sets.
Experience with Databricks, Spark, Airflow, and Scala development.
Experience working with retailer and supplier analytics data.
Experience with Cloud platforms – Azure strongly preferred.
Experience in data integration design, development, and maintenance, data lakes/hubs.
Result-driven, pragmatic, and innovative.
Experience with developing REST APIs and microservices.
Computer Science, Engineering, Information Systems, Statistics, Math degree (or equivalent combination of skill and experience).
Experience with SingleStore, Snowflake, BI tools i.e. PowerBI – nice to have.