OfferUp is seeking an experienced Data Engineer to build, operate, and scale batch and near real-time data processing platforms and tools.
This role will support backend engineers, business intelligence dashboards, reports, data analysts, and data scientists.
The position involves designing and developing applications to process large amounts of critical information for analytics and user-facing features.
Responsibilities include monitoring and resolving data pipeline or data integrity issues and working across multiple teams to understand their data needs.
The Data Engineer will also maintain and expand the company's data infrastructure.
This position is remote and only available to individuals outside the US and US territories.
Requirements:
Candidates must have 3+ years of professional software development experience.
A strong ability in distributed systems for processing large-scale data is required.
Effective communication of technical information to both technical and non-technical audiences is essential.
Proficiency in SQL and Python is necessary.
Experience with open-source data infrastructure projects such as Airflow, Kafka, Avro, Parquet, Hadoop, Hive, HBase, Presto, or Druid is required.
Candidates should have experience building scalable data pipelines and real-time data streams.
Experience in building software in AWS or a similar cloud environment is necessary.
Familiarity with AWS services like Kinesis, Firehose, Lambda, and Sagemaker is a big plus.
Experience with GCP services like BigQuery and Cloud Functions is also a big plus.
Knowledge of operational tools like Terraform, Datadog, and Pagerduty is a big plus.
A Computer Science or Engineering degree is required, with a Master's degree preferred.
Excellent written and spoken communication skills in English are required.
Benefits:
OfferUp provides equal employment opportunities to all employees and applicants without discrimination.
The company complies with applicable state and local laws governing nondiscrimination in employment.
OfferUp has a dynamic team dedicated to creating a trusted platform for local communities.
The company has a strong commitment to building trust in local communities by working directly with nearly 2000 US law enforcement agencies.