Remote Python Data Engineer - Weather Team

at DRW

Posted 5 hours ago 3 applied

Description:

  • DRW is a diversified trading firm with over 3 decades of experience in global markets.
  • The firm values autonomy and the ability to quickly pivot to capture opportunities, operating with its own capital and trading at its own risk.
  • DRW is headquartered in Chicago and has offices throughout the U.S., Canada, Europe, and Asia, trading various asset classes including Fixed Income, ETFs, Equities, FX, Commodities, and Energy.
  • The company has expanded into non-traditional strategies such as real estate, venture capital, and cryptoassets.
  • DRW seeks a skilled and motivated Python Data Engineer to join its Weather team.
  • The ideal candidate will have a strong background in Python programming, data pipeline development, and experience with various data processing and storage solutions.
  • Responsibilities include designing, developing, and maintaining efficient and scalable data pipelines, collaborating with data scientists and analysts, monitoring and optimizing data pipeline performance, and implementing data validation mechanisms.
  • The role involves working with cloud-based data storage and processing solutions and staying updated with industry trends.

Requirements:

  • A Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field is required.
  • A minimum of 3 years of experience in data engineering or a related role is necessary.
  • Experience with weather and climate datasets and tooling such as Copernicus, Xarray, Zarr, and NetCDF is required.
  • Proficiency in Python programming and experience with libraries like Pandas, NumPy, and FastAPI is essential.
  • Experience with ETL tools and frameworks such as Apache Airflow, Apache NiFi, or Talend is needed.
  • A strong understanding of relational databases and SQL is required.
  • Experience with cloud platforms like AWS, GCP, or Azure and their data services is necessary.
  • Familiarity with data warehousing solutions such as Redshift, BigQuery, or Snowflake is required.
  • Experience with version control systems like Git is necessary.
  • Strong problem-solving skills and attention to detail are essential.
  • Excellent communication and collaboration skills are required.

Benefits:

  • The annual base salary range for this position is $150,000 to $300,000, depending on experience, qualifications, and relevant skills.
  • The position is eligible for an annual discretionary bonus.
  • DRW offers a comprehensive suite of employee benefits including group medical, pharmacy, dental, and vision insurance.
  • A 401k plan with discretionary employer match is provided.
  • Short and long-term disability, life and AD&D insurance, health savings accounts, and flexible spending accounts are included in the benefits package.