Remote Advana Mid-Level Data Engineer

at Redhorse Corporation

Posted 1 day ago 1 applied

Description:

  • Redhorse Corporation is seeking a skilled Mid-Level Data Engineer to support the Chief Digital and Artificial Intelligence Office (CDAO) within the Department of Defense (DoD).
  • The role involves developing and maintaining robust data pipelines to ensure secure and efficient information flow across diverse environments.
  • Key responsibilities include supporting the configuration and ingestion of structured, unstructured, and semi-structured data repositories to meet mission partner requirements.
  • The Data Engineer will maintain operational aspects of data transfers while ensuring the security posture of the underlying infrastructure.
  • Responsibilities also include automating configuration management, leveraging tools, and staying current on ETL technologies and services.
  • The position requires working under general guidance to develop independent solutions, review architecture, and identify areas for automation and optimization.
  • The engineer will apply knowledge of data engineering technologies, databases, and Cloud architectural constructs, and support the establishment of Cloud environments programmatically.
  • Engagement with multiple functional groups is necessary to understand client challenges and prototype new ideas and technologies.
  • The role includes maintaining a collection of web scraping tools used in the ETL process and identifying scalable coding solutions.

Requirements:

  • A Bachelor’s degree plus 3 years of experience, or a Master’s degree plus 3 years of experience is required.
  • Candidates must have experience with Big Data systems, including Apache Spark/Databricks.
  • Experience with ETL processes is essential.
  • Familiarity with the ADVANA Data Environment is required.
  • Candidates should have experience with Amazon Web Services (AWS), Microsoft Azure, or MilCloud 2.0.
  • Knowledge of applying DoD Security Technical Implementation Guides (STIGs) and automating that process is necessary.
  • Proficiency in multiple coding languages is required.
  • An active Secret security clearance is mandatory.

Benefits:

  • Redhorse Corporation is an Equal Opportunity Employer, providing opportunities for veterans and individuals with disabilities.
  • The company offers reasonable accommodations for qualified individuals with disabilities or disabled veterans.
  • The job description is subject to modification to meet the changing needs of Redhorse Corporation.