Remote Data Engineer

Description:

• Procurement Sciences AI (PSci.AI) is seeking a skilled Data Engineer to join their team, focusing on building and optimizing data infrastructure.
• The ideal candidate will have experience with modern data stack tools, cloud platforms (specifically Azure), and strong SQL skills.
• The role involves working with relational databases, data processing and transformation, cloud platforms, programming and scripting, version control, and soft skills.
• The company is a venture-backed B2B SaaS entity dedicated to revolutionizing government contracting through generative AI.

Requirements:

• A strong understanding of relational databases, including schema design, normalization, indexing, and query optimization, with hands-on experience in PostgreSQL for data modeling and optimization.
• Proficiency in data processing and transformation using dbt, SQL, and Python, along with experience in workflow orchestration tools such as Airflow or Azure Data Factory.
• Experience in data integration, including ingesting data from various sources like APIs, flat files, and government databases, and familiarity with ETL/ELT tools such as Airbyte and metadata governance tools like OpenMetadata.
• Hands-on experience with Azure Data Factory, Azure Blob Storage, and Azure Databricks, as well as an understanding of Delta Lake for data lakehouse management and Kubernetes for container orchestration.
• Proficiency in Python for data manipulation and automation, with strong SQL skills for writing complex queries using CTEs and window functions.
• Experience with Git, including branching strategies and collaborative development.
• Excellent communication skills to explain complex concepts to both technical and non-technical stakeholders, along with strong problem-solving skills and the ability to troubleshoot data issues efficiently.

Benefits:

• The position offers the opportunity to work remotely, providing flexibility in the work environment.
• Employees will be part of a dynamic team at the forefront of generative artificial intelligence in the government contracting sector.
• The role allows for professional growth and the chance to work with large datasets and scalable data solutions.
• Being part of a venture-backed company provides access to resources and support for rapid innovation and scaling.