Please, let Procurement Sciences know you found this job
on RemoteYeah.
This helps us grow π±.
Description:
Procurement Sciences AI (PSci.AI) is seeking a skilled Data Engineer to join their team, focusing on building and optimizing data infrastructure.
The ideal candidate will have experience with modern data stack tools, cloud platforms (specifically Azure), and strong SQL skills.
The role involves working with relational databases, data processing and transformation, cloud platforms, programming and scripting, version control, and soft skills.
The Data Engineer will be responsible for data modeling, optimization, and ensuring effective data integration from various sources.
Requirements:
The candidate must have a strong understanding of schema design, normalization, indexing, and query optimization, with hands-on experience in PostgreSQL for data modeling and optimization.
Proficiency in dbt, SQL, and Python for data transformation and cleansing is mandatory, along with experience in workflow orchestration tools such as Airflow or Azure Data Factory.
Experience in ingesting data from various sources, including APIs, flat files, and government databases like SAM.gov, is required, as well as familiarity with ETL/ELT tools like Airbyte and metadata governance tools like OpenMetadata.
Hands-on experience with Azure Data Factory, Azure Blob Storage, and Azure Databricks is essential, along with an understanding of Delta Lake for data lakehouse management and Kubernetes as a container orchestrator.
Proficiency in Python for data manipulation and automation, as well as strong SQL skills for writing complex queries, is necessary.
Experience with Git, including branching strategies and collaborative development, is required.
Excellent communication skills to explain complex concepts to both technical and non-technical stakeholders, strong problem-solving skills, and the ability to collaborate effectively within a team are essential.
Benefits:
The position offers the opportunity to work remotely, providing flexibility in the work environment.
As part of a venture-backed B2B SaaS company, employees will be involved in innovative projects that leverage generative AI to transform the government contracting sector.
The role provides a chance to work with large datasets and build scalable data solutions, contributing to the company's mission of enhancing operational efficiencies for clients.
Employees will have the opportunity to collaborate with a talented team and lead technical initiatives, fostering professional growth and development.
Apply now
Please, let Procurement Sciences know you found this job
on RemoteYeah
.
This helps us grow π±.