Description:

Abacus Insights is a mission-driven, growth-stage technology company focused on transforming the healthcare industry to create a more personalized patient experience, improve health outcomes, and lower healthcare costs.
The company provides a flexible, efficient, and secure platform that organizes and exchanges healthcare data from various sources and formats, allowing customers to uncover differentiated insights.
The Sr. Data Engineer will join the dynamic and rapidly expanding Tech Ops division and will collaborate with customers, data vendors, and internal teams to integrate data into a state-of-the-art data platform.
The role involves working with clients and the implementation team to understand data distribution requirements and developing data pipelines integrating with Databricks and Snowflake.
Responsibilities include leading the architecture and implementation of solutions for health plan clients, optimizing cloud-based technologies, and ensuring compliance with healthcare regulations like HIPAA.
The Sr. Data Engineer will provide technical leadership, mentor junior engineers, and focus on optimizing data processes for efficiency while creating detailed documentation.
Conducting training for team members and clients to enhance understanding and utilization of data solutions is also part of the role.

Requirements:

A Bachelor’s Degree in computer science, computer engineering, or any related IT field is required.
The candidate must have experience communicating with both technical and non-technical stakeholders.
Proficiency in Python and SQL is essential.
Experience in building and managing efficient ETL pipelines using Databricks workflows or other orchestration frameworks is required.
Familiarity with both structured and semi-structured data and the ability to ingest and process this data using PySpark is necessary.
Knowledge of fundamental AWS services (S3, SQS) or similar services for other clouds is required.
Experience with Terraform and GitLab CI/CD is necessary.
The candidate should have skills in query tuning and performance optimization in SQL and/or SparkSQL.
Familiarity with data warehousing solutions like Snowflake or similar is required.

Abacus Insights offers a mission-driven work environment focused on driving better healthcare outcomes.
The company is committed to building diverse teams and providing equal employment opportunities to all applicants.
Employees play an active role in keeping customer data safe and ensuring compliance with comprehensive policies and practices.
The company has raised over $81 Million from leading VC firms, indicating strong financial backing and growth potential.
Employees will have the opportunity to work with cutting-edge technologies and best practices in data engineering.