Remote Senior Data Engineer

at Board of Innovation

Posted 2 days ago 0 applied

Description:

  • BOI is a company focused on AI strategy and applied AI, partnering with businesses globally to create transformative AI products.
  • The role is for a Senior Data Engineer who will design, build, and manage scalable data pipelines for AI-powered tools and applications.
  • Responsibilities include integrating, harmonizing, and transforming data from various sources for foundational model integrations.
  • This is a hands-on position requiring the building and implementation of systems from scratch, including writing production-level code and defining processes for team growth.
  • The engineer will collaborate with an international team to understand customer needs and develop end-to-end solutions.
  • Key tasks include developing and managing ETL pipelines, optimizing cloud databases, ensuring data integrity and security, and collaborating with AI Engineers for model workflows.

Requirements:

  • Candidates must have 5+ years of experience in building secure and scalable cloud data infrastructure and hold a degree in Computer Science or a related field.
  • Proficiency in Python, SQL, and data transformation libraries such as pandas or PySpark is required.
  • Hands-on experience with data pipeline orchestration tools like Apache Airflow or Prefect is necessary.
  • A solid understanding of database design and optimization for both relational and non-relational databases is essential.
  • Experience with deployment on major cloud providers, preferably Azure, is required.
  • Advanced English skills, both written and verbal, are necessary for effective communication in an international team.
  • Experience in a consulting or agency environment on project-based work is preferred.
  • Candidates should be passionate about data and building reliable, scalable systems, and familiar with DevOps practices in CI/CD, container orchestration, and deployment automation.
  • A commitment to improving code quality through code reviews and adherence to best practices for testing and debugging is expected.
  • The ability to manage a project from conception to production-level deployment is essential.

Benefits:

  • The position offers the opportunity to work with a collaborative international team of engineers, designers, and solution leads.
  • Employees will have the chance to develop and manage innovative AI-powered tools and applications.
  • The role provides a platform for continuous learning and development in new technologies and software development best practices.
  • There is a clear job evolution path, with milestones set for integration into the team, involvement in client projects, and contributions to scalable client deployments.
  • The company fosters a culture of collaboration and knowledge sharing, enhancing professional growth and expertise in the field.