Remote Senior Data Engineer

at Bright Vision Technologies

Posted 1 day ago 2 applied

Description:

  • Bright Vision Technologies is seeking a skilled Data Engineer to join their remote team.
  • The company focuses on building innovative software solutions to help businesses automate and optimize operations.
  • The Data Engineer will be responsible for designing, developing, and managing scalable data pipelines for both structured and unstructured data.
  • Key responsibilities include building and optimizing data solutions using Azure Data Factory, Azure Databricks, Blob Storage, and Key Vault.
  • The role involves developing and maintaining PySpark-based ETL processes and orchestrating data migration from on-premises systems to Azure cloud.
  • The Data Engineer will ensure the security, reliability, and performance of data solutions and collaborate with various teams to ensure high-quality data delivery.
  • Documentation of data models, workflows, and system configurations is also a key responsibility.

Requirements:

  • Candidates must have 9+ years of experience in data engineering or a related field.
  • Expert-level knowledge of Azure cloud components, including Data Factory, Blob Storage, Data Flows, Key Vault, and Databricks, is required.
  • Strong experience with PySpark for data transformation and analytics is essential.
  • Familiarity with version control, CI/CD pipelines, and data orchestration tools is necessary.
  • Proficiency in SQL with the ability to write optimized queries for large datasets is required.
  • Familiarity with Delta Lake, Parquet, or other big data formats is a plus.
  • Strong communication and documentation skills are essential for this role.

Benefits:

  • The position offers tremendous career growth potential within an established and well-respected organization.
  • Bright Vision Technologies is committed to providing equal employment opportunities and fostering an inclusive work environment.
  • The company encourages applications from all qualified individuals, regardless of race, ethnicity, religion, gender identity, sexual orientation, age, disability, or any other protected status.