Description:

Truelogic is seeking a Junior to Semi-Senior PySpark Data Engineer to join their team in a full-time capacity.
The role involves designing, developing, and optimizing data pipelines using PySpark and Apache Spark.
Responsibilities include integrating and processing data from various sources such as databases, APIs, files, and streaming.
The engineer will implement efficient data transformations for Big Data in distributed environments and optimize code for performance and scalability.
Collaboration with Data Science, BI, and DevOps teams is essential to ensure seamless integration.
The position requires monitoring and debugging data processes to maintain quality and reliability.
Best practices in data engineering must be applied, along with maintaining clear documentation.
Staying updated with the latest trends in Big Data and distributed computing is expected.

Requirements:

Candidates should have 1-3 years of experience working with PySpark and Apache Spark in Big Data environments.
Experience with SQL and both relational and NoSQL databases such as PostgreSQL, MySQL, and MongoDB is required.
Knowledge of ETL processes and data processing in distributed environments is necessary.
Familiarity with Apache Hadoop, Hive, or Delta Lake is preferred.
Experience with cloud storage solutions like AWS S3, Google Cloud Storage, or Azure Blob is essential.
Proficiency in Git and version control is required.
Strong problem-solving skills and a proactive attitude are necessary for success in this role.
A passion for learning and continuous improvement is highly valued.

The position offers 100% remote work, allowing employees to work from any location with a reliable internet connection.
Highly competitive pay in USD is provided, exceeding typical market offerings.
Paid time off policies are in place to ensure employees can unwind and recharge as needed.
Employees enjoy autonomy in managing their time, focusing on results rather than hours worked.
The opportunity to work with top American companies on innovative, high-impact projects is available.
The company fosters a culture that values well-being and work-life balance, with engagement activities and dynamic teams.
Employees can connect with a diverse, global network of over 600 professionals across 25+ countries.