Remote Data Architect- Part-Time (AU Media, Home-based)

Description:

• The Cloud Data Architect will design, implement, and maintain a scalable cloud data infrastructure on Google Cloud Platform (GCP).
• Key responsibilities include deploying tools like Apache Airflow on Kubernetes and Databricks, while collaborating with data engineers and analytics teams to support data workflows, optimize performance, security, and cost efficiency.
• The role involves leading the design of GCP-based infrastructure to support data pipelines, machine learning, and analytics workloads, ensuring scalability and reliability.
• Responsibilities also include setting up and maintaining Apache Airflow for orchestrating data workflows in a Kubernetes environment, ensuring seamless scheduling and execution of DAGs.
• The architect will provision and manage Databricks environments, ensuring efficient use of resources for data processing and analytics.
• Implementing Infrastructure as Code (IaC) using tools like Terraform or Cloud Deployment Manager to automate the provisioning and management of cloud infrastructure is required.
• The role requires optimizing GCP’s data products, such as BigQuery, Dataflow, Pub/Sub, and Cloud Storage, to build scalable data architectures.
• Collaboration with data engineering teams to design efficient data pipelines, optimize data workflows, and support data integration and processing at scale is essential.
• Ensuring security and compliance by implementing best practices for securing data infrastructure, including IAM policies, VPC configurations, and data encryption is a key responsibility.
• The architect will monitor and optimize the performance of cloud infrastructure, ensuring it meets the needs of data pipelines and analytical workloads.
• Cost management through implementing cost-effective solutions and continuously optimizing cloud infrastructure to reduce operational costs without compromising performance is necessary.
• Maintaining detailed documentation of the cloud architecture and establishing best practices for data infrastructure management is also part of the role.

Requirements:

• A minimum of 3 years of experience in a similar role is required.
• Candidates must have 3+ years of experience in Python programming.
• A minimum of 3+ years of experience with SQL is necessary.
• A strong understanding of data modeling, design, ETL processes, and data warehousing concepts is essential.
• Experience with data visualization tools (e.g., Tableau, Power BI, Looker Studio) and proficiency in dashboard development and reporting is required.
• Candidates should have experience with CI/CD pipelines for infrastructure and data workflows.
• Familiarity with other cloud platforms (e.g., AWS, Azure) and multi-cloud environments is necessary.
• Knowledge of real-time data streaming architectures using tools like Pub/Sub or Kafka is required.
• Experience with machine learning infrastructure and deploying ML models on cloud platforms is essential.
• Certification in Google Cloud (e.g., Professional Cloud Architect, Professional Data Engineer) is required, and Databricks certification will be advantageous.
• Familiarity with machine learning and AI concepts, stakeholder management, and knowledge of best practices in data security and compliance are nice to have.
• Experience with Databricks, Docker, Kubernetes, and Agile methodologies is preferred.
• Excellent communication skills with the ability to translate complex technical concepts into actionable insights for non-technical stakeholders are essential.

Benefits:

• ConnectOS is certified as a Great Place to Work and is recognized as a top-rated employer in the Philippines.
• The position offers the opportunity to work with Australia’s largest independent publishing business, which has a significant reach and established client base.
• Employees will be part of a talented team dedicated to serving audiences, advertisers, and customers.
• The role provides a chance to work in a dynamic environment with over 100 brands and a network that includes 14 daily titles.
• ConnectOS ensures the full confidentiality of the data it processes and promotes equal employment opportunities.