data engineer.

Key Responsibilities

• Pipeline Engineering: Design and maintain scalable automated data pipelines (ETL/ELT) using Azure Data Factory and Databricks.
• Architecture: Implement and optimize the Medallion Architecture within an Azure Lakehouse environment.
• Data Governance: Utilize Unity Catalog to manage data lineage and secure access controls.
• Legacy Integration: Extract and transform data from diverse sources, including complex on-prem SQL Server environments.
• DevOps: Drive CI/CD best practices using Azure DevOps to ensure reliable and repeatable deployments.

Technical Requirements

• Azure Stack: Expert-level experience with Azure Data Factory, ADLS Gen2, and Synapse.
• Spark/Databricks: Strong proficiency in PySpark for large-scale data transformations.
• Databases: Expert SQL skills and a solid understanding of SQL Server management.
• Programming: High proficiency in Python is essential.
• Reporting: Familiarity with Power BI to support data consumption for end-users.

What’s on Offer

• Initial 6-month contract with strong long-term extension prospects.
• East Perth / CBD office base.
• The chance to work on a high-impact, state-wide digital transformation project.

At Randstad Digital, we are passionate about providing equal employment opportunities and embracing diversity to the benefit of all. We actively encourage applications from any background.