Randstad are currently working with an exciting public sector client to find a Data Engineer for an initial contract until August 2026. This role is based in Brisbane City with hybrid flexibility (WFH 2 days per week).
In a nutshell:
...
The program is replacing the legacy HR/payroll system with SAP SuccessFactors (EC/ECP) and supporting cloud-native data and integration platforms (Azure and Microsoft Fabric). The Data Engineer will be responsible for designing and implementing high-performance, secure, and reusable data pipelines within Microsoft Fabric, supporting the data migration from legacy systems into a modern cloud-based HR data platform. This role will enable the ingestion, transformation, and quality assurance of critical HR and payroll data in support of SAP SuccessFactors and ECP. The engineer will work closely with the Data Architects, Data Governance Lead, and QA to ensure compliance and delivery excellence. Key Duties:
- Automate batch processing & real-time data flows using Azure Event Hub & API Management (APIM).
- Develop Azure Data Factory (ADF) workflows to extract, transform, and load (ETL) data from TSS, SAP, and third-party HR systems.
- Build & optimise data storage solutions in Azure Fabric, source systems, and SAP.
- Implement data partitioning & indexing strategies for high-performance HR data queries.
- Enable scalable data pipelines to support historical payroll archiving & regulatory compliance.
- Implement data validation rules to ensure accuracy & completeness in payroll processing.
- Enforce data security policies using Azure Purview for compliance with Australian Privacy Act & other Aus security standards.
- Data API & Real-Time Processing.
- Expose HR & Payroll data via Azure API Management (APIM) for SAP integrations.
- Enable real-time HR event streaming using Azure Event Hub & SAP OData APIs.
- Ensure seamless data synchronisation between legacy and SAP HCM.
- Collaboration & Stakeholder Engagement.
- Work with HR, Payroll, and IT teams to define data mapping rules for SAP integration.
- Support Data Analysts & Business Intelligence teams in reporting HR & workforce insights.
- Provide technical guidance to System Integrators on data transformation requirements.
Capabilities:
- ETL/ELT Development: Strong expertise in Azure Data Factory (ADF) & SQL-based ETL/ELT transformations.
- Programming & Scripting: Proficiency in Python, SQL, and PowerShell for data pipeline automation.
- Cloud Data Engineering: Experience with Azure, Azure Fabric is a must.
- API & Event-Driven Processing: Hands-on experience with Azure API Management (APIM), SAP OData APIs, and Event Hub, Azure Fabric.
- Data Governance & Security: Familiarity with Azure Purview, role-based access control (RBAC), and data encryption policies.
- Data Quality & Validation: Ability to implement reconciliation reports & ensure data integrity in payroll migration.
The ideal candidate will possess the following:
● Strong understanding of Azure stack.
● Experience using Azure Fabric.
● Thorough understanding of Data Engineering frameworks.
● Programming and Scripting knowledge.
● Data Security and Governance expertise.
At Randstad, we are passionate about providing equal employment opportunities and embracing diversity to the benefit of all. We actively encourage applications from any background.