senior data engineer in Sydney

posted
contact
katie frost, randstad
job type
permanent

job details

posted
location
sydney, new south wales
specialism
IT & ICT
job type
permanent
working hours
Full-Time
experience
4 years
reference number
90M0428796_1603409356
contact
katie frost, randstad
Apply with
add to saved jobs print

job description

Randstad Technologies is partnering with a Government Department to identify a strong Senior Data Engineer for an initial 6 month engagement to deliver expert advice and services in the design of data products and data-related services to support the achievement of business outcomes and strategic goals.

Responsibilities

  • Support creation and maintenance AWS Data environments for DEV and TEST (requires knowledge of AWS Data Lakes, Redshift and Redshift Spectrum)
  • Create data pipelines for ingestion of data from external parties. (AWS Data Pipeline or preferably AWS Glue)
  • Assist develop and maintain MDM data model and Data Catalog (Data Vault)
  • Develop and enhance data matching of external and internal data structures
  • Building and optimizing data pipelines, architectures and data sets.
  • Building processes supporting data transformation, data structures, metadata, dependency and workload management.
  • A successful history of manipulating, processing and extracting value from large disconnected datasets.
  • Relational SQL and NoSQL databases, including Postgres and Cassandra.
  • Data pipeline and workflow management tools: AWS Data Pipeline (or preferably AWS Glue)
  • AWS cloud services: EC2, EMR, RDS, Redshift, Data Lakes and Redshift Spectrum)
  • Object-oriented/object function scripting languages


Desirable

  • Strong analytic skills related to working with unstructured datasets.
  • Experience with big data tools: Hadoop, Spark, Kafka, etc.

Please note that candidates must be immediately available of have a MAXIMUM of 2 weeks notice.

For consideration, please forward resumes to katie.frost@randstad.com.au by 12pm Monday 26th November 2020.

At Randstad, we are passionate about providing equal employment opportunities and embracing diversity to the benefit of all. We actively encourage applications from any background.

skills

Government Opportunity / AWS Cloud / Redshift / Hadoop / Spark / Kafka

educational requirements

Bachelor Degree