senior software data engineer (enterprise, evangelist) in Melbourne CBD

apply now

job details

posted
location
melbourne cbd, victoria
specialism
IT & ICT
job type
permanent
reference number
90M0342526_1523154442
contact
santosh chacko, randstad
phone
03 8319 1271
apply now

job description

Our clients is a highly recognised player in the financial space and are going through an Enterprise-wise transformation.

As part of this push they are also actively on the hunt for a highly experienced Enterprise Software Data Engineer to join their fold.

Key Focus of the role includes:

Ability to demonstrate a solid understanding of programming languages such as Python, Java, Scala and shell scripting. Experience with infrastructure tools such as Terraform and Ansible, and CI/CD pipelines are highly regarded. Also required is hands-on experience with AWS web services, particularly with a focus on configuring a secure environment.

Responsibilities will involve:

  • Promoting AWS and cloud best practices to maximise compute performance while minimising infrastructure costs.
  • Design and develop usage patterns and APIs to enable user self-service.
  • Ability to write and optimize complex queries using both SQL and NoSQL paradigms.
  • Able to work with different data types e.g. streaming, real-time, file based, RDMS, unstructured data, etc.
  • Ability to design and build complex event processing, preferably in a large-data environment.
  • Design and develop NDC core capabilities such as data ingestion, feature engineering, data science pipeline, model management.
  • Actively contribute to planning sessions both within the core NDC engineering team, the wider NDC team and NDC users.

Key skills and experience:

  • Experience working with large datasets in a restrictive environment (considerations around privacy, limits around user access, encryption, etc.).
  • Demonstrable experience of Hadoop technologies e.g. Spark, PySpark, Kafka, Hive, Flume, Hue, Sqoop, etc.
  • Experience working with, and configuring AWS services, preferably in a production environment.
  • Experience with DevOps and Agile – with demonstrated ability to drive continuous improvement.
  • Ability to mentor less experienced colleagues.
  • Excellent communication and interpersonal skills, both oral and written.
  • Ability to assess and implement new technologies and processes.
  • An open mindset and proven ability to innovate and influence.

Preference will be given to candidates with the following:

  • Administration of Hadoop ecosystem.
  • Data ingestion technologies and capturing meta-data and data lineage.
  • Experience with ‘infrastructure as code’, e.g. Terraform, Ansible.
  • Experience with shell scripting.
  • Experience with configuring secure environments with AD groups, SSO, SAML, etc.
  • Experience of Reporting and Analytics, and/or experience working with analysts and data scientists.
  • Experience using productivity and collaboration tools such as JIRA and confluence in a software delivery environment
  • Postgrad qualifications and self-learning courses and certifications (Coursera, Udacity, AWS, etc.) highly regarded.

Key skills required for the role

  • > 6 yrs experience in Build and deployment of High Volume Transactional systems
  • Strong experience in AWS
  • Strong experience in continuous integration environments
  • Well experienced in CI tools such as Jenkins/Bamboo
  • Experienced or strong knowledge in Chef, Puppet, Ansible
  • Strong experience with automated/scripted Infrastructure
  • Education Institutional background experience highly advantageous
  • Experienced working in building containerisation technologies like Docker and or similar techs like (Kubernetes or OpenShift) ideal

This is an exciting opportunity to join a team of highly talented Peers who are highly professional and passionate about what they do.

Previous experience working in High Pressure Delivery oriented environment is a Must with the ability work in technical builds and dealing with vendors.

If you think you have the right skills and experience, then please submit a cover-letter justifying your suitability for the role with regards to the above-mentioned points (e.g. 7yrs Agile Scrum, 2yrs BPMN) together with your resume (both in MS Word format) and click on the ‘apply now’ tab.



Ref No. 90M0342526



skills

DevOps, Data Engineering, Hadoop, Software Engineering

qualification

Relevant Tertiary qualifications

educational requirements

Bachelor Degree