Lead Databricks Developer
Are you a passionate and experienced Databricks professional ready to take on a role with leadership responsibility? We're looking for a Lead Databricks Developer to design, build, and implement cutting-edge data solutions on the Databricks Lakehouse Platform. If you love solving complex data challenges and mentoring a talented team, this is the role for you.
What You'll Do:
Lead a Team: Provide technical guidance and mentorship to a team of data engineers, setting best practices for coding, performance, and CI/CD pipelines.
Design & Architect: Create and implement end-to-end data pipelines (ETL/ELT)
Develop & Optimize: Get hands-on with development to ensure peak performance and data quality.
Ensure Security & Governance: Implement robust data validation, cleansing, and security controls, including Databricks Unity Catalog.
Collaborate: Work closely with cross-functional teams in an Agile environment to translate business needs into powerful data solutions.
What You'll Bring:
Experience: A minimum of 5+ years in data engineering, with at least 2 years in a technical lead or senior role focused on Databricks.
Technical Skills: Expert proficiency in Python and SQL, deep knowledge of the Apache Spark ecosystem, and extensive experience with a major cloud platform (Azure, AWS, or GCP).
Problem-Solving: Exceptional analytical and problem-solving skills with a knack for troubleshooting complex data issues.
Communication: Excellent communication and collaboration skills to effectively lead a team and work with stakeholders.
If you are keen on this role, it will interview this week, with a view to start as soon as you are available.
...
Please get in touch with ram.basra@randstaddigital.com.au for further information.
At Randstad, we are passionate about providing equal employment opportunities and embracing diversity to the benefit of all. We actively encourage applications from any background.