Don’t miss your opportunity to join an award-winning technology driven organisation as a Data Engineer using Databricks embedded within a high performing product team This established Brisbane success story and employer of choice are enjoying significant growth through product innovation. About the role: Working closely with an empowered product team you will contribute to conceiving and creating a data platform that delivers highly performant data focusing on: Ingestion, cleansing and fusion; Analysis, reporting; Real-time dashboards, predictive analytics and machine learning; and Strategic response capabilities built around extensible long-term data repositories and industry open data integrations. Your day-to-day will include: Work with high performing internal technical and product teams to achieve sprint goals, ensuring delivered quality of functionality, useability and performance; Work with data scientists and analysts to consider data source, lineage, quality, stewardship, security and privacy governance, data lifecycle and associated metadata; Develop end-to-end data pipelines to transform data into useful, actionable information, ensuring appropriate data validation methods and data analysis tools are provided; and Resolving data engineering challenges or improving the quality of existing processes and commercial outcomes. About you: You will be preferably tertiary-level qualified in Software Engineering, Information Technology or Computer Science, with preferably 3 years of industry experience in designing, building and supporting data systems in a large enterprise environment. Your toolkit for success: Demonstrated experience in developing data lakes and data marts (including ingestion pipelines and transformations) and in integrating industry-leading analytics, reporting, dashboard and API toolsets and related technologies, for consumer access; Hands-on experience with utilising extensible data platform framework – Databricks is essential; Proficiency with associated data processing technologies (such as Apache Spark); Competent with Python to solve data engineering tasks (including hands-on experience with PySpark and Python notebooks) and with other appropriate programming languages (such as C#, JavaScript, Java or Scala); Comfortability working in both Windows and Linux environments and with utilising public cloud infrastructure and services, such as offered by Amazon Web Services (AWS); Experience with source code control and CI/CD pipeline technologies (such as GitLab), with some exposure to IaaC concepts and tools; Be adept at understanding and utilising internet protocols and application interface technologies such as REST, AMQP, JSON, geoJSON, Parquet, XML and Protobuf; and Experience with working in a software-as-a-service environment that utilises DevOps and SRE practices to continuously develop, test, deploy and support scalable, highly-available software services is an advantage. This employer offers competitive salaries, a high-trust, high-empowering, openly supportive working environment & culture with WFH options (2 days in office per week). A true highlight of working in this supportive environment is that all staff have access to uncapped training budgets to support your career development. This role requires full Australian working rights and to be based in Brisbane to attend the Brisbane office. APPLY NOW For more information or a confidential discussion please email Michael Whelan on michael.whelanuandu.com quoting reference number 36200. At u&u Recruitment Partners, we value diversity, equity and inclusion. We welcome applications from Aboriginal and Torres Strait Islander people, people with diverse cultural and linguistic backgrounds and people with disability. Should you require reasonable adjustments throughout the recruitment process, we encourage you to make a request via adjustmentsuandu.com or phone the above-mentioned u&u consultant to discuss. In response to these requests, we will collaborate closely with you to implement the appropriate adjustments. Additionally, for a barrier-free and inclusive online experience, you can access u&u’s opportunities using accessibility software Recite Me at https://www.uandu.com/jobs. Please submit your resume in Word format only.