Data Engineer Permanent $130k-$140k Super Our client is seeking a seasoned Data Engineer with expertise in the Cloudera Data Platform (CDP) and Spark-based ingestion pipelines. This role is ideal for a professional with a strong background in building and optimising data pipelines and a track record of working with large-scale data infrastructures. Key Responsibilities: Develop, implement, and manage scalable data systems to ensure efficient extraction, transformation, and loading of data from diverse sources using SQL, Spark, and Cloudera technologies. Create high-performance algorithms, predictive models, and prototypes utilizing Spark and Scala. Handle and deploy interactive Hive queries for data analysis and manipulation. Maintain data privacy and compliance in line with data governance standards. Collaborate with stakeholders, including Executive, Product, Data, and Design teams, to address technical issues and support data infrastructure needs. Work with data scientists to transform data and integrate algorithms and models into automated processes. Qualifications: Proficient in Spark, Scala, and Hive, with practical experience in Cloudera Data Platform (CDP). Extensive experience in building and optimizing big data pipelines, architectures, and data sets. Strong knowledge of Spark SQL and ANSI SQL. Experience in the banking sector, preferably in Payments or Financial Crime. Skilled in data pipeline and workflow management tools. Excellent project management and organizational skills. Proven ability to support and collaborate with cross-functional teams in a dynamic environment. If you're interested in the role please APPLY NOW or email me on Jmitchellattributegroup.com.au