Senior Data Engineer Sydney, Australia $185,000 (including Super) Bonus About the Role: Join a high-performing Data Team within a leading financial services as a Senior Data Engineer, you will be pivotal in the design and implementation of data solutions, focusing on regulatory epics and enhancing platform efficiency using AI and automation. Key Responsibilities: Design, build, and optimize data integration pipelines and data platforms. Collaborate with business and technical stakeholders to deliver data-driven solutions. Enhance platform efficiency by integrating AI and automation capabilities. Ensure compliance with data governance and quality standards. Support the transformation of regulatory reporting processes. Contribute to the architecture and modeling of robust data solutions. Required Skills and Experience: Proficiency in Spark, Hive, Presto, and big data storage formats (Parquet, ORC, Avro). Experience with orchestration tools like Airflow. Hands-on experience with tools such as Talend, DataStage, or Informatica. Strong knowledge of data warehouse implementation. Experience with AWS services such as EC2, S3, RDS, and EMR. Expertise in Spark SQL, with a focus on query tuning and optimization. Familiarity with Python for automation and data processing. Understanding of data lineage, metadata, data quality, and reconciliation processes. Knowledge of data modeling techniques and architecture principles. Strong communication and problem-solving abilities. Self-driven with a passion for learning and innovation. If you feel you possess the relevant skills to the above, apply now with most updated CV