DataOps Engineer Our Story Scentre Group is the owner and operator of 42 Westfield living centres in Australia and New Zealand; partnering with the world's leading retail and luxury brands to create a unique shopping and leisure experience for our customers. A career with us fosters the chance to be a part of a company that is transforming the digital and physical retail space. Every day, our people play a vital role in our purpose to 'create extraordinary places, connecting and enriching communities.' Your Opportunity An exciting new opportunity for an experienced Data Engineer to join Scentre Group on a 12-month fixed-term contract. The Desired candidate will have experience in Data Warehousing and Big Data, where they have spent their time predominantly in Design and Development of ETL / ELT framework, jobs and pipelines. A snapshot of your role: To operate secured, scalable, and optimal data pipelines on Scentre Group's cloud data platform, by following 'DataOps' processes and principles. As a member of the Data Engineering team, provide operational support to ensure our data pipelines are reliable and continuously improve data platform to deliver operational excellence Design, Develop and Maintain data pipelines utilising standard toolset, including but not limited to Spring microservices, dbt, Cloud Dataflow, Cloud Composer, GoAnywhere, Cloud PubSub and Confluent Kafka Understand various data security standards and adhere to the required data controls Perform code release using CI/CD tools including BuildKite, Terraform and GitHub. Deploy automated monitoring processes to collect metrics for all data pipelines using standard tools and technologies used by Scentre Group - Prometheus, Grafana Monitor data pipelines ensuring the statistics remains within acceptable limits, and continuously improve the efficiency, quality and transparency. Support production platforms and monitor to resolve bugs, performance problems and production issues. What will set you apart from the rest? Understanding of Cloud Computing technologies (Google Cloud Platform, including open source). Proficient in operating complex data pipelines including real-time streaming and batch (ELT, ETL) patterns. Proficient in Data Warehousing ETL concepts and data modelling principles including Star Schema and Data Vault. Proficient in programming languages such as Python, Java, SQL, Shell Scripting Well developed knowledge of RESTful and GraphQL APIs Proficient in DevOps principles, tools and methods and using CI/CD processes for managing releases of ETL / ELT pipelines. Proficient in monitoring production systems, managing incidents and providing support and fixes to ensure reliability of the data pipelines Good communication and collaboration abilities in addition to technical depth, working in cross functional teams. We are the place where talent thrives We promise to respect, inspire and develop you, and do work that matters. We are committed to providing a range of benefits that support our people in all aspects of life. Our benefits include financial assistance, family support, community engagement, growth and development opportunities and health and lifestyle support to create a positive work life balance as you grow your career with us Some of our most exciting and unique benefits include: Life Leave - additional 5 days paid leave to use however you like on top of your 4 weeks annual leave Gender neutral parental leave - 18 weeks paid with no qualifying period Free parking at your local Westfield destinations Our diverse and inclusive workforce is not only something we're proud of but something we're committed to. We encourage and support our people to bring their 'whole selves' to work every day. This is because we believe all our differences contribute to our success and ensure a workforce that reflects the customers we serve. Our commitment is backed by executive and employee-led working groups including All Abilities, LGBTI, Mental Health and Wellness and Gender Equity alongside other initiatives such as our Reconciliation Action Plan to grow our Aboriginal and Torres Strait Islander workforce. Scentre Group exclusively recruits for roles based in Australia and New Zealand. If you are contacted regarding employment opportunities with Scentre Group based in any other country, we encourage you not to disclose any personal information. Any email communication regarding an employment opportunity with us will come from a scentregroup.com email address. If you receive any suspicious emails regarding employment with Scentre Group, please forward them to: [email protected] Advertised: 09 Jul 2024 AUS Eastern Standard Time Applications close: 19 Jul 2024 AUS Eastern Standard Time