Hybrid work - Any state in Australia - Sydney, CBD, NSW 12 12 12 months - Baseline clearance required Data Engineering, ELT, Coding, Data Modelling, DevOps Integrated cargo clearance system for biosecurity risk management Our client, a biosecurity focussed Federal Government department in Melbourne CBD, requires an experienced Lead Data Engineer for a 12 12 12 month contract. Duties Understand data requirements and deliver effective solutions. Design, develop, and maintain data pipelines and code-first ELT processes. Optimise pipeline performance through performance-tuning techniques. Ensure data quality, reliability, and availability across different sources and destinations. Design and maintain reference data tables according to the team's reference data standards using manual and automated mechanisms. Implement defined data governance, security, and privacy policies and standards. Monitor, troubleshoot, and optimise data pipeline performance and issues. Write clear, meaningful, code documentation that explains the intent and mechanics of scripts. Selection Criteria Data Modelling, Architecture and Integration Proficiency with relational databases; Experience in designing and managing data warehouses; proven ability to data model, including schema design, and normalization for relational and non-relational databases. Experience in data partitioning, sharding, and indexing for optimisation. Programming Language and Tools Competent capability in programming languages such as Python, Java, Scala, or SQL. Experience working with cloud services for data storage, processing, and management. Competence with Docker, Kubernetes, and CI/CD pipelines to deploy and manage data infrastructure. To apply for this long Lead Data Engineer contract, please click the Quick Apply button to forward your CV to Andy at the Recruitment Hive. Please note our internal Job ID is AE 10316 and this RFQ closes on the 20th of December 2024.