Data Engineer — Adelaide CBD, Adelaide

Hudson is looking for an experienced and skilled Data Engineer. The successful candidate will play a critical role by designing, building, and maintaining scalable and robust data pipelines within the Microsoft Azure environment for a large organisation. Key Responsibilities: Design, build, and maintain scalable and robust data pipelines within the Microsoft Azure environment. Utilize Azure Data Factory, Azure Databricks, and other Azure services for data extraction, transformation, and loading (ETL) processes. Implement and manage data warehousing solutions using Azure and Snowflake data management. Work with common healthcare data models, ensuring compliance with industry standards such as HL7, FHIR, and HIPAA. Collaborate with data scientists and analysts to provide accessible, clean, and integrated data for advanced analytics. Optimize data storage and performance in Azure and Snowflake, managing both structured and unstructured data. Ensure data quality and integrity, implementing appropriate data governance and security measures. Develop and maintain documentation for data models, data flow diagrams, and ETL processes. Essential Requirements: Proven experience designing and implementing enterprise-wide data models and pipelines, using a broad range of modern platforms and technologies. Proven experience as a Data Engineer on Microsoft Azure platforms. Expertise in SQL, Python, and other data processing languages. Strong knowledge of ETL techniques and tools, data modelling, and data warehousing. Experience working in a large, complex organization and adhering to enterprise standards and policies. Comprehensive knowledge of technology solution design, particularly related to the design of complex enterprise-level system interfaces and data exchanges. Experience with database technologies, migration, integration, virtualization, and deployment methodologies. Extensive experience applying dimensional modelling principles to data structures. Proven experience in serving data to a broad range of consumers (e.g., semantic layers, tools, data structures). Strong understanding of information architecture, security, quality control, and governance principles associated with enterprise data warehousing solutions. Exceptional written and verbal communication skills, particularly in developing project documentation. Excellent problem-solving and troubleshooting skills. Experience with healthcare data models and familiarity with healthcare data standards and regulations. Awareness of healthcare industry and clinical processes. Qualifications: While there are no mandatory qualifications for this position, a tertiary qualification in a related discipline would be highly desirable. To apply follow the provided links, for a confidential discussion please reach out to harme.sonhudson.com to learn more REF: 238673

Applications close Sunday, 14 July 2024
Take me to the job
Find more jobs nearby: Adelaide, Kent Town, Parkside, Wayville, Hackney.