Senior Data Engineer required to support the development of an Azure Databricks platform for a leading retail business. Responsibilities: design and development of pipelines using Databricks and Lakehouse optimisation and maintenance of data workflows, ensuring quality and integrity performance tuning and monitoring set up and manage CI/CD pipelines Notebook development using Python and/or Pyspark adhere best practices for data engineering, including governance and security own ML engines, further developing architecture for model execution and monitoring Requirements: extensive experience building data pipelines in an Azure Databricks environment well-versed with PySpark and SQL solid experience around ML models and algorithms Click on the 'Apply' button to submit your CV.