Project Background-

Identity Access Management - Live Service with significant transformation ongoing

The Role:

As a Data Engineer, you will build, optimise, and maintain robust end-to-end data pipelines and platforms on Microsoft Foundry, Azure, and Databricks to enable analytics, AI, and digital healthcare initiatives.

Your responsibilities:

• Develop and maintain production-grade data pipelines using Microsoft Foundry, Azure Data Factory, ADLS, Synapse, and Databricks (Spark & Delta Lake). • Implement ETL/ELT processes, data ingestion, transformation, and loading with Python, SQL, and Spark. • Apply data modelling best practices (star schema and lakehouse) for reliable storage and processing. • Handle NHS/healthcare datasets while ensuring FHIR/HL7 compliance and patient data security. • Support ML workflows through high-quality data preparation and feature engineering. • Monitor, troubleshoot, and continuously optimise pipeline performance, quality, and reliability.