Data Engineer

Location: Leeds, UK 

Work Pattern: Hybrid

Travel Requirements: Mostly Remote - Travel to customer and Mastek offices as required

Security Clearance: Not Mandatory - Good to Have

Immediate Joiners

About Mastek

Mastek Limited is a global provider of enterprise AI, digital, and cloud services, enabling clients to achieve measurable and sustainable returns on their technology investments. With a presence in over 40 countries and a workforce of nearly 5,000 professionals, Mastek delivers innovative technology solutions that help organisations accelerate transformation and unlock business value.

Through our Lead with AI approach, we integrate intelligence across our solutions and operations, enabling ethical, scalable, and domain-driven AI adoption. We partner with industry leaders including Oracle, Salesforce, Microsoft, AWS, Snowflake, and Databricks, delivering outcomes across sectors such as Healthcare, Financial Services, Retail, Manufacturing, Higher Education, and the Public Sector.Guided by our core values of Trust, Value, and Velocity, we foster a culture of collaboration, innovation, continuous learning, and career growth.

Data Engineer

Demographic and Geospatial Data

Databricks  |  Python  |  PySpark  |  SQL  |  Pipeline Development

About the role

We are looking for a hands-on Data Engineer to develop and maintain Databricks pipelines that combine demographic information with geographic reference data. You will produce reliable datasets for demographic reporting, population analysis and service planning, with clear rules for how records are assigned to geographic areas.

You will work with data owners, analysts and platform teams to translate requirements into reusable processing. The role includes postcode enrichment, spatial processing, data quality and management of changing geographic reference data, from development through release and production support.

Key responsibilities

• Design, develop and deploy data pipelines using Databricks, Python, PySpark and SQL. Build reusable ingestion, transformation and validation components, with reliable scheduling, incremental processing and safe reprocessing.
• Ingest demographic records, postcode directories, geographic boundaries and organisation reference data. Maintain source metadata, data lineage and versioned raw and curated datasets using Delta Lake.
• Standardise postcode and address fields while preserving source values. Apply agreed record keys and effective dates, and manage invalid, missing, terminated or unmatched postcodes through documented exception rules.
• Enrich records using approved NHS and ONS postcode products and lookup tables. Derive agreed statistical, local authority and health geographies, and validate organisation and site codes against ODS reference data.
• Implement spatial joins, including point-in-polygon matching, and distance calculations where required. Validate geometry and coordinate reference systems, and define how boundary-edge cases and multiple matches are handled.
• Maintain versions and effective dates for postcode lookups, boundaries and organisation changes. Apply the correct geographic vintage for each reporting period so historical outputs remain reproducible.
• Keep residential geography distinct from registered-practice and provider geography. Agree demographic definitions, age reference dates and aggregation rules with analysts to avoid incorrect linkage or double counting.
• Automate checks for completeness, duplicate records, unmatched locations, invalid coordinates and unexpected geography changes. Reconcile counts before and after joins and report exceptions for investigation.
• Optimise Spark and spatial processing through appropriate partitioning, join strategies and spatial indexing where supported. Monitor runtime, data volumes and resource use as pipelines scale.
• Apply approved access, pseudonymisation and disclosure controls to demographic and location data. Use authorised reference and geocoding services, and produce outputs at the agreed geographic granularity.
• Use code review, automated tests and controlled releases. Document mappings, reference-data versions and recovery procedures, and investigate production issues with data owners and support teams.

Essential skills and experience

• Strong Databricks, Python, PySpark and SQL skills, with hands-on experience developing and supporting production data pipelines processing large datasets.
• Experience with Delta Lake, batch and incremental ingestion, schema management, merge logic, deduplication and maintaining historical records without losing the meaning of effective dates.
• Practical geospatial data engineering experience working with points, polygons, spatial joins, geometry validation and geographic aggregation.
• Understanding of coordinate reference systems, including British National Grid and WGS84, coordinate transformation, distance units and the limitations of postcode centroids for precise location analysis.
• Experience with a scalable Spark spatial approach, such as supported native Databricks spatial functions or Apache Sedona. Able to select tooling compatible with the deployed runtime and workload.
• Ability to ingest and transform spatial formats such as GeoJSON, WKT/WKB and Shapefile or GeoParquet, alongside tabular reference files.
• Experience joining demographic or other record-level data to geographic reference data, handling unmatched and multiple matches, and controlling changes to lookup versions and boundaries.
• Strong data quality and reconciliation skills, including tests that identify record multiplication, missing mappings and incorrect geographic assignments.
• Experience with Git, CI/CD, code review, automated testing, job monitoring and performance troubleshooting. Able to document assumptions and explain data issues clearly to analysts and data owners.

Desirable experience

• NHS demographic or patient registration data, the NHS Postcode Directory, ONS Postcode Directory, National Statistics Postcode Lookup and Organisation Data Service reference data.
• UK statistical and health geographies, including Lower layer and Middle layer Super Output Areas (LSOAs and MSOAs), local authorities and Integrated Care Boards (ICBs).
• GeoPandas, Shapely, pyproj or QGIS for investigation and validation; address matching using Unique Property Reference Numbers (UPRNs) and approved address reference sources.
• Population and census data, area-level deprivation indicators, cloud object storage and handling sensitive demographic data in a regulated environment.

Why Join Mastek?

• Work on large-scale digital transformation programmes across public and private sector clients.
• Collaborate with highly skilled and diverse teams across multiple disciplines.
• Gain exposure to modern technologies, frameworks, and delivery methodologies.
• Access ongoing learning, professional development, and certification opportunities.
• Contribute to meaningful projects that have real-world impact.
• Be part of an inclusive culture that values innovation, teamwork, and continuous improvement.
• Enjoy clear career progression opportunities within a global technology organisation.

Our UK Benefits Include

• Competitive salary and annual bonus opportunities
• Hybrid and flexible working options
• Generous annual leave entitlement plus bank holidays
• Company pension scheme with employer contributions
• Private medical insurance (for self and dependants)
• Life assurance cover
• Employee Assistance Programme (EAP)
• Wellbeing initiatives and gym support
• Learning and development programmes, certifications, and professional training
• Employee recognition and reward schemes
• Cycle to Work scheme
• Employee referral bonus programme
• Enhanced family-friendly policies

Diversity & Inclusion

At Mastek, we are committed to building a diverse workforce and creating an inclusive environment where everyone can succeed. We welcome applications from all backgrounds and are proud to be an equal opportunities employer.

We believe diversity drives innovation and are dedicated to fostering a workplace where every employee feels valued, respected, and empowered to make an impact.