Community directory

Interest group

Improving Transparency Around Linkage Outputs (ITALO)

ITALO is an interest group focused on developing standards for reporting data linkage outputs to help users make informed analyses. The group aims to establish data linkage reporting standards, create training materials for best practices, and promote consistency in data linkage, hosting public engagement activities to enhance transparency and public confidence.

Status: Active
Primary contact: ich.italo@ucl.ac.uk

Capability and capacity Data and discovery Demonstrating trustworthiness

Join the community!

Click the button to complete the form and join the interest group

Community charter

The group has quarterly online meetings to discuss emerging challenges, share updates on ongoing projects, and plan collective activities. Between these sessions, members engage through local discussions, wider working groups, and our online collaboration platform.

Download full charter

Co-chairs

Meet the ITALO co-chairs leading community efforts co-developing and promoting common standards for reporting on the outputs of data linkage processes.

Joseph Lam

Joseph Lam

University College London

Ludivine Garside

Ludivine Garside

Rees Centre, University of Oxford

Giulia Mantovani

Giulia Mantovani

NHS England

 

 

 

 

Tony Stone

Tony Stone

University of Sheffield

Group events

ITALO community events promoting common reporting standards for data linkage outputs.

All group events

Group updates

Latest news and developments from the ITALO community.

Latest

No posts at the moment. Check back soon!

ALL COMMUNITY UPDATES

Group outputs

Key outputs from the ITALO community, promoting common reporting standards for data linkage outputs.

Latest

Media

In this presentation, Jo Lam (co-chair of ITALO) introduces a scalable framework for the automated evaluation and benchmarking of data linkage equality, within the NHSE’s new proposed linkage pipeline.

This is from his first milestone presentation at his third week with NHS England PhD Internship Program.  Jo works within the NHS England Data Linkage Hub, lead by Giulia Mantovani (co-chair of ITALO).

As the NHS moves toward a single, authoritative patient record, automated data linkage plays a central role. But without robust evaluation, this process risks embedding systemic biases, especially for marginalised populations. This presentation introduces a transparent, automated framework to benchmark data linkage equality—ensuring linked data are not only accurate, but also fair and trustworthy.

The framework is structured around three interlinked work packages:

  1. Pre-Linkage Profiling:
    Systematic analysis of input data quality—completeness, identifier structure—to assess linkability and detect early bias risks. Outputs include data enrichment reports for owners and linkers to support traceability and audit.
  2. In-Linkage Model Diagnostics:
    Automated tools to evaluate model bias before thresholds are applied. This includes match weight analysis, blocking rule assessment, and interactive bias diagnostics. Enables transparency in strategy selection and allows deviation from a “one-size-fits-all” pipeline when needed.
  3. Post-Linkage Equity Reporting:
    After linkage, sample bias and subgroup-specific error patterns (e.g., by ethnicity or deprivation) are quantified. Outputs include equity dashboards, analyst guidance, and feedback loops to data owners to inform future improvements.

Core assumptions challenged:

  • That all individuals are represented in central systems (e.g., NHS Spine)
  • That input data are equally complete across groups
  • That linked entities reflect ground truth

Key considerations:

  • Trade-offs between precision and recall often mask subgroup disparities.
  • The pipeline must accommodate diverse user needs—data owners, linkers, analysts—while remaining explainable and auditable.

Tools and progress:

  • Synthetic testbeds and reproducible dashboards support open-access benchmarking.
  • Developed in alignment with international best practices (UK, Canada, Australia).
  • Actively integrated with NHS England’s federated linkage infrastructure and informed by the ITALO expert network.

This work delivers practical, automated tooling to detect, explain, and mitigate linkage bias—helping ensure the NHS’s data future is not only powerful, but also inclusive.

ITALO

All group outputs