Prediction with Expert Advice under Local Differential Privacy

arXiv ID: 2512.06971v1

Published: 2025-12-07

Authors: Ben Jacobsen, Kassem Fawaz

Categories: cs.LG, cs.CR, cs.DS, stat.ML

Relevance Score: 0.90 / 1.00

View on arXiv Download PDF

Summary

This paper addresses the problem of prediction with expert advice under local differential privacy (LDP), proposing two novel algorithms, RW-AdaBatch and RW-Meta, that significantly improve upon classical methods. RW-AdaBatch introduces a novel privacy amplification mechanism, while RW-Meta provides a general method for privately selecting complex, non-trivial learning experts, a significant advancement over prior work. Evaluated on real-world COVID-19 hospital data, RW-Meta demonstrated superior performance, outperforming both classical LDP and state-of-the-art central DP algorithms in predicting high COVID patient density.

Medical Relevance

This research is highly relevant to medicine and public health by enabling privacy-preserving predictive analytics on sensitive healthcare data, such as real-time hospital statistics during a pandemic. It allows for more accurate forecasting and resource allocation without compromising patient or institutional privacy, crucial for managing public health crises.

AI Health Application

The research develops privacy-preserving machine learning algorithms (RW-AdaBatch and RW-Meta) that, when applied to hospital data, predict the weekly density of COVID-19 patients in specific hospitals. This AI application assists in critical tasks like anticipating surges in patient load, optimizing resource allocation across healthcare facilities, and informing public health strategies during pandemics, all while ensuring the privacy of sensitive health information through Local Differential Privacy.

Key Points

The research addresses the classic problem of prediction with expert advice, specifically under the stringent constraint of Local Differential Privacy (LDP).
A classical prediction algorithm is shown to naturally satisfy LDP, serving as a baseline for comparison.
RW-AdaBatch is introduced, exploiting LDP's limited-switching behavior to achieve a novel form of privacy amplification that strengthens on 'easier' data, akin to the shuffle model, without significant utility cost.
RW-Meta is developed as a general method for privately selecting among non-trivial learning algorithms (experts), a departure from prior work that only considered data-independent experts, with no extra privacy cost under LDP.
Formal regret bounds are derived for the proposed algorithms, scaling inversely with the degree of independence between experts, providing theoretical guarantees.
The algorithms were empirically evaluated using real-world data reported by hospitals during the COVID-19 pandemic.
RW-Meta achieved a 1.5-3x performance improvement over a classical LDP baseline and a state-of-the-art central DP algorithm in predicting which hospital would report the highest density of COVID patients each week.

Methodology

The methodology involves theoretical analysis and algorithm design. It first assesses a classical prediction algorithm's inherent LDP properties. Then, two new algorithms are designed: RW-AdaBatch, which leverages random walks and limited-switching for privacy amplification, and RW-Meta, a general framework for privately selecting among complex, non-trivial learning experts. Formal regret bounds are derived to theoretically guarantee performance and privacy. Empirical evaluation is conducted using real-world COVID-19 hospital data, comparing RW-Meta against the classical LDP baseline and a central DP algorithm on a prediction task.

Key Findings

The paper finds that a classical prediction algorithm can naturally satisfy LDP. It introduces RW-AdaBatch, demonstrating a novel privacy amplification technique without utility loss, and RW-Meta, a significant advancement enabling private selection of sophisticated learning experts under LDP with no additional privacy cost. Formal regret bounds were established. Crucially, RW-Meta empirically outperformed both classical LDP and a central DP baseline by 1.5-3 times in predicting high COVID-19 patient density hospitals using real-world pandemic data.

Clinical Impact

The clinical impact lies in providing more robust and private predictive tools for healthcare systems. This can lead to improved resource allocation (e.g., ICU beds, staff, PPE) during public health emergencies like pandemics by accurately forecasting hotspots while fully protecting sensitive hospital reporting data. It facilitates the use of advanced machine learning for critical decision-making in healthcare without the privacy risks typically associated with sharing granular data.

Limitations

The abstract highlights that prior work in this domain primarily considered only data-independent experts, a limitation addressed and overcome by RW-Meta. While the abstract does not explicitly state limitations of the proposed methods, generalizability beyond the COVID-19 prediction task or the computational overhead of these advanced LDP algorithms in extremely high-throughput clinical settings could be implicit considerations.

Future Directions

The abstract does not explicitly mention future research directions. However, the development of a general method for privately selecting non-trivial learning algorithms suggests potential for applying RW-Meta to a wider array of privacy-sensitive medical prediction tasks and exploring its performance across different data modalities and health conditions.

Medical Domains

Public Health Epidemiology Hospital Management Infectious Diseases (COVID-19) Healthcare Analytics

Keywords

Local Differential Privacy Prediction with Expert Advice Machine Learning Privacy Amplification Random Walks Ensemble Learning COVID-19 Healthcare Data

Abstract

We study the classic problem of prediction with expert advice under the constraint of local differential privacy (LDP). In this context, we first show that a classical algorithm naturally satisfies LDP and then design two new algorithms that improve it: RW-AdaBatch and RW-Meta. For RW-AdaBatch, we exploit the limited-switching behavior induced by LDP to provide a novel form of privacy amplification that grows stronger on easier data, analogous to the shuffle model in offline learning. Drawing on the theory of random walks, we prove that this improvement carries essentially no utility cost. For RW-Meta, we develop a general method for privately selecting between experts that are themselves non-trivial learning algorithms, and we show that in the context of LDP this carries no extra privacy cost. In contrast, prior work has only considered data-independent experts. We also derive formal regret bounds that scale inversely with the degree of independence between experts. Our analysis is supplemented by evaluation on real-world data reported by hospitals during the COVID-19 pandemic; RW-Meta outperforms both the classical baseline and a state-of-the-art \textit{central} DP algorithm by 1.5-3$\times$ on the task of predicting which hospital will report the highest density of COVID patients each week.

Comments

19 pages, 3 figures