Computer Science > Machine Learning
arXiv:2512.06971 (cs)
COVID-19 e-print
Important: e-prints posted on arXiv are not peer-reviewed by arXiv; they should not be relied upon without context to guide clinical practice or health-related behavior and should not be reported in news media as established information without consulting multiple experts in the field.
Title:Prediction with Expert Advice under Local Differential Privacy
Abstract:We study the classic problem of prediction with expert advice under the constraint of local differential privacy (LDP). In this context, we first show that a classical algorithm naturally satisfies LDP and then design two new …
Computer Science > Machine Learning
arXiv:2512.06971 (cs)
COVID-19 e-print
Important: e-prints posted on arXiv are not peer-reviewed by arXiv; they should not be relied upon without context to guide clinical practice or health-related behavior and should not be reported in news media as established information without consulting multiple experts in the field.
Title:Prediction with Expert Advice under Local Differential Privacy
Abstract:We study the classic problem of prediction with expert advice under the constraint of local differential privacy (LDP). In this context, we first show that a classical algorithm naturally satisfies LDP and then design two new algorithms that improve it: RW-AdaBatch and RW-Meta. For RW-AdaBatch, we exploit the limited-switching behavior induced by LDP to provide a novel form of privacy amplification that grows stronger on easier data, analogous to the shuffle model in offline learning. Drawing on the theory of random walks, we prove that this improvement carries essentially no utility cost. For RW-Meta, we develop a general method for privately selecting between experts that are themselves non-trivial learning algorithms, and we show that in the context of LDP this carries no extra privacy cost. In contrast, prior work has only considered data-independent experts. We also derive formal regret bounds that scale inversely with the degree of independence between experts. Our analysis is supplemented by evaluation on real-world data reported by hospitals during the COVID-19 pandemic; RW-Meta outperforms both the classical baseline and a state-of-the-art \textit{central} DP algorithm by 1.5-3$\times$ on the task of predicting which hospital will report the highest density of COVID patients each week.
| Comments: | 19 pages, 3 figures |
| Subjects: | Machine Learning (cs.LG); Cryptography and Security (cs.CR); Data Structures and Algorithms (cs.DS); Machine Learning (stat.ML) |
| Cite as: | arXiv:2512.06971 [cs.LG] |
| (or arXiv:2512.06971v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2512.06971 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Ben Jacobsen [view email] [v1] Sun, 7 Dec 2025 19:31:35 UTC (166 KB)