PPFL: A Personalized Federated Learning Framework for Heterogeneous Population

References

• Bonkhoff AK, Grefkes C (2022) Precision medicine in stroke: Towards personalized outcome predictions using artificial intelligence. Brain 145(2):457–475.Crossref, Google Scholar
• Chen Z, Deng Y, Wu Y, Gu Q, Li Y (2022) Towards understanding the mixture-of-experts layer in deep learning. Koyejo S, Mohamed S, Agarwal A, Belgrave D, Cho K, Oh A, eds. NIPS’22: Proc. 36th Internat. Conf. Neural Inform. Processing Systems (Curran Associates Inc., Red Hook, NY), 23049–23062.Google Scholar
• Collins L, Hassani H, Mokhtari A, Shakkottai S (2021) Exploiting shared representations for personalized federated learning. Marina M, Tong Z, eds. Internat. Conf. Machine Learn. (PMLR, Cambridge, MA), 10126–10146.Google Scholar
• Dang CD, Lan G (2015) Stochastic block mirror descent methods for nonsmooth and stochastic optimization. SIAM J. Optim. 25(2):856–881.Crossref, Google Scholar
• Dayan I, Roth HR, Zhong A, Harouni A, Gentili A, Abidin AZ, Liu A, et al. (2021) Federated learning for predicting clinical outcomes in patients with COVID-19. Nature Medicine 27(10):1735–1743.Crossref, Google Scholar
• Di H, Yang Y, Ye H, Xiang Y (2025) PPFL: A personalized federated learning framework for heterogeneous population. https://doi.org/10.1287/ijoc.2023.0376, https://github.com/INFORMSJoC/2023.0376.Google Scholar
• Dinh CT, Tran N, Nguyen J (2020) Personalized federated learning with Moreau envelopes. Larochelle H, Ranzato M, Hadsell R, Balcan MF, Lin H, eds. NIPS’20: Proc. 34th Internat. Conf. Neural Inform. Processing Systems (Curran Associates Inc., Red Hook, NY), 21394–21405.Google Scholar
• Feffer M, Rudovic O, Picard RW (2018) A mixture of personalized experts for human affect estimation. Perner P, ed. Machine Learn. Data Mining Pattern Recognition. MLDM 2018, Lecture Notes in Computer Science, vol. 10935 (Springer, Cham, Switzerland), 316–330.Google Scholar
• Feng J, Zhu X, Wang F, Huang S, Chen C (2020) A learning framework for personalized random utility maximization (rum) modeling of user behavior. IEEE Trans. Automation Sci. Engrg. 19(1):510–521.Crossref, Google Scholar
• Ghosh A, Chung J, Yin D, Ramchandran K (2020) An efficient framework for clustered federated learning. Larochelle H, Ranzato M, Hadsell R, Balcan MF, Lin H, eds. NIPS’20: Proc. 34th Internat. Conf. Neural Inform. Processing Systems (Curran Associates Inc., Red Hook, NY), 19586–19597.Google Scholar
• Hanzely F, Zhao B, Kolar M (2023) Personalized federated learning: A unified framework and universal optimization techniques. Trans. Machine Learn. Res.Google Scholar
• Jeong W, Hwang SJ (2022) Factorized-FL: Personalized federated learning with parameter factorization & similarity matching. Koyejo S, Mohamed S, Agarwal A, Belgrave D, Cho K, Oh A, eds. NIPS’22: Proc. 36th Internat. Conf. Neural Inform. Processing Systems (Curran Associates Inc., Red Hook, NY), 35684–35695.Google Scholar
• Kamp M, Fischer J, Vreeken J (2023) Federated learning from small datasets. Kamalika C, Stefanie J, Le S, Csaba S, Gang N, Sivan S, eds. Internat. Conf. Learn. Representations (PMLR, Cambridge, MA), 14800–14819.Google Scholar
• Kim H, Allenby GM (2022) Integrating textual information into models of choice and scaled response data. Marketing Sci. 41(4):815–830.Link, Google Scholar
• Kosolwattana T, Wang H, Kontar RA, Lin Y (2025) FCOM: A federated collaborative online monitoring framework via representation learning. Proc. AAAI Conf. Artificial Intelligence (AAAI Press, Menlo Park, CA), 17957–17965.Google Scholar
• Li T, Hu S, Beirami A, Smith V (2021) Ditto: Fair and robust federated learning through personalization. Marina M, Tong Z, eds. Internat. Conf. Machine Learn. (PMLR, Cambridge, MA), 6434–6444.Google Scholar
• Li T, Sahu AK, Talwalkar A, Smith V (2020) Federated learning: Challenges, methods, and future directions. IEEE Signal Processing Magazine 37(3):50–60.Crossref, Google Scholar
• Liang PP, Liu T, Ziyin L, Salakhutdinov R, Morency LP (2020) Think locally, act globally: Federated learning with local and global representations. Preprint, submitted January 6, https://arxiv.org/abs/2001.01523.Google Scholar
• Liu B, Guo Y, Chen X (2021) PFA: Privacy-preserving federated adaptation for effective model personalization. WWW’21: Proc. Web Conf. (Association for Computing Machinery, New York), 923–934.Google Scholar
• Lin Y, Liu S, Huang S (2018) Selective sensing of a heterogeneous population of units with dynamic health conditions. IISE Trans. 50(12):1076–1088.Crossref, Google Scholar
• Lin Y, Liu K, Byon E, Qian X, Liu S, Huang S (2017) A collaborative learning framework for estimating many individualized regression models in a heterogeneous population. IEEE Trans. Reliability 67(1):328–341.Crossref, Google Scholar
• Marfoq O, Neglia G, Bellet A, Kameni L, Vidal R (2021) Federated multi-task learning under a mixture of distributions. Ranzato M, Beygelzimer A, Dauphin Y, Liang PS, Wortman Vaughan J, eds. NIPS’21: Proc. 35th Internat. Conf. Neural Inform. Processing Systems (Curran Associates Inc., Red Hook, NY), 15434–15447.Google Scholar
• McMahan B, Moore E, Ramage D, Hampson S, Agüera y Arcas BA (2017) Communication-efficient learning of deep networks from decentralized data. Aarti A, Jerry Z, eds. Proc. 20th Internat. Conf. Artificial Intelligence Statist. (PMLR, Cambridge, MA), 1273–1282.Google Scholar
• Murdoch WJ, Singh C, Kumbier K, Abbasi-Asl R, Yu B (2019) Definitions, methods, and applications in interpretable machine learning. Proc. Natl. Acad. Sci. USA 116(44):22071–22080.Crossref, Google Scholar
• Nader R, Bretto A, Mourad B, Abbas H (2019) On the positive semi-definite property of similarity matrices. Theoret. Comput. Sci. 755:13–28.Crossref, Google Scholar
• Pillutla K, Malik K, Mohamed AR, Rabbat M, Sanjabi M, Xiao L (2022) Federated learning with partial model personalization. Kamalika C, Stefanie J, Le S, Csaba S, Gang N, Sivan S, eds. Internat. Conf. Machine Learn. (PMLR, Cambridge, MA), 17773–17807.Google Scholar
• Sattler F, Müller KR, Samek W (2020) Clustered federated learning: Model-agnostic distributed multitask optimization under privacy constraints. IEEE Trans. Neural Networks Learn. Systems 32(8):3710–3722.Crossref, Google Scholar
• Shazeer N, Mirhoseini A, Maziarz K, Davis A, Le QV, Hinton GE, Dean J (2017) Outrageously large neural networks: The sparsely-gated mixture-of-experts layer. Internat. Conf. Learn. Representations (Curran Associates, Inc., Red Hook, NY), 875–888.Google Scholar
• Smith AN, Seiler S, Aggarwal I (2023) Optimal price targeting. Marketing Sci. 42(3):476–499.Link, Google Scholar
• Smith V, Chiang CK, Sanjabi M, Talwalkar AS (2017) Federated multi-task learning. von Luxburg U, Guyon I, Bengio S, Wallach H, Fergus R, eds. NIPS’17: Proc. 31st Internat. Conf. Neural Inform. Processing Systems (Curran Associates Inc., Red Hook, NY), 4427–4437.Google Scholar
• Tan AZ, Yu H, Cui L, Yang Q (2022) Towards personalized federated learning. IEEE Trans. Neural Networks Learn. Systems 34(12):9587–9603.Crossref, Google Scholar
• Tuck J, Hallac D, Boyd S (2019) Distributed majorization-minimization for Laplacian regularized problems. IEEE/CAA J. Automatica Sinica 6(1):45–52.Crossref, Google Scholar
• Verbeke G, Lesaffre E (1996) A linear mixed-effects model with heterogeneity in the random-effects population. J. Amer. Statist. Assoc. 91(433):217–221.Crossref, Google Scholar
• Wu R, Scaglione A, Wai HT, Karakoc N, Hreinsson K, Ma WK (2021) Federated block coordinate descent scheme for learning global and personalized models. Proc. AAAI Conf. Artificial Intelligence 35(12):10355–10362.Crossref, Google Scholar
• Yang Y, Huang S, Huang W, Chang X (2021) Privacy-preserving cost-sensitive learning. IEEE Trans. Neural Networks Learn. Systems 32(5):2105–2116.Crossref, Google Scholar
• Yue X, Kontar RA, Gómez AME (2024) Federated data analytics: A study on linear models. IISE Trans. 56(1):16–28.Crossref, Google Scholar
• Zhong A, He H, Ren Z, Li N, Li Q (2023) FedDAR: Federated domain-aware representation learning. Internat. Conf. Learn. Representations (Curran Associates, Inc., Red Hook, NY), 11210–11241.Google Scholar
• Zhou S, Li GY (2023) Federated learning via inexact ADMM. IEEE Trans. Pattern Anal. Machine Intelligence 45(8):9699–9708.Crossref, Google Scholar
• Ziko I, Dolz J, Granger E, Ayed IB (2020) Laplacian regularized few-shot learning. Internat. Conf. Machine Learn. (PMLR, Cambridge, MA), 14521–14532.Google Scholar