Fair Collaborative Learning (FairCL): A Method to Improve Fairness amid Personalization

References

• Abul-Husn NS, Kenny EE (2019) Personalized medicine and the power of electronic health records. Cell 177(1):58–69.Google Scholar
• Agarwal A, Dudík M, Wu ZS (2019) Fair regression: Quantitative definitions and reduction-based algorithms. Internat. Conf. Machine Learn. (PMLR, New York), 120–129.Google Scholar
• Alabi D, Immorlica N, Kalai A (2018) Unleashing linear optimizers for group-fair learning and optimization. 31st Annual Conf. Learn. Theory (PMLR, New York), 2043–2066.Google Scholar
• Alfian G, Syafrudin M, Ijaz MF, Syaekhoni MA, Fitriyani NL, Rhee J (2018) A personalized healthcare monitoring system for diabetic patients by utilizing BLE-based sensors and real-time data processing. Sensors (Basel) 18(7):2183.Google Scholar
• Amara S, Subramanian RR (2020) Collaborating personalized recommender system and content-based recommender system using textcorpus. Internat. Conf. Advanced Comput. Comm. Systems (IEEE, Piscataway, NJ), 105–109.Google Scholar
• Andreu-Perez J, Leff DR, Ip HM, Yang GZ (2015) From wearable sensors to smart implants—Toward pervasive and personalized healthcare. IEEE Trans. Biomedical Engrg. 62(12):2750–2762.Google Scholar
• Aribi Y, Boutora S, Zamoum PRB, Menasria H, Abdellaoui A, Kouzou PA (2023) Turbofan engine RUL prediction using ICA and machine learning algorithms. 20th Internat. Multi-Conf. Systems Signals Devices (IEEE, Piscataway, NJ), 477–484.Google Scholar
• Ban GY, Keskin NB (2021) Personalized dynamic pricing with machine learning: High-dimensional features and heterogeneous elasticity. Management Sci. 67(9):5549–5568.Link, Google Scholar
• Belkin M, Niyogi P, Sindhwani V (2005) On manifold regularization. Internat. Workshop Artificial Intelligence Statist. (PMLR, New York), 17–24.Google Scholar
• Benhamdi S, Babouri A, Chiky R (2017) Personalized recommender system for e-learning environment. Ed. Inform. Tech. 22(4):1455–1477.Google Scholar
• Berk R, Heidari H, Jabbari S, Kearns M, Roth A (2021) Fairness in criminal justice risk assessments: The state of the art. Sociol. Methods Res. 50(1):3–44.Google Scholar
• Bilenko M, Richardson M (2011) Predictive client-side profiles for personalized advertising. Proc. 17th ACM SIGKDD Internat. Conf. Knowledge Discovery Data Mining (ACM, New York), 413–421.Google Scholar
• Briggs C, Fan Z, Andras P (2020) Federated learning with hierarchical clustering of local updates to improve training on non-IID data. Internat. Joint Conf. Neural Networks (IEEE, Piscataway, NJ), 1–9.Google Scholar
• Caldas S, Konečny J, McMahan HB, Talwalkar A (2018) Expanding the reach of federated learning by reducing client resource requirements. Preprint, submitted December 18, https://arxiv.org/abs/1812.07210.Google Scholar
• Caton S, Haas C (2020) Fairness in machine learning: A survey. Preprint, submitted October 4, https://arxiv.org/abs/2010.04053.Google Scholar
• Chen J, Kallus N, Mao X, Svacha G, Udell M (2019) Fairness under unawareness: Assessing disparity when protected class is unobserved. Proc. Conf. Fairness Accountability Transparency (ACM, New York), 339–348.Google Scholar
• Chi J, Tian Y, Gordon GJ, Zhao H (2021) Understanding and mitigating accuracy disparity in regression. Internat. Conf. Machine Learn. (PMLR, New York), 1866–1876.Google Scholar
• Chzhen E, Denis C, Hebiri M, Oneto L, Pontil M (2020) Fair regression with Wasserstein barycenters. Larochelle H, Ranzato M, Hadsell R, Balcan MF, Lin H, eds. Advances in Neural Information Processing Systems, vol. 33 (Curran Associates, Inc., Red Hook, NY), 7321–7331.Google Scholar
• Corbett-Davies S, Goel S (2018) The measure and mismeasure of fairness: A critical review of fair machine learning. Preprint, submitted July 31, https://arxiv.org/abs/1808.00023.Google Scholar
• Corbett-Davies S, Pierson E, Feller A, Goel S, Huq A (2017) Algorithmic decision making and the cost of fairness. Proc. 23rd ACM SIGKDD Internat. Conf. Knowledge Discovery Data Mining (Association for Computing Machinery, New York), 797–806.Google Scholar
• Costabella F, Patel KB, Adepoju AV, Singh P, Mahmoud HAH, Zafar A, Patel T, et al. (2023) Healthcare cost and outcomes associated with surgical site infection and patient outcomes in low-and middle-income countries. Cureus 15(7):e42493.Google Scholar
• Cotter A, Jiang H, Gupta MR, Wang S, Narayan T, You S, Sridharan K (2019) Optimization with non-differentiable constraints with applications to fairness, recall, churn, and other goals. J. Machine Learn. Res. 20(172):1–59.Google Scholar
• Cudeck R (1996) Mixed-effects models in the study of individual differences with repeated measures data. Multivariate Behav Res. 31(3):371–403.Google Scholar
• Du W, Xu D, Wu X, Tong H (2021) Fairness-aware agnostic federated learning. Proc. 2021 SIAM Internat. Conf. Data Mining (SIAM, Philadelphia), 181–189.Google Scholar
• Dwork C, Hardt M, Pitassi T, Reingold O, Zemel R (2012) Fairness through awareness. Proc. 3rd Innovations Theoret. Comput. Sci. Conf. (ACM, New York), 214–226.Google Scholar
• Emmert-Streib F, Dehmer M (2018) A machine learning perspective on personalized medicine: An automized, comprehensive knowledge base with ontology for pattern recognition. Machine Learn. Knowledge Extraction 1(1):149–156.Google Scholar
• Feldman M, Friedler SA, Moeller J, Scheidegger C, Venkatasubramanian S (2015) Certifying and removing disparate impact. Proc. 21st ACM SIGKDD Internat. Conf. Knowledge Discovery Data Mining (Association for Computing Machinery, New York), 259–268.Google Scholar
• Feng J, Zhu X, Wang F, Huang S, Chen C (2020) A learning framework for personalized random utility maximization (RUM) modeling of user behavior. IEEE Transactions Automation Sci. Engrg. 19(1):510–521.Google Scholar
• Firdaus M, Shandilya A, Ekbal A, Bhattacharyya P (2022) Being polite: Modeling politeness variation in a personalized dialog agent. IEEE Trans. Comput. Soc. Systems 10(4):1455–1464.Google Scholar
• Fleisher W (2021) What’s fair about individual fairness? Proc. 2021 AAAI/ACM Conf. AI Ethics Soc. (Association for Computing Machinery, New York).Google Scholar
• Gao D, Liu Y, Zeng D (2022) Non-asymptotic properties of individualized treatment rules from sequentially rule-adaptive trials. J. Machine Learn. Res. 23(250):1–42.Google Scholar
• Gao L, Li L, Chen Y, Zheng W, Xu C, Xu M (2021) FIFL: A fair incentive mechanism for federated learning. Proc. 50th Internat. Conf. Parallel Processing (ACM, New York), 1–10.Google Scholar
• Ghosh A, Chung J, Yin D, Ramchandran K (2020) An efficient framework for clustered federated learning. Advances in Neural Information Processing Systems, vol. 33 (Curran Associates, Inc., Red Hook, NY), 19586–19597.Google Scholar
• Ghosh A, Hong J, Yin D, Ramchandran K (2019) Robust federated learning in a heterogeneous environment. Preprint, submitted June 16, https://arxiv.org/abs/1906.06629.Google Scholar
• Guo L, Jin J, Zhang H, Zheng Z, Yang Z, Xing Z, Pan F, et al. (2021) We know what you want: An advertising strategy recommender system for online advertising. Proc. 27th ACM SIGKDD Conf. Knowledge Discovery Data Mining (Association for Computing Machinery, New York), 2919–2927.Google Scholar
• Hardt M, Price E, Srebro N (2016) Equality of opportunity in supervised learning. Lee D, Sugiyama M, Luxburg U, Guyon I, Garnett R, eds. Advances in Neural Information Processing Systems, vol. 29 (Curran Associates, Inc., Red Hook, NY).Google Scholar
• He Z, Wang L, Cai Z (2023) Clustered federated learning with adaptive local differential privacy on heterogeneous IoT data. IEEE Internet Things J. 11(1):137–146.Google Scholar
• Hu S, Wu ZS, Smith V (2022) Provably fair federated learning via bounded group loss. Preprint, submitted March 18, https://arxiv.org/abs/2203.10190.Google Scholar
• Huang T, Lin W, Shen L, Li K, Zomaya AY (2022) Stochastic client selection for federated learning with volatile clients. IEEE Internet Things J. 9(20):20055–20070.Google Scholar
• Huang T, Lin W, Wu W, He L, Li K, Zomaya AY (2020) An efficiency-boosting client selection scheme for federated learning with fairness guarantee. IEEE Trans. Parallel Distributed Systems 32(7):1552–1564.Google Scholar
• Jiang M, Wang Z, Guo S, Gao X, Tan KC (2020) Individual-based transfer learning for dynamic multiobjective optimization. IEEE Trans. Cybernetics 51(10):4968–4981.Google Scholar
• Jiang Z, Han X, Fan C, Yang F, Mostafavi A, Hu X (2022) Generalized demographic parity for group fairness. 10th Internat. Conf. Learn. Representations (OpenReview.net).Google Scholar
• Kamp M, Fischer J, Vreeken J (2023) Federated learning from small datasets. Internat. Conf. Learn. Representations (OpenReview.net).Google Scholar
• Knisely BM, Vaughn-Cooke M, Wagner LA, Fink JC (2021) Device personalization for heterogeneous populations: Leveraging physician expertise and national population data to identify medical device patient user groups. User Modeling User-Adapted Interaction 31(5):979–1025.Google Scholar
• Koh PW, Liang P (2017) Understanding black-box predictions via influence functions. Internat. Conf. Machine Learn. (PMLR, New York), 1885–1894.Google Scholar
• Kulkarni V, Kulkarni M, Pant A (2020) Survey of personalization techniques for federated learning. Fourth World Conf. Smart Trends Systems Security Sustainability (London), 794–797.Google Scholar
• Kusner MJ, Loftus J, Russell C, Silva R (2017) Counterfactual fairness. Advances in Neural Information Processing Systems, vol. 30 (Curran Associates, Inc., Red Hook, NY).Google Scholar
• Laird NM, Ware JH (1982) Random-effects models for longitudinal data. Biometrics 38(4):963–974.Google Scholar
• Li T, Hu S, Beirami A, Smith V (2021) Ditto: Fair and robust federated learning through personalization. Internat. Conf. Machine Learn. (PMLR, New York), 6357–6368.Google Scholar
• Li T, Sanjabi M, Beirami A, Smith V (2020a) Fair resource allocation in federated learning. 10th Internat. Conf. Learn. Representations (OpenReview.net).Google Scholar
• Li T, Sahu AK, Zaheer M, Sanjabi M, Talwalkar A, Smith V (2020b) Federated optimization in heterogeneous networks. Proc. Machine Learn. Systems, vol. 2, 429–450.Google Scholar
• Li T, Li Z, Li A, Du M, Liu A, Guo Q, Meng G, Liu Y (2023) Fairness via group contribution matching. Proc. 32nd Internat. Joint Conf. Artificial Intelligence (International Joint Conferences on Artificial Intelligence), 436–445.Google Scholar
• Lin Y, Liu S, Huang S (2018) Selective sensing of a heterogeneous population of units with dynamic health conditions. IISE Trans. 50(12):1076–1088.Google Scholar
• Lin Y, Liu K, Byon E, Qian X, Huang S (2015) Domain-knowledge driven cognitive degradation modeling for Alzheimer’s disease. Proc. 2015 SIAM Internat. Conf. Data Mining (SIAM, Philadelphia), 721–729.Google Scholar
• Lin Y, Liu K, Byon E, Qian X, Liu S, Huang S (2017) A collaborative learning framework for estimating many individualized regression models in a heterogeneous population. IEEE Trans. Reliability 67(1):328–341.Google Scholar
• Liu J, Huang J, Zhou Y, Li X, Ji S, Xiong H, Dou D (2022) From distributed machine learning to federated learning: A survey. Knowledge Inform. Systems 64(4):885–917.Google Scholar
• Liu Q, Tong S, Liu C, Zhao H, Chen E, Ma H, Wang S (2019) Exploiting cognitive structure for adaptive learning. Proc. 25th ACM SIGKDD Internat. Conf. Knowledge Discovery Data Mining (Association for Computing Machinery, New York), 627–635.Google Scholar
• Loyer JL, Henriques E, Wiseall S (2014) Comparison of binary classifiers for data-driven prognosis of jet engines health. PHM Soc. Eur. Conf., vol. 2 (PHM Society).Google Scholar
• Lyu L, Yu J, Nandakumar K, Li Y, Ma X, Jin J, Yu H, Ng KS (2020) Toward fair and privacy-preserving federated deep models. IEEE Trans. Parallel Distributed Systems 31(11):2524–2541.Google Scholar
• Ma Z, Dou Z, Zhu Y, Zhong H, Wen JR (2021) One chatbot per person: Creating personalized chatbots based on implicit user profiles. Proc. 44th Internat. ACM SIGIR Conf. Res. Development Inform. Retrieval (ACM, New York), 555–564.Google Scholar
• Mansour Y, Mohri M, Ro J, Suresh AT (2020) Three approaches for personalization with applications to federated learning. Preprint, submitted February 25, https://arxiv.org/abs/2002.10619.Google Scholar
• Marfoq O, Neglia G, Bellet A, Kameni L, Vidal R (2021) Federated multi-task learning under a mixture of distributions. Advances in Neural Information Processing Systems, vol. 34 (Curran Associates Inc., Red Hook, NY), 15434–15447.Google Scholar
• McAuley J (2022) Personalized Machine Learning (Cambridge University Press, Cambridge, UK).Google Scholar
• Mehrabi N, Naveed M, Morstatter F, Galstyan A (2021a) Exacerbating algorithmic bias through fairness attacks. Proc. Conf. AAAI Artificial Intelligence, vol. 35 (AAAI Press, Palo Alto, CA), 8930–8938.Google Scholar
• Mehrabi N, Morstatter F, Saxena N, Lerman K, Galstyan A (2021b) A survey on bias and fairness in machine learning. ACM Comput. Surveys 54(6):1–35.Google Scholar
• Mehta M, Shao C (2023) A greedy agglomerative framework for clustered federated learning. IEEE Trans. Indust. Informatics 19(12):11856–11867.Google Scholar
• Miao X, Chu CT, Tang L, Zhou Y, Young J, Bhasin A (2015) Distributed personalization. Proc. 21th ACM SIGKDD Internat. Conf. Knowledge Discovery Data Mining (Association for Computing Machinery, New York), 1989–1998.Google Scholar
• Mohri M, Sivek G, Suresh AT (2019) Agnostic federated learning. Internat. Conf. Machine Learn. (PMLR, New York), 4615–4625.Google Scholar
• Morafah M, Vahidian S, Wang W, Lin B (2023) FLIS: Clustered federated learning via inference similarity for non-IID data distribution. IEEE Open J. Comput. Soc. 4:109–120.Google Scholar
• Naumov M, Mudigere D, Shi HJM, Huang J, Sundaraman N, Park J, Wang X, et al. (2019) Deep learning recommendation model for personalization and recommendation systems. Preprint, submitted May 31, https://arxiv.org/abs/1906.00091.Google Scholar
• Navarro M, Little C, Allen GI, Segarra S (2024) Data augmentation via subgroup mixup for improving fairness. 2024 IEEE Internat. Conf. Acoustics Speech Signal Processing (IEEE, Piscataway, NJ), 7350–7354.Google Scholar
• Pessach D, Shmueli E (2020) Algorithmic fairness. Preprint, submitted January 21, https://arxiv.org/abs/2001.09784.Google Scholar
• Ruan Y, Joe-Wong C (2022) Fedsoft: Soft clustered federated learning with proximal local updating. Proc. Conf. AAAI Artificial Intelligence, vol. 36 (AAAI Press, Palo Alto, CA), 8124–8131.Google Scholar
• Sattler F, Müller KR, Samek W (2020) Clustered federated learning: Model-agnostic distributed multitask optimization under privacy constraints. IEEE Trans. Neural Networks Learning Systems 32(8):3710–3722.Google Scholar
• Saxena A, Goebel K, Simon D, Eklund N (2008) Damage propagation modeling for aircraft engine run-to-failure simulation. Internat. Conf. Prognostics Health Management (IEEE, Piscataway, NJ), 1–9.Google Scholar
• Shamir O, Srebro N (2014) Distributed stochastic optimization and learning. 52nd Annual Allerton Conf. Comm. Control Comput. (Allerton) (IEEE, Piscataway, NJ), 850–857.Google Scholar
• Shi Y, Yu H, Leung C (2023a) Toward fairness-aware federated learning. IEEE Trans. Neural Networks Learning Systems 35(9):11922–11938.Google Scholar
• Shi Y, Liu Z, Shi Z, Yu H (2023b) Fairness-aware client selection for federated learning. IEEE Internat. Conf. Multimedia Expo (IEEE, Piscataway, NJ), 324–329.Google Scholar
• Solans D, Biggio B, Castillo C (2020) Poisoning attacks on algorithmic fairness. Joint Eur. Conf. Machine Learn. Knowledge Discovery Databases (Springer, Cham, Switzerland), 162–177.Google Scholar
• Song Z, Sun H, Yang HH, Wang X, Zhang Y, Quek TQ (2021) Reputation-based federated learning for secure wireless networks. IEEE Internet Things J. 9(2):1212–1226.Google Scholar
• Tan AZ, Yu H, Cui L, Yang Q (2022) Toward personalized federated learning. IEEE Trans. Neural Networks Learning Systems 34(12):9587–9603.Google Scholar
• Tobore I, Li J, Yuhang L, Al-Handarish Y, Kandwal A, Nie Z, Wang L, et al. (2019) Deep learning intervention for healthcare challenges: Some biomedical domain considerations. JMIR Mhealth Uhealth 7(8):e11966.Google Scholar
• Verbraeken J, Wolting M, Katzy J, Kloppenburg J, Verbelen T, Rellermeyer JS (2020) A survey on distributed machine learning. ACM Comput. Surveys 53(2):1–33.Google Scholar
• Xian R, Yin L, Zhao H (2023) Fair and optimal classification via post-processing. Internat. Conf. Machine Learn. (PMLR, New York), 37977–38012.Google Scholar
• Xu G, Jia G, Shi L, Zhang Z (2021) Personalized course recommendation system fusing with knowledge graph and collaborative filtering. Comput. Intelligence Neuroscience 2021(1):9590502.Google Scholar
• Yang M, Wang X, Zhu H, Wang H, Qian H (2021) Federated learning with class imbalance reduction. 29th Eur. Signal Processing Conf. (IEEE, Piscataway, NJ), 2174–2178.Google Scholar
• Yang Q, Liu Y, Chen T, Tong Y (2019) Federated machine learning: Concept and applications. ACM Trans. Intelligent Systems Tech. 10(2):1–19.Google Scholar
• Yang Q, Zhang Y, Dai W, Pan SJ (2020) Transfer Learning (Cambridge University Press, Cambridge, UK).Google Scholar
• Yoganarasimhan H (2020) Search personalization using machine learning. Management Sci. 66(3):1045–1070.Link, Google Scholar
• Yu H, Liu Z, Liu Y, Chen T, Cong M, Weng X, Niyato D, Yang Q (2020) A fairness-aware incentive scheme for federated learning. Proc. AAAI/ACM Conf. AI Ethics Soc. (Association for Computing Machinery, New York), 393–399.Google Scholar
• Yue X, Nouiehed M, Al Kontar R (2023) GIFAIR-FL: A framework for group and individual fairness in federated learning. INFORMS J. Data Sci. 2(1):10–23.Link, Google Scholar
• Zafar MB, Valera I, Gomez-Rodriguez M, Gummadi KP (2019) Fairness constraints: A flexible approach for fair classification. J. Machine Learn. Res. 20(1):2737–2778.Google Scholar
• Zemel R, Wu Y, Swersky K, Pitassi T, Dwork C (2013) Learning fair representations. Internat. Conf. Machine Learn. (PMLR, New York), 325–333.Google Scholar
• Zhang Y, Yang Q (2021) A survey on multi-task learning. IEEE Trans. Knowledge Data Engrg. 34(12):5586–5609.Google Scholar
• Zhang H, Cisse M, Dauphin YN, Lopez-Paz D (2017) mixup: Beyond empirical risk minimization. Preprint, submitted October 25, https://arxiv.org/abs/1710.09412.Google Scholar
• Zhang X, Li Y, Li W, Guo K, Shao Y (2022) Personalized federated learning via variational Bayesian inference. Internat. Conf. Machine Learn. (PMLR, New York), 26293–26310.Google Scholar
• Zhang T, Zhu T, Li J, Han M, Zhou W, Philip SY (2020) Fairness in semi-supervised learning: Unlabeled data help to reduce discrimination. IEEE Trans. Knowledge Data Engrg. 34(4):1763–1774.Google Scholar
• Zhao C, Chen F (2019) Rank-based multi-task learning for fair regression. 2019 IEEE Internat. Conf. Data Mining (ICDM) (IEEE, Piscataway, NJ), 916–925.Google Scholar
• Zhu X, Feng J, Huang S, Chen C (2020) An online updating method for time-varying preference learning. Transportation Res. Part C Emerging Tech. 121:102849.Google Scholar
• Zhu X, Wang F, Chen C, Reed D (2019) Personalized control for promoting sustainable travel behaviors. Transportation Res. Procedia 38:730–750.Google Scholar
• Zhuang F, Qi Z, Duan K, Xi D, Zhu Y, Zhu H, Xiong H, He Q (2020) A comprehensive survey on transfer learning. Proc. IEEE 109(1):43–76.Google Scholar