GIFAIR-FL: A Framework for Group and Individual Fairness in Federated Learning

References

• Al-Ali A, Gupta R, Nabulsi AA (2018) Cyber physical systems role in manufacturing technologies. AIP Conf. Proc., vol. 1957 (AIP Publishing, Melville, NY), 050007.Google Scholar
• Arivazhagan MG, Aggarwal V, Singh AK, Choudhary S (2019) Federated learning with personalization layers. Preprint, submitted December 2, https://arxiv.org/abs/1912.00818.Google Scholar
• Bhagoji AN, Chakraborty S, Mittal P, Calo S (2019) Analyzing federated learning through an adversarial lens. Proc. 36th Internat. Conf. Machine Learn. Proceedings of Machine Learning Research, vol. 97, 634–643.Google Scholar
• Caldas S, Duddu SMK, Wu P, Li T, Konečnà J, McMahan HB, Smith V, Talwalkar A (2018) LEAF: A benchmark for federated settings. Preprint, submitted December 3, https://arxiv.org/abs/1812.01097.Google Scholar
• Chen F, Luo M, Dong Z, Li Z, He X (2018) Federated meta-learning with fast convergence and efficient communication. Preprint, submitted February 22, https://arxiv.org/abs/1802.07876.Google Scholar
• CleanTechnica (2021) Tesla FSD hardware has 150 million times more computer power than Apollo 11 computer. Accessed May 24, https://cleantechnica.com/2021/05/24/tesla-fsd-hardware-has-150-million-times-more-computer-power-than-apollo-11-computer/.Google Scholar
• Cohen G, Afshar S, Tapson J, Van Schaik A (2017) EMNIST: Extending MNIST to handwritten letters. 2017 Internat. Joint Conf. Neural Networks (Institute of Electrical and Electronics Engineers, Piscataway, NJ), 2921–2926.Google Scholar
• Dai Z, Low KH, Jaillet P (2020) Federated Bayesian optimization via Thompson sampling. Preprint, submitted October 20, https://arxiv.org/abs/2010.10154.Google Scholar
• Dinh CT, Tran NH, Nguyen TD (2020) Personalized federated learning with Moreau envelopes. Larochelle H, Ranzato M, Hadsell R, Balcan MF, Lin H, eds. Proc. 34th Internat. Conf. Neural Inform. Processing Systems (Curran Associates, Red Hook, NY), 21394–21405.Google Scholar
• Du W, Xu D, Wu X, Tong H (2020) Fairness-aware agnostic federated learning. Preprint, October 10, https://arxiv.org/abs/2010.05057.Google Scholar
• Fallah A, Mokhtari A, Ozdaglar A (2020) Personalized federated learning: A meta-learning approach. Larochelle H, Ranzato M, Hadsell R, Balcan MF, Lin H, eds. Proc. 34th Internat. Conf. Neural Inform. Processing Systems (Curran Associates, Red Hook, NY).Google Scholar
• Feldman M, Friedler SA, Moeller J, Scheidegger C, Venkatasubramanian S (2015) Certifying and removing disparate impact. Proc. 21th ACM SIGKDD Internat. Conf. Knowledge Discovery Data Mining (Association for Computing Machinery, New York), 259–268.Google Scholar
• Ghosh A, Hong J, Yin D, Ramchandran K (2019) Robust federated learning in a heterogeneous environment. Preprint, submitted June 16, https://arxiv.org/abs/1906.06629.Google Scholar
• Hard A, Rao K, Mathews R, Ramaswamy S, Beaufays F, Augenstein S, Eichner H, Kiddon C, Ramage D (2018) Federated learning for mobile keyboard prediction. Preprint, submitted November 8, https://arxiv.org/abs/1811.03604.Google Scholar
• Hardt M, Price E, Srebro N (2016) Equality of opportunity in supervised learning. Lee D, Sugiyama M, Luxburg U, Guyon I, Garnett R, eds. Proc. 30th Internat. Conf. Neural Inform. Processing Systems (Curran Associates Inc., Red Hook, NY).Google Scholar
• Hu B, Gao Y, Liu L, Ma H (2018) Federated region-learning: An edge computing based framework for urban environment sensing. 2018 IEEE Global Comm. Conf. (Institute of Electrical and Electronics Engineers, Piscataway, NJ), 1–7.Google Scholar
• Hu Z, Shaloudegi K, Zhang G, Yu Y (2020) FedMGDA+: Federated learning meets multi-objective optimization. Preprint, submitted June 20, https://arxiv.org/abs/2006.11489.Google Scholar
• Huang W, Li T, Wang D, Du S, Zhang J (2020) Fairness and accuracy in federated learning. Preprint, submitted December 18, https://arxiv.org/abs/2012.10069.Google Scholar
• Jiang JC, Kantarci B, Oktug S, Soyata T (2020b) Federated learning in smart city sensing: Challenges and opportunities. Sensors (Basel) 20(21):6230.Google Scholar
• Jiang Y, Konečnà J, Rush K, Kannan S (2019) Improving federated learning personalization via model agnostic meta learning. Preprint, submitted September 27, https://arxiv.org/abs/1909.12488.Google Scholar
• Jiang J, Hu L, Hu C, Liu J, Wang Z (2020a) BACombo-bandwidth-aware decentralized federated learning. Electronics (Basel) 9(3):440.Google Scholar
• Jones MN, Mewhort DJ (2004) Case-sensitive letter and bigram frequency counts from large-scale English corpora. Behav. Res. Methods Instruments Comput. 36(3):388–396.Google Scholar
• Kairouz P, McMahan HB, Avent B, Bellet A, Bennis M, Bhagoji AN, Bonawitz K, et al. (2019) Advances and open problems in federated learning. Preprint, submitted December 10, https://arxiv.org/abs/1912.04977.Google Scholar
• Karimireddy SP, Kale S, Mohri M, Reddi S, Stich S, Suresh AT (2020) SCAFFOLD: Stochastic controlled averaging for federated learning. Proc. 37th Internat. Conf. Machine Learn. Proceedings of Machine Learning Research, vol. 119, 5132–5143.Google Scholar
• Khodak M, Tu R, Li T, Li L, Balcan MF, Smith V, Talwalkar A (2021) Federated hyperparameter tuning: Challenges, baselines, and connections to weight-sharing. Preprint, submitted June 8, https://arxiv.org/abs/2106.04502.Google Scholar
• Kontar R, Shi N, Yue X, Chung S, Byon E, Chowdhury M, Jin J, et al. (2021) The internet of federated things (IoFT). IEEE Access 9:156071–156113.Google Scholar
• Li D, Wang J (2019) FedMD: Heterogenous federated learning via model distillation. Preprint, submitted October 8, https://arxiv.org/abs/1910.03581.Google Scholar
• Li T, Beirami A, Sanjabi M, Smith V (2020b) Tilted empirical risk minimization. Preprint, submitted July 2, https://arxiv.org/abs/2007.01162.Google Scholar
• Li L, Fan Y, Tse M, Lin KY (2020a) A review of applications in federated learning. Comput. Indust. Engrg. 149(November):106854.Google Scholar
• Li T, Hu S, Beirami A, Smith V (2021) Ditto: Fair and robust federated learning through personalization. Proc. 38th Internat. Conf. Machine Learn. Proceedings of Machine Learning Research, vol. 139, 6357–6368.Google Scholar
• Li T, Sanjabi M, Beirami A, Smith V (2019a) Fair resource allocation in federated learning. Internat. Conf. Learn. Representations.Google Scholar
• Li X, Yang W, Wang S, Zhang Z (2019b) Communication-efficient local decentralized SGD methods. Preprint, submitted October 21, https://arxiv.org/abs/1910.09126.Google Scholar
• Li X, Huang K, Yang W, Wang S, Zhang Z (2019c) On the convergence of FedAvg on non-IID data. Preprint, submitted July 4, https://arxiv.org/abs/1907.02189.Google Scholar
• Li T, Sahu AK, Zaheer M, Sanjabi M, Talwalkar A, Smith V (2018) Federated optimization in heterogeneous networks. Dhillon I, Papailiopoulos D, Sze V, eds. Proc. Machine Learn. Systems, vol. 2, 429–450.Google Scholar
• Liang PP, Liu T, Ziyin L, Allen NB, Auerbach RP, Brent D, Salakhutdinov R, Morency LP (2020) Think locally, act globally: Federated learning with local and global representations. Preprint, submitted January 6, https://arxiv.org/abs/2001.01523.Google Scholar
• Lyu L, Xu X, Wang Q, Yu H (2020) Collaborative fairness in federated learning. Goebel R, Tanaka Y, Wahlster W, eds. Federated Learning (Springer, Cham, Switzerland), 189–204.Google Scholar
• Mansour Y, Mohri M, Ro J, Suresh AT (2020) Three approaches for personalization with applications to federated learning. Preprint, submitted February 25, https://arxiv.org/abs/2002.10619.Google Scholar
• McMahan B, Moore E, Ramage D, Hampson S, Arcas BA (2017) Communication-efficient learning of deep networks from decentralized data. Proc. 20th Internat. Conf. Artificial Intelligence Statist. Proceedings of Machine Learning Research, vol. 54, 1273–1282.Google Scholar
• Mohri M, Sivek G, Suresh AT (2019) Agnostic federated learning. Proc. 36th Internat. Conf. Machine Learn. Proceedings of Machine Learning Research, vol. 97, 4615–4625.Google Scholar
• Nguyen HT, Sehwag V, Hosseinalipour S, Brinton CG, Chiang M, Poor HV (2020) Fast-convergent federated learning. IEEE J. Selected Areas Comm. 39(1):201–218.Google Scholar
• Pillutla K, Kakade SM, Harchaoui Z (2019) Robust aggregation for federated learning. Preprint, submitted December 31, https://arxiv.org/abs/1912.13445.Google Scholar
• Ramaswamy S, Mathews R, Rao K, Beaufays F (2019) Federated learning for emoji prediction in a mobile keyboard. Preprint, submitted June 11, https://arxiv.org/abs/1906.04329.Google Scholar
• Reddi S, Charles Z, Zaheer M, Garrett Z, Rush K, Konečnà J, Kumar S, McMahan HB (2020) Adaptive federated optimization. Preprint, submitted February 29, https://arxiv.org/abs/2003.00295.Google Scholar
• Samsung (2019) Your phone is now more powerful than your PC. Accessed February 19, 2019, https://insights.samsung.com/2021/08/19/your-phone-is-now-more-powerful-than-your-pc-3/.Google Scholar
• Sattler F, Wiedemann S, Müller KR, Samek W (2019) Robust and communication-efficient federated learning from non-iid data. IEEE Trans. Neural Networks Learn. Systems 31(9):3400–3413.Google Scholar
• Smith V, Chiang CK, Sanjabi M, Talwalkar AS (2017) Federated multi-task learning. Guyon I, Von Luxburg U, Bengio S, Wallach H, Fergus R, Vishwanathan S, Garnett R, eds. Advances in Neural Information Processing Systems, vol. 30 (Curran Associates, Red Hook, NY), 4424–4434.Google Scholar
• Wang H, Yurochkin M, Sun Y, Papailiopoulos D, Khazaeni Y (2020b) Federated learning with matched averaging. Internat. Conf. Learn. Representations.Google Scholar
• Wang K, Mathews R, Kiddon C, Eichner H, Beaufays F, Ramage D (2019) Federated evaluation of on-device personalization. Preprint, submitted October 22, https://arxiv.org/abs/1910.10252.Google Scholar
• Wang H, Sreenivasan K, Rajput S, Vishwakarma H, Agarwal S, Sohn Jy, Lee K, Papailiopoulos D (2020a) Attack of the tails: Yes, you really can backdoor federated learning. Larochelle H, Ranzato M, Hadsell R, Balcan MF, Lin H, eds. Proc. 34th Internat. Conf. Neural Inform. Processing Systems (Curran Associates, Red Hook, NY),16070–16084.Google Scholar
• Xu X, Lyu L (2020) A reputation mechanism is all you need: Collaborative fairness and adversarial robustness in federated learning. Preprint, submitted November 20, https://arxiv.org/abs/2011.10464.Google Scholar
• Xu J, Glicksberg BS, Su C, Walker P, Bian J, Wang F (2021) Federated learning for healthcare informatics. J. Healthcare Informatics Res. 5(1):1–19.Google Scholar
• Yang K, Jiang T, Shi Y, Ding Z (2020) Federated learning via over-the-air computation. IEEE Trans. Wireless Comm. 19(3):2022–2035.Google Scholar
• Yu T, Bagdasaryan E, Shmatikov V (2020) Salvaging federated learning by local adaptation. Preprint, submitted February 12, https://arxiv.org/abs/2002.04758.Google Scholar
• Yuan H, Ma T (2020) Federated accelerated stochastic gradient descent. Proc. 34th Internat. Conf. Neural Inform. Processing Systems (Curran Associates Inc., Red Hook, NY), 5332–5344.Google Scholar
• Yue X, Kontar RA (2021) Federated Gaussian process: Convergence, automatic personalization and multi-fidelity modeling. Preprint, submitted November 28, https://arxiv.org/abs/2111.14008.Google Scholar
• Zafar MB, Valera I, Gomez Rodriguez M, Gummadi KP (2017) Fairness beyond disparate treatment & disparate impact: Learning classification without disparate mistreatment. Proc. 26th Internat. Conf. World Wide Web (International World Wide Web Conferences Steering Committee, Geneva, Switzerland), 1171–1180.Google Scholar
• Zhang DY, Kou Z, Wang D (2020a) FairFL: A fair federated learning approach to reducing demographic bias in privacy-sensitive classification models. 2020 IEEE Internat. Conf. Big Data (Institute of Electrical and Electronics Engineers, Piscataway, NJ), 1051–1060.Google Scholar
• Zhang J, Li C, Robles-Kelly A, Kankanhalli M (2020b) Hierarchically fair federated learning. Preprint, submitted April 22, https://arxiv.org/abs/2004.10386.Google Scholar
• Zhang X, Zhu X, Wang J, Yan H, Chen H, Bao W (2020c) Federated learning with adaptive communication compression under dynamic bandwidth and unreliable networks. Inform. Sci. 540(November):242–262.Google Scholar
• Zhao Y, Li M, Lai L, Suda N, Civin D, Chandra V (2018) Federated learning with non-IID data. Preprint, submitted June 2, https://arxiv.org/abs/1806.00582.Google Scholar