Workshop
International Workshop on Federated Foundation Models in Conjunction with NeurIPS 2024 (FL@FM-NeurIPS'24)
Sai Praneeth Karimireddy · Xiaoxiao Li · Songtao Lu · Stacy Patterson · Pascal Poupart · Han Yu
East Meeting Room 8, 15
Sun 15 Dec, 8:15 a.m. PST
The rise of foundation models (FMs) amplifies the importance and relevance of federated learning (FL) as a crucial research direction. With FMs becoming the norm in machine learning development, the focus shifts from model architecture design to tackling the issues surrounding privacy-preserving and distributed learning. Advancements in FL methods have the potential to unlock the use of FMs, enabling efficient and scalable training while safeguarding sensitive data. With this in mind, we invite original research contributions, position papers, and work-in-progress reports on various aspects of federated learning in the era of foundation models. Since the emergence of foundation models has been a relatively recent phenomenon, their full impact on federated learning has not yet been well explored or understood. We hope to provide a platform to facilitate interaction among students, scholars, and industry professionals from around the world to discuss the latest advancements, share insights, and identify future directions in this exciting field. This workshop aims to bring together academic researchers and industry practitioners to address open issues in this interdisciplinary research area. For industry participants, we intend to create a forum to communicate problems are practically relevant. For academic participants, we hope to make it easier to become productive in this area. The workshop will focus on the theme of combining FL with FM to open up opportunities to address new challenges.
Schedule
Sun 8:15 a.m. - 8:20 a.m.
|
Opening Remarks
(
Intro
)
>
SlidesLive Video |
🔗 |
Sun 8:20 a.m. - 9:00 a.m.
|
Federated Large Language Models and Their Applications, by Qiang Yang
(
Keynote Talk
)
>
SlidesLive Video |
Qiang Yang 🔗 |
Sun 9:00 a.m. - 9:07 a.m.
|
Alex Iacob, Lorenzo Sani, Bill Marino, Preslav Aleksandrov, William F. Shen & Nicholas Donald Lane. Worldwide Federated Training of Language Models
(
Paper Presentation
)
>
link
SlidesLive Video |
🔗 |
Sun 9:07 a.m. - 9:14 a.m.
|
Alexander Bienstock, Antigoni Polychroniadou & Ujjwal Kumar. Distributed Matrix Mechanism for Federated Learning
(
Paper Presentation
)
>
link
SlidesLive Video |
🔗 |
Sun 9:14 a.m. - 9:21 a.m.
|
Christian Internò, Elena Raponi, Niki van Stein, Thomas Bäck, Markus Olhofer, Yaochu Jin & Barbara Hammer. Adaptive Model Hybrid Pruning in Federated Learning through Loss Exploration
(
Paper Presentation
)
>
link
SlidesLive Video |
🔗 |
Sun 9:21 a.m. - 9:28 a.m.
|
Filip Granqvist, Congzheng Song, Áine Cahill, Rogier van Dalen, Martin Pelikan, Yi Sheng Chan, Xiaojun Feng, Natarajan Krishnaswami, Vojta J & Mona Chitnis. pfl-research: Simulation Framework for Accelerating Research in Private Federated Learning
(
Paper Presentation
)
>
link
SlidesLive Video |
🔗 |
Sun 9:30 a.m. - 10:00 a.m.
|
Coffee Break
|
🔗 |
Sun 10:00 a.m. - 10:07 a.m.
|
Harish Karthikeyan & Antigoni Polychroniadou. OPA: One-shot Private Aggregation with Single Client Interaction and its Applications to Federated Learning
(
Paper Presentation
)
>
link
SlidesLive Video |
🔗 |
Sun 10:07 a.m. - 10:14 a.m.
|
Kai Yi, Timur Kharisov, Igor Sokolov & Peter Richtárik. Cohort Squeeze: Beyond a Single Communication Round per Cohort in Cross-Device Federated Learning
(
Paper Presentation
)
>
link
SlidesLive Video |
🔗 |
Sun 10:14 a.m. - 10:21 a.m.
|
Lei Shen, Zhenheng Tang, Lijun Wu, Yonggang Zhang, Xiaowen Chu, Tao Qin & Bo Han. Hot Pluggable Federated Learning
(
Paper Presentation
)
>
link
SlidesLive Video |
🔗 |
Sun 10:21 a.m. - 10:28 a.m.
|
Lorenzo Sani, Alex Iacob, Zeyu Cao, Bill Marino, Yan Gao, Tomas Paulik, Wanru Zhao, William F. Shen, Preslav Aleksandrov, Xinchi Qiu & Nicholas Donald Lane. The Future of Large Language Model Pre-training is Federated
(
Paper Presentation
)
>
link
SlidesLive Video |
🔗 |
Sun 10:30 a.m. - 11:00 a.m.
|
The first AGI will be Federated, by Nicholas Lane
(
Keynote Talk
)
>
SlidesLive Video |
Nicholas Lane 🔗 |
Sun 11:00 a.m. - 11:07 a.m.
|
Lu Li, Tianyu Zhang, Zhiqi Bu, Suyuchen Wang, Huan He, Jie Fu, Yonghui Wu, Jiang Bian, Yong Chen & Yoshua Bengio. MAP: Model Merging with Amortized Pareto Front Using Limited Computation
(
Paper Presentation
)
>
link
SlidesLive Video |
🔗 |
Sun 11:07 a.m. - 11:14 a.m.
|
Mariel Werner, Sai Praneeth Karimireddy & Michael Jordan. Defection-Free Collaboration between Competitors in a Learning System ( Paper Presentation ) > link | 🔗 |
Sun 11:14 a.m. - 11:21 a.m.
|
Muxing Wang, Pengkun Yang & Lili Su. On the Convergence Rates of Federated Q-Learning across Heterogeneous Environments
(
Paper Presentation
)
>
link
SlidesLive Video |
🔗 |
Sun 11:21 a.m. - 11:28 a.m.
|
Rui Ye, Jingyi Chai, Xiangrui Liu, Yaodong Yang, Yanfeng Wang & Siheng Chen. Emerging Safety Attack and Defense in Federated Instruction Tuning of Large Language Models ( Paper Presentation ) > link | 🔗 |
Sun 11:28 a.m. - 11:35 a.m.
|
Rui Ye, Rui Ge, Fengting Yuchi, Jingyi Chai, Yanfeng Wang & Siheng Chen. Leveraging Unstructured Text Data for Federated Instruction Tuning of Large Language Models ( Paper Presentation ) > link | 🔗 |
Sun 11:35 a.m. - 11:42 a.m.
|
Rui Ye, Xinyu Zhu, Jingyi Chai, Lingjuan Lyu, Chen Xie, Yanfeng Wang & Siheng Chen. Federated Learning with Generative Content ( Paper Presentation ) > link | 🔗 |
Sun 11:42 a.m. - 11:49 a.m.
|
Sergio Zaera Mata & Roberto Gómez-Espinosa Martín. The SynapticCity Phenomenon: When All Foundation Models Marry Federated Learning and Blockchain
(
Paper Presentation
)
>
link
SlidesLive Video |
🔗 |
Sun 11:49 a.m. - 11:56 a.m.
|
Steffen Schotthöfer & M. Paul Laiu. Federated Dynamical Low-Rank Training with Global Loss Convergence Guarantees
(
Paper Presentation
)
>
link
SlidesLive Video |
🔗 |
Sun 11:56 a.m. - 12:03 p.m.
|
Sunny Gupta & Amit Sethi. FedStein: Enhancing Multi-Domain Federated Learning Through James-Stein Estimator
(
Paper Presentation
)
>
link
SlidesLive Video |
🔗 |
Sun 12:03 p.m. - 12:10 p.m.
|
Tao Yu, Congzheng Song, Jianyu Wang & Mona Chitnis. Momentum Approximation in Asynchronous Private Federated Learning
(
Paper Presentation
)
>
link
SlidesLive Video |
🔗 |
Sun 12:30 p.m. - 2:00 p.m.
|
Lunch Break
|
🔗 |
Sun 2:00 p.m. - 2:30 p.m.
|
Transforming Multicenter Neurology Trials with Federated Learning: A New Era of Collaborative Medicine, by Martin J. McKeown
(
Keynote Talk
)
>
SlidesLive Video |
🔗 |
Sun 2:30 p.m. - 3:00 p.m.
|
Federated Optimization Beyond Standard Empirical Risk Minimization, by Gauri Joshi
(
Keynote Talk
)
>
SlidesLive Video |
Gauri Joshi 🔗 |
Sun 3:00 p.m. - 3:30 p.m.
|
Coffee Break
|
🔗 |
Sun 3:30 p.m. - 4:00 p.m.
|
Machine Learning from Imbalanced Data Sources, by Shiqiang Wang
(
Keynote Talk
)
>
SlidesLive Video |
Shiqiang Wang 🔗 |
Sun 4:00 p.m. - 4:07 p.m.
|
Vasileios Tsouvalas, Samaneh Mohammadi, Ali Balador, Tanir Özçelebi, Francesco Flammini & Nirvana Meratnia. EncCluster: Bringing Functional Encryption in Federated Foundational Models
(
Paper Presentation
)
>
link
SlidesLive Video |
🔗 |
Sun 4:07 p.m. - 4:14 p.m.
|
Wang Lu, Hao Yu, Jindong Wang, Damien Teney, Haohan Wang, Yao Zhu, Yiqiang Chen, Qiang Yang, Xing Xie & Xiangyang Ji. ZOOPFL: Exploring Black-box Foundation Models for Personalized Federated Learning
(
Paper Presentation
)
>
link
SlidesLive Video |
🔗 |
Sun 4:14 p.m. - 4:21 p.m.
|
Xianjie Guo, Liping Yi, Xiaohu Wu, Kui Yu & Gang Wang. Enhancing Causal Discovery in Federated Settings with Limited Local Samples
(
Paper Presentation
)
>
link
SlidesLive Video |
🔗 |
Sun 4:21 p.m. - 4:28 p.m.
|
Xiaochun Niu, Lili Su, Jiaming Xu & Pengkun Yang. Collaborative Learning with Shared Linear Representation: Statistical Rates and Optimal Algorithms
(
Paper Presentation
)
>
link
SlidesLive Video |
🔗 |
Sun 4:28 p.m. - 4:35 p.m.
|
Yao Shu, Wenyang Hu, See-Kiong Ng, Bryan Kian Hsiang Low & Fei Richard Yu. Ferret: Federated Full-Parameter Tuning at Scale for Large Language Models
(
Paper Presentation
)
>
link
SlidesLive Video |
🔗 |
Sun 4:35 p.m. - 4:42 p.m.
|
Zexi Li, Jie Lin, Zhiqi Li, Didi Zhu, Rui Ye, Tao Shen, Tao Lin & Chao Wu. Improving Group Connectivity for Generalization of Federated Deep Learning ( Paper Presentation ) > link | 🔗 |
Sun 4:42 p.m. - 4:49 p.m.
|
Zhe Li, Bicheng Ying, Zidong Liu, Chaosheng Dong & Haibo Yang. DeComFL: Federated Learning with Dimension-Free Communication
(
Paper Presentation
)
>
link
SlidesLive Video |
🔗 |
Sun 4:49 p.m. - 4:56 p.m.
|
Zhilong Li, Xiaohu Wu, Xiaoli Tang, Tiantian He, Yew-Soon Ong, Mengmeng Chen, Qiqi Liu, Qicheng Lao, Xiaoxiao Li & Han Yu. Benchmarking Data Heterogeneity Evaluation Approaches for Personalized Federated Learning
(
Paper Presentation
)
>
link
SlidesLive Video |
🔗 |
Sun 5:00 p.m. - 5:15 p.m.
|
Award Ceremony
(
Closing
)
>
SlidesLive Video |
🔗 |
-
|
ZOOPFL: Exploring Black-box Foundation Models for Personalized Federated Learning ( Oral ) > link | Wang Lu · 浩 余 · Jindong Wang · Damien Teney · Haohan Wang · Yao Zhu · Yiqiang Chen · Qiang Yang · Xing Xie · Xiangyang Ji 🔗 |
-
|
Improving Group Connectivity for Generalization of Federated Deep Learning ( Oral ) > link | Zexi Li · Jie Lin · Zhiqi Li · Didi Zhu · Rui Ye · Tao Shen · Tao Lin · Chao Wu 🔗 |
-
|
FedStein: Enhancing Multi-Domain Federated Learning Through James-Stein Estimator ( Oral ) > link | Sunny Kumar Gupta · Amit Sethi 🔗 |
-
|
OPA: One-shot Private Aggregation with Single Client Interaction and its Applications to Federated Learning ( Oral ) > link | Harish Karthikeyan · Antigoni Polychroniadou 🔗 |
-
|
Leveraging Unstructured Text Data for Federated Instruction Tuning of Large Language Models ( Oral ) > link | Rui Ye · Rui Ge · Fengting Yuchi · Jingyi Chai · Yanfeng Wang · Siheng Chen 🔗 |
-
|
Momentum Approximation in Asynchronous Private Federated Learning ( Oral ) > link | Tao Yu · Congzheng Song · Jianyu Wang · Mona Chitnis 🔗 |
-
|
Collaborative Learning with Shared Linear Representations: Statistical Rates and Optimal Algorithms ( Oral ) > link | Xiaochun Niu · Lili Su · Jiaming Xu · Pengkun Yang 🔗 |
-
|
The Future of Large Language Model Pre-training is Federated ( Oral ) > link |
11 presentersLorenzo Sani · Alexandru-Andrei Iacob · Zeyu Cao · Bill Marino · Yan Gao · Tomas Paulik · Wanru Zhao · William Shen · Preslav Aleksandrov · Xinchi Qiu · Nicholas Lane |
-
|
Federated Learning with Generative Content ( Oral ) > link | Rui Ye · Xinyu Zhu · Jingyi Chai · Lingjuan Lyu · Chen Xie · Yanfeng Wang · Siheng Chen 🔗 |
-
|
Worldwide Federated Training of Language Models ( Oral ) > link | Alexandru-Andrei Iacob · Lorenzo Sani · Bill Marino · Preslav Aleksandrov · William Shen · Nicholas Lane 🔗 |
-
|
DeComFL: Federated Learning with Dimension-Free Communication ( Oral ) > link | Zhe Li · Bicheng Ying · Zidong Liu · Chaosheng Dong · Haibo Yang 🔗 |
-
|
Benchmarking Data Heterogeneity Evaluation Approaches for Personalized Federated Learning ( Oral ) > link | Zhilong Li · Xiaohu Wu · Xiaoli Tang · Tiantian He · Yew Soon Ong · Mengmeng Chen · QIQI LIU · Qicheng Lao · Han Yu 🔗 |
-
|
Ferret: Federated Full-Parameter Tuning at Scale for Large Language Models ( Oral ) > link | Yao Shu · Wenyang Hu · See-Kiong Ng · Bryan Kian Hsiang Low · Fei Yu 🔗 |
-
|
The SynapticCity Phenomenon: When All Foundation Models Marry Federated Learning and Blockchain ( Oral ) > link | Sergio Zaera Mata · Roberto Gómez-Espinosa Martín 🔗 |
-
|
Adaptive Hybrid Model Pruning in Federated Learning through Loss Exploration ( Oral ) > link | Christian Internò · Elena Raponi · Niki van Stein · Thomas Bäck · Markus Olhofer · Yaochu Jin · Barbara Hammer 🔗 |
-
|
Federated Dynamical Low-Rank Training with Global Loss Convergence Guarantees ( Oral ) > link | Steffen Schotthöfer · M. Laiu 🔗 |
-
|
MAP: Model Merging with Amortized Pareto Front Using Limited Computation ( Oral ) > link | Lu Li · Tianyu Zhang · Zhiqi Bu · Suyuchen Wang · Huan He · Jie Fu · Yonghui Wu · Jiang Bian · Yong Chen · Yoshua Bengio 🔗 |
-
|
Enhancing Causal Discovery in Federated Settings with Limited Local Samples ( Oral ) > link | Xianjie Guo · Liping Yi · Xiaohu Wu · Kui Yu · Gang Wang 🔗 |
-
|
DMM: Distributed Matrix Mechanism for Differentially-Private Federated Learning using Packed Secret Sharing ( Oral ) > link | Alexander Bienstock · Antigoni Polychroniadou · Ujjwal Kumar 🔗 |
-
|
Hot Pluggable Federated Learning ( Oral ) > link | Lei SHEN · Zhenheng Tang · Lijun Wu · Yonggang Zhang · Xiaowen Chu · Tao Qin · Bo Han 🔗 |
-
|
On the Convergence Rates of Federated Q-Learning across Heterogeneous Environments ( Oral ) > link | Muxing Wang · Pengkun Yang · Lili Su 🔗 |
-
|
Cohort Squeeze: Beyond a Single Communication Round per Cohort in Cross-Device Federated Learning ( Oral ) > link | Kai Yi · Timur Kharisov · Igor Sokolov · Peter Richtarik 🔗 |
-
|
EncCluster: Bringing Functional Encryption in Federated Foundational Models ( Oral ) > link | Vasileios Tsouvalas · Samaneh Mohammadi · Ali Balador · Tanir Özçelebi · Francesco Flammini · Nirvana Meratnia 🔗 |
-
|
$\texttt{pfl-research}$: simulation framework for accelerating research in Private Federated Learning ( Oral ) > link | Filip Granqvist · Congzheng Song · Áine Cahill · Rogier van Dalen · Martin Pelikan · Yi Sheng Chan · Xiaojun Feng · Natarajan Krishnaswami · Vojta Jina · Mona Chitnis 🔗 |
-
|
Defection-Free Collaboration between Competitors in a Learning System ( Oral ) > link | Mariel Werner · Sai Praneeth Karimireddy · Michael Jordan 🔗 |
-
|
Emerging Safety Attack and Defense in Federated Instruction Tuning of Large Language Models ( Oral ) > link | Rui Ye · Jingyi Chai · Xiangrui Liu · Yaodong Yang · Yanfeng Wang · Siheng Chen 🔗 |