Workshop
AIM-FM: Advancements In Medical Foundation Models: Explainability, Robustness, Security, and Beyond
Yixuan Yuan · Yao Qin · Xiang Li · Ying Wei · Bulat Ibragimov · Linda Petzold
East Ballroom A, B
Sat 14 Dec, 8:20 a.m. PST
Towards next-generation medical analysis: Unlock the potential of medical foundation models for more explainable, robust, secure diagnosis solutions. Workshop Homepage: https://wymancv.github.io/AIM-FM-NeurIPS-Workshop/
Chat is not available.
Timezone: America/Los_Angeles
Schedule
|
Sat 8:20 a.m. - 8:30 a.m.
|
8:20 - 8:30 AM: Introduction
(
Introduction
)
>
SlidesLive Video |
Yixuan Yuan 🔗 |
|
Sat 8:30 a.m. - 9:10 a.m.
|
8:30 - 9:10 AM: Speaker: Pearse Keane
(
Invited talk
)
>
SlidesLive Video |
Pearse Keane 🔗 |
|
Sat 9:10 a.m. - 9:50 a.m.
|
9:10 - 9:50 AM: Speaker: Faisal Mahmood
(
Invited talk
)
>
SlidesLive Video |
Faisal Mahmood 🔗 |
|
Sat 9:50 a.m. - 10:00 a.m.
|
09:50 - 10:00 AM: Break (10 minutes)
|
🔗 |
|
Sat 10:00 a.m. - 10:40 a.m.
|
10:00 - 10:40 AM: Speaker: Sheng Wang
(
Invited talk
)
>
SlidesLive Video |
Sheng Wang 🔗 |
|
Sat 10:40 a.m. - 11:20 a.m.
|
10:40 - 11:20 AM: Panel Discussion
(
Discussion Panel
)
>
SlidesLive Video |
Pearse Keane · James Zou · Tianming Liu · Faisal Mahmood · Shekoofeh Azizi 🔗 |
|
Sat 11:20 a.m. - 12:00 p.m.
|
11:20 AM - 12:00 PM: Poster Session
(
Poster
)
>
|
🔗 |
|
Sat 12:00 p.m. - 1:00 p.m.
|
12:00 - 1:00 PM Lunch Break
|
🔗 |
|
Sat 1:00 p.m. - 1:40 p.m.
|
1:00 - 1:40 PM: Speaker: Tianming Liu
(
Invited talk
)
>
SlidesLive Video |
Tianming Liu 🔗 |
|
Sat 1:40 p.m. - 2:20 p.m.
|
1:40 - 2:20 PM: Speaker: James Zou
(
Invited talk
)
>
SlidesLive Video |
James Zou 🔗 |
|
Sat 2:20 p.m. - 2:30 p.m.
|
2:20 - 2:30 PM: Break (10 minutes)
|
🔗 |
|
Sat 2:30 p.m. - 3:30 p.m.
|
2:30 - 3:30 PM: Oral Session
(
Oral
)
>
SlidesLive Video |
🔗 |
|
Sat 2:30 p.m. - 3:30 p.m.
|
2:30 - 3:30 PM: M3H: Multimodal Multitask ML for Healthcare
(
Online Oral
)
>
link
SlidesLive Video |
🔗 |
|
Sat 2:30 p.m. - 3:30 p.m.
|
2:30 - 3:30 PM: Deep Generative Models Unveil Patterns in Medical Images Through Vision-Language Conditioning
(
Online Oral
)
>
link
SlidesLive Video |
🔗 |
|
Sat 2:30 p.m. - 3:30 p.m.
|
2:30 - 3:30 PM: Applying SAM to Few-shot Medical Image Segmentation using Mask Propagation and Auto-prompting
(
Online Oral
)
>
link
SlidesLive Video |
🔗 |
|
Sat 3:30 p.m. - 4:10 p.m.
|
3:30 - 4:10 PM: Speaker: Animashree Anandkumar
(
Invited talk
)
>
SlidesLive Video |
Animashree Anandkumar 🔗 |
|
Sat 4:10 p.m. - 4:50 p.m.
|
4:10 - 4:50 PM: Speaker: Karan Singhal
(
Invited talk
)
>
SlidesLive Video |
Karan Singhal 🔗 |
|
Sat 4:50 p.m. - 5:00 p.m.
|
4:50 - 5:00 PM: Break (10 minutes)
|
🔗 |
|
Sat 5:00 p.m. - 5:10 p.m.
|
5:00- 5:10 PM: Award Presentation and Summary
SlidesLive Video |
🔗 |
|
Sat 5:10 p.m. - 5:30 p.m.
|
5:10- 5:30 PM: Poster Session
(
Poster
)
>
|
🔗 |
|
-
|
Development and bilingual evaluation of Japanese medical large language model within reasonably low computational resources ( Poster ) > link | Issey Sukeda 🔗 |
|
-
|
Anatomical 3D Style Transfer Enabling Efficient Federated Learning with Extremely Low Communication Costs ( Poster ) > link | Yuto Shibata · Yasunori Kudo · Yohei Sugawara 🔗 |
|
-
|
VidLPRO: A Video-Language Pre-training Framework for Robotic and Laparoscopic Surgery ( Poster ) > link | Mohammadmahdi Honarmand · Muhammad Abdullah Jamal · Omid Mohareri 🔗 |
|
-
|
Biomedical SAM-2: Segment Anything in Biomedical Images and Videos ( Poster ) > link |
14 presentersZhiling Yan · Weixiang Sun · Rong Zhou · Zhengqing Yuan · Kai Zhang · Yiwei Li · Sekeun Kim · Sifan Song · Hui Ren · Tianming Liu · Quanzheng Li · Xiang Li · Lifang He · Lichao Sun |
|
-
|
Assessment of Medical Foundation Models for Survival Prediction with Whole Slide Images ( Poster ) > link | Elena Menand 🔗 |
|
-
|
Universal Speech Disorder Recognition: Towards a Foundation Model for Cross-Pathology Generalisation ( Poster ) > link | Giulia Sanguedolce · Dragos-Cristian Gruia · Sophie Brook · Patrick Naylor · Fatemeh Geranmayeh 🔗 |
|
-
|
DAug: Diffusion-based Channel Augmentation for Radiology Image Retrieval and Classification ( Poster ) > link | Zhuoran Zhou · Zhuoran Zhou · Haoquan Fang · Jenq-Neng Hwang 🔗 |
|
-
|
Exploring Fairness in Long-Term Prediction of Type 2 Diabetes Microvascular Complications ( Poster ) > link | Elizabeth Remfry · Rafael Henkin · Zainab Awan · Rohini Mathur · Michael Barnes · Aakanksha Naik 🔗 |
|
-
|
MediConfusion: Can you trust your AI radiologist? Probing the reliability of multimodal medical foundation models ( Poster ) > link | Mohammad Shahab Sepehri · Zalan Fabian · Maryam Soltanolkotabi · Mahdi Soltanolkotabi 🔗 |
|
-
|
Going beyond H&E and Oncology: how do Histopathology Foundation Models perform for multi-stain IHC & Immunology? ( Poster ) > link | Amaya Gallagher-Syed · ELENA PONTARINI · Myles Lewis · Greg Slabaugh · Michael Barnes 🔗 |
|
-
|
M3H: Multimodal Multitask Machine Learning for Healthcare ( Oral ) > link | Dimitris Bertsimas · Yu Ma 🔗 |
|
-
|
Reliability in AI-Assisted Critical Care: Assessing Large Language Model Robustness and Instruction Following for Cardiac Arrest Identification ( Poster ) > link | Ugurcan Vurgun · Sy Hwang · Danielle Mowery 🔗 |
|
-
|
Armadillo: Robust Secure Aggregation for Federated Learning with Input Validation ( Poster ) > link | Yiping Ma · Yue Guo · Harish Karthikeyan · Antigoni Polychroniadou 🔗 |
|
-
|
DiversityMedQA: A Benchmark for Assessing Demographic Biases in Medical Diagnosis using Large Language Models ( Poster ) > link | Rajat Rawat · Hudson McBride · Rajarshi Ghosh · Dhiyaan Nirmal · Jong Moon · Dhruv Alamari · Kevin Zhu · Sean O'Brien 🔗 |
|
-
|
Demographic Bias of Expert-Level Vision-Language Foundation Models in Medical Imaging ( Poster ) > link | Yuzhe Yang · Yujia Liu · Xin Liu · Wei Wu · Shwetak Patel 🔗 |
|
-
|
Hetero-UNet: Heterogeneous Transformer with Mamba for Medical Image Segmentation ( Poster ) > link | Zhiling Yan · yixin liu · Xiang Li · Lichao Sun 🔗 |
|
-
|
GPT Sonograpy: Hand Gesture Decoding from Forearm Ultrasound Images via VLM ( Poster ) > link | Keshav Bimbraw · Ye Wang · Jing Liu · Toshiaki Koike-Akino 🔗 |
|
-
|
Deep Generative Models Unveil Patterns in Medical Images Through Vision- “Language” Conditioning ( Oral ) > link | Xiaodan Xing · Junzhi Ning · Yang Nan · Guang Yang 🔗 |
|
-
|
Federated Self-Supervised Single-cell Clustering of scRNA-seq Data ( Poster ) > link | Shentong Mo 🔗 |
|
-
|
Synthetic Multimodal Data Generation and Training Optimization For Computed Tomography Cardiac Imaging Applications ( Poster ) > link | Masaki Ikuta · Quanqi Hu · Ashok Addala · Ravi Soni · Avinash Gopal 🔗 |
|
-
|
PATIENT-Ψ: Using Large Language Models to Simulate Patients for Training Mental Health Professionals ( Poster ) > link |
12 presentersRuiyi Wang · Stephanie Milani · Jamie Chiu · Jiayin Zhi · Shaun Eack · Travis Labrum · Samuel Murphy · Nev Jones · Kate Hardy · Hong Shen · Fei Fang · Zhiyu Chen |
|
-
|
Learning biologically relevant features in a pathology foundation model using sparse autoencoders ( Poster ) > link | Nhat Le · Neel Patel · Ciyue Shen · Blake Martin · Alfred Eng · Chintan Shah · Sean Grullon · Dinkar Juyal 🔗 |
|
-
|
Controlling for Unobserved Confounding with Large Language Model Classification of Patient Smoking Status ( Oral ) > link | Samuel Lee · Zach Wood-Doughty 🔗 |
|
-
|
Necessity of Uncertainty Quantification for Audio-driven Healthcare Diagnosis ( Poster ) > link | Shubham Kulkarni · Hideaki Watanabe · Fuminori Homma 🔗 |
|
-
|
ProMISe: Promptable Medical Image Segmentation using SAM ( Poster ) > link | Jinfeng Wang · Sifan Song · Xinkun Wang · yiyi wang · Yiyi Miao · Jionglong Su · S. Kevin Zhou 🔗 |
|
-
|
Best of Both Worlds: Harmonizing LLM Capabilities in Decision-Making and Question-Answering for Treatment Regimes ( Poster ) > link | Hongxuan Liu · Zhiyao Luo · Tingting Zhu 🔗 |
|
-
|
Do Large Language Models have Shared Weaknesses in Medical Question Answering? ( Poster ) > link | Andrew M. Bean · Karolina Korgul · Felix Krones · Robert McCraith · Adam Mahdi 🔗 |
|
-
|
Med-FastSAM: Improving Transfer Efficiency of SAM to Domain-Generalised Medical Image Segmentation ( Poster ) > link | Yuxiang Luo · Qing Xu · Jinglei Feng · Guangwu Qian · Wenting Duan 🔗 |
|
-
|
Sentiment Reasoning for Healthcare ( Poster ) > link | Khai-Nguyen Nguyen · Khai Le-Duc · Bach Phan Tat · Duy Le · Phuc H Ngo · Long Vo-Dang · Anh Nguyen · Truong Son Hy 🔗 |
|
-
|
Surgical SAM 2: Real-time Segment Anything in Surgical Video by Efficient Frame Pruning ( Poster ) > link | Haofeng Liu · Erli Zhang · Junde Wu · Mingxuan Hong · Yueming Jin 🔗 |
|
-
|
Do Histopathological Foundation Models Eliminate Batch Effects? A Comparative Study ( Poster ) > link | Jonah Kömen · Hannah Marienwald · Jonas Dippel · Julius Hense 🔗 |
|
-
|
Integrating Image Interpretation and Textual Context for Improved Breast Imaging Classification ( Poster ) > link | Ibrahim Gulluk · Olivier Gevaert 🔗 |
|
-
|
A Self-Supervised Model for Multi-modal Stroke Risk Prediction ( Poster ) > link | Camille Delgrange · Olga Demler · Samia Mora · bjoern menze · Ezequiel De la Rosa · Neda Davoudi 🔗 |
|
-
|
Improving the Classification Effect of Clinical Images of Diseases for Multi-Source Privacy Protection ( Poster ) > link | Bowen Tian · Zhengyang Xu · Zihao Yin · JingyingWang · Yutao Yue 🔗 |
|
-
|
DMM: Distributed Matrix Mechanism for Differentially-Private Federated Learning using Packed Secret Sharing ( Poster ) > link | Alexander Bienstock · Ujjwal Kumar · Antigoni Polychroniadou 🔗 |
|
-
|
Contextual Evaluation of Large Language Models for Classifying Tropical and Infectious Diseases ( Poster ) > link | Mercy Asiedu · Nenad Tomasev · Chintan Ghate · Tiya Tiyasirichokchai · Awa Dieng · Geoffrey Siwo · Steve Adudans · Oluwatosin Akande · Katherine Heller 🔗 |
|
-
|
A Textbook Remedy for Domain Shifts: Knowledge Priors for Medical Image Analysis ( Oral ) > link | Yue Yang · Mona Gandhi · Yufei Wang · Yifan Wu · Michael Yao · Chris Callison-Burch · James Gee · Mark Yatskar 🔗 |
|
-
|
Research Journey of Generative Protein Modeling ( Poster ) > link |
13 presentersXinhui Chen · Yiwen Yuan · Joseph Liu · Chak Tou Leong · Zhen Xie · Xiaoye Zhu · Ying Chen · Songyue Chen · Chenyi Wang · Kun Li · Jie Zhang · Zuchao Li · Jiaqi Chen |
|
-
|
An Autonomous Dual-channel Entity Recognition Method for Chinese Acupuncture ( Poster ) > link | Changshuai Zhang · Yuxin Zhang · Wenjun Tan 🔗 |
|
-
|
MambaHealth: A Lightweight Foundation Model for Efficient Drug Recommendation ( Poster ) > link | Yuda Wang · Xuxin He · Shengxin Zhu 🔗 |
|
-
|
Application of Contrastive Learning on ECG Data: Evaluating Performance in Japanese and Classification with Around 100 Labels ( Poster ) > link | Junichiro Takahashi · JingChuan Guan · Kaito Baba · satoshi kodera 🔗 |
|
-
|
Towards Foundation Models for Critical Care Time Series ( Oral ) > link |
13 presentersManuel Burger · Fedor Sergeev · Malte Londschien · Daphné Chopard · Hugo Yèche · Eike Gerdes · Polina Leshetkina · Alexander Morgenroth · Zeynep Babür · Jasmina Bogojeska · Martin Faltys · Rita Kuznetsova · Gunnar Rätsch |
|
-
|
How Does Diverse Interpretability of Textual Prompts Impact Medical Vision-Language Zero-Shot Tasks? ( Poster ) > link | Sicheng Wang · Che Liu · Rossella Arcucci 🔗 |
|
-
|
Random Token Fusion for Multi-View Medical Diagnosis ( Poster ) > link | Jingyu Guo · Christos Matsoukas · Fredrik Strand · Kevin Smith 🔗 |
|
-
|
A self-supervised framework for learning whole slide representations ( Poster ) > link | Xinhai Hou · Cheng Jiang · Akhil Kondepudi · Yiwei Lyu · Asadur Chowdury · Honglak Lee · Todd Hollon 🔗 |
|
-
|
SAM-MPA: Applying SAM to Few-shot Medical Image Segmentation using Mask Propagation and Auto-prompting ( Oral ) > link | Jie Xu · LiXiaokang · Chengyuyue · Chen Ma · yi guo · Yuanyuan Wang 🔗 |
|
-
|
TTT-UNet: Enhancing U-Net with Test-Time Training Layers for Biomedical Image Segmentation ( Poster ) > link | Rong Zhou · Zhengqing Yuan · Zhiling Yan · Weixiang Sun · Kai Zhang · Yiwei Li · Xiang Li · Quanzheng Li · Lifang He · Lichao Sun 🔗 |
|
-
|
Promoting cross-modal representations to improve multimodal foundation models for physiological signals ( Poster ) > link | Ching Fang · Christopher Sandino · Behrooz Mahasseni · Juri Minxha · Hadi Pouransari · Erdrin Azemi · Ali Moin · Ellen Zippi 🔗 |
|
-
|
JRadiEvo: A Japanese Radiology Report Generation Model Enhanced by Evolutionary Optimization of Model Merging ( Poster ) > link | Kaito Baba · Ryota Yagi · Junichiro Takahashi · Risa Kishikawa · satoshi kodera 🔗 |
|
-
|
Surgical-LLaVA: Toward Surgical Scenario Understanding via Large Language and Vision Models ( Poster ) > link | Juseong Jin · Chang Jeong 🔗 |
|
-
|
Fairness Of AI Models in vector embedded Chest X-ray representations ( Poster ) > link | Gebreyowhans H. Bahre · Hassan Hamidi · Francesco Calimeri · Andrew Sellergren · Leo Anthony Celi · Laleh Seyyed-Kalantari 🔗 |
|
-
|
Precise Lens Status Classification via Projection Tuning for Efficient Adaptation to Data Shifts in Small Cataract Image Datasets ( Poster ) > link | Ji Young Byun · Jordan Shuff · Kunal S. Parikh · Rama Chellappa 🔗 |
|
-
|
MSA-LM: Integrating DNA-level Inductive Biases into DNA Language Models ( Poster ) > link | Vishrut Thoutam 🔗 |
|
-
|
Masked Modeling for Single-cell Clustering of scRNA‐seq Data ( Poster ) > link | Shentong Mo 🔗 |
|
-
|
PICASO: Secure Aggregation for Federated Learning with Minimal Synchronization ( Poster ) > link | Harish Karthikeyan · Antigoni Polychroniadou 🔗 |
|
-
|
Catching the Spikes: Heteroscedastic Uncertainty Quantification for Enhanced Malaria Prediction ( Poster ) > link | Feng Chen · Qi Qi · Jiayu Qiu · Kemeng Zhang · Xiang Li 🔗 |
|
-
|
Multimodal Lego: Model Merging and Fine-Tuning Across Topologies and Modalities ( Poster ) > link | Konstantin Hemker · Nikola Simidjievski · Mateja Jamnik 🔗 |
|
-
|
Neural machine translation of clinical procedure codes for medical diagnosis and uncertainty quantification ( Poster ) > link | Pei-Hung Chung · Shuhan He · Norawit Kijpaisalratana · Abdel Ariss · Byung-Jun Yoon 🔗 |
|
-
|
A Benchmark for Long-Form Medical Question Answering ( Poster ) > link | Pedram Hosseini · Jessica Sin · Bing Ren · Bryceton Thomas · Elnaz Nouri · Ali Farahanchi · Saeed Hassanpour 🔗 |
|
-
|
Gaze-Assisted Medical Image Segmentation ( Poster ) > link | Leila Khaertdinova · Ilya Pershin · Tatyana Shmykova · Bulat Ibragimov 🔗 |
|
-
|
Cell ontology guided transcriptome foundation model ( Poster ) > link | XINYU YUAN · Zhihao Zhan · Zuobai Zhang · Manqi Zhou · Jianan Zhao · Boyu Han · Yue Li · Jian Tang 🔗 |
|
-
|
Explaining Chest X-ray Pathology Models using Textual Concepts ( Poster ) > link | Vijay Sadashivaiah · Pingkun Yan · James Hendler 🔗 |
|
-
|
RespLLM: Unifying Audio and Text with Multimodal LLMs for Generalized Respiratory Health Prediction ( Poster ) > link | Yuwei Zhang · Tong Xia · Aaqib Saeed · Cecilia Mascolo 🔗 |
|
-
|
Towards a Personal Health Large Language Model ( Oral ) > link |
15 presentersJustin Cosentino · Anastasiya Belyaeva · Xin Liu · Zhun Yang · Yun Liu · Shyam Tailor · Tim Althoff · John Hernandez · Yossi Matias · Greg Corrado · Shwetak Patel · Shravya Shetty · Jiening Zhan · Daniel McDuff · Cory McLean |
|
-
|
ASTRID - An Automated and Scalable TRIaD for the Evaluation of RAG-based Clinical Question Answering Systems ( Poster ) > link | Mohita Chowdhury · Yajie He · Ernest Lim · Aisling Higham 🔗 |