Workshop
Robustness in Sequence Modeling
Nathan Ng · Haoran Zhang · Vinith Suriyakumar · Chantal Shaib · Kyunghyun Cho · Yixuan Li · Alice Oh · Marzyeh Ghassemi
Room 290
Fri 2 Dec, 7 a.m. PST
As machine learning models find increasing use in the real world, ensuring their safe and reliable deployment depends on ensuring their robustness to distribution shift. This is especially true for sequential data, which occurs naturally in various data domains such as natural language processing, healthcare, computational biology, and finance. However, building models for sequence data which are robust to distribution shifts presents a unique challenge. Sequential data are often discrete rather than continuous, exhibit difficult to characterize distributions, and can display a much greater range of types of distributional shifts. Although many methods for improving model robustness exist for imaging or tabular data, extending these methods to sequential data is a challenging research direction that often requires fundamentally different techniques.
This workshop aims to facilitate progress towards improving the distributional robustness of models trained on sequential data by bringing together researchers to tackle a wide variety of research questions including, but not limited to:
(1) How well do existing robustness methods work on sequential data, and why do they succeed or fail?
(2) How can we leverage the sequential nature of the data to develop novel and distributionally robust methods?
(3) How do we construct and utilize formalisms for distribution shifts in sequential data?
We hope that this workshop provides a first step towards improving the robustness, and ultimately safety and reliability, of models in sequential data domains.
Schedule
Fri 7:00 a.m. - 7:15 a.m.
|
Opening Remarks
(
Opening Remarks
)
>
SlidesLive Video |
🔗 |
Fri 7:15 a.m. - 8:00 a.m.
|
Invited Talk: Behnam Neyshabur
(
Invited Talk
)
>
SlidesLive Video |
🔗 |
Fri 8:00 a.m. - 8:10 a.m.
|
An Invariant Learning Characterization of Controlled Text Generation
(
Spotlight
)
>
link
SlidesLive Video |
Claudia Shi · Carolina Zheng · Keyon Vafa · Amir Feder · David Blei 🔗 |
Fri 8:10 a.m. - 8:20 a.m.
|
Exploiting Variable Correlation with Masked Modeling for Anomaly Detection in Time Series
(
Spotlight
)
>
link
SlidesLive Video |
Panagiotis Lymperopoulos · Yukun Li · Liping Liu 🔗 |
Fri 8:20 a.m. - 8:30 a.m.
|
Online Policy Optimization for Robust MDP
(
Spotlight
)
>
link
SlidesLive Video |
Jing Dong · Jingwei Li · Baoxiang Wang · Jingzhao Zhang 🔗 |
Fri 8:30 a.m. - 9:30 a.m.
|
Poster Session #1
(
Poster Session
)
>
|
🔗 |
Fri 9:30 a.m. - 10:00 a.m.
|
Invited Talk: Dan Hendrycks
(
Invited Talk
)
>
SlidesLive Video |
🔗 |
Fri 10:00 a.m. - 10:30 a.m.
|
Invited Talk: Suchi Saria
(
Invited Talk
)
>
SlidesLive Video |
🔗 |
Fri 10:30 a.m. - 11:30 a.m.
|
Lunch Break
|
🔗 |
Fri 11:30 a.m. - 12:15 p.m.
|
Invited Talk: Yejin Choi
(
Invited Talk
)
>
SlidesLive Video |
🔗 |
Fri 12:15 p.m. - 12:25 p.m.
|
Comparison of Uncertainty Quantification in Time Series Regression
(
Spotlight
)
>
link
SlidesLive Video |
Levente Foldesi · Matias Valdenegro-Toro 🔗 |
Fri 12:25 p.m. - 12:35 p.m.
|
Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors ( Spotlight ) > link | Thomas Hartvigsen · Swami Sankaranarayanan · Hamid Palangi · Yoon Kim · Marzyeh Ghassemi 🔗 |
Fri 12:35 p.m. - 12:45 p.m.
|
Out-of-Distribution Detection and Selective Generation for Conditional Language Models
(
Spotlight
)
>
link
SlidesLive Video |
Jie Ren · Jiaming Luo · Yao Zhao · Kundan Krishna · Mohammad Saleh · Balaji Lakshminarayanan · Peter Liu 🔗 |
Fri 12:45 p.m. - 1:45 p.m.
|
Poster Session #2
(
Poster Session
)
>
|
🔗 |
Fri 1:45 p.m. - 2:15 p.m.
|
Invited Talk: Byron Wallace
(
Invited Talk
)
>
SlidesLive Video |
🔗 |
Fri 2:15 p.m. - 2:45 p.m.
|
Invited Talk: He He
(
Invited Talk
)
>
SlidesLive Video |
🔗 |
Fri 2:45 p.m. - 3:00 p.m.
|
Closing Remarks
(
Closing Remarks
)
>
SlidesLive Video |
🔗 |
-
|
Perturbation Augmentation for Fairer NLP ( Poster ) > link | Rebecca Qian · Candace Ross · Jude Fernandes · Eric Michael Smith · Douwe Kiela · Adina Williams 🔗 |
-
|
Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors ( Poster ) > link | Thomas Hartvigsen · Swami Sankaranarayanan · Hamid Palangi · Yoon Kim · Marzyeh Ghassemi 🔗 |
-
|
Feature Restricted Group Dropout for Robust Electronic Health Record Predictions ( Poster ) > link | Bret Nestor · Anna Goldenberg · Marzyeh Ghassemi 🔗 |
-
|
CLIFT : Analysing Natural Distribution Shift on Question Answering Models in Clinical Domain ( Poster ) > link | Ankit Pal 🔗 |
-
|
Probabilistic thermal stability prediction through sparsity promoting transformer representation ( Poster ) > link | Yevgen Zainchkovskyy · Jesper Ferkinghoff-Borg · Anja Bennett · Thomas Egebjerg · Nikolai Lorenzen · Per Greisen · Søren Hauberg · Carsten Stahlhut 🔗 |
-
|
On the Abilities of Sequence Extrapolation with Implicit Models ( Poster ) > link | Juliette Decugis · Alicia Tsai · Ashwin Ganesh · Max Emerling · Laurent El Ghaoui 🔗 |
-
|
An Invariant Learning Characterization of Controlled Text Generation ( Poster ) > link | Claudia Shi · Carolina Zheng · Keyon Vafa · Amir Feder · David Blei 🔗 |
-
|
Robustness of Neural Networks used in Electrical Motor Time-Series ( Poster ) > link | Sagar Verma · Kavya Gupta 🔗 |
-
|
Quantifying Uncertainty in Foundation Models via Ensembles ( Poster ) > link | Meiqi Sun · Wilson Yan · Pieter Abbeel · Igor Mordatch 🔗 |
-
|
An Adaptive Temporal Attention Mechanism to Address Distribution Shifts ( Poster ) > link | sepideh koohfar · Laura Dietz 🔗 |
-
|
Defend Against Textual Backdoor Attacks By Token Substitution ( Poster ) > link | Xinglin Li · Yao Li · Minhao Cheng 🔗 |
-
|
Behavioral Classification of Sequential Neural Activity Using Time Varying Recurrent Neural Networks ( Poster ) > link | Yongxu Zhang · Shreya Saxena 🔗 |
-
|
Strategy-Aware Contextual Bandits ( Poster ) > link | Keegan Harris · Chara Podimata · Steven Wu 🔗 |
-
|
Revealing the Bias in Large Language Models via Reward Structured Questions ( Poster ) > link | Ezgi Korkmaz 🔗 |
-
|
Online Policy Optimization for Robust MDP ( Poster ) > link | Jing Dong · Jingwei Li · Baoxiang Wang · Jingzhao Zhang 🔗 |
-
|
Exploiting Variable Correlation with Masked Modeling for Anomaly Detection in Time Series ( Poster ) > link | Panagiotis Lymperopoulos · Yukun Li · Liping Liu 🔗 |
-
|
Comparison of Uncertainty Quantification in Time Series Regression ( Poster ) > link | Levente Foldesi · Matias Valdenegro-Toro 🔗 |
-
|
Out-of-Distribution Detection and Selective Generation for Conditional Language Models ( Poster ) > link | Jie Ren · Jiaming Luo · Yao Zhao · Kundan Krishna · Mohammad Saleh · Balaji Lakshminarayanan · Peter Liu 🔗 |
-
|
Are Deep Sequence Classifiers Good at Non-Trivial Generalization? ( Poster ) > link | Francesco Cazzaro · Ariadna Quattoni · Xavier Carreras 🔗 |
-
|
Conditional COT-GAN for Video Prediction with Kernel Smoothing ( Poster ) > link | Tianlin Xu · Beatrice Acciaio 🔗 |