Workshop
Gaze meets ML
Ismini Lourentzou · Joy T Wu · Satyananda Kashyap · Alexandros Karargyris · Leo Anthony Celi · Ban Kawas · Sachin S Talathi
Room 386
Sat 3 Dec, 5:30 a.m. PST
Eye gaze has proven to be a cost-efficient way to collect large-scale physiological data that can reveal the underlying human attentional patterns in real-life workflows, and thus has long been explored as a signal to directly measure human-related cognition in various domains. Physiological data (including but not limited to eye gaze) offer new perception capabilities, which could be used in several ML domains, e.g., egocentric perception, embodied AI, NLP, etc. They can help infer human perception, intentions, beliefs, goals, and other cognition properties that are much needed for human-AI interactions and agent coordination. In addition, large collections of eye-tracking data have enabled data-driven modeling of human visual attention mechanisms, both for saliency or scanpath prediction, with twofold advantages: from the neuroscientific perspective to understand biological mechanisms better, and from the AI perspective to equip agents with the ability to mimic or predict human behavior and improve interpretability and interactions.
With the emergence of immersive technologies, now more than any time there is a need for experts of various backgrounds (e.g., machine learning, vision, and neuroscience communities) to share expertise and contribute to a deeper understanding of the intricacies of cost-efficient human supervision signals (e.g., eye-gaze) and their utilization towards by bridging human cognition and AI in machine learning research and development. The goal of this workshop is to bring together an active research community to collectively drive progress in defining and addressing core problems in gaze-assisted machine learning.
Schedule
Sat 5:30 a.m. - 6:00 a.m.
|
Meet and Greet and Getting started
|
🔗 |
Sat 6:00 a.m. - 6:10 a.m.
|
Opening Remarks (10 mins) Organizers
(
Opening Remarks
)
>
|
🔗 |
Sat 6:10 a.m. - 6:55 a.m.
|
Learning gaze control, external attention, and internal attention since 1990-91
(
Keynote
)
>
SlidesLive Video |
Jürgen Schmidhuber 🔗 |
Sat 7:00 a.m. - 7:30 a.m.
|
Eye-tracking what's going on in the mind
(
Keynote
)
>
SlidesLive Video |
Tobias Gerstenberg 🔗 |
Sat 7:30 a.m. - 8:00 a.m.
|
Neural encoding and decoding of facial movements
(
Keynote
)
>
SlidesLive Video |
Scott Linderman 🔗 |
Sat 8:00 a.m. - 8:15 a.m.
|
Coffee Break
|
🔗 |
Sat 8:20 a.m. - 8:32 a.m.
|
Electrode Clustering and Bandpass Analysis of EEG Data for Gaze Estimation
(
Spotlight
)
>
link
SlidesLive Video |
Ard Kastrati · Martyna Plomecka · Joël Küchler · Nicolas Langer · Roger Wattenhofer 🔗 |
Sat 8:32 a.m. - 8:44 a.m.
|
Modeling Human Eye Movements with Neural Networks in a Maze-Solving Task
(
Spotlight
)
>
link
SlidesLive Video |
Jason Li · Nicholas Watters · Sandy Wang · Hansem Sohn · Mehrdad Jazayeri 🔗 |
Sat 8:44 a.m. - 8:56 a.m.
|
Intention Estimation via Gaze for Robot Guidance in Hierarchical Tasks
(
Spotlight
)
>
link
SlidesLive Video |
Yifan SHEN · Xiaoyu Mo · Vytas Krisciunas · David Hanson · Bertram Shi 🔗 |
Sat 8:56 a.m. - 9:08 a.m.
|
Facial Composite Generation with Iterative Human Feedback
(
Spotlight
)
>
link
SlidesLive Video |
Florian Strohm · Ekta Sood · Dominike Thomas · Mihai Bace · Andreas Bulling 🔗 |
Sat 9:08 a.m. - 9:20 a.m.
|
Simulating Human Gaze with Neural Visual Attention
(
Spotlight
)
>
link
SlidesLive Video |
Leo Schwinn · Doina Precup · Bjoern Eskofier · Dario Zanca 🔗 |
Sat 9:20 a.m. - 9:50 a.m.
|
Foveated Models of Visual Search and Medical Image Perception
(
Keynote
)
>
|
Miguel Eckstein 🔗 |
Sat 10:00 a.m. - 10:30 a.m.
|
Lunch
(
Lunch and Poster Walk-Around
)
>
|
🔗 |
Sat 10:30 a.m. - 11:30 a.m.
|
Appearance-Based Gaze Estimation for Driver Monitoring
(
Poster
)
>
link
SlidesLive Video |
Soodeh Nikan · devesh upadhyay 🔗 |
Sat 10:30 a.m. - 11:30 a.m.
|
Selection of XAI Methods Matters: Evaluation of Feature Attribution Methods for Oculomotoric Biometric Identification
(
Poster
)
>
link
SlidesLive Video |
Daniel Krakowczyk · David Robert Reich · Paul Prasse · Sebastian Lapuschkin · Lena A. Jäger · Tobias Scheffer 🔗 |
Sat 10:30 a.m. - 11:30 a.m.
|
Time-to-Saccade metrics for real-world evaluation
(
Poster
)
>
link
SlidesLive Video |
Tim Rolff · Niklas Stein · Markus Lappe · Frank Steinicke · Simone Frintrop 🔗 |
Sat 10:30 a.m. - 11:30 a.m.
|
Electrode Clustering and Bandpass Analysis of EEG Data for Gaze Estimation ( Poster ) > link | Ard Kastrati · Martyna Plomecka · Joël Küchler · Nicolas Langer · Roger Wattenhofer 🔗 |
Sat 10:30 a.m. - 11:30 a.m.
|
Skill, or Style? Classification of Fetal Sonography Eye-Tracking Data
(
Poster
)
>
link
SlidesLive Video |
Clare Teng · Lior Drukker · Aris Papageorghiou · Alison Noble 🔗 |
Sat 10:30 a.m. - 11:30 a.m.
|
Decoding Attention from Gaze: A Benchmark Dataset and End-to-End Models
(
Poster
)
>
link
SlidesLive Video |
Karan Uppal · Jaeah Kim · Shashank Singh 🔗 |
Sat 10:30 a.m. - 11:30 a.m.
|
Learning to count visual objects by combining "what" and "where" in recurrent memory
(
Poster
)
>
link
SlidesLive Video |
Jessica Thompson · Hannah Sheahan · Christopher Summerfield 🔗 |
Sat 10:30 a.m. - 11:30 a.m.
|
Modeling Human Eye Movements with Neural Networks in a Maze-Solving Task
(
Poster
)
>
link
SlidesLive Video |
Jason Li · Nicholas Watters · Sandy Wang · Hansem Sohn · Mehrdad Jazayeri 🔗 |
Sat 10:30 a.m. - 11:30 a.m.
|
Generating Attention Maps from Eye-gaze for the Diagnosis of Alzheimer's Disease
(
Poster
)
>
link
SlidesLive Video |
Carlos Antunes · Margarida Silveira 🔗 |
Sat 10:30 a.m. - 11:30 a.m.
|
Do They Look Where They Go? Gaze Classification During Walking
(
Poster
)
>
link
SlidesLive Video |
Gianni Bremer · Niklas Stein · Markus Lappe 🔗 |
Sat 10:30 a.m. - 11:30 a.m.
|
Intention Estimation via Gaze for Robot Guidance in Hierarchical Tasks
(
Poster
)
>
link
SlidesLive Video |
Yifan SHEN · Xiaoyu Mo · Vytas Krisciunas · David Hanson · Bertram Shi 🔗 |
Sat 10:30 a.m. - 11:30 a.m.
|
Comparing radiologists' gaze and saliency maps generated by interpretability methods for chest x-rays
(
Poster
)
>
link
SlidesLive Video |
Ricardo Bigolin Lanfredi · Ambuj Arora · Trafton Drew · Joyce Schroeder · Tolga Tasdizen 🔗 |
Sat 10:30 a.m. - 11:30 a.m.
|
Integrating eye gaze into machine learning using fractal curves
(
Poster
)
>
link
SlidesLive Video |
Robert Ahadizad Newport · Sidong Liu · Antonio Di Ieva 🔗 |
Sat 10:30 a.m. - 11:30 a.m.
|
Facial Composite Generation with Iterative Human Feedback
(
Poster
)
>
link
SlidesLive Video |
Florian Strohm · Ekta Sood · Dominike Thomas · Mihai Bace · Andreas Bulling 🔗 |
Sat 10:30 a.m. - 11:30 a.m.
|
Federated Learning for Appearance-based Gaze Estimation in the Wild
(
Poster
)
>
link
SlidesLive Video |
Mayar Elfares · Zhiming Hu · Pascal Reisert · Andreas Bulling · Ralf Küsters 🔗 |
Sat 10:30 a.m. - 11:30 a.m.
|
Simulating Human Gaze with Neural Visual Attention
(
Poster
)
>
link
SlidesLive Video |
Leo Schwinn · Doina Precup · Bjoern Eskofier · Dario Zanca 🔗 |
Sat 10:30 a.m. - 11:30 a.m.
|
Contrastive Representation Learning for Gaze Estimation
(
Poster
)
>
link
SlidesLive Video |
Swati Jindal · Roberto Manduchi 🔗 |
Sat 10:30 a.m. - 11:30 a.m.
|
SecNet: Semantic Eye Completion in Implicit Field
(
Poster
)
>
link
SlidesLive Video |
Yida Wang · Yiru Shen · David Joseph Tan · Federico Tombari · Sachin S Talathi 🔗 |
Sat 11:30 a.m. - 12:00 p.m.
|
Use of Machine Learning and Gaze Tracking to Predict Radiologists’ Decisions in Breast Cancer Detection
(
Keynote
)
>
SlidesLive Video |
Claudia Mello-Thoms 🔗 |
Sat 12:00 p.m. - 12:30 p.m.
|
Gabriel A. Silva Keynote
(
Keynote
)
>
|
Gabriel Silva 🔗 |
Sat 12:30 p.m. - 1:30 p.m.
|
Breakout session
(
Discussion within onsite small groups on preselected themes
)
>
|
🔗 |
Sat 1:30 p.m. - 1:45 p.m.
|
Coffee
|
🔗 |
Sat 1:45 p.m. - 1:57 p.m.
|
Contrastive Representation Learning for Gaze Estimation
(
Spotlight
)
>
link
SlidesLive Video |
Swati Jindal · Roberto Manduchi 🔗 |
Sat 1:57 p.m. - 2:09 p.m.
|
SecNet: Semantic Eye Completion in Implicit Field ( Spotlight ) > link | Yida Wang · Yiru Shen · David Joseph Tan · Federico Tombari · Sachin S Talathi 🔗 |
Sat 2:45 p.m. - 3:00 p.m.
|
Wrap Up - Closing remarks
(
Closing
)
>
|
🔗 |