Workshop
Machine Learning with New Compute Paradigms
Jannes Gladrow · Benjamin Scellier · Eric Xing · Babak Rahmani · Francesca Parmigiani · Paul Prucnal · Cheng Zhang
Room 235 - 236
Sat 16 Dec, 7 a.m. PST
As GPU computing comes closer to a plateau in terms of efficiency and cost due to Moore’s law reaching its limit, there is a growing need to explore alternative computing paradigms, such as (opto-)analog, neuromorphic, and low-power computing. This NeurIPS workshop aims to unite researchers from machine learning and alternative computation fields to establish a new hardware-ML feedback loop.By co-designing models with specialized accelerators, we can leverage the benefits of increased throughput or lower per-flop power consumption. Novel devices hold the potential to further accelerate standard deep learning or even enable efficient inference and training of hitherto compute-constrained model classes. However, new compute paradigms typically present challenges such as intrinsic noise, restricted sets of compute operations, or limited bit-depth, and thus require model-hardware co-design. This workshop’s goal is to foster cross-disciplinary collaboration to capitalize on the opportunities offered by emerging AI accelerators.
Schedule
Sat 7:00 a.m. - 7:10 a.m.
|
Opening Remarks
(
Talk
)
>
|
Cheng Zhang 🔗 |
Sat 7:10 a.m. - 7:30 a.m.
|
Computing with physical systems: reimagining special-purpose computers from the bottom up
(
Invited Talk
)
>
SlidesLive Video |
Peter McMahon 🔗 |
Sat 7:30 a.m. - 7:40 a.m.
|
SpiNNaker2: A Large-Scale Neuromorphic System for Event-Based and Asynchronous Machine Learning
(
Oral
)
>
link
SlidesLive Video |
14 presentersHector Gonzalez · Jiaxin Huang · Florian Kelber · Khaleelulla Khan Nazeer · Tim Hauke Langer · Chen Liu · Matthias Lohrmann · Amirhossein Rostami · Mark Schoene · Bernhard Vogginger · Timo Wunderlich · Yexin Yan · Mahmoud Akl · Christian Mayr |
Sat 7:40 a.m. - 7:50 a.m.
|
Scaling-up Memristor Monte Carlo with magnetic domain-wall physics
(
Oral
)
>
link
SlidesLive Video |
11 presentersThomas Dalgaty · Shogo Yamada · Anca Molnos · Eiji Kawasaki · Thomas Mesquida · Rummens François · TATSUO SHIBATA · Yukihiro Urakawa · Yukio Terasaki · Tomoyuki Sasaki · Marc Duranton |
Sat 7:50 a.m. - 8:10 a.m.
|
Analog AI Accelerators
(
Invited Talk
)
>
link
SlidesLive Video |
Jesus del Alamo 🔗 |
Sat 8:10 a.m. - 8:25 a.m.
|
Break
|
🔗 |
Sat 8:25 a.m. - 8:35 a.m.
|
Analog-Optical Computation for optimization and machine-learning inference
(
Talk
)
>
link
SlidesLive Video |
Jannes Gladrow 🔗 |
Sat 8:35 a.m. - 8:45 a.m.
|
Bayesian Metaplasticity from Synaptic Uncertainty
(
Oral
)
>
link
SlidesLive Video |
Djohan Bonnet · Tifenn HIRTZLIN · Tarcisius Januel · Thomas Dalgaty · Damien Querlioz · Elisa Vianello 🔗 |
Sat 8:45 a.m. - 9:05 a.m.
|
Training physical systems with Equilibrium Propagation
(
Invited Talk
)
>
link
SlidesLive Video |
Julie Grollier 🔗 |
Sat 9:05 a.m. - 9:25 a.m.
|
Low-precision Sampling for Probabilistic Deep Learning
(
Invited Talk
)
>
link
SlidesLive Video |
Ruqi Zhang 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Inference analysis of optical transformers ( Poster ) > link | Xianxin Guo · Chenchen Wang · Djamshid Damry 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Diffractive Optical Neural Networks with Arbitrary Spatial Coherence ( Poster ) > link | Matthew Filipovich · Aleksei Malyshev · Alexander Lvovsky 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
The Data Movement Bottleneck in Analog Computing Accelerators: An Analog Optical Fourier Transform and Convolution Accelerator Case Study ( Poster ) > link | James Meech · Vasileios Tsoutsouras · Phillip Stanley-Marbell 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Hierarchy of the echo state property in quantum reservoir computing ( Poster ) > link | Shumpei Kobayashi · Hoan Tran Quoc · Kohei Nakajima 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Contrastive power-efficient physical learning in resistor networks ( Poster ) > link | Menachem Stern · Sam Dillavou · Dinesh Jayaraman · Douglas Durian · Andrea Liu 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Energy-Based Learning Algorithms for Analog Computing: A Comparative Study ( Poster ) > link | Benjamin Scellier · Maxence Ernoult · Jack Kendall · Suhas Kumar 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Expanding Spiking Neural Networks With Dendrites for Deep Learning ( Poster ) > link | Mark Plagge · Suma Cardwell · Frances Chance 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Activity Sparsity Complements Weight Sparsity for Efficient RNN Inference ( Poster ) > link | Rishav Mukherji · Mark Schoene · Khaleelulla Khan Nazeer · Christian Mayr · Anand Subramoney 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Algebraic Design of Physical Computing System for Time-Series Generation ( Poster ) > link | Mizuka Komatsu · Takaharu Yaguchi · Kohei Nakajima 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
PhyFF: Physical forward forward algorithm for in-hardware training and inference ( Poster ) > link | Ali Momeni · Babak Rahmani · Matthieu Malléjac · Philipp del Hougne · Romain Fleury 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
A Green Granular Convolutional Neural Network with Software-FPGA Co-designed Learning ( Poster ) > link | Yanqing Zhang · Huaiyuan Chu 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Real-Time FJ/MAC PDE Solvers via Tensorized, Back-Propagation-Free Optical PINN Training ( Poster ) > link | Yequan Zhao · Xian Xiao · Xinling Yu · Ziyue Liu · Zhixiong Chen · Geza Kurczveil · Raymond Beausoleil · Zheng Zhang 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Enhancing Low-Precision Sampling via Stochastic Gradient Hamiltonian Monte Carlo ( Poster ) > link | Ziyi Wang · Yujie Chen · Ruqi Zhang · Qifan Song 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Squeezed Edge YOLO: Onboard Object Detection on Edge Devices ( Poster ) > link | Edward Humes · Mozhgan Navardi · Tinoosh Mohsenin 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Virtual reservoir acceleration for CPU and GPU: Case study for coupled spin-torque oscillator reservoir ( Poster ) > link | Thomas de Jong · Nozomi Akashi · Tomohiro Taniguchi · Hirofumi Notsu · Kohei Nakajima 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Adjoint Method: The Connection between Analog-based Equilibrium Propagation Architectures and Neural ODEs ( Poster ) > link | Mohamed Watfa · Alberto Garcia-Ortiz 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Beyond Digital: Harnessing Analog Hardware for Machine Learning ( Poster ) > link | Marvin Syed · Kirill Kalinin · Natalia Berloff 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Biologically-plausible hierarchical chunking on mixed-signal neuromorphic hardware ( Poster ) > link | Atilla Schreiber · Shuchen Wu · Chenxi Wu · Giacomo Indiveri · Eric Schulz 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Frequency propagation: Multi-mechanism learning in nonlinear physical networks ( Poster ) > link | Vidyesh Anisetti · Ananth Kandala · Benjamin Scellier · J. M. Schwarz 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
The Benefits of Self-Supervised Learning for Training Physical Neural Networks ( Poster ) > link | Jeremie Laydevant · Peter McMahon · Davide Venturelli · Paul Lott 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Towards low power cognitive load analysis using EEG signal: A neuromorphic computing approach ( Poster ) > link | Dighanchal Banerjee · Sounak Dey · Debatri Chatterjee · Arpan Pal 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Neuromorphic Co-Design as a Game ( Poster ) > link | Craig M Vineyard · William Severa · Brad Aimone 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Device Codesign using Reinforcement Learning and Evolutionary Optimization ( Poster ) > link | Catherine Schuman · Suma Cardwell · Karan Patel · J. Smith · Jared Arzate · Andrew Maicke · Samuel Liu · Jaesuk Kwon · Jean Anne Incorvia 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Mean-Field Assisted Deep Boltzmann Learning with Probabilistic Computers ( Poster ) > link | Shuvro Chowdhury · Shaila Niazi · Kerem Camsari 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Emergent learning in physical systems as feedback-based aging in a glassy landscape ( Poster ) > link | Vidyesh Anisetti · Ananth Kandala · Jennifer Schwarz 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Unleashing Hyperdimensional Computing with Nyström Method based Data Adaptive Encoding ( Poster ) > link | Quanling Zhao · Anthony Thomas · Xiaofan Yu · Tajana S Rosing 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Thermodynamic AI and Thermodynamic Linear Algebra ( Poster ) > link | Patrick Coles · Maxwell Aifer · Kaelan Donatella · Denis Melanson · Max Hunter Gordon · Thomas Ahle · Daniel Simpson · Gavin Crooks · Antonio Martinez · Faris Sbahi 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Nonlinear Classification Without a Processor ( Poster ) > link | Sam Dillavou · Benjamin Beyer · Menachem Stern · Marc Miskin · Andrea Liu · Douglas Durian 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Neural Deep Operator Networks representation of Coherent Ising Machine Dynamics ( Poster ) > link | Arsalan Taassob · Davide Venturelli · Paul Lott 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Exploiting Symmetric Temporally Sparse BPTT for Efficient RNN Training ( Poster ) > link | Xi Chen · Chang Gao · Zuowen Wang · Longbiao Cheng · Sheng Zhou · Shih-Chii Liu · Tobi Delbruck 🔗 |
Sat 9:25 a.m. - 10:30 a.m.
|
Poster Session I
(
Poster Session
)
>
|
🔗 |
Sat 10:30 a.m. - 11:30 a.m.
|
Lunch Break
|
🔗 |
Sat 11:30 a.m. - 11:50 a.m.
|
The Optimization Conundrum: Balancing Data, Speed, and Accuracy in Real-Time Machine Learning
(
Invited Talk
)
>
link
SlidesLive Video |
Mihaela van der Schaar 🔗 |
Sat 11:50 a.m. - 12:00 p.m.
|
A Lagrangian Perspective on Dual Propagation
(
Oral
)
>
link
SlidesLive Video |
Rasmus Høier · Christopher Zach 🔗 |
Sat 12:00 p.m. - 12:10 p.m.
|
Scaling of Optical Transformers
(
Oral
)
>
link
SlidesLive Video |
Maxwell Anderson · Shi-Yuan Ma · Tianyu Wang · Logan Wright · Peter McMahon 🔗 |
Sat 12:10 p.m. - 12:30 p.m.
|
Low-Precision & Analog Computational Techniques for Sustainable & Accurate AI Inference & Training
(
Invited Talk
)
>
link
SlidesLive Video |
Kailash Gopalakrishnan 🔗 |
Sat 12:30 p.m. - 2:00 p.m.
|
Poster Session II
(
Poster Session
)
>
|
🔗 |
Sat 2:00 p.m. - 3:00 p.m.
|
Panel Discussion
(
Panel
)
>
SlidesLive Video |
🔗 |