Workshop: Beyond BackPropagation: Novel Ideas for Training Neural Architectures
Mateusz Malinowski, Grzegorz Swirszcz, Viorica Patraucean, Marco Gori, Yanping Huang, Sindy Löwe, Anna Choromanska
2020-12-12T06:00:00-08:00 - 2020-12-12T16:30:00-08:00
Abstract: Is backpropagation the ultimate tool on the path to achieving synthetic intelligence as its success and widespread adoption would suggest?
Many have questioned the biological plausibility of backpropagation as a learning mechanism since its discovery. The weight transport and timing problems are the most disputable. The same properties of backpropagation training also have practical consequences. For instance, backpropagation training is a global and coupled procedure that limits the amount of possible parallelism and yields high latency.
These limitations have motivated us to discuss possible alternative directions. In this workshop, we want to promote such discussions by bringing together researchers from various but related disciplines, and to discuss possible solutions from engineering, machine learning and neuroscientific perspectives.
Many have questioned the biological plausibility of backpropagation as a learning mechanism since its discovery. The weight transport and timing problems are the most disputable. The same properties of backpropagation training also have practical consequences. For instance, backpropagation training is a global and coupled procedure that limits the amount of possible parallelism and yields high latency.
These limitations have motivated us to discuss possible alternative directions. In this workshop, we want to promote such discussions by bringing together researchers from various but related disciplines, and to discuss possible solutions from engineering, machine learning and neuroscientific perspectives.
Chat
To ask questions please use rocketchat, available only upon registration and login.
Schedule
2020-12-12T06:00:00-08:00 - 2020-12-12T06:15:00-08:00
Live Intro
Mateusz Malinowski, Viorica Patraucean, Grzegorz Swirszcz, Sindy Löwe, Anna Choromanska, Marco Gori, Yanping Huang
2020-12-12T06:15:00-08:00 - 2020-12-12T06:17:00-08:00
Introduction: Bastiaan Veeling
Mateusz Malinowski
2020-12-12T06:17:00-08:00 - 2020-12-12T06:45:00-08:00
Invited Talk Bastiaan Veeling
Bas Veeling
2020-12-12T06:45:00-08:00 - 2020-12-12T06:47:00-08:00
Introduction: Olivier Teytaud
Sindy Löwe
2020-12-12T06:47:00-08:00 - 2020-12-12T07:15:00-08:00
Invited Talk Olivier Teytaud
Olivier Teytaud
2020-12-12T07:15:00-08:00 - 2020-12-12T08:30:00-08:00
Poster Session: Morning
2020-12-12T08:30:00-08:00 - 2020-12-12T08:32:00-08:00
Introduction: Karl Friston
Mateusz Malinowski
2020-12-12T08:32:00-08:00 - 2020-12-12T09:00:00-08:00
Invited Talk Karl Friston
Karl Friston
2020-12-12T09:00:00-08:00 - 2020-12-12T09:45:00-08:00
Panel discussion 1
Bas Veeling, Olivier Teytaud, Karl Friston, Sindy Löwe, Mateusz Malinowski
2020-12-12T09:45:00-08:00 - 2020-12-12T11:00:00-08:00
Long Break
2020-12-12T11:00:00-08:00 - 2020-12-12T11:02:00-08:00
Introduction: Yoshua Bengio
Anna Choromanska
2020-12-12T11:02:00-08:00 - 2020-12-12T11:32:00-08:00
Invited Talk Yoshua Bengio
Yoshua Bengio
2020-12-12T11:32:00-08:00 - 2020-12-12T11:34:00-08:00
Introduction: Danielle Bassett
Anna Choromanska
2020-12-12T11:34:00-08:00 - 2020-12-12T12:08:00-08:00
Invited Talk Danielle Bassett
Dani S Bassett
2020-12-12T12:09:00-08:00 - 2020-12-12T12:10:00-08:00
Introduction: Oral 1.1 and Oral 1.2
Viorica Patraucean
2020-12-12T12:10:00-08:00 - 2020-12-12T12:22:00-08:00
Orals 1.1: Randomized Automatic Differentiation
Deniz Oktay, Nick B McGreivy, Alex Beatson, Ryan Adams
2020-12-12T12:22:00-08:00 - 2020-12-12T12:35:00-08:00
Orals 1.2: ZORB: A Derivative-Free Backpropagation Algorithm for Neural Networks
Varun Ranganathan, Alex Lewandowski
2020-12-12T12:35:00-08:00 - 2020-12-12T12:40:00-08:00
Oral 1.1 and 1.2 Q&A
2020-12-12T12:40:00-08:00 - 2020-12-12T12:45:00-08:00
Short Break 2
2020-12-12T12:45:00-08:00 - 2020-12-12T12:46:00-08:00
Introduction: Oral 2.1 and Oral 2.2
Viorica Patraucean
2020-12-12T12:46:00-08:00 - 2020-12-12T12:59:00-08:00
Orals 2.1: Policy Manifold Search for Improving Diversity-based Neuroevolution
Nemanja Rakicevic
2020-12-12T12:59:00-08:00 - 2020-12-12T13:12:00-08:00
Orals 2.2: Hardware Beyond Backpropagation: a Photonic Co-Processor for Direct Feedback Alignmen
Julien Launay, Iacopo Poli, Laurent Daudet, Florent Krzakala
2020-12-12T13:12:00-08:00 - 2020-12-12T13:15:00-08:00
Oral 2.1 and Oral 2.2 Q&A
2020-12-12T13:15:00-08:00 - 2020-12-12T13:17:00-08:00
Introduction: David Duvenaud
Yanping Huang
2020-12-12T13:17:00-08:00 - 2020-12-12T13:45:00-08:00
Invited Talk David Duvenaud
David Duvenaud
2020-12-12T13:45:00-08:00 - 2020-12-12T13:47:00-08:00
Introduction: Cristina Savin
Yanping Huang
2020-12-12T13:47:00-08:00 - 2020-12-12T14:15:00-08:00
Invited Talk Cristina Savin
Cristina Savin
2020-12-12T14:15:00-08:00 - 2020-12-12T15:00:00-08:00
Panel discussion 2
Dani S Bassett, Yoshua Bengio, Cristina Savin, David Duvenaud, Anna Choromanska, Yanping Huang
2020-12-12T15:00:00-08:00 - 2020-12-12T16:30:00-08:00