Skip to yearly menu bar Skip to main content


Poster
in
Workshop: Bayesian Deep Learning

Diversity is All You Need to Improve Bayesian Model Averaging

Yashvir Singh Grewal · Thang Bui


Abstract:

Existing approximate inference techniques produce predictive distributions that are quite distinct from the predictive distribution of the gold-standard Hamiltonian Monte Carlo. In this work, we bring the predictive distribution produced by deep ensembles more closer to the Hamiltonian Monte Carlo predictive distribution by increasing the diversity within the ensembles. The proposed approach outperforms the existing approximate inference methods and is also currently ranked the highest in the Approximate Inference competition at NeurIPS 2021.

Chat is not available.