---
date: '2025-03-22'
description: applying bayesian inference to learn probability distributions over neural networks, mitigating overfitting and enabling learning from small datasets.
id: Bayesian Neural Network
modified: 2026-06-05 15:08:05 GMT-04:00
tags:
  - ml
title: Bayesian Neural Network
created: '2025-03-22'
published: '2025-03-22'
pageLayout: default
slug: thoughts/Bayesian-Neural-Network
permalink: https://aarnphm.xyz/thoughts/Bayesian-Neural-Network.md
generator:
  quartz: v4.6.0
  hostedProvider: Cloudflare
  baseUrl: aarnphm.xyz
full: https://aarnphm.xyz/llms-full.txt
---
excerpt from this [post](https://www.cs.toronto.edu/~duvenaud/distill_bayes_net/public/)

> Apply Bayesian inference to learn probability distribution over a neural network, the results will mitigate overfitting, enable learning from small datasets (grokking)