---
date: '2024-01-20'
description: a la carte.
id: Information Theory
modified: 2026-06-05 15:08:37 GMT-04:00
tags:
  - seed
title: Information Theory
created: '2024-01-20'
published: '2024-01-20'
pageLayout: default
slug: thoughts/Information-Theory
permalink: https://aarnphm.xyz/thoughts/Information-Theory.md
generator:
  quartz: v4.6.0
  hostedProvider: Cloudflare
  baseUrl: aarnphm.xyz
full: https://aarnphm.xyz/llms-full.txt
---
_excerpt from [MIT’s 6.441S16](https://ocw.mit.edu/courses/6-441-information-theory-spring-2016/resources/mit6_441s16_course_notes/)_

see also: [pdf](https://fleuret.org/public/EN_essays/fleuret-inf-theory-2024.pdf), [[thoughts/Entropy|entropy]]

<blockquote class="twitter-tweet" data-lang="fr" data-dnt="true"><p lang="en" dir="ltr">Less horror. Probably full of typo.<br><br>Source tex there:<a href="https://t.co/M1CPZs1kPl">https://t.co/M1CPZs1kPl</a> <a href="https://t.co/Spiy0JvC3f">https://t.co/Spiy0JvC3f</a> <a href="https://t.co/9e4FdQol3b">pic.twitter.com/9e4FdQol3b</a></p>&mdash; François Fleuret (@francoisfleuret) <a href="https://x.com/francoisfleuret/status/1748011011590799462?ref_src=twsrc%5Etfw">18 janvier 2024</a></blockquote>