---
date: '2024-02-07'
description: learning patterns from data
id: Machine learning
modified: 2026-06-05 15:08:04 GMT-04:00
tags:
  - ml
  - sapling
title: Machine learning
created: '2024-02-07'
published: '2024-02-07'
pageLayout: default
slug: thoughts/Machine-learning
permalink: https://aarnphm.xyz/thoughts/Machine-learning.md
generator:
  quartz: v4.6.0
  hostedProvider: Cloudflare
  baseUrl: aarnphm.xyz
full: https://aarnphm.xyz/llms-full.txt
---
Machine learning fits models to data so they can make predictions or choose actions on new inputs.

In the usual taxonomy, $\mathrm{DL} \subset \mathrm{ML} \subset \mathrm{AI}$: [[thoughts/deep learning|deep learning]] is part of machine learning, which is part of artificial intelligence. See [Deep Learning, chapter 1](https://www.deeplearningbook.org/contents/intro.html).

[[thoughts/AGI]] concerns the breadth of tasks a system can perform. It describes a capability goal; machine learning describes an approach to building systems. See [2311.02462](https://arxiv.org/abs/2311.02462) \[@morris2025levelsagioperationalizingprogress\] .

Some main exploration:

- [[thoughts/Transformers|Transformers]]
  - [[thoughts/LLMs|Large language models]]
- [[thoughts/NLP]]
- [[thoughts/Bayesian Neural Network]]
- [[thoughts/university/twenty-four-twenty-five/sfwr-4ml3/Convolutional Neural Network|CNN]]
- [[thoughts/Logistic regression]]
- [[thoughts/optimization|Optimization]]
  - [[thoughts/gradient descent]]
  - hyperparameter tuning
- [[thoughts/ensemble learning]]
- Recommender systems
- [[thoughts/Reinforcement learning]]
  - Q-learning
  - Policy Gradient
  - [[thoughts/Monte-Carlo|Monte-Carlo]] Tree Search
- Generative Models
  - GAN
  - VAE
- [[thoughts/autoencoders|Autoencoder]]
  - [[thoughts/sparse autoencoder]]
  - [[thoughts/sparse crosscoders]]
- [[thoughts/university/twenty-four-twenty-five/sfwr-4ml3/midterm|Supervised learning]]
- [[thoughts/Low-rank adapters]]
- Transfer learning
  - [[thoughts/knowledge distillation]]

Fields

- [[thoughts/mechanistic interpretability]]
- [[thoughts/pre-training]]

Related:

- [[tags/linalg]].
- [[thoughts/Automatic Differentiation|autograd]]
- [[thoughts/university/twenty-four-twenty-five/sfwr-4ml3/midterm|supervised machine learning]].