---
date: '2025-12-15'
description: everything related to pretraining a neural network
id: pre-training
modified: 2026-06-05 15:08:23 GMT-04:00
socials:
  elie podcast: https://x.com/eliebakouch/status/1980301162734624769
tags:
  - engineering
  - technical
  - ml
title: pre-training
created: '2025-12-15'
published: '2025-12-15'
pageLayout: default
slug: thoughts/pre-training
permalink: https://aarnphm.xyz/thoughts/pre-training.md
generator:
  quartz: v4.6.0
  hostedProvider: Cloudflare
  baseUrl: aarnphm.xyz
full: https://aarnphm.xyz/llms-full.txt
---
Ontologically this should be applicable to most domains with deep learning, however, pre-training is often referred to pre-training [[thoughts/LLMs|large language models]]