---
date: '2026-01-22'
description: and longest hash matching, i.e a [[thoughts/Search|search]] problem
id: prefix caching
modified: 2026-06-05 15:08:29 GMT-04:00
tags:
  - inference
  - ml
title: prefix caching
created: '2026-01-22'
published: '2026-01-22'
pageLayout: default
slug: thoughts/prefix-caching
permalink: https://aarnphm.xyz/thoughts/prefix-caching.md
generator:
  quartz: v4.6.0
  hostedProvider: Cloudflare
  baseUrl: aarnphm.xyz
full: https://aarnphm.xyz/llms-full.txt
---
_the idea is to create a set of longest-prefix for frequent section of the prompts for reusing over multiple passes_