---
cited_by:
  - '[[thoughts/inference/kv-transfer#5-reading-order|reading-map §5]]'
date: '2026-11-11'
kind: pr
local:
  - file:///Users/aarnphm/workspace/vllm/vllm/v1/kv_cache_interface.py
  - file:///Users/aarnphm/workspace/vllm/vllm/model_executor/layers/attention/attention.py
  - file:///Users/aarnphm/workspace/vllm/vllm/platforms/interface.py
  - file:///Users/aarnphm/workspace/vllm/vllm/model_executor/layers/attention/mla_attention.py
  - file:///Users/aarnphm/workspace/vllm/vllm/v1/attention/backends/flashinfer.py
  - file:///Users/aarnphm/workspace/vllm/vllm/v1/attention/backends/triton_attn.py
  - file:///Users/aarnphm/workspace/vllm/vllm/v1/attention/backends/turboquant_attn.py
  - file:///Users/aarnphm/workspace/vllm/vllm/v1/attention/backend.py
merged: '2026-08-14'
number: 51704
source:
  - https://github.com/vllm-project/vllm/blob/57bd0ed441095b5c546707cabe25d3fa08b7f161/vllm/v1/kv_cache_interface.py
  - https://github.com/vllm-project/vllm/blob/57bd0ed441095b5c546707cabe25d3fa08b7f161/vllm/model_executor/layers/attention/attention.py
  - https://github.com/vllm-project/vllm/blob/57bd0ed441095b5c546707cabe25d3fa08b7f161/vllm/platforms/interface.py
  - https://github.com/vllm-project/vllm/blob/57bd0ed441095b5c546707cabe25d3fa08b7f161/vllm/model_executor/layers/attention/mla_attention.py
  - https://github.com/vllm-project/vllm/blob/57bd0ed441095b5c546707cabe25d3fa08b7f161/vllm/v1/attention/backends/flashinfer.py
  - https://github.com/vllm-project/vllm/blob/57bd0ed441095b5c546707cabe25d3fa08b7f161/vllm/v1/attention/backends/triton_attn.py
  - https://github.com/vllm-project/vllm/blob/57bd0ed441095b5c546707cabe25d3fa08b7f161/vllm/v1/attention/backends/turboquant_attn.py
  - https://github.com/vllm-project/vllm/blob/57bd0ed441095b5c546707cabe25d3fa08b7f161/vllm/v1/attention/backend.py
state: merged
tags:
  - vllm
  - vllm-pr
  - hetero-tp-kv-layout
title: '#51704 [5/N][KV-Cache Layout Refactor] Backend-published KV packing via customize_spec'
topic: hetero-tp-kv-layout
url: https://github.com/vllm-project/vllm/pull/51704
created: '2026-11-11'
modified: '2026-11-11'
published: '2026-11-11'
pageLayout: default
slug: hinterland/papers/maps/prs/51704
permalink: https://aarnphm.xyz/hinterland/papers/maps/prs/51704.md
generator:
  quartz: v4.6.0
  hostedProvider: Cloudflare
  baseUrl: aarnphm.xyz
full: https://aarnphm.xyz/llms-full.txt
---
Part of the KV-cache layout standardization series (RFC [#42082](https://github.com/aarnphm/aarnphm.github.io/issues/42082)). Stacked on [#51612](https://github.com/aarnphm/aarnphm.github.io/issues/51612) — the diff shown includes it until that lands and this retargets `main`. · full dump: [[thoughts/inference/vllm-prs/51704|#51704]]

