---
title: '50493'
pageLayout: default
slug: thoughts/inference/vllm-prs/50493
permalink: https://aarnphm.xyz/thoughts/inference/vllm-prs/50493.md
generator:
  quartz: v4.6.0
  hostedProvider: Cloudflare
  baseUrl: aarnphm.xyz
full: https://aarnphm.xyz/llms-full.txt
---
# [#50493](https://github.com/aarnphm/aarnphm.github.io/issues/50493) \[Kimi-K3\] support DCP partial prefix cache hit

[vllm-project/vllm#50493](https://github.com/vllm-project/vllm/pull/50493) · GirasoleY · MERGED · created 2026-07-30T23:38:15Z · merged 2026-08-18T00:05:51Z

Builds on the Kimi-K3 DCP support from [#50484](https://github.com/aarnphm/aarnphm.github.io/issues/50484).

- Enables hash-aligned partial-prefix reuse under DCP for FullAttention plus aligned Mamba while preserving sharded-attention and replicated-Mamba correctness.
- Fixes MRV2 block-table geometry. MRV2 previously divided every cache group’s block-table width by DCP size—correct for attention, but wrong for replicated Mamba. For a 1M context, DCP8, and 16-token Mamba blocks, it allocated 8,192 entries instead of 65,536, potentially causing metadata corruption and CUDA illegal-address failures. The fix uses cache-type-specific sizing and adds a bounds check.

Validation:

- focused functional and MRV2 tests: 49 passed;
- DCP MLA non-virtual-block-aligned metadata test: passed;
- pre-commit lint, format, type, SPDX, and policy hooks: passed.

---

## comments

**mergify** (2026-08-09T23:06:59Z):

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @GirasoleY.

<https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork>

**mergify** (2026-08-12T11:15:00Z):

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @GirasoleY.

<https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork>

**wzhao18** (2026-08-14T22:48:22Z):

/ci run

**github-actions** (2026-08-14T22:48:38Z):

❌ @wzhao18, Only reviewers with write access can use CI commands before CI is delegated to the PR author.

<!-- vllm-ci-command:5298916953 -->

**mergify** (2026-08-17T15:36:31Z):

Hi @GirasoleY, the pre-commit checks have failed. Please run:



```bash
uv pip install pre-commit>=4.5.1
pre-commit install
pre-commit run --all-files
```

Then, commit the changes and push to your branch.

For future commits, `pre-commit` will run automatically on changed files before each commit.

**ivanium** (2026-08-17T20:19:02Z):

/ci run

**github-actions** (2026-08-17T20:19:56Z):

✅ Triggered [Buildkite CI #84258](https://buildkite.com/vllm/ci/builds/84258) for commit `f478f18a84f2`.

