---
title: '54859'
pageLayout: default
slug: thoughts/inference/vllm-prs/54859
permalink: https://aarnphm.xyz/thoughts/inference/vllm-prs/54859.md
generator:
  quartz: v4.6.0
  hostedProvider: Cloudflare
  baseUrl: aarnphm.xyz
full: https://aarnphm.xyz/llms-full.txt
---
# [#54859](https://github.com/aarnphm/aarnphm.github.io/issues/54859) \[Kimi-K3\] Bump FlashKDA to fix unstable inverse

[vllm-project/vllm#54859](https://github.com/vllm-project/vllm/pull/54859) · gau-nernst · MERGED · created 2026-09-02T01:19:22Z · merged 2026-09-02T07:16:29Z

## Purpose

See [vllm-project/FlashKDA#10](https://github.com/vllm-project/FlashKDA/pull/10)

We also add a unit test here

We don’t expect e2e perf regression since the kernel is only slower by 1-2% in microbenchmarks.

## Test Plan

TP8 GB300

- GSM8K: 0.9651, 2,638 requests, zero errors
- OCRBench: 0.894, 1,000 requests, zero errors

## Test Result

---

<details>
<summary> Essential Elements of an Effective PR Description Checklist </summary>

- [ ] The purpose of the PR, such as “Fix some issue (link existing issues this PR will resolve)”.
- [ ] The test plan, such as providing test command.
- [ ] The test results, such as pasting the results comparison before and after, or e2e results
- [ ] (Optional) The necessary documentation update, such as updating `supported_models.md` and `examples` for a new model.

</details>

---

## comments

**gau-nernst** (2026-09-02T02:37:24Z):

/ci run

**github-actions** (2026-09-02T02:37:43Z):

✅ Triggered [Buildkite CI #86757](https://buildkite.com/vllm/ci/builds/86757) for commit `d322c74373c6`.

**gau-nernst** (2026-09-02T04:52:14Z):

/ci run

**github-actions** (2026-09-02T04:52:51Z):

✅ Triggered [Buildkite CI #86780](https://buildkite.com/vllm/ci/builds/86780) for commit `8f5727cc8107`.

