---
title: '50104'
pageLayout: default
slug: thoughts/inference/vllm-prs/50104
permalink: https://aarnphm.xyz/thoughts/inference/vllm-prs/50104.md
generator:
  quartz: v4.6.0
  hostedProvider: Cloudflare
  baseUrl: aarnphm.xyz
full: https://aarnphm.xyz/llms-full.txt
---
# [#50104](https://github.com/aarnphm/aarnphm.github.io/issues/50104) \[Model\] Add Kimi K3 support: Rust frontend \[1/2\]

[vllm-project/vllm#50104](https://github.com/vllm-project/vllm/pull/50104) · BugenZhao · MERGED · created 2026-07-28T07:41:14Z · merged 2026-07-28T21:31:14Z

## Purpose

Extract the Kimi K3 Rust frontend from [#50000](https://github.com/aarnphm/aarnphm.github.io/issues/50000) into an independently reviewable stack rooted at `main`. This layer adds native XTML rendering, unified parsing, tokenizer/model selection, structured-tag support, and top-level `response_format` forwarding.

Model and kernel work remains in [#50089](https://github.com/aarnphm/aarnphm.github.io/issues/50089). This PR contains only `rust/` changes. An open-PR search found this as the sole Kimi K3 Rust frontend PR, so it represents the focused extraction rather than duplicate work.

## Test Plan

- `cargo fmt --all --check`
- `cargo test -p vllm-server routes::openai::chat_completions::convert::tests`
- `cargo test -p vllm-chat kimi_k3`
- `cargo clippy -p vllm-server --tests -- -D warnings`

## Test Result

- 30 server request-conversion tests passed.
- 14 Kimi K3 chat tests and 1 roundtrip test passed.
- Rust formatting and clippy passed.
- Model evals were not run; exact prompt goldens and parser roundtrip tests cover this frontend-only change.

AI assistance was used to extract, rebase, test, and review this change. The human submitter reviewed the resulting diff and test results.

---

## comments

**mergify** (2026-07-28T08:04:57Z):

Documentation preview: [https://vllm—50104.org.readthedocs.build/en/50104/](https://vllm--50104.org.readthedocs.build/en/50104/)

**mergify** (2026-07-28T08:53:06Z):

Hi @BugenZhao, the pre-commit checks have failed. Please run:



```bash
uv pip install pre-commit>=4.5.1
pre-commit install
pre-commit run --all-files
```

Then, commit the changes and push to your branch.

For future commits, `pre-commit` will run automatically on changed files before each commit.

