---
title: '50093'
pageLayout: default
slug: thoughts/inference/vllm-prs/50093
permalink: https://aarnphm.xyz/thoughts/inference/vllm-prs/50093.md
generator:
  quartz: v4.6.0
  hostedProvider: Cloudflare
  baseUrl: aarnphm.xyz
full: https://aarnphm.xyz/llms-full.txt
---
# [#50093](https://github.com/aarnphm/aarnphm.github.io/issues/50093) \[Model\] Add Kimi K3 support: Python frontend \[2/2\]

[vllm-project/vllm#50093](https://github.com/vllm-project/vllm/pull/50093) · BugenZhao · MERGED · created 2026-07-28T06:30:45Z · merged 2026-07-29T08:06:01Z

## Purpose

Extract the Kimi K3 Python frontend from [#50000](https://github.com/aarnphm/aarnphm.github.io/issues/50000) as the top layer of the independent frontend stack rooted at `main` through [#50104](https://github.com/aarnphm/aarnphm.github.io/issues/50104). This layer adds Python XTML rendering, reasoning and tool parsing, structural-tag handling, and streaming support.

Model-side `preprocess_messages` cleanup lives in [#50089](https://github.com/aarnphm/aarnphm.github.io/issues/50089). This PR contains no `vllm/models/kimi_k3` or `rust/` changes. An open-PR search found this as the sole Kimi K3 Python frontend PR, so it represents the focused extraction rather than duplicate work.

## Test Plan

- `pre-commit run --files <all Python-layer files>`
- `.venv/bin/python -m pytest tests/renderers/test_kimi_k3.py tests/reasoning/test_kimi_k3_reasoning_parser.py tests/tool_parsers/test_kimi_k3_named_tool_choice.py tests/tool_parsers/test_structural_tag_registry.py tests/tool_use/test_kimi_k3_tool_parser.py -q`

## Test Result

- All pre-commit hooks passed for the complete Python layer.
- 123 focused renderer, reasoning, structural-tag, and tool-parser tests passed.
- Model evals were not run; renderer and parser unit tests cover this frontend-only change.

AI assistance was used to extract, rebase, test, and review this change. The human submitter reviewed the resulting diff and test results.

---

## comments

**mergify** (2026-07-28T08:59:53Z):

Hi @BugenZhao, the pre-commit checks have failed. Please run:



```bash
uv pip install pre-commit>=4.5.1
pre-commit install
pre-commit run --all-files
```

Then, commit the changes and push to your branch.

For future commits, `pre-commit` will run automatically on changed files before each commit.

**WoosukKwon** (2026-07-28T21:40:37Z):

@BugenZhao Please rebase and check the failed CI. It seems related?

**njhill** (2026-07-28T22:27:43Z):

@BugenZhao FYI I rebased it already to save time

**mergify** (2026-07-29T04:02:06Z):

Hi @BugenZhao, the pre-commit checks have failed. Please run:



```bash
uv pip install pre-commit>=4.5.1
pre-commit install
pre-commit run --all-files
```

Then, commit the changes and push to your branch.

For future commits, `pre-commit` will run automatically on changed files before each commit.

