---
title: '56208'
pageLayout: default
slug: thoughts/inference/vllm-prs/56208
permalink: https://aarnphm.xyz/thoughts/inference/vllm-prs/56208.md
generator:
  quartz: v4.6.0
  hostedProvider: Cloudflare
  baseUrl: aarnphm.xyz
full: https://aarnphm.xyz/llms-full.txt
---
# [#56208](https://github.com/aarnphm/aarnphm.github.io/issues/56208) \[Model\]\[Frontend\] Support DeepSeek-V4.1-Flash in Rust and Python frontends

[vllm-project/vllm#56208](https://github.com/vllm-project/vllm/pull/56208) · BugenZhao · MERGED · created 2026-09-10T07:02:43Z · merged 2026-09-10T08:15:07Z

## Purpose

Extract the Rust and Python frontend portions of [#56201](https://github.com/aarnphm/aarnphm.github.io/issues/56201) onto main for separate review: tokenization/rendering, reasoning and tool parsing, tool grammar, image preprocessing, and config adapters. Pins `llm-multimodal` to `24c676d`; enables roundtrip coverage with `deepseek-ai/DeepSeek-V4.1-Flash`. Model execution and GPU kernels remain in [#56201](https://github.com/aarnphm/aarnphm.github.io/issues/56201).

## Test Plan / Results

- `cargo nextest run --locked -p vllm-parser -p vllm-chat --lib`: 764 passed.
- `cargo nextest run --locked -p vllm-chat --test roundtrip -E 'test(roundtrip_deepseek_v41)'`: passed with cached public model files.
- `python -m pytest tests/tokenizers_/test_deepseek_v41.py tests/parser/engine/test_deepseek_v41.py tests/parser/engine/test_deepseek_v4.py tests/tool_parsers/test_structural_tag_registry.py -q`: 213 passed.
- Pre-commit, Mypy 3.12, and Rust Clippy passed. Validation covers frontend behavior; standalone GPU/model evaluation is pending the execution components.

AI-assisted extraction and validation.

---

## comments

**BugenZhao** (2026-09-10T07:09:28Z):

/ci run

**github-actions** (2026-09-10T07:09:57Z):

✅ Triggered [Buildkite CI #88073](https://buildkite.com/vllm/ci/builds/88073) for commit `01f6ac3139f6`.

**BugenZhao** (2026-09-10T07:29:13Z):

/ci run

**github-actions** (2026-09-10T07:30:56Z):

✅ Triggered [Buildkite CI #88074](https://buildkite.com/vllm/ci/builds/88074) for commit `f5de19f99bcc`.

**BugenZhao** (2026-09-10T07:34:25Z):

/ci run

**github-actions** (2026-09-10T07:34:43Z):

✅ Triggered [Buildkite CI #88076](https://buildkite.com/vllm/ci/builds/88076) for commit `18e1282aa562`.

**mergify** (2026-09-10T07:39:49Z):

Hi @BugenZhao, the pre-commit checks have failed. Please run:



```bash
uv pip install pre-commit>=4.5.1
pre-commit install
pre-commit run --all-files
```

Then, commit the changes and push to your branch.

For future commits, `pre-commit` will run automatically on changed files before each commit.

