---
title: '50068'
pageLayout: default
slug: thoughts/inference/vllm-prs/50068
permalink: https://aarnphm.xyz/thoughts/inference/vllm-prs/50068.md
generator:
  quartz: v4.6.0
  hostedProvider: Cloudflare
  baseUrl: aarnphm.xyz
full: https://aarnphm.xyz/llms-full.txt
---
# [#50068](https://github.com/aarnphm/aarnphm.github.io/issues/50068) \[Model\] Enable Qwen3.8 for AMD Rocm

[vllm-project/vllm#50068](https://github.com/vllm-project/vllm/pull/50068) · haic0 · MERGED · created 2026-07-28T02:14:23Z · merged 2026-08-07T13:19:07Z

## Summary

- register the text-only `Qwen3_5ForCausalLM` and `Qwen3_5MoeForCausalLM` architectures
- advertise hybrid and M-RoPE support on the causal implementation
- expose Gated DeltaNet Mamba cache dtype, shape, and copy metadata so text-only Qwen3.5-compatible checkpoints such as Qwen3.8 Max FP8 can initialize through the causal LM path

## Test plan

- [x] Run `python3 -m py_compile` on the modified model and registry files
- [x] Run `git diff --check`
- [x] Validate the equivalent patch with a two-node ROCm vLLM deployment using TP=8 and PP=2
- [x] Verify OpenAI-compatible health, chat, streaming, and completion requests

---

## comments

**mergify** (2026-08-03T02:43:36Z):

Hi @haic0, the pre-commit checks have failed. Please run:



```bash
uv pip install pre-commit>=4.5.1
pre-commit install
pre-commit run --all-files
```

Then, commit the changes and push to your branch.

For future commits, `pre-commit` will run automatically on changed files before each commit.

**mergify** (2026-08-03T02:53:51Z):

Hi @haic0, the pre-commit checks have failed. Please run:



```bash
uv pip install pre-commit>=4.5.1
pre-commit install
pre-commit run --all-files
```

Then, commit the changes and push to your branch.

For future commits, `pre-commit` will run automatically on changed files before each commit.

**tjtanaa** (2026-08-04T06:51:44Z):

@haic0 please fix the prefix commit.

**mergify** (2026-08-07T05:41:58Z):

Hi @haic0, the pre-commit checks have failed. Please run:



```bash
uv pip install pre-commit>=4.5.1
pre-commit install
pre-commit run --all-files
```

Then, commit the changes and push to your branch.

For future commits, `pre-commit` will run automatically on changed files before each commit.

**haic0** (2026-08-07T07:06:26Z):

> @haic0 please fix the prefix commit.

@tjtanaa Fixed,pls check, thanks!

**ZJY0516** (2026-08-07T07:07:29Z):

/ci run

**github-actions** (2026-08-07T07:07:46Z):

✅ Triggered [Buildkite CI #82808](https://buildkite.com/vllm/ci/builds/82808) for commit `1b9eed4fffd4`.

