---
title: '53797'
pageLayout: default
slug: thoughts/inference/vllm-prs/53797
permalink: https://aarnphm.xyz/thoughts/inference/vllm-prs/53797.md
generator:
  quartz: v4.6.0
  hostedProvider: Cloudflare
  baseUrl: aarnphm.xyz
full: https://aarnphm.xyz/llms-full.txt
---
# [#53797](https://github.com/aarnphm/aarnphm.github.io/issues/53797) Add support for loading dflash2 model in speculators format

[vllm-project/vllm#53797](https://github.com/vllm-project/vllm/pull/53797) · fynnsu · MERGED · created 2026-08-25T21:23:33Z · merged 2026-08-27T22:12:02Z

## Purpose

Add speculators format loading logic for dflash2.

Note: we use `dflash2` in the speculators config to denote the algorithm, but overwrite with `dflash` in vllm to match vllm conventions.

## Test Plan

Successfully served a model produced by [vllm-project/speculators#1006](https://github.com/vllm-project/speculators/pull/1006) in vllm using this change.

## Test Result

Speculator served.

---

<details>
<summary> Essential Elements of an Effective PR Description Checklist </summary>

- [x] The purpose of the PR, such as “Fix some issue (link existing issues this PR will resolve)”.
- [x] The test plan, such as providing test command.
- [x] The test results, such as pasting the results comparison before and after, or e2e results
- [ ] (Optional) The necessary documentation update, such as updating `supported_models.md` and `examples` for a new model.

</details>

---

## comments

**github-actions** (2026-08-27T19:44:36Z):

✅ @fynnsu, CI is now available for this PR.

- `/ci run` starts upstream CI; `/amd-ci run` starts AMD CI only.
- `/ci retry` retries failed jobs in the CI build for the current PR head. If the current head has no CI build, it starts a new CI build for the current head containing only jobs that failed in the latest earlier CI build for this PR.
- `/amd-ci retry` retries failed jobs in AMD CI for the current PR head. Use `/amd-ci run` when the current head has no AMD CI build.
- `/ci cancel` cancels scheduled or running CI builds for this PR branch; `/amd-ci cancel` does the same for AMD CI only.

<!-- vllm-ci-authorized -->

**mgoin** (2026-08-27T19:44:47Z):

/ci run

**github-actions** (2026-08-27T19:45:05Z):

✅ Triggered [Buildkite CI #85874](https://buildkite.com/vllm/ci/builds/85874) for commit `a3476dc8acda`.

