---
title: '51819'
pageLayout: default
slug: thoughts/inference/vllm-prs/51819
permalink: https://aarnphm.xyz/thoughts/inference/vllm-prs/51819.md
generator:
  quartz: v4.6.0
  hostedProvider: Cloudflare
  baseUrl: aarnphm.xyz
full: https://aarnphm.xyz/llms-full.txt
---
# [#51819](https://github.com/aarnphm/aarnphm.github.io/issues/51819) \[Bugfix\]\[MoE\] Support GELU tanh in FlashInfer B12x MoE

[vllm-project/vllm#51819](https://github.com/vllm-project/vllm/pull/51819) · askliar · MERGED · created 2026-08-11T12:50:59Z · merged 2026-08-11T15:07:59Z

## Summary

Adds `MoEActivation.GELU_TANH` support to the FlashInfer B12x MoE backend so Gemma 4 NVFP4 can use `--moe-backend flashinfer_b12x`.

## Validation

Validated with `nvidia/Gemma-4-26B-A4B-NVFP4` on DGX Spark using FlashInfer 0.6.16.post3

---

## comments

**github-actions** (2026-08-11T13:59:47Z):

✅ @askliar, CI is now available for this PR.

- `/ci run` starts a CI build.
- `/ci retry` retries failed jobs in the CI build for the current PR head. If the current head has no CI build, it starts a new CI build for the current head containing only jobs that failed in the latest earlier CI build for this PR.
- `/ci cancel` cancels scheduled or running CI builds for this PR branch.

<!-- vllm-ci-authorized -->

**benchislett** (2026-08-11T14:00:02Z):

/ci run

**github-actions** (2026-08-11T14:00:58Z):

✅ Triggered [Buildkite CI #83360](https://buildkite.com/vllm/ci/builds/83360) for commit `0f9ef9e27c92`.

