Resources

Any plan to release Qwen3.8-27B-NVFP4 checkpoint?

#22 opened 11 days ago by

bucunzai

Update (docs): Included image text-to-test in readme

#21 opened about 1 month ago by

reality-interface

Has anyone got this same CUDA error: an illegal memory access was encountered while using this model in vllm:v0.25.0?

#20 opened about 2 months ago by

lzachary

vLLM 0.23.1rc1.dev774+g2b802ad5b.d20260706. . load this model encounter OOM !!

#18 opened 2 months ago by

xuefeizzzzzz

SGLang support?

➕ 5

#17 opened 2 months ago by

danielus

[need help] vllm 0.24.0 on dgx spark warn Your GPU does not have native support for FP4

➕ 1

#16 opened 2 months ago by

imshenshen

doubled TPS NVFP4 vs FP8

🔥 4

#15 opened 2 months ago by

sSeeMyRolexXx

Fallback to marlin kernel give wired/incorrect and sometime gable result

#14 opened 2 months ago by

sapjunior

this model hallucinates easily

#13 opened 2 months ago by

batsclamp

vLLM + HGX B200: Your GPU does not have native support for FP4 computation but FP4 quantization is being used.

👍 3

#12 opened 2 months ago by

cgelias

Works via Ollama, but the ~40 tok/s MTP speedup requires raw llama-server (Ollama has no --spec-type flag) - plus vLLM lockup findings on DGX Spark

#11 opened 2 months ago by

darkmatter2222

为什么全是！！！！！！！！！

#10 opened 2 months ago by

jiecong

Why does this say 18B?

#9 opened 2 months ago by

darkmatter2222

NVFP4 vs FP8 on an RTX PRO 6000 Blackwell (vLLM 0.24): sadly, FP4 is still not faster than FP8 - Qwen3.6‑27B

👀👍 13

#8 opened 2 months ago by

janreges3

CUDA error: an illegal memory access was encountered using vllm(sm120)

#7 opened 2 months ago by

shakhizat

Does it support MTP?

➕👍 3

#6 opened 2 months ago by

sharon8811

will it work on rtx 5090 32gb vram ?

#5 opened 2 months ago by

arunsahu44

nvidia/Qwen3.6-27B-NVFP4 outputs repeated "!" / "d" tokens on Blackwell SM120

➕ 1

#4 opened 2 months ago by

richgua

Could we include BF16 as well as FP8 in the benchmarks please?

➕👀 5

#3 opened 2 months ago by

haydonryan

Qwen-AgentWorld-35B-A3B-NVFP4?

👍 2

#2 opened 2 months ago by

nagelanping

Approved

👍 1

#1 opened 2 months ago by

jasionkajakub