G

MadGoatHaz

·

AI & ML interests

None yet

Recent Activity

new activity 3 days ago

Vishva007/Qwen3.8-27B-W4A16-AutoRound-GPTQ:Issue & Fix: vLLM Speculative Decoding (MTP) Fails Due to Quantized Draft Head

updated a collection 3 days ago

new activity 3 days ago

Frozenlock/Qwen3.8-27B-int4-AutoRound:Great stuff on Ampere

View all activity

Organizations

None yet

New activity in Vishva007/Qwen3.8-27B-W4A16-AutoRound-GPTQ 3 days ago

Issue & Fix: vLLM Speculative Decoding (MTP) Fails Due to Quantized Draft Head

#1 opened 3 days ago by

New activity in Frozenlock/Qwen3.8-27B-int4-AutoRound 3 days ago

Great stuff on Ampere

#2 opened 3 days ago by

New activity in bottlecapai/ThinkingCap-Qwen3.6-27B-FP8 about 1 month ago

Deployment Note: vLLM JIT Path Resolution -nvidia/cu13/lib/-

#5 opened about 2 months ago by

New activity in bottlecapai/ThinkingCap-Qwen3.6-27B-FP8 about 2 months ago

Fix for vLLM Loading Crash on Ampere/Ada GPUs (TP=8, RuntimeError: size_n = 12)

#2 opened about 2 months ago by

vllm loaded with error

#1 opened about 2 months ago by

New activity in Xingyu-Zheng/Qwen3.6-27B-INT8-FOEM 4 months ago

MTP not accepting tokens

#1 opened 4 months ago by

MTP not accepting tokens

#1 opened 4 months ago by