Pavlin Penev

zelias's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in cyankiwi/Kimi-Linear-48B-A3B-Instruct-AWQ-4bit 9 months ago

vLLM v0.11.1 seems to work, but v0.11.2 fails

👍❤️ 2

9

#3 opened 9 months ago by

stelterlab

New activity in Firworks/Kimi-Linear-48B-A3B-Instruct-nvfp4 9 months ago

How many tokens/s are you seeing on those two 6000 Blackwell's?

1

#6 opened 9 months ago by

zelias

New activity in cyankiwi/Kimi-Linear-48B-A3B-Instruct-AWQ-4bit 9 months ago

vLLM v0.11.1 seems to work, but v0.11.2 fails

👍❤️ 2

9

#3 opened 9 months ago by

stelterlab