Models

openbmb/MiniCPM-o-4_5-awq

Any-to-Any • 9B • Updated 2 days ago • 263 • 9

mratsim/MiniMax-M2.1-FP8-INT4-AWQ

Text Generation • 39B • Updated 24 days ago • 5.58k • 32

MTSAIR/Cotype-Nano-4bit

Text Generation • 2B • Updated Nov 25, 2024 • 22 • 13

bullpoint/Qwen3-Coder-Next-AWQ-4bit

Text Generation • 14B • Updated 4 days ago • 20.2k • 2

casperhansen/tinyllama-1b-awq

Text Generation • Updated Oct 31, 2023 • 65 • 1

TheBloke/TinyLlama-1.1B-Chat-v0.3-AWQ

Text Generation • 1B • Updated Nov 9, 2023 • 81.4k • 4

TheBloke/deepseek-coder-1.3b-instruct-AWQ

Text Generation • 1B • Updated Nov 9, 2023 • 224 • 5

TheBloke/meditron-7B-AWQ

Text Generation • 7B • Updated Nov 30, 2023 • 2.73k • 4

TheBloke/Mistral-7B-Instruct-v0.2-AWQ

Text Generation • 7B • Updated Dec 11, 2023 • 12.6k • 52

casperhansen/llama-3-8b-instruct-awq

Text Generation • 8B • Updated Jun 8, 2024 • 53.8k • 28

TechxGenus/DeepSeek-Coder-V2-Lite-Instruct-AWQ

Text Generation • 16B • Updated Jun 22, 2024 • 3.77k • 8

TechxGenus/DeepSeek-Coder-V2-Lite-Base-AWQ

Text Generation • 16B • Updated Jun 22, 2024 • 8 • 3

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • 8B • Updated Aug 7, 2024 • 449k • 86

Qwen/Qwen2.5-3B-Instruct-AWQ

Text Generation • 3B • Updated Oct 9, 2024 • 49.4k • 16

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • 73B • Updated Oct 9, 2024 • 745k • 75

Qwen/Qwen2.5-Coder-32B-Instruct-AWQ

Text Generation • 33B • Updated Nov 18, 2024 • 435k • 33

casperhansen/llama-3.3-70b-instruct-awq

Text Generation • 71B • Updated Dec 6, 2024 • 193k • 37

kosbu/Llama-3.3-70B-Instruct-AWQ

Text Generation • 71B • Updated Dec 7, 2024 • 438k • 10

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • 8B • Updated Apr 6, 2025 • 710k • 99

Qwen/Qwen3-32B-AWQ

Text Generation • 33B • Updated May 21, 2025 • 273k • 124

Qwen/Qwen3-8B-AWQ

Text Generation • 8B • Updated May 21, 2025 • 137k • 36

Qwen/Qwen3-4B-AWQ

Text Generation • 4B • Updated May 21, 2025 • 86.4k • 23

Qwen/Qwen2.5-Omni-7B-AWQ

Any-to-Any • 11B • Updated May 15, 2025 • 41.2k • 17

QuantTrio/Qwen3-235B-A22B-Thinking-2507-AWQ

Text Generation • 235B • Updated Sep 5, 2025 • 3.76k • 6

openbmb/MiniCPM-V-4_5-AWQ

Image-Text-to-Text • 9B • Updated Sep 26, 2025 • 5.11k • 12

QuantTrio/Qwen3-VL-32B-Thinking-AWQ

Image-Text-to-Text • 33B • Updated Dec 3, 2025 • 902 • 5

QuantTrio/GLM-4.7-AWQ

Text Generation • 358B • Updated Dec 29, 2025 • 22.6k • 23

mratsim/MiniMax-M2.1-BF16-INT4-AWQ

Text Generation • 39B • Updated 24 days ago • 3.17k • 5

QuantTrio/GLM-4.7-Flash-AWQ

Text Generation • 31B • Updated 17 days ago • 85.5k • 4

casperhansen/mpt-7b-8k-chat-awq

Text Generation • Updated Nov 4, 2023 • 8 • 3