Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

134

Base only

Active filters: ik_llama.cpp

nimishchaudhari/Magistral-Small-2509-IQ4_KS-GGUF

24B • Updated Sep 24, 2025 • 7

anikifoss/DeepSeek-V3.1-Terminus-HQ4_K

Text Generation • 671B • Updated Nov 27, 2025 • 6 • 2

Downtown-Case/GLM-4.6-128GB-RAM-IK-GGUF

Text Generation • 357B • Updated Dec 19, 2025 • 55 • 19

ubergarm/GLM-4.6-GGUF

Text Generation • 357B • Updated Oct 2, 2025 • 66 • 28

ubergarm/Ling-1T-GGUF

Text Generation • Updated Oct 29, 2025 • 50 • 12

ubergarm/Kimi-K2-Thinking-GGUF

Text Generation • Updated Nov 20, 2025 • 366 • 22

ubergarm/GigaChat3-10B-A1.8B-GGUF

Text Generation • Updated Nov 21, 2025 • 62 • 13

sokann/GLM-4.5-GGUF-3.2162bpw

358B • Updated Nov 29, 2025 • 2

sokann/GLM-4.6-GGUF-3.2263bpw

357B • Updated Nov 30, 2025 • 3

ubergarm/Devstral-2-123B-Instruct-2512-GGUF

Text Generation • Updated Dec 10, 2025 • 19 • 7

ubergarm/GLM-4.7-GGUF

Text Generation • 358B • Updated Dec 24, 2025 • 183 • 25

ubergarm/Devstral-Small-2-24B-Instruct-2512-GGUF

Text Generation • 24B • Updated Dec 25, 2025 • 14 • 1

ubergarm/MiMo-V2-Flash-GGUF

Text Generation • 309B • Updated Jan 6 • 11 • 4

ubergarm/DeepSeek-V3.2-Speciale-GGUF

Text Generation • 671B • Updated Jan 9 • 146 • 18

ubergarm/GLM-4.7-Flash-GGUF

Text Generation • 30B • Updated Jan 21 • 214 • 24

ubergarm/Kimi-K2.5-GGUF

Text Generation • 1T • Updated Feb 6 • 27 • 11

ubergarm/MiniMax-M2.5-GGUF

Text Generation • 229B • Updated Feb 15 • 203 • 51

ubergarm/GLM-5-GGUF

Text Generation • 754B • Updated Feb 15 • 109 • 16

ubergarm/Qwen3.5-397B-A17B-GGUF

Text Generation • 396B • Updated Apr 3 • 564 • 37

ubergarm/Qwen3-Coder-Next-GGUF

Text Generation • 80B • Updated Feb 26 • 20.9k • 21

ubergarm/Qwen3.5-122B-A10B-GGUF

Text Generation • 122B • Updated Mar 20 • 2.98k • 20

ubergarm/Qwen3.5-35B-A3B-GGUF

Text Generation • 35B • Updated Mar 16 • 295 • 10

ubergarm/Qwen3.5-27B-GGUF

Text Generation • 27B • Updated Apr 24 • 118 • 18

sokann/GLM-5-GGUF-1.594bpw

754B • Updated Mar 1 • 44 • 3

sokann/Qwen3.5-27B-GGUF-4.165bpw

27B • Updated Mar 13 • 37 • 9

KeinNiemand/Qwen3.5-122B-A10B-IK_GGUF

Text Generation • 122B • Updated Mar 13 • 17 • 1

Uninformed/GLM-4.7-Architect-355B-A32B-GGUF

Text Generation • Updated Mar 13 • 22 • 2

sokann/Qwen3.5-27B-GGUF-4.915bpw

27B • Updated Mar 13 • 11 • 6

sokann/Qwen3.5-27B-GGUF-4.151bpw

27B • Updated Mar 13 • 24 • 1

ubergarm/GLM-5.1-GGUF

Text Generation • 754B • Updated Apr 9 • 461 • 25