Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

588

Base only

Active filters: q4_k_m

Auroraventures/cipher-sft25-merged-Q4_K_M-GGUF

Text Generation • 31B • Updated Apr 18 • 33

PhysShell/SuperGemma4-31b-abliterated-GGUF

Text Generation • 31B • Updated Apr 16 • 16

ramankrishna10/npc-fast-1.7b-gguf

2B • Updated Apr 25 • 70

wangzhang/gemma-4-31B-it-abliterated-GGUF

Text Generation • 31B • Updated 21 days ago • 2.73k • 10

steve-nguyen/aai-accountant-tt133-v1.1-GGUF

4B • Updated Apr 24 • 51

lkjiop8/reasoning-expert-v3-GGUF

27B • Updated Apr 23 • 60

tfl35/ti-analyst-9b

9B • Updated Apr 24 • 12

tfl35/ti-analyst-4b-150

4B • Updated Apr 24 • 16

loilkon/Qwopus3.5-9B-v3.5-Uncensored

Text Generation • 9B • Updated Apr 25 • 173 • 8

QuantLLM/Qwen3-0.6B-4bit-gguf

0.6B • Updated Apr 25 • 13

lebiraja/customer-support-grpo-v5-gguf

8B • Updated Apr 26 • 9

HomeroKzam/gemma-4-4b-it-llamasharp-gguf

Text Generation • Updated Apr 26

Handyfff/Gemma-4-E4B-OBLITERATED-PRUNED-TextOnly-EnglishOnly-it-GGUF

Updated Apr 27 • 1

pbhappliedsystems/qwen3.6-27B-gguf-Q4-K-M

27B • Updated May 6 • 22

tawatchai/gemma4-e4b-nothink-gguf

Text Generation • 8B • Updated Apr 27 • 20

clxudfast/huihui4-8b-a4b-v2-Q4_K_M

8B • Updated Apr 27 • 26 • 1

Zoed/Qwen3-Coder-30B-A3B-Instruct

Text Generation • 31B • Updated Apr 28 • 71 • 1

Hob-forge/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-GGUF

Text Generation • 32B • Updated 27 days ago • 209

ramyun/adelie-qwen-roleplay-v2-gguf

Text Generation • 8B • Updated Apr 29 • 112 • 1

Hob-forge/BAR-2x7B-Tool-Use-GGUF

Text Generation • 12B • Updated 27 days ago • 162

QuantLLM/TinyLlama-1.1B-Chat-GGUF

1B • Updated Apr 29 • 46

QuantLLM/SmolLM2-135M-GGUF

0.1B • Updated Apr 29 • 101 • 1

Hob-forge/helium-1-2b-GGUF

Text Generation • 2B • Updated 27 days ago • 317

FiShota/sarashina2.2-3b-sft-v3-Q4_K_M-gguf

3B • Updated May 3 • 120

Hob-forge/BAR-5x7B-GGUF

Text Generation • 25B • Updated 28 days ago • 111

robertzty/Cosmos-Reason2-32B-GGUF

Image-Text-to-Text • 33B • Updated Apr 30 • 42

Hob-forge/Cosmos-Reason2-32B-GGUF

Image-Text-to-Text • 33B • Updated 27 days ago • 582

FiShota/sarashina2.2-3b-sft-v4-gguf

3B • Updated May 4 • 53

Catter58/CASELLM-26b-a4b-evaluation

25B • Updated May 3 • 40

andreribeiro87/telco-troubleshooting-agentic-challenge-gguf

Text Generation • 35B • Updated May 3 • 48