Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

977

Base only

Active filters: 4bit

mlx-community/Qwen3.5-9B-MLX-4bit

Image-Text-to-Text • 2B • Updated Mar 23 • 21.9k • 150

mlx-community/Qwen3.6-27B-OptiQ-4bit

Text Generation • 27B • Updated 17 days ago • 12.5k • 75

mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit

Text Generation • 35B • Updated 17 days ago • 12.6k • 58

mlx-community/gemma-4-e4b-it-qat-OptiQ-4bit

Text Generation • 7B • Updated 12 days ago • 4.31k • 15

mlx-community/Qwen3.5-9B-OptiQ-4bit

Text Generation • 9B • Updated 17 days ago • 9.55k • 89

mlx-community/gemma-4-12B-it-qat-OptiQ-4bit

Text Generation • 12B • Updated 12 days ago • 5.02k • 11

mlx-community/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-OptiQ-4bit

Text Generation • 0.2B • Updated 17 days ago • 1.27k • 4

0xroyce/Plutus-Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • 8B • Updated Jun 29 • 2.28k • 8

bullpoint/Qwen3-Coder-Next-AWQ-4bit

Text Generation • 14B • Updated Feb 3 • 80.5k • 30

mlx-community/Qwen3.5-4B-MLX-4bit

1.0B • Updated Mar 2 • 27k • 31

mlx-community/Qwen3.5-4B-OptiQ-4bit

Text Generation • 0.9B • Updated 17 days ago • 3.75k • 27

mlx-community/gemma-4-e4b-it-OptiQ-4bit

Text Generation • 7B • Updated 12 days ago • 7.99k • 29

OsaurusAI/Qwen3.6-27B-JANG_4M

Image-Text-to-Text • 5B • Updated Apr 23 • 130 • 2

mlx-community/gemma-4-26B-A4B-it-OptiQ-4bit

Text Generation • 25B • Updated 12 days ago • 4.22k • 18

mlx-community/gemma-4-31B-it-OptiQ-4bit

Text Generation • 31B • Updated 12 days ago • 4.22k • 12

samajlouis/Qwen3.6-27B-bnb-nf4

Image-Text-to-Text • 28B • Updated May 7 • 169 • 2

AxisQuant/Qwen3.6-27b-gptq-int4

Text Generation • 27B • Updated 29 days ago • 4.83k • 5

samwang0041/Qwen3.6-27B-MLX-4bit-MTP

Text Generation • 27B • Updated May 16 • 833 • 5

Alennnndy/Qwen3.6-27B-AWQ-4bit

Text Generation • 28B • Updated 28 days ago • 67.1k • 3

mlx-community/ThinkingCap-Qwen3.6-27B-OptiQ-4bit

Image-Text-to-Text • 27B • Updated 17 days ago • 1.86k • 3

mlx-community/Ornith-1.0-9B-OptiQ-4bit

Image-Text-to-Text • 9B • Updated 17 days ago • 1.36k • 5

mlx-community/Ornith-1.0-35B-OptiQ-4bit

Image-Text-to-Text • 35B • Updated 17 days ago • 1.39k • 3

SwinliQ-AIs/Qwen3.5-2B-4bit

Text Generation • 0.4B • Updated 5 days ago • 236 • 1

mayaeary/pygmalion-6b-4bit-128g

Text Generation • Updated Mar 28, 2023 • 15 • 40

mayaeary/pygmalion-6b_dev-4bit-128g

Text Generation • Updated Mar 28, 2023 • 14 • 121

mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g

Text Generation • Updated Mar 31, 2023 • 9 • 2

mayaeary/PPO_Pygway-6b-Mix-4bit-128g

Text Generation • Updated Mar 31, 2023 • 7 • 2

Ancestral/Dolly_Shygmalion-6b-4bit-128g

Text Generation • Updated Apr 9, 2023 • 9 • 5

Ancestral/PPO_Shygmalion-6b-4bit-128g

Text Generation • Updated Apr 9, 2023 • 6

Ancestral/Dolly_Malion-6b-4bit-128g

Text Generation • Updated Apr 10, 2023 • 3 • 1