Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

13

Base only

Active filters: deepseek-v3

richardyoung/Kimi-K2-Instruct-0905-MLX-8bit

Text Generation • 1T • Updated Nov 26, 2025 • 68

richardyoung/Kimi-K2-Instruct-0905-MLX-6bit

Text Generation • 1T • Updated Nov 26, 2025 • 21

richardyoung/Kimi-K2-Instruct-0905-MLX-4bit

Text Generation • 1T • Updated Nov 26, 2025 • 46 • 1

richardyoung/Kimi-K2-Instruct-0905-MLX-2bit

Text Generation • 1T • Updated Nov 26, 2025 • 727 • 2

richardyoung/Kimi-K2-Instruct-0905-MLX-3bit

Text Generation • 1T • Updated Nov 26, 2025 • 22

RockTalk/GigaChat3.1-702B-A36B-MLX-4bit

Text Generation • 702B • Updated Mar 26 • 50

0xSero/DeepSeek-V3.2-508B-NVFP4

Text Generation • 2B • Updated May 30 • 18

wafer-ai/Kimi-K2.6-NVFP4

Image-Text-to-Text • Updated Apr 27 • 3.25k • 3

wafer-ai/Kimi-K2.6-MXFP4

Image-Text-to-Text • 551B • Updated Apr 23 • 1.5k • 2

TilQazyna/Til-mini-1B

Text Generation • 1.0B • Updated 26 days ago • 1

TilQazyna/Til-2B

Text Generation • 2B • Updated 23 days ago

freakyskittle/kimi-k2.75-code

Text Generation • 742B • Updated 19 days ago • 1.18k • 1

freakyskittle/kimi-k2.75-code-GGUF

Text Generation • 62B • Updated 19 days ago • 3.15k • 1