Inference Providers
Active filters: 2-bit
Brooooooklyn/Qwen3.6-35B-A3B-UD-Q2_K_XL-mlx
Text Generation
• 4B • Updated • 1.31k
• 3
MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF
Text Generation
• 24B • Updated • 69.9k
• 12
richardyoung/Kimi-K2-Instruct-0905-MLX-2bit
Text Generation
• 1T • Updated • 186
• 2
spicyneuron/GLM-5.1-MLX-2.9bit
Text Generation
• 744B • Updated • 3.41k
• 2
majentik/Mistral-Small-4-119B-TurboQuant-MLX-2bit
Text Generation
• 12B • Updated • 450
• 1
zecanard/gemma-4-26B-A4B-it-uncensored-abliterix-MLX-2bit-int2-affine
Image-Text-to-Text
• 4B • Updated • 1.72k
• 3
bearzi/Qwen3.6-35B-A3B-oQ2
Text Generation
• 4B • Updated • 2.56k
• 5
majentik/Qwen3.6-35B-A3B-RotorQuant-MLX-2bit
Image-Text-to-Text
• 35B • Updated • 3.56k
• 3
Brooooooklyn/Qwen3.6-27B-UD-Q2_K_XL-mlx
Text Generation
• 6B • Updated • 610
• 1
JANGQ-AI/DeepSeek-V4-Flash-JANGTQ2
Text Generation
• 20B • Updated • 1.33k
• 1
deucebucket/Qwen3.6-27B-Osmosis-Q2_K-GGUF
Text Generation
• Updated • 319
• 1
OsaurusAI/DeepSeek-V4-Flash-JANGTQ2
Text Generation
• 20B • Updated • 949
• 1
MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF
Text Generation
• 7B • Updated • 109k
• 139
Open4bits/DeepSeek-R1-mlx-2Bit
Text Generation
• 671B • Updated • 415
• 2
Ayushnangia/bloom3B-2bit-gptq
Text Generation
• Updated • 6
kaitchup/Llama-2-7b-gptq-2bit
Text Generation
• 7B • Updated • 11
• 1
nesty/sg-bart-large-4096-gptq-2bit
Arylwen/instruct-palmyra-20b-gptq-2
Text Generation
• Updated • 5
Text Generation
• 0.1B • Updated • 5
Sujan42024/dlite-v2-1_5b-2bitQuantization
Text Generation
• 2B • Updated • 2
kaitchup/Mistral-7B-v0.1-gptq-2bit
Text Generation
• 7B • Updated • 4
kaitchup/Llama-2-13b-hf-gptq-2bit
Text Generation
• 13B • Updated • 4
kaitchup/Llama-2-7b-hf-gptq-2bit
Text Generation
• 7B • Updated • 236
Text Generation
• 3B • Updated • 356
• 6
MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 1.04k
• 6
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 853
• 4
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF
Text Generation
• 7B • Updated • 862
• 5
MaziyarPanahi/NeuralPipe-7B-slerp-GGUF
Text Generation
• 7B • Updated • 231
• 3
MaziyarPanahi/NeuralPipe-7B-slerp-v0.2-GGUF
Text Generation
• 7B • Updated • 214
• 2
MaziyarPanahi/Mistral-7B-Instruct-v0.1-16k-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 104
• 2