Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

368

Base only

Active filters: local-ai

Youssofal/Qwen3.6-27B-MTPLX-Optimized-Speed

Text Generation • 5B • Updated 16 days ago • 33.7k • 48

aiplatforms/mistral-24b-ru-uncensored-gguf

Text Generation • 24B • Updated May 7 • 850 • 6

mradermacher/Meta-Llama-3.1-8B-Instruct_CODE_Python_English_Asistant-16bit-v2-i1-GGUF

Text Generation • 8B • Updated 1 day ago • 422 • 3

maytman12/s2s-complete-setup

Automatic Speech Recognition • Updated Apr 28 • 41 • 1

Youssofal/Qwen3.5-9B-MTPLX-Optimized-Speed

Text Generation • 9B • Updated 11 days ago • 1.11k • 1

ddalcu/Qwen3.6-27B-4bit-MTP-MLX-Serve

Text Generation • 5B • Updated 12 days ago • 401 • 1

UlukaDev/uluka-studio-mercury-mini-8b-q5-k-m

Text Generation • 8B • Updated 4 days ago • 11 • 1

Agnuxo/Mistral-NeMo-Minitron-8B-Base-Nebula

Text Generation • Updated May 10

Agnuxo/Mistral-NeMo-Minitron-8B-Base-Nebulal

Text Generation • Updated May 10 • 8

Agnuxo/Mistral-NeMo-Minitron-8B-Base-CODE-Python

Text Generation • Updated May 10 • 9

mradermacher/Mistral-NeMo-Minitron-8B-Base-Nebulal-GGUF

Text Generation • 8B • Updated 10 days ago • 658

Agnuxo/Mistral-NeMo-Minitron-8B-Alpaca-CODE-Python-GGUF-8bit

Text Generation • 8B • Updated May 10 • 269

Agnuxo/Mistral-NeMo-Minitron-8B-Alpaca-CODE-Python-GGUF-16bit

Text Generation • 8B • Updated May 10 • 247

Agnuxo/Meta-Llama-3.1-8B-CODE-Python-4bit

Text Generation • Updated May 10

Agnuxo/Meta-Llama-3.1-8B-CODE-Python-16bit

Text Generation • Updated May 10 • 16 • 1

Agnuxo/Meta-Llama-3.1-8B-CODE-Alpaca-Python-8bit-GGUF

Text Generation • 8B • Updated May 10 • 248

Agnuxo/Meta-Llama-3.1-8B-CODE-Python-Alpaca-Lora

Text Generation • Updated May 10

Agnuxo/Phi-3.5-mini-instruct-lora_model

Text Generation • Updated May 10

Agnuxo/Phi-3.5-mini-instruct-python_coding_assistant_16bit

Text Generation • 4B • Updated May 10 • 26

Agnuxo/Phi-3.5-mini-instruct-python_coding_assistant-GGUF_8bit

Text Generation • 4B • Updated May 10 • 310

Agnuxo/Phi-3.5-mini-instruct-python_coding_assistant-GGUF_16bit

Text Generation • 4B • Updated May 10 • 1.16k • 3

Agnuxo/Phi-3.5-mini-instruct-python_coding_assistant-GGUF_4bit

Text Generation • 4B • Updated May 10 • 1.77k

Agnuxo/Mamba-Codestral-7B-v0.1-python_coding_assistant_16bit

Text Generation • 7B • Updated May 10 • 26

Agnuxo/Mamba-Codestral-7B-v0.1-lora_model

Text Generation • Updated May 10

Agnuxo/Mamba-Codestral-7B-v0.1-python_coding_assistant-GGUF_8bit

Text Generation • 7B • Updated May 10 • 445 • 1

Agnuxo/Mamba-Codestral-7B-v0.1-instruct-python_coding_assistant-GGUF_16bit

Text Generation • 7B • Updated May 10 • 440

Agnuxo/Mamba-Codestral-7B-v0.1-instruct-python_coding_assistant-GGUF_4bit

Text Generation • 7B • Updated May 10 • 2.03k • 4

Agnuxo/gemma-2-2b-lora_model

Text Generation • Updated May 10

Agnuxo/gemma-2-2b-Python_CODE_assistant_16bit

Text Generation • 3B • Updated May 10 • 3

Agnuxo/gemma-2-2b-Python_CODE_assistant-GGUF_8bit

Text Generation • 3B • Updated May 10 • 79