Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

184

Base only

Active filters: 12b

roleplaiapp/Slush-Sunfall-Rocinante-GGLD-12B-Q6_K-GGUF

Text Generation • 12B • Updated Jan 31, 2025 • 13

roleplaiapp/Slush-Sunfall-Rocinante-GGLD-12B-Q8_0-GGUF

Text Generation • 12B • Updated Jan 31, 2025 • 12

roleplaiapp/Slush-Sunfall-Rocinante-GGLD-12B-Q3_K_L-GGUF

Text Generation • 12B • Updated Jan 31, 2025 • 14

roleplaiapp/Slush-Sunfall-Rocinante-GGLD-12B-Q3_K_M-GGUF

Text Generation • 12B • Updated Jan 31, 2025 • 9

roleplaiapp/Slush-Sunfall-Rocinante-GGLD-12B-Q3_K_S-GGUF

Text Generation • 12B • Updated Jan 31, 2025 • 5

roleplaiapp/Slush-Sunfall-Rocinante-GGLD-12B-Q4_K_M-GGUF

Text Generation • 12B • Updated Jan 31, 2025 • 24

roleplaiapp/Slush-Sunfall-Rocinante-GGLD-12B-Q4_K_S-GGUF

Text Generation • 12B • Updated Jan 31, 2025 • 20

roleplaiapp/Slush-Sunfall-Rocinante-GGLD-12B-Q5_K_M-GGUF

Text Generation • 12B • Updated Jan 31, 2025 • 8

roleplaiapp/Slush-Sunfall-Rocinante-GGLD-12B-Q5_K_S-GGUF

Text Generation • 12B • Updated Jan 31, 2025 • 18

roleplaiapp/Slush-Sunfall-Rocinante-GGLD-12B-IQ4_XS-GGUF

Text Generation • 12B • Updated Jan 31, 2025 • 9

roleplaiapp/saiga_nemo_12b_gguf-Q2_K-GGUF

Text Generation • 12B • Updated Feb 2, 2025 • 2

roleplaiapp/saiga_nemo_12b_gguf-Q6_K-GGUF

Text Generation • 12B • Updated Feb 2, 2025 • 9

roleplaiapp/saiga_nemo_12b_gguf-Q8_0-GGUF

Text Generation • 12B • Updated Feb 2, 2025 • 10

roleplaiapp/saiga_nemo_12b_gguf-Q3_K_M-GGUF

Text Generation • 12B • Updated Feb 2, 2025 • 9

roleplaiapp/saiga_nemo_12b_gguf-Q3_K_S-GGUF

Text Generation • 12B • Updated Feb 2, 2025 • 4

roleplaiapp/saiga_nemo_12b_gguf-Q4_K_M-GGUF

Text Generation • 12B • Updated Feb 2, 2025 • 56

roleplaiapp/saiga_nemo_12b_gguf-Q4_K_S-GGUF

Text Generation • 12B • Updated Feb 2, 2025 • 2

roleplaiapp/saiga_nemo_12b_gguf-Q5_K_M-GGUF

Text Generation • 12B • Updated Feb 2, 2025 • 4

roleplaiapp/saiga_nemo_12b_gguf-Q5_K_S-GGUF

Text Generation • 12B • Updated Feb 2, 2025 • 2

BernTheCreator/GodSlayer-12B-ABYSS-Q4_0-GGUF

12B • Updated Feb 3, 2025 • 13 • 2

mradermacher/wuriaee-12B-schizostock-i1-GGUF

12B • Updated Feb 8, 2025 • 437 • 1

mradermacher/matricide-12B-Unslop-Unleashed-GGUF

12B • Updated Jul 11, 2025 • 10 • 1

tensorblock/redrix_patricide-12B-Unslop-Mell-GGUF

12B • Updated Jan 27 • 36

klusai/tf2-12b-gguf

Text Generation • 12B • Updated Aug 20, 2025 • 22

klusai/tf2-12b-w8a8

Text Generation • 12B • Updated Aug 20, 2025 • 5

DeathGodlike/Kitsune-Symphony-V0.0-12B_EXL3

Text Generation • Updated Aug 13, 2025 • 2 • 1

hobaratio/AbominationScience-12B-v4-mlx-4Bit

Text Generation • 12B • Updated Aug 24, 2025 • 2

thelamapi/next-12b

Image-Text-to-Text • 12B • Updated Mar 1 • 122 • • 15

Lamapi/next-12b-Q4_K_M-GGUF

Image-Text-to-Text • 12B • Updated Oct 30, 2025 • 707 • 2

Lamapi/next-12b-Q2_K-GGUF

Image-Text-to-Text • 12B • Updated Oct 30, 2025 • 37 • 2