Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,119

Base only

Active filters: language

jncraton/granite-embedding-107m-multilingual-ct2-int8

Sentence Similarity • Updated Dec 18, 2024 • 13

ticlazau/granite-3.1-8b-instruct-GGUF

Text Generation • 8B • Updated Dec 19, 2024 • 21

QuantFactory/granite-3.1-2b-base-GGUF

3B • Updated Dec 19, 2024 • 497 • 3

QuantFactory/granite-3.1-2b-instruct-GGUF

Text Generation • 3B • Updated Dec 19, 2024 • 3.77k • 4

QuantFactory/granite-3.1-3b-a800m-base-GGUF

Text Generation • 3B • Updated Dec 19, 2024 • 221 • 3

QuantFactory/granite-3.1-3b-a800m-instruct-GGUF

Text Generation • 3B • Updated Dec 19, 2024 • 194 • 7

QuantFactory/granite-3.1-1b-a400m-instruct-GGUF

Text Generation • 1B • Updated Dec 19, 2024 • 535 • 4

QuantFactory/granite-3.1-1b-a400m-base-GGUF

Text Generation • 1B • Updated Dec 19, 2024 • 565 • 6

QuantFactory/granite-3.1-8b-instruct-GGUF

Text Generation • 8B • Updated Dec 19, 2024 • 717 • 7

mradermacher/granite-3.1-1b-a400m-base-GGUF

1B • Updated Dec 21, 2024 • 191

mradermacher/granite-3.1-1b-a400m-instruct-GGUF

1B • Updated Dec 21, 2024 • 306

mradermacher/granite-3.1-2b-base-GGUF

3B • Updated Dec 21, 2024 • 156

mradermacher/granite-3.1-2b-instruct-GGUF

3B • Updated Dec 20, 2024 • 333

mradermacher/granite-3.1-8b-base-GGUF

8B • Updated Dec 20, 2024 • 149

mradermacher/granite-3.1-8b-instruct-GGUF

8B • Updated Dec 20, 2024 • 172 • 1

mradermacher/granite-3.1-1b-a400m-base-i1-GGUF

1B • Updated Dec 21, 2024 • 240

mradermacher/granite-3.1-8b-instruct-i1-GGUF

8B • Updated Feb 13, 2025 • 306 • 2

mradermacher/granite-3.1-1b-a400m-instruct-i1-GGUF

1B • Updated Dec 21, 2024 • 508 • 3

mradermacher/granite-3.1-2b-instruct-i1-GGUF

3B • Updated Dec 20, 2024 • 502

mradermacher/granite-3.1-2b-base-i1-GGUF

3B • Updated Dec 21, 2024 • 177

QuantFactory/granite-3.1-8b-base-GGUF

8B • Updated Dec 20, 2024 • 77 • 3

mradermacher/granite-3.1-8b-base-i1-GGUF

8B • Updated Dec 20, 2024 • 199

skarmani/granite-3.1-2b-instruct-Q5_K_M-GGUF

Text Generation • 3B • Updated Dec 21, 2024 • 1

mradermacher/granite-3.1-8b-instruct-abliterated-GGUF

8B • Updated Dec 21, 2024 • 224 • 3

mradermacher/granite-3.1-2b-instruct-abliterated-GGUF

3B • Updated Dec 21, 2024 • 126

mradermacher/granite-3.1-2b-instruct-abliterated-i1-GGUF

3B • Updated Dec 21, 2024 • 491 • 1

mradermacher/granite-3.1-8b-instruct-abliterated-i1-GGUF

8B • Updated Dec 21, 2024 • 42 • 5

CreativeAlloyYT/FrenchLlama-3.2-1B-Instruct-GGUF

Text Generation • 1B • Updated Apr 1, 2025 • 193 • 1

bartowski/granite-3.1-1b-a400m-instruct-GGUF

Text Generation • 1B • Updated Dec 23, 2024 • 1.53k • 2

itlwas/granite-3.1-2b-instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Dec 23, 2024 • 15