Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,118

Base only

Active filters: language

davelsphere/granite-3.0-2b-instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Oct 21, 2024 • 14

davelsphere/granite-3.0-1b-a400m-instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Oct 21, 2024 • 42 • 1

Fluf22/fashion-clip-inference

Zero-Shot Image Classification • 0.2B • Updated Oct 21, 2024 • 9 • 1

davelsphere/granite-3.0-8b-base-Q4_K_M-GGUF

Text Generation • 8B • Updated Oct 21, 2024 • 9

davelsphere/granite-3.0-2b-base-Q4_K_M-GGUF

Text Generation • 3B • Updated Oct 21, 2024 • 12

davelsphere/granite-3.0-3b-a800m-base-Q4_K_M-GGUF

Text Generation • 3B • Updated Oct 21, 2024 • 15

davelsphere/granite-3.0-1b-a400m-base-Q4_K_M-GGUF

Text Generation • 1B • Updated Oct 21, 2024 • 12

davelsphere/granite-3.0-3b-a800m-instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Oct 21, 2024 • 25

bartowski/granite-3.0-8b-instruct-GGUF

Text Generation • 8B • Updated Oct 21, 2024 • 1.04k • 12

lmstudio-community/granite-3.0-8b-instruct-GGUF

Text Generation • 8B • Updated Oct 21, 2024 • 151 • 1

bartowski/granite-3.0-2b-instruct-GGUF

Text Generation • 3B • Updated Oct 21, 2024 • 1.67k • 5

lmstudio-community/granite-3.0-2b-instruct-GGUF

Text Generation • 3B • Updated Oct 21, 2024 • 218 • 1

bartowski/granite-3.0-1b-a400m-instruct-GGUF

Text Generation • 1B • Updated Oct 21, 2024 • 1.07k • 6

lmstudio-community/granite-3.0-1b-a400m-instruct-GGUF

Text Generation • 1B • Updated Oct 21, 2024 • 191

bartowski/granite-3.0-3b-a800m-instruct-GGUF

Text Generation • 3B • Updated Oct 21, 2024 • 1.1k • 3

lmstudio-community/granite-3.0-3b-a800m-instruct-GGUF

Text Generation • 3B • Updated Oct 21, 2024 • 352 • 1

MCZK/granite-3.0-2b-instruct-GGUF

Text Generation • 3B • Updated Oct 21, 2024 • 188

QuantFactory/granite-3.0-1b-a400m-instruct-GGUF

Text Generation • 1B • Updated Oct 23, 2024 • 548 • 4

aashish1904/granite-3.0-8b-instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Oct 21, 2024 • 12 • 1

aashish1904/granite-3.0-8b-instruct-Q2_K-GGUF

Text Generation • 8B • Updated Oct 21, 2024 • 12 • 1

aashish1904/granite-3.0-8b-instruct-Q8_0-GGUF

Text Generation • 8B • Updated Oct 21, 2024 • 30 • 1

aashish1904/granite-3.0-2b-instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Oct 21, 2024 • 27 • 1

NikolayKozloff/granite-3.0-8b-instruct-Q8_0-GGUF

Text Generation • 8B • Updated Oct 21, 2024 • 12 • 1

QuantFactory/granite-3.0-8b-instruct-GGUF

Text Generation • 8B • Updated Oct 21, 2024 • 149 • 2

aashish1904/granite-3.0-2b-instruct-Q2_K-GGUF

Text Generation • 3B • Updated Oct 21, 2024 • 9 • 1

aashish1904/granite-3.0-2b-instruct-Q8_0-GGUF

Text Generation • 3B • Updated Oct 21, 2024 • 23 • 1

QuantFactory/granite-3.0-1b-a400m-base-GGUF

Text Generation • 1B • Updated Oct 21, 2024 • 210 • 4

QuantFactory/granite-3.0-2b-base-GGUF

Text Generation • 3B • Updated Oct 21, 2024 • 149 • 2

MCZK/granite-3.0-3b-a800m-instruct-GGUF

Text Generation • 3B • Updated Oct 21, 2024 • 97

QuantFactory/granite-3.0-3b-a800m-base-GGUF

Text Generation • 3B • Updated Oct 21, 2024 • 442 • 2