Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

112

Base only

Active filters: granite-3.3

ibm-granite/granite-3.3-8b-instruct

Text Generation • 8B • Updated May 12, 2025 • 73.5k • 157

ibm-granite/granite-3.3-2b-base

Text Generation • 3B • Updated May 8, 2025 • 1.53k • 22

ibm-granite/granite-3.3-2b-instruct

Text Generation • 3B • Updated May 8, 2025 • 28.2k • 85

ibm-granite/granite-3.3-8b-base

Text Generation • 8B • Updated May 8, 2025 • 3.74k • 27

ibm-granite/granite-3.3-2b-instruct-GGUF

Text Generation • 3B • Updated Apr 16, 2025 • 595 • 14

ibm-granite/granite-3.3-8b-instruct-GGUF

Text Generation • 8B • Updated Apr 16, 2025 • 1.21k • 36

mlx-community/granite-3.3-8b-instruct-fp16

Text Generation • Updated Apr 16, 2025 • 76 • 3

mlx-community/granite-3.3-8b-instruct-8bit

Text Generation • Updated Apr 16, 2025 • 44 • 2

mlx-community/granite-3.3-8b-instruct-6bit

Text Generation • Updated Apr 16, 2025 • 9 • 1

LogicBombaklot/granite-3.3-8b-instruct-mlx-8Bit

Text Generation • 2B • Updated Apr 16, 2025 • 4

mlx-community/granite-3.3-8b-instruct-4bit

Text Generation • Updated Apr 16, 2025 • 142 • 1

mlx-community/granite-3.3-2b-instruct-fp16

Text Generation • Updated Apr 16, 2025 • 31 • 1

mlx-community/granite-3.3-2b-instruct-8bit

Text Generation • Updated Apr 16, 2025 • 63

mlx-community/granite-3.3-2b-instruct-6bit

Text Generation • Updated Apr 16, 2025 • 9

mlx-community/granite-3.3-2b-instruct-4bit

Text Generation • Updated Apr 16, 2025 • 1.04k • 1

NikolayKozloff/granite-3.3-8b-instruct-Q8_0-GGUF

Text Generation • 8B • Updated Apr 16, 2025 • 2 • 2

NikolayKozloff/granite-3.3-2b-instruct-Q8_0-GGUF

Text Generation • 3B • Updated Apr 16, 2025 • 6 • 1

stelterlab/granite-3.3-8b-instruct-FP8-Dynamic

Text Generation • 8B • Updated Apr 16, 2025 • 3

cgus/granite-3.3-8b-instruct-exl2

Text Generation • Updated Apr 16, 2025 • 5

mradermacher/granite-3.3-2b-instruct-GGUF

3B • Updated Jul 11, 2025 • 82 • 2

mradermacher/granite-3.3-2b-base-GGUF

3B • Updated Jul 11, 2025 • 63

mradermacher/granite-3.3-8b-base-GGUF

8B • Updated Jul 11, 2025 • 42 • 2

mradermacher/granite-3.3-2b-base-i1-GGUF

3B • Updated Jul 11, 2025 • 111

mradermacher/granite-3.3-8b-instruct-GGUF

8B • Updated Jul 11, 2025 • 54

mradermacher/granite-3.3-2b-instruct-i1-GGUF

3B • Updated Jul 11, 2025 • 138 • 2

mradermacher/granite-3.3-8b-base-i1-GGUF

8B • Updated Jul 11, 2025 • 132

mradermacher/granite-3.3-8b-instruct-i1-GGUF

8B • Updated Jul 11, 2025 • 162

pankaj217/granite-3.3-8b-instruct-Q8_0-GGUF

Text Generation • 8B • Updated Apr 17, 2025 • 3

bartowski/ibm-granite_granite-3.3-8b-instruct-GGUF

Text Generation • 8B • Updated Apr 17, 2025 • 1.56k • 3

lmstudio-community/granite-3.3-8b-instruct-GGUF

Text Generation • 8B • Updated Apr 17, 2025 • 83