Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

111

Base only

Active filters: granite-3.3

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autogptq-int4-gs64-asym

Text Generation • 3B • Updated Apr 22, 2025 • 6

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autogptq-int4-gs64-sym

Text Generation • 3B • Updated Apr 22, 2025 • 3

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoawq-int4-gs64-asym

Text Generation • 3B • Updated Apr 22, 2025 • 2

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoawq-int4-gs64-sym

Text Generation • 3B • Updated Apr 22, 2025 • 3

fbaldassarri/ibm-granite_granite-3.3-2b-base-autoround-int4-gs64-asym

Text Generation • 0.4B • Updated Apr 22, 2025 • 2

fbaldassarri/ibm-granite_granite-3.3-2b-base-autoround-int4-gs64-sym

Text Generation • 0.4B • Updated Apr 22, 2025 • 2

fbaldassarri/ibm-granite_granite-3.3-2b-base-autogptq-int4-gs64-asym

Text Generation • 3B • Updated Apr 22, 2025 • 2

fbaldassarri/ibm-granite_granite-3.3-2b-base-autogptq-int4-gs64-sym

Text Generation • 3B • Updated Apr 22, 2025 • 2

fbaldassarri/ibm-granite_granite-3.3-2b-base-autoawq-int4-gs64-asym

Text Generation • 3B • Updated Apr 22, 2025 • 3

fbaldassarri/ibm-granite_granite-3.3-2b-base-autoawq-int4-gs64-sym

Text Generation • 3B • Updated Apr 22, 2025 • 2

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoround-int8-gs64-asym

Text Generation • 0.8B • Updated Apr 23, 2025 • 4

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoround-int8-gs64-sym

Text Generation • 0.8B • Updated Apr 23, 2025 • 4

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autogptq-int8-gs64-asym

Text Generation • 3B • Updated Apr 23, 2025 • 4

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autogptq-int8-gs64-sym

Text Generation • 3B • Updated Apr 23, 2025 • 3

fbaldassarri/ibm-granite_granite-3.3-2b-base-autoround-int8-gs64-asym

Text Generation • 0.8B • Updated Apr 23, 2025 • 4

fbaldassarri/ibm-granite_granite-3.3-2b-base-autoround-int8-gs64-sym

Text Generation • 0.8B • Updated Apr 23, 2025 • 4

fbaldassarri/ibm-granite_granite-3.3-2b-base-autogptq-int8-gs64-asym

Text Generation • 3B • Updated Apr 23, 2025 • 4

fbaldassarri/ibm-granite_granite-3.3-2b-base-autogptq-int8-gs64-sym

Text Generation • 3B • Updated Apr 23, 2025 • 4

Fmuaddib/granite-3.3-8b-instruct-mlx-8Bit

Text Generation • 2B • Updated Apr 25, 2025 • 3

Fmuaddib/granite-3.3-8b-instruct-mlx-fp16

Text Generation • 8B • Updated Apr 25, 2025 • 4

lawrencenull/granite-3.3-8b-instruct-Q2_K-GGUF

Text Generation • 8B • Updated Apr 26, 2025 • 5

tensorblock/ibm-granite_granite-3.3-2b-instruct-GGUF

Text Generation • 3B • Updated Jan 27 • 4

KushGupster/granite-3.3-2b-base-Q4_K_M-GGUF

3B • Updated Apr 27, 2025 • 1

ibm-granite/granite-3.3-2b-base-GGUF

Text Generation • 3B • Updated May 2, 2025 • 244 • 2

ibm-granite/granite-3.3-8b-base-GGUF

Text Generation • 8B • Updated May 2, 2025 • 242 • 1

unsloth/granite-3.3-8b-instruct-GGUF

Text Generation • 8B • Updated May 10, 2025 • 670 • 7

sizzlebop/granite-3.3-2b-instruct-Q8_0-GGUF

Text Generation • 3B • Updated Jun 1, 2025 • 2

sizzlebop/granite-3.3-2b-instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Jun 1, 2025 • 2

Prince-1/Granite-3.3-8B-Instruct-Onnx

Text Generation • Updated Jun 22, 2025

Prince-1/Granite-3.3-2B-Instruct-Onnx

Text Generation • Updated Jun 22, 2025