Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

110

Full-text search

Active filters: ibm

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoround-int8-gs64-asym

Text Generation • 0.8B • Updated Apr 23, 2025 • 1

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoround-int8-gs64-sym

Text Generation • 0.8B • Updated Apr 23, 2025 • 1

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autogptq-int8-gs64-asym

Text Generation • 3B • Updated Apr 23, 2025

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autogptq-int8-gs64-sym

Text Generation • 3B • Updated Apr 23, 2025 • 1

fbaldassarri/ibm-granite_granite-3.3-2b-base-autoround-int8-gs64-asym

Text Generation • 0.8B • Updated Apr 23, 2025 • 1

fbaldassarri/ibm-granite_granite-3.3-2b-base-autoround-int8-gs64-sym

Text Generation • 0.8B • Updated Apr 23, 2025

fbaldassarri/ibm-granite_granite-3.3-2b-base-autogptq-int8-gs64-asym

Text Generation • 3B • Updated Apr 23, 2025 • 1

fbaldassarri/ibm-granite_granite-3.3-2b-base-autogptq-int8-gs64-sym

Text Generation • 3B • Updated Apr 23, 2025

Mungert/granite-7b-instruct-GGUF

Text Generation • 7B • Updated Sep 24, 2025 • 162

mlx-community/granite-4.0-h-tiny-3bit-MLX

Text Generation • 0.9B • Updated Oct 3, 2025 • 97 • 2

mlx-community/granite-4.0-h-tiny-6bit-MLX

Text Generation • Updated Oct 3, 2025 • 59

mlx-community/granite-4.0-h-tiny-5bit-MLX

Text Generation • Updated Oct 3, 2025 • 18 • 2

xJoePec/galena-2b-math-physics

Text Generation • 3B • Updated Nov 18, 2025 • 16 • 1

TevunahAi/granite-8b-code-instruct-4k-FP8

Text Generation • 8B • Updated Dec 8, 2025 • 1

TevunahAi/granite-20b-code-instruct-8k-FP8

Text Generation • 20B • Updated Dec 8, 2025

TevunahAi/granite-34b-code-instruct-8k-FP8

Text Generation • 34B • Updated Dec 8, 2025 • 10

TevunahAi/granite-8b-code-instruct-4k-2048-Calibration-FP8

Text Generation • 8B • Updated Dec 8, 2025 • 2

TevunahAi/granite-20b-code-instruct-8k-2048-Calibration-FP8

Text Generation • 20B • Updated Dec 8, 2025 • 1

TevunahAi/Granite-34B-Code-Instruct-8k-2048-Calibration-FP8

Text Generation • 34B • Updated Dec 8, 2025 • 9

TevunahAi/Granite-3.3-8B-Instruct-GPTQ

Text Generation • 8B • Updated Jan 4 • 60