Models

ModelCloud/QwQ-32B-gptqmodel-4bit-vortex-v1

Text Generation • 33B • Updated Mar 9, 2025 • 8 • 11

tensorblock/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-GGUF

Updated 10 days ago • 94

FunAGI/LLaDA-8B-Base-gptqmodel-4bit

Text Generation • 8B • Updated Mar 15, 2025 • 2 • 1

rpanchum/jais-13b-int4-sym-ov

Text Generation • Updated Mar 10, 2025 • 5

rpanchum/falcon3-7b-instruct-int4-sym-ov

Text Generation • Updated Mar 10, 2025

ISTA-DASLab/gemma-3-27b-it-GPTQ-4b-128g

Image-Text-to-Text • 5B • Updated Mar 20, 2025 • 23.2k • 43

FunAGI/LLaDA-8B-Instruct-gptqmodel-4bit

Text Generation • Updated Mar 15, 2025 • 3 • 4

ISTA-DASLab/Mistral-Small-3.1-24B-Instruct-2503-GPTQ-4b-128g

Image-Text-to-Text • 5B • Updated Apr 6, 2025 • 280 • 17

FunAGI/Qwen2.5-Omni-7B-GPTQ-4bit

Any-to-Any • 11B • Updated Mar 28, 2025 • 199 • 55

RedHatAI/whisper-large-v3-quantized.w4a16

Automatic Speech Recognition • 0.3B • Updated Apr 22, 2025 • 633 • 3

RedHatAI/whisper-large-v2-quantized.w4a16

Automatic Speech Recognition • 0.3B • Updated Apr 22, 2025 • 19 • 1

RedHatAI/whisper-large-v3-turbo-quantized.w4a16

Automatic Speech Recognition • 0.2B • Updated 14 days ago • 544 • 7

RedHatAI/whisper-medium-quantized.w4a16

Automatic Speech Recognition • 0.2B • Updated Apr 22, 2025 • 29

RedHatAI/whisper-small-quantized.w4a16

Automatic Speech Recognition • 77M • Updated Apr 22, 2025 • 18 • 1

ISTA-DASLab/gemma-3-4b-it-GPTQ-4b-128g

Image-Text-to-Text • 2B • Updated Apr 13, 2025 • 670 • 7

ISTA-DASLab/gemma-3-12b-it-GPTQ-4b-128g

Image-Text-to-Text • 3B • Updated Apr 13, 2025 • 2.07k • 6

RedHatAI/Qwen2.5-7B-Instruct-quantized.w4a16

Text Generation • 2B • Updated Sep 22, 2025 • 39

prashantarya/orpheus-tts-shaurya-4bit-new

Text Generation • Updated May 2, 2025 • 2

CarlOwOs/Qwen3-0.6B-Base-int4

Text Generation • 0.5B • Updated Jun 5, 2025 • 1

nikodoz/qwen2.5-7b-instruct-int4

Text Generation • 8B • Updated Jun 10, 2025 • 3 • 1

Prince-1/Veena-Onnx-Int4

Text-to-Speech • Updated Jun 26, 2025

liuming9157/Wan2.1-T2V-1.3B-Diffusers-ov-int4

Text-to-Video • Updated Jul 11, 2025

cuongpp/gemma-3-12b-it-GPTQ-4bit

Image-Text-to-Text • 3B • Updated Jul 16, 2025 • 331

dev-bjoern/smolvlm-int4-ov

Image-to-Text • Updated Aug 6, 2025 • 2

dev-bjoern/smollm3-int4-ov

Text Generation • Updated Aug 6, 2025 • 1

RedHatAI/SmolLM3-3B-quantized.w4a16

0.9B • Updated Jul 31, 2025 • 22 • 1

RedHatAI/gemma-3n-E4B-it-quantized.w4a16

Image-to-Text • 4B • Updated Aug 1, 2025 • 12

RedHatAI/gemma-3n-E2B-it-quantized.w4a16

Image-to-Text • 4B • Updated Aug 1, 2025 • 15 • 1

Ju214/Mistral-Small-24B-3.1

Image-Text-to-Text • 5B • Updated Aug 7, 2025 • 5

2imi9/Qwen3-1.7b-gptq-int4

Text Generation • 0.9B • Updated Sep 12, 2025 • 44