Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,143

Base only

Active filters: gptq

TheBloke/GPT4All-13B-snoozy-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 86 • 31

TheBloke/gpt4-x-vicuna-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 83 • 34

pszemraj/stablelm-7b-sft-v7e3-autogptq-4bit-128g

Text Generation • Updated Dec 29, 2025 • 19 • 3

ethzanalytics/stablelm-tuned-alpha-3b-gptq-4bit-128g

Text Generation • Updated May 7, 2023 • 25

TheBloke/h2ogpt-oasst1-512-30B-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 15 • 5

TheBloke/dromedary-65B-lora-GPTQ

Text Generation • 65B • Updated Aug 21, 2023 • 18 • 6

TheBloke/gpt4-alpaca-lora_mlp-65B-GPTQ

Text Generation • 65B • Updated Aug 21, 2023 • 92 • 14

TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 234 • 319

TheBloke/wizard-mega-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 95 • 108

TheBloke/VicUnlocked-30B-LoRA-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 102 • 20

TheBloke/Wizard-Vicuna-7B-Uncensored-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 455 • 164

TheBloke/Manticore-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 84 • 37

qwopqwop/KoAlpaca-Polyglot-5.8B-GPTQ

Text Generation • Updated May 19, 2023 • 21 • 3

qwopqwop/KoAlpaca-Polyglot-12.8B-GPTQ

Text Generation • Updated May 19, 2023 • 22 • 5

TheBloke/WizardLM-30B-Uncensored-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 145 • 118

digitous/13B-Chimera

Text Generation • Updated May 24, 2023 • 69 • 6

TheBloke/airoboros-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 89 • 13

TheBloke/manticore-13b-chat-pyg-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 100 • 33

TheBloke/Project-Baize-v2-7B-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 137 • 4

TheBloke/Project-Baize-v2-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 119 • 11

digitous/13B-HyperMantis_GPTQ_4bit-128g

Text Generation • Updated May 24, 2023 • 38 • 12

TheBloke/guanaco-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 94 • 29

TheBloke/guanaco-33B-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 137 • 74

TheBloke/guanaco-65B-GPTQ

Text Generation • 65B • Updated Sep 27, 2023 • 333 • 262

TheBloke/guanaco-7B-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 106 • 28

TheBloke/Vigogne-Instruct-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 17 • 2

elinas/chronos-13b-4bit

Text Generation • Updated Jun 23, 2023 • 43 • 23

TheBloke/Falcon-7B-Instruct-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 82 • 68

TheBloke/falcon-40b-instruct-GPTQ

Text Generation • 42B • Updated Aug 21, 2023 • 177 • 197

TheBloke/WizardLM-13B-1.0-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 81 • 21