Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

129

Base only

Active filters: llm-foundry

emozilla/mpt-7b-storywriter-fast

Text Generation • Updated Jun 8, 2023 • 19 • 11

TheBloke/mpt-30B-instruct-GGML

Updated Jun 23, 2023 • 5 • 43

TheBloke/mpt-30B-chat-GGML

Updated Jun 26, 2023 • 5 • 73

michaelfeil/ct2fast-mpt-30b-instruct

Text Generation • Updated Jun 28, 2023 • 9 • 4

TheBloke/mpt-30B-GGML

Updated Jun 23, 2023 • 7 • 17

michaelfeil/ct2fast-mpt-30b

Text Generation • Updated Jun 28, 2023 • 12 • 3

michaelfeil/ct2fast-mpt-30b-chat

Text Generation • Updated Jun 28, 2023 • 11 • 2

blackmount8/mpt-30b-instruct-ct2-int8_float16

Updated Jun 25, 2023 • 5

eluzhnica/mpt-30b-peft-compatible

Text Generation • Updated Jun 27, 2023 • 28 • 8

eluzhnica/mpt-30b-instruct-peft-compatible

Text Generation • Updated Jun 27, 2023 • 20 • 2

zhao-mm/mpt-30b-instruct-test

Text Generation • Updated Jun 29, 2023 • 6

Abzu/mpt-30b-instruct-q8

Text Generation • 30B • Updated Jul 6, 2023 • 20 • 5

TheBloke/mpt-7b-chat-GGML

Updated Jun 30, 2023 • 9

eluzhnica/mpt-7b-instruct-peft-compatible

Text Generation • Updated Jul 5, 2023 • 8

Abzu/mpt-7b-q8

Text Generation • 7B • Updated Jul 6, 2023 • 5 • 1

Abzu/mpt-7b-instruct-q8

Text Generation • 7B • Updated Jul 7, 2023 • 22 • 2

Abzu/mpt-7b-chat-q8

Text Generation • 7B • Updated Jul 7, 2023 • 4 • 1

Abzu/mpt-7b-storywriter-q8

Text Generation • 7B • Updated Jul 7, 2023 • 18 • 2

Abzu/mpt-30b-q8

Text Generation • 30B • Updated Jul 7, 2023 • 16 • 3

Abzu/mpt-30b-chat-q8

Text Generation • 30B • Updated Jul 7, 2023 • 19 • 1

DanielTTY/mpt-30b-qlora

Text Generation • Updated Jul 12, 2023 • 3

FarziBuilder/fastInferencetry4

Text Generation • Updated Jul 12, 2023 • 2

sl-alex/mosaicml-mpt-7b-chat-qlora

Text Generation • Updated May 30, 2023 • 6

blackmount8/mpt-7b-instruct-ct2-int8_float16

Updated Jul 15, 2023 • 4

eluzhnica/mpt-7b-8k-instruct-peft-compatible

Text Generation • Updated Jul 18, 2023 • 6 • 1

eluzhnica/mpt-7b-8k-peft-compatible

Text Generation • Updated Jul 18, 2023 • 20 • 3

jamesdborin/ct2-int8-mtb-7b

Text Generation • Updated Jul 18, 2023 • 6

jamesdborin/ct2-int8-mtb-7b-storywriter

Text Generation • Updated Jul 18, 2023 • 6

jamesdborin/ct2-int8-mtb-7b-chat

Text Generation • Updated Jul 18, 2023 • 6

jamesdborin/ct2-int8-mtb-7b-8k-instruct

Text Generation • Updated Jul 18, 2023 • 6