Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

156

Base only

Active filters: float16

OpenNMT/codet5p-770m-ct2-int8

Updated Nov 30, 2023 • 11 • 1

OpenNMT/nllb-200-distilled-1.3B-ct2-int8

Translation • Updated Nov 30, 2023 • 1.47k • 15

OpenNMT/phi-1_5-ct2-int8

Text Generation • Updated Nov 30, 2023 • 14 • 1

OpenNMT/phi-1-ct2-int8

Text Generation • Updated Nov 30, 2023 • 12

OpenNMT/Llama-2-7b-hf-ct2-int8

Text Generation • Updated Dec 1, 2023 • 9

OpenNMT/nllb-200-3.3B-ct2-int8

Translation • Updated Dec 1, 2023 • 1.15k • 5

OpenNMT/Llama-2-7b-chat-hf-ct2-int8

Text Generation • Updated Dec 1, 2023 • 16

avans06/ALMA-7B-ct2-int8_float16

Text Generation • Updated Dec 15, 2023 • 8

avans06/ALMA-13B-ct2-int8_float16

Text Generation • Updated Dec 15, 2023 • 7

avans06/madlad400-7b-mt-bt-ct2-int8_float16

Updated Dec 24, 2023 • 53 • 3

avans06/Meta-Llama-3-8B-Instruct-ct2-int8_float16

Text Generation • Updated Apr 25, 2024 • 11

nitsuai/ct2fast-all-MiniLM-L6-v2

Sentence Similarity • Updated Apr 26, 2024 • 12

nitsuai/ct2fast-paraphrase-multilingual-MiniLM-L12-v2

Sentence Similarity • Updated Apr 26, 2024 • 14

Weblet/Llama-2-7b-chat-hf-ct2-int8

Text Generation • Updated Apr 30, 2024 • 7

ctranslate2-4you/distil-whisper-large-v3-ct2-float16

Automatic Speech Recognition • Updated Feb 28 • 23

ctranslate2-4you/whisper-large-v3-ct2-float16

Automatic Speech Recognition • Updated Feb 28 • 41

ctranslate2-4you/distil-whisper-small.en-ct2-float16

Automatic Speech Recognition • Updated Feb 28 • 12

ctranslate2-4you/distil-whisper-medium.en-ct2-float16

Automatic Speech Recognition • Updated Feb 28 • 9

avans06/Meta-Llama-3.1-8B-Instruct-ct2-int8_float16

Text Generation • Updated Oct 10, 2024 • 11

avans06/Meta-Llama-3.2-8B-Instruct-ct2-int8_float16

Text Generation • Updated Oct 13, 2024 • 25

DavidAU/How-To-Use-Reasoning-Thinking-Models-and-Create-Them

Text Generation • Updated Jul 27, 2025 • 26

ctranslate2-4you/whisper-large-v3-turbo-ct2-float16

Automatic Speech Recognition • Updated Feb 28 • 31

DavidAU/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506

Text Generation • 46B • Updated Jun 29, 2025 • 86 • 8

mradermacher/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506-GGUF

45B • Updated Aug 1, 2025 • 164 • 3

wesjos/spark-tts-genshin-charactors

Text-to-Speech • Updated Jul 21, 2025 • 3

mradermacher/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506-i1-GGUF

45B • Updated Jul 11, 2025 • 235 • 3

wesjos/spark-tts-genshin-charactors-new

Text-to-Speech • Updated Apr 14

Dafisns/whisper-turbo-multilingual-cf-ct2

Automatic Speech Recognition • Updated Nov 30, 2025 • 26 • 1

Jonandrop/opus-mt-de-es-ct2-float16

Translation • Updated Jul 18 • 15

AlekseyCalvin/Lyrical_Llama31_8B_ru2en_bnb_4bit

Text Generation • 8B • Updated May 16 • 9