Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

16

Base only

Active filters: mainframe

taronaeo/Granite-3.0-1B-A400M-Instruct-BE-GGUF

Text Generation • 1B • Updated Apr 2, 2025 • 263 • 1

taronaeo/Qwen2.5-1.5B-Instruct-BE-GGUF

Text Generation • 2B • Updated May 3, 2025 • 200

taronaeo/Qwen2.5-3B-Instruct-BE-GGUF

Text Generation • 3B • Updated May 4, 2025 • 443

taronaeo/Qwen2.5-7B-Instruct-BE-GGUF

Text Generation • 8B • Updated May 4, 2025 • 283

taronaeo/Granite-3.1-2B-Instruct-BE-GGUF

Text Generation • 3B • Updated Jul 9, 2025 • 60

taronaeo/Granite-3.3-2B-Instruct-BE-GGUF

Text Generation • 3B • Updated Jul 9, 2025 • 235

taronaeo/Llama-3.2-1B-Instruct-BE-GGUF

Text Generation • 1B • Updated Jul 9, 2025 • 373

taronaeo/Llama-3.2-3B-Instruct-BE-GGUF

Text Generation • 3B • Updated Jul 9, 2025 • 154

taronaeo/DeepSeek-R1-Distill-Llama-8B-BE-GGUF

8B • Updated Jul 12, 2025 • 173 • 1

taronaeo/DeepSeek-R1-0528-Qwen3-8B-BE-GGUF

8B • Updated Jul 26, 2025 • 32

taronaeo/all-MiniLM-L6-v2-BE

Sentence Similarity • 22.6M • Updated Aug 1, 2025 • 109

FLs-AI/FL-1.1-9B

9B • Updated 17 days ago • 161

FLs-AI/FL-12B-MoE-2

Text Generation • 12B • Updated 15 days ago • 77

FLs-AI/FL-7B-3

Text Generation • 8B • Updated 11 days ago • 84

FLs-AI/FL-7B-3.1

Text Generation • 8B • Updated 11 days ago • 133

FLs-AI/FL-9B-4

Text Generation • 9B • Updated 4 days ago • 160