Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
Edit Models filters
Main
Tasks
Libraries
Languages
Licenses
Other
1
Model Tree
Base
Adapters
Finetunes
Quantizations
Merges
Apps
llama.cpp
LM Studio
Jan
Draw Things
DiffusionBee
JoyFusion
vLLM
Ollama
MLX LM
Docker Model Runner
Lemonade
SGLang
Unsloth Studio
Pi
Hermes Agent
Atomic Chat
OpenClaw
Inference Providers
Select all
Groq
Novita
Cerebras
Nscale
fal
Together AI
Fireworks
Featherless AI
Zai
Replicate
Cohere
Scaleway
Public AI
OVHcloud AI Endpoints
HF Inference API
DeepInfra
WaveSpeed
Misc
Reset Misc
tokenizers
Inference Endpoints
text-generation-inference
Eval Results (legacy)
text-embeddings-inference
custom_code
4-bit precision
Merge
8-bit precision
Mixture of Experts
Carbon Emissions
Eval Results
Apply filters
Models
184
Base only
Inference Available
Inference
Edit filters
Sort: Trending
Active filters:
tokenizers
Clear all
boffire/Kabyle-BPE-Tokenizer-v2
Text Generation
•
Updated
May 24
olaverse/otk-bpe-50k
Updated
May 28
JamesQuartz/qt-V.4.6-32k
Updated
May 26
BlackwoodAI/blackwood-0.7b-bpe49152-tokenizer
Feature Extraction
•
Updated
May 27
•
1
eljanmahammadli/turkic-tokenizers
Updated
May 28
Xerv-AI/CRAYON-tokenizer
Text Generation
•
Updated
Jun 19
•
2
AMFORGE/cofos_tok_v2
Updated
Jun 2
AMFORGE/cofos_general_tok
Updated
Jun 3
•
1
TilQazyna/Til-Tokenizer-128k
Updated
Jun 8
AMFORGE/samg_mm_tok
Updated
Jun 10
SceneWorks/kolors-chatglm3-tokenizer
Updated
Jun 11
boffire/gemma-2b-kabyle-tokenizer
Text Generation
•
Updated
Jun 12
mokataria/hindi-hinglish-bpe-tokenizer-v0.1-experimental
Feature Extraction
•
Updated
Jun 15
SceneWorks/qwen-image-tokenizer
Updated
about 1 month ago
ken-sungmin/propagator-tokenizer
Updated
29 days ago
Tralalabs/TralaBPE-32K-EnglishMix-v1
Updated
25 days ago
•
1
timothydillan/oim-script-equitable-regional-sp-bpe-32k-native-weighted-v0
Updated
23 days ago
timothydillan/oim-script-equitable-regional-sp-bpe-48k-native-weighted-v1
Updated
24 days ago
renaissancefieldlite/tris-tokenizers-json-regex-panic-poc
Updated
18 days ago
moche-ai/moche-tokenizer-ko-en-64k
Updated
9 days ago
miguelcsx/tolm-wordlevel-16k-tokenizer
Updated
13 days ago
JamesQuartz/qt-VI.1.3-32k
Updated
10 days ago
thoughtcast/wyrd42-tokenizer
Updated
9 days ago
PRAIG/smb-staff-abc-bpe
Updated
7 days ago
Uunan/turkish-bpe-tokenizer
Updated
6 days ago
qikp/pika-5
Updated
4 days ago
bilalabic/my-tokenizer-turkish
Updated
3 days ago
namruni/meb-ogretmen-tokenizer
Updated
1 day ago
namruni/bpe-deneyleri-tr
Updated
1 day ago
gorkemergune/my-tokenizer
Text Generation
•
Updated
1 day ago
Previous
1
...
4
5
6
7
Next