ggunio
/

B2NL-IntelligentTokenizer-v6.2.1

semantic-boundaries

Eval Results (legacy)

Model card Files Files and versions

B2NL-IntelligentTokenizer-v6.2.1

1.84 GB

Ctrl+K

Ctrl+K

1 contributor

History: 12 commits

ggunio's picture

Update README.md

4df097b verified 8 months ago

.gradio
Initial upload: B2NL-IntelligentTokenizer v6.2.1 (Autoregressive Mode) 8 months ago
core
Initial upload: B2NL-IntelligentTokenizer v6.2.1 (Autoregressive Mode) 8 months ago
.gitattributes

1.52 kB
initial commit 8 months ago
MODEL_CARD.md

4.75 kB
Initial upload: B2NL-IntelligentTokenizer v6.2.1 (Autoregressive Mode) 8 months ago
README.md

6.12 kB
Update README.md 8 months ago
app.py

29.9 kB
Initial upload: B2NL-IntelligentTokenizer v6.2.1 (Autoregressive Mode) 8 months ago
config.json

515 Bytes
Initial upload: B2NL-IntelligentTokenizer v6.2.1 (Autoregressive Mode) 8 months ago
config.yaml

6 kB
Initial upload: B2NL-IntelligentTokenizer v6.2.1 (Autoregressive Mode) 8 months ago
inference.py

6.47 kB
Initial upload: B2NL-IntelligentTokenizer v6.2.1 (Autoregressive Mode) 8 months ago
model.safetensors

921 MB
xet

Initial upload: B2NL-IntelligentTokenizer v6.2.1 (Autoregressive Mode) 8 months ago
parallel_inference.py

9.04 kB
Initial upload: B2NL-IntelligentTokenizer v6.2.1 (Autoregressive Mode) 8 months ago
pytorch_model.bin
Detected Pickle imports (4)
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.LongStorage"
What is a pickle import?
922 MB
xet

Initial upload: B2NL-IntelligentTokenizer v6.2.1 (Autoregressive Mode) 8 months ago
requirements.txt

109 Bytes
Initial upload: B2NL-IntelligentTokenizer v6.2.1 (Autoregressive Mode) 8 months ago