Instructions to use asas-ai/mt5xl_8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use asas-ai/mt5xl_8bit with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="asas-ai/mt5xl_8bit")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("asas-ai/mt5xl_8bit") model = AutoModel.from_pretrained("asas-ai/mt5xl_8bit", device_map="auto") - Notebooks
- Google Colab
- Kaggle
File size: 135 Bytes
bef09f8 | 1 2 3 4 | version https://git-lfs.github.com/spec/v1
oid sha256:9f5863f9b0896a3d171635ec5b817e8919c27526c8d06436cf1e862b7ef0bfb0
size 5257472329
|