Instructions to use TheBloke/Yi-34B-GPTQ with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use TheBloke/Yi-34B-GPTQ with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("TheBloke/Yi-34B-GPTQ", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Not Support for text-genenration.
#9 opened over 2 years ago
by
RogerREN
minimum EC2 instance ?
#8 opened over 2 years ago
by
CarlosAndrea
Model card displaying wrong size
1
#7 opened over 2 years ago
by
Remilistrasza
Why no GPTQ of Yi-34B 200k context?
👍 1
1
#5 opened over 2 years ago
by
DrNicefellow
Update README.md
#4 opened over 2 years ago
by
YaTharThShaRma999
This model is not a chat model?
4
#3 opened over 2 years ago
by
Winkuis
How do i run it?
4
#2 opened over 2 years ago
by
Yuuru