Instructions to use zai-org/chatglm-6b-int4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use zai-org/chatglm-6b-int4 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("zai-org/chatglm-6b-int4", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
questioni
#20
by jldx17661290553 - opened
File "C:\Users\lenovo/.cache\huggingface\modules\transformers_modules\chatglm-6b-int4\quantization.py", line 316, in extract_weight_to_float
func(
TypeError: 'NoneType' object is not callable