Duplicated from prince-canuma/Mixtral-8x22B-Instruct-v0.1-4bit

mistral-community
/

Mixtral-8x22B-Instruct-v0.1-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Resources

View closed (3)

Upload tokenizer

#8 opened over 1 year ago by

Error in example code

#5 opened almost 2 years ago by

GPTQ

#4 opened almost 2 years ago by

error in sagemaker deployement

#2 opened almost 2 years ago by

LorenzoCevolaniAXA

vLLM 4Bit?

#1 opened almost 2 years ago by