needs work. it appears that the 1bit models are far less efficient when scare in terms of memory usage

Downloads last month
12
Safetensors
Model size
9B params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Dataset used to train limin-arc/llama3-8b-1.58bit-pretrained