alphaXiv
/

filter-0.5B-W8A8

8-bit precision

compressed-tensors

Model card Files Files and versions

filter-0.5B-W8A8

915 MB

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

alphaXiv's picture

Add W8A8 int8 quantized model via llmcompressor compressed-tensors

95cfd64 verified 8 days ago

.gitattributes

1.57 kB
Add W8A8 int8 quantized model via llmcompressor compressed-tensors 8 days ago
chat_template.jinja

2.51 kB
Add W8A8 int8 quantized model via llmcompressor compressed-tensors 8 days ago
config.json

2.59 kB
Add W8A8 int8 quantized model via llmcompressor compressed-tensors 8 days ago
generation_config.json

241 Bytes
Add W8A8 int8 quantized model via llmcompressor compressed-tensors 8 days ago
model.safetensors

903 MB
xet

Add W8A8 int8 quantized model via llmcompressor compressed-tensors 8 days ago
recipe.yaml

169 Bytes
Add W8A8 int8 quantized model via llmcompressor compressed-tensors 8 days ago
tokenizer.json

11.4 MB
xet

Add W8A8 int8 quantized model via llmcompressor compressed-tensors 8 days ago
tokenizer_config.json

694 Bytes
Add W8A8 int8 quantized model via llmcompressor compressed-tensors 8 days ago