YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
4 bit quantized version using Intel's autoround. I had problems with 4 bit awq having weird outputs with tool calls, paths and variable names. This version work as expected.
- Downloads last month
- 34
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support