Inference Providers
Active filters: hqq
fayez-siddiqui/Llama3_8b_HQQ-2bit
Text Generation • 3B • Updated • 23
gurro/Llama-3.1-8B_hqq_4bit
Updated • 24
gurro/llama-3.1-8B-hqq-int3-g64
gurro/llama-3.1-8B-hqq-int2-g32
gurro/llama-3.1-8B-hqq-int3-g32
11B • Updated • 5
gurro/Llama-3.1-8B_hqq_nbits2_for_bitblas
gurro/Llama-3.1-8B_hqq_nbits2_g32_latest
AminBH/Llama-3-8B-HQQ-2bit
Updated • 20
taobao-mnn/DeepSeek-R1-1.5B-Qwen-MNN
Text Generation • Updated • 651
• 1
rohan700/TinyLlama-1.1B-Chat-v1.0-4bit-HQQ
Updated • 17
dropbox-dash/Meta-Llama-3-8B-Instruct_4bitgs64_hqq_hf
Text Generation • 5B • Updated • 16
• 2
dropbox-dash/Llama-3.1-8B-Instruct_4bitgs64_hqq_hf
Text Generation • 5B • Updated • 10
• 1
dropbox-dash/Llama-3.2-3B-Instruct_4bitgs64_hqq_hf
Text Generation • 2B • Updated • 20
• 1
dropbox-dash/Qwen2.5-7B-Instruct-1M_4bitgs64_hqq_hf
Text Generation • 5B • Updated • 13
• 1
dropbox-dash/Qwen2.5-14B-Instruct-1M_4bitgs64_hqq_hf
Text Generation • 9B • Updated • 11
• 1
brunopio/Yi-Coder-1.5B-Chat-nbits4-GS64-Axis1-HQQ-T
0.9B • Updated • 22
brunopio/Yi-Coder-1.5B-Chat-nbits4-GSNone-Axis0-HQQ-T
0.9B • Updated • 21
dropbox-dash/Qwen2.5-7B-Instruct_4bitgs64_hqq_hf
Text Generation • 5B • Updated • 8
• 2
brunopio/Phi-3-mini-128k-instruct-nbits4-GS64-Axis1-HQQ-T
2B • Updated • 5
brunopio/Phi-3-mini-128k-instruct-nbits4-GSNone-Axis0-HQQ-T
2B • Updated • 4
brunopio/TriLM_99M_Unpacked-nbits4-GSNone-Axis0-HQQ-T
75.8M • Updated • 8
brunopio/TriLM_99M_Unpacked-nbits4-GS64-Axis1-HQQ-T
77.2M • Updated • 7
brunopio/TinyLlama-1.1B-Chat-v1.0-nbits4-GSNone-Axis0-HQQ-T
0.6B • Updated • 7
brunopio/TinyLlama-1.1B-Chat-v1.0-nbits4-GS64-Axis1-HQQ-T
0.6B • Updated • 5
brunopio/TinyLlama_v1.1_math_code-nbits4-GSNone-Axis0-HQQ-T
0.6B • Updated • 3
brunopio/TinyLlama_v1.1_math_code-nbits4-GS64-Axis1-HQQ-T
0.6B • Updated • 6
brunopio/SmolLM2-135M-Instruct-nbits4-GSNone-Axis0-HQQ-T
81.7M • Updated • 8
brunopio/SmolLM2-135M-Instruct-nbits4-GS64-Axis1-HQQ-T
84.8M • Updated • 11
brunopio/RAG-Instruct-Llama3-3B-nbits4-GSNone-Axis0-HQQ-T
2B • Updated • 5