RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16 Text Generation • 3B • Updated Oct 23, 2024 • 2.54k • 12
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 Text Generation • 8B • Updated Sep 22 • 7.72k • 19
joshnader/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF Text Generation • 8B • Updated Jul 24, 2024 • 1.37k • 1
azhiboedova/Meta-Llama-3.1-8B-Instruct-AQLM-2Bit-1x16 Text Generation • 2B • Updated Aug 28, 2024 • 16 • 13
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16 Text Generation • 8B • Updated Sep 22 • 25.6k • 30