nthngdy/Llama-3.1-8B-Instruct_qfilt
32.8k • Updated • 16.9k
Q-Filters
Pre-computed Q-Filters for efficient KV cache compression.
-
-
nthngdy/Llama-3.2-1B-Instruct_qfilt
8.19k • Updated • 971 -
nthngdy/Llama-3.2-3B-Instruct_qfilt
28.7k • Updated • 47.5k -
nthngdy/Llama-3.2-3B_qfilt
28.7k • Updated • 962 -
nthngdy/Llama-3.1-8B_qfilt
32.8k • Updated • 952 -
nthngdy/Llama-3.1-70B-Instruct_qfilt
81.9k • Updated • 960 -
nthngdy/Llama-3.1-70B_qfilt
81.9k • Updated • 937 -
nthngdy/Meta-Llama-3.1-405B_qfilt
258k • Updated • 952 -
nthngdy/Mistral-Small-24B-Instruct-2501_qfilt
41k • Updated • 965 -
nthngdy/phi-4_qfilt
51.2k • Updated • 919 -
nthngdy/Llama-3.2-1B_qfilt
8.19k • Updated • 949 -
nthngdy/Qwen2.5-7B_qfilt
14.3k • Updated • 928 -
nthngdy/Qwen2.5-7B-Instruct_qfilt
14.3k • Updated • 934 -
nthngdy/DeepSeek-R1-Distill-Llama-8B_qfilt
32.8k • Updated • 935 -
nthngdy/DeepSeek-R1-Distill-Qwen-1.5B_qfilt
7.17k • Updated • 921