no gguf ?

#1
by kalle07 - opened

why after 3 years of gguf no gguf compatibility with llama.cpp ?
so you get never on the main front of anything ... because users can give you a lot of feedback
and no explanation why? i mean 137 members here on that account thats more embarrassing situation...

ask the people form teuken opengpt-X how that works

Aleph Alpha org
edited Sep 11, 2025

Hi @kalle07 - reasonable remarks.
Currently our focus is on vLLM for our B2B customers. GGUF is not the prominent file format in vLLM (yet), even though (partially) supported.
Would you be willing to support us here next time?

Regarding users' feedback: Yes, we want and need to get you guys more involved in our approaches. We can do better here.

Either way - thanks for giving this a test.

Cheers, Sven

maxmeuer changed discussion status to closed

Sign up or log in to comment