Thank you, but...
#2
by kafej666 - opened
Hi, Thank's for awesome work but I'm not sure if numbers are correct?
Additionally I observed that vllm:engine even if idle is on 100% Maybe linked to: https://github.com/vllm-project/vllm/issues/41964
Thank you so much for pointing this out I just updated the page with instructions.
This is a bug that previously affected the other ling I have made and it is the same thing.
Strange, now entire server just reboot after some time.
Unfortunately after version 1.1 model start to give me strange characters and strange output after some time.
There was a bug where it was running a CPU too high but I just fixed it maybe that was causing it?