This model, quant' to:
5.8G Apriel-1.6-15b-Thinker.i1-IQ3_XS.gguf
passes the 'bingobird lateral thinking test' which only 1/5 of models under 7GB succeed at.
If you seek a small model for laptop/edge that can think (somewhat), I recommend this one.
· Sign up or log in to comment
