Banaxi-Tech/HumanNumberEval
Viewer • Updated • 6.6k • 144
Banaxi PRO
Banaxi-Tech
AI & ML interests
SLMs, training from scratch, LoRA, TTS, Ternary models
Recent Activity
new activity 32 minutes ago
AxiomicLabs/Open_SLM_Leaderboard:Add https://huggingface.co/BananaMind/BananaMind-2-MoE liked a model about 1 hour ago
BananaMind/BananaMind-2-MoE posted an update about 1 hour ago
We're excited to release BananaMind 2 MoE, a new addition to the BananaMind 2 series!
BananaMind 2 MoE is a sparse mixture-of-experts model with 25M total parameters but only 2M active per token, Like the rest of the series, it uses our custom digit-aware BPE tokenizer that keeps every digit isolated, fixing the core arithmetic weakness of our earlier models. It's trained on 30B tokens from FineWeb-Edu, DCLM, Cosmopedia-v2 and FineMath-4+, and outperforms Pythia-31M on average despite activating just 2M parameters.
Check it out at
https://huggingface.co/BananaMind/BananaMind-2-MoE
BananaMind 2 Nano is Coming Next. Already training. Apache 2.0.Organizations
