GODELEV/Arithmetic-XL
Viewer • Updated • 12M • 103 • 4
🔄 In a Training Loop
Mr Munk
GODELEV
AI & ML interests
High schooler by day, LLM builder by night. Driven by a deep love for both Physics and AI. Currently spending my runtime building on Hugging Face, experimenting with transformer architectures, and training custom LLMs.
Recent Activity
reacted to Banaxi-Tech's post with 🔥 about 21 hours ago
We're excited to release BananaMind 2.1 Pico Preview!
It includes the first preview of our BananaMind 2.1 architecture!
This model gets near BananaMind 2 Micro performance at half the parameters and 37.5x less tokens!
Thats insane!
The current architectures includes about 500K parameters of the total 1.5M parameters in n-gram embeddings and the layer 2 is run twice.
It also includes XSA and the XSA refresh gate.
We're still going to improve the architecture in the final release.
Check it out at:
Follow us for more models:
https://huggingface.co/BananaMind
@Banaxi-Tech
@vovaRL
@DedeProGames
new activity about 21 hours ago
BananaMind/BananaMind-2.1-Pico-Preview:Enquiry liked a model 1 day ago
opencerebral/Boris-1.7-D60M-n30MOrganizations
