Hugging Face's logo
Mr Munk's picture
🔄 In a Training Loop

Mr Munk

GODELEV
52 4 70
dipankarsarkar's profile picture ThingsAI's profile picture AxionLab-official's profile picture
·

AI & ML interests

High schooler by day, LLM builder by night. Driven by a deep love for both Physics and AI. Currently spending my runtime building on Hugging Face, experimenting with transformer architectures, and training custom LLMs.

Recent Activity

new activity about 1 hour ago
AxiomicLabs/Open_SLM_Leaderboard:Adding Rose-Medium
liked a Space about 11 hours ago
hugging-apps/charles-the-chess-bot
repliedto Banaxi-Tech's post about 13 hours ago
We're excited to release BananaMind 2 Micro, our smallest model yet. It fits a compact architecture in only 2.9M parameters achieving the highest parameter efficiency on BananaMind Base Bench against comparable models. It achieves comparable performance to GPT S2 5M and GPT S 5M at almost half the size while beating CMA 1M Mini. BananaMind 2 Micro achieved the #1 spot on the Open SLM Leaderboard for the sub 3M category (not added yet but it achieves #1) For the training we used Muon + the XSA Refresh Gate with a 5e-2 lr for Muon and 4e-3 for the 1D weights. Its score on our efficiency measure is 0.326 getting the first place with Syn 2.6M on the second place scoring 0.291 and GPT S 5M at 0.235* Check it out at https://huggingface.co/BananaMind/BananaMind-2-Micro and follow us at: @vovaRL @DedeProGames @Banaxi-Tech https://huggingface.co/BananaMind Our new releases aren't stopping 🚀 August 13-14 BananaMind 2 Pro
View all activity

Organizations

BananaMind Model Previewers's profile picture