BananaMind 3 is going to be an comeback. Sorry for the BGA things ( i genuinely didnt know about nsa existing and yes I used aiiii) Were going to use our BananaMind 2.1 Unified architecture with some changes + NSA and some other stuff.
You know, I can't believe we are actually doing it, literally advancing the frontier at the edge! We've come a long way since the first models on open slm leaderboard, and, as many things that change, performance is one of the main things that has exploded.
7 years ago, the best we had was GPT-2. Today, we got 90m models beating smollm2! I can't barely see what a future with increasingly powerful small models will look like.
All I can say is that the best is yet to come. And will be agentic.