🔄 In a Training Loop

MetrisVailore

Metris

·

MetrisVailore

AI & ML interests

Building a new general architecture for LLMs https://huggingface.co/Dream-W

Recent Activity

repliedto appvoid's post about 8 hours ago

You know, I can't believe we are actually doing it, literally advancing the frontier at the edge! We've come a long way since the first models on open slm leaderboard, and, as many things that change, performance is one of the main things that has exploded. 7 years ago, the best we had was GPT-2. Today, we got 90m models beating smollm2! I can't barely see what a future with increasingly powerful small models will look like. All I can say is that the best is yet to come. And will be agentic.

repliedto appvoid's post about 8 hours ago

You know, I can't believe we are actually doing it, literally advancing the frontier at the edge! We've come a long way since the first models on open slm leaderboard, and, as many things that change, performance is one of the main things that has exploded. 7 years ago, the best we had was GPT-2. Today, we got 90m models beating smollm2! I can't barely see what a future with increasingly powerful small models will look like. All I can say is that the best is yet to come. And will be agentic.

liked a dataset about 9 hours ago

IFM/Pretrain-Behaviors

View all activity

Organizations

models 0

None public yet

datasets 0

None public yet