ContextReq/Notio-PLACEHOLDER
Text Generation • Updated • 1
👋 Open to Work
ConReq.
ContextReq
AI & ML interests
Most commonly optimization focus with a side of what ever catches my interest.
Recent Activity
liked a model about 5 hours ago
ContextReq/Notio-PLACEHOLDER updated a model about 5 hours ago
ContextReq/Notio-PLACEHOLDER published a model about 5 hours ago
ContextReq/Notio-PLACEHOLDEROrganizations
liked a
model about 5 hours ago
updated a
model about 5 hours ago
published a
model about 5 hours ago
updated 4
models 1 day ago
basically-experimental/Pebble-10M-Chat-GGUF
Text Generation • 10.3M • Updated • 407 • 3
basically-experimental/Pebble-25M-GGUF
Text Generation • 24.5M • Updated • 205 • 1
basically-experimental/Pebble-25M-Chat-GGUF
Text Generation • 24.5M • Updated • 226 • 1
basically-experimental/Pebble-10M-GGUF
Text Generation • 10.3M • Updated • 244 • 3
liked a
model 1 day ago
updated a
model 1 day ago
published a
model 1 day ago
OOOOO good idea i might try to make it work on cpu
liked 2
models 3 days ago
published 2
models 3 days ago
liked 2
models 3 days ago
reacted to Hoglet-33's post with 🔥 3 days ago
Post
3046
We are announcing the first generation of the Pebble model family!
These are the models we are releasing:
- Pebble 10M
- Pebble 25M
- Pebble 50M
Each model will use a Mamba-Transformer 3:1 hybrid architecture and will be pretrained on 25 billion tokens before IFT and SFT.
Depending on development time and resources, we may also release:
- Pebble 5M
- Pebble 75M
- Pebble 1M (possibly)
We hope you're excited and enjoy the models!
Follow for more:
@Hoglet-33
basically-ai
These are the models we are releasing:
- Pebble 10M
- Pebble 25M
- Pebble 50M
Each model will use a Mamba-Transformer 3:1 hybrid architecture and will be pretrained on 25 billion tokens before IFT and SFT.
Depending on development time and resources, we may also release:
- Pebble 5M
- Pebble 75M
- Pebble 1M (possibly)
We hope you're excited and enjoy the models!
Follow for more:
@Hoglet-33
- 7 replies
liked a
model 3 days ago