CUDA fork of antirez ds4 that runs giant MoE language models on a single consumer GPU by streaming routed experts from SSD.
Gianni Sanrochman
giannisan
AI & ML interests
Transfromers, LLMs, multimodel, vision, audio
Recent Activity
updated a model 5 days ago
giannisan/Hy3-ds4-gguf liked a model 9 days ago
sakamakismile/ThinkingCap-Qwen3.6-27B-NVFP4 updated a collection 10 days ago
NeutronStarOrganizations
-
giannisan/penny-llama3-2x8b
Text Generation • 14B • Updated • 5 • 1 -
giannisan/penny5-dolphin-einstein-llama3-dare-ties-chatml
Text Generation • 8B • Updated • 7 • 1 -
giannisan/penny5-dolphin-einstein-llama3-dare-ties-chatml.gguf
8B • Updated • 16 • 1 -
mradermacher/penny-llama3-2x8b-v2-GGUF
14B • Updated • 54 • 1
CUDA fork of antirez ds4 that runs giant MoE language models on a single consumer GPU by streaming routed experts from SSD.
-
giannisan/penny-llama3-2x8b
Text Generation • 14B • Updated • 5 • 1 -
giannisan/penny5-dolphin-einstein-llama3-dare-ties-chatml
Text Generation • 8B • Updated • 7 • 1 -
giannisan/penny5-dolphin-einstein-llama3-dare-ties-chatml.gguf
8B • Updated • 16 • 1 -
mradermacher/penny-llama3-2x8b-v2-GGUF
14B • Updated • 54 • 1
models 48
giannisan/Hy3-ds4-gguf
299B • Updated • 18.1k • 26
giannisan/GLM-5.2-ds4-gguf
754B • Updated • 1.11k • 3
giannisan/light-fantasy-flux2-klein-base-lora
Text-to-Image • Updated • 6
giannisan/light-fantasy-flux2-klein-lora
Text-to-Image • Updated • 23
giannisan/heartformer
Object Detection • Updated • 3
giannisan/penta-reaserch
Updated
giannisan/PENNY-R1-7B-2-Q4_K_M-GGUF
8B • Updated • 3
giannisan/PENNY-R1-7B-2-Q8_0-GGUF
8B • Updated • 5
giannisan/PENNY-R1-7B-2
Text Generation • 8B • Updated • 3
giannisan/penny-lexi-llama3.1-8B
Text Generation • 8B • Updated • 2 • 1
datasets 22
giannisan/gemma-csm-shards
Updated • 1.22k
giannisan/light-fantasy-dataset
Viewer • Updated • 232 • 15
giannisan/light_fantasy_dataset
Viewer • Updated • 232 • 18
giannisan/penta-reaserch
Updated • 7
giannisan/test_dataset_7
Viewer • Updated • 4 • 13
giannisan/test_dataset_6
Viewer • Updated • 4 • 10
giannisan/test_dataset_5
Viewer • Updated • 15
giannisan/penny_dataset_v4
Viewer • Updated • 229k • 17
giannisan/conversations_dataset_v1
Viewer • Updated • 480 • 13
giannisan/penny_dataset_v3
Viewer • Updated • 168k • 23