openbmb/MiniCPM-V-4.7-1B-gguf
Image-Text-to-Text • 1B • Updated • 18
Javed Alam PRO
Javedalam
AI & ML interests
Ai user, tester, and developer of open source ai based applications.
Recent Activity
liked a model about 8 hours ago
openbmb/MiniCPM-V-4.7-1B-gguf liked a Space 3 days ago
nandakishorm/vega-ttt liked a model 11 days ago
Cloudflare/clefOrganizations
liked a
model about 8 hours ago
liked a
Space 3 days ago
liked a
model 11 days ago
liked a
model 21 days ago
liked a
Space 22 days ago
liked a
model 22 days ago
liked a
Space 22 days ago
updated a
collection 25 days ago
liked a
model 25 days ago
liked a
Space 28 days ago
liked a
model 28 days ago
liked a
model about 1 month ago
replied to their post about 1 month ago
https://huggingface.co/XHToken/Spark-X2.5-4B — Official Spark-X2.5 model page with architecture, capabilities, benchmark scores and deployment information.
https://huggingface.co/XHToken/Spark-X2.5-4B-GGUF — Quantized GGUF versions, including the approximately 2.6 GB Q4_K_M model used on both phones.
https://github.com/XHToken/llama.cpp — Developer’s compatible llama.cpp fork required to run the spark2_5 architecture.
https://artificialanalysis.ai/hardware-inference-stack/mobile-phones — Artificial Analysis benchmark comparing the intelligence, speed and memory requirements of small models running on phones.
posted an update about 1 month ago
Post
81
Spark-X2.5 Running Locally on Two Android Phones
I compiled Spark-X2.5-4B Q4_K_M directly in Termux on a OnePlus 8 Pro and Samsung Galaxy S26 using the specialized XHToken llama.cpp fork.
This 2.6 GB model is attractive for private, offline phone AI because it supports reasoning, coding, translation, tool use and agentic workflows. Published scores include 90.7 on AIME 2026, 65.1 on BFCL-V4, 54.6 on MCP-Atlas and 14.2 on MCP-Mark.
The OnePlus CPU achieved 12 prompt and 4.6 generation tokens/s. It even solved a second-order differential equation, although Vulkan crashed—likely because of its old Adreno 650 driver.
The S26 CPU reached 37 prompt and 14 generation tokens/s. Vulkan on its Adreno 840 reached about 36 prompt and 20 generation tokens/s. Its 16K-context web server delivered 33 prompt and 15 generation tokens/s.
A capable reasoning and tool-oriented AI can now run privately and offline on a phone, without cloud inference or NPU execution.
I compiled Spark-X2.5-4B Q4_K_M directly in Termux on a OnePlus 8 Pro and Samsung Galaxy S26 using the specialized XHToken llama.cpp fork.
This 2.6 GB model is attractive for private, offline phone AI because it supports reasoning, coding, translation, tool use and agentic workflows. Published scores include 90.7 on AIME 2026, 65.1 on BFCL-V4, 54.6 on MCP-Atlas and 14.2 on MCP-Mark.
The OnePlus CPU achieved 12 prompt and 4.6 generation tokens/s. It even solved a second-order differential equation, although Vulkan crashed—likely because of its old Adreno 650 driver.
The S26 CPU reached 37 prompt and 14 generation tokens/s. Vulkan on its Adreno 840 reached about 36 prompt and 20 generation tokens/s. Its 16K-context web server delivered 33 prompt and 15 generation tokens/s.
A capable reasoning and tool-oriented AI can now run privately and offline on a phone, without cloud inference or NPU execution.
- 1 reply
Local AI on Phones: Spark-X2.5 on OnePlus 8 Pro and Galaxy S26
🔥 2
3
#7 opened about 1 month ago
by Javedalam
liked a
Space about 1 month ago
liked 2
models about 1 month ago
updated 2
collections about 1 month ago