Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,341

Base only

Active filters: llama-cpp

Nguuma/security-slm-unsloth-1.5b

Text Generation • 2B • Updated May 7 • 1.05k • 38

BennyDaBall/Krea-2-Engineer-V1-GGUF

Text Generation • 4B • Updated 11 days ago • 4.58k • 26

jica98/qwen3.5-4B-super-coder

Text Generation • 4B • Updated 11 days ago • 22.2k • 28

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated 25 days ago • 20.9k • 90

LordNeel/Agents-A1-GGUF

Text Generation • 35B • Updated 8 days ago • 28.1k • 11

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated 28 days ago • 11.8k • 106

Abiray/ThinkingCap-Qwen3.6-27B-MTP-Q4_K_M-GGUF

27B • Updated 1 day ago • 5

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 566 • 252

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated 30 days ago • 49.1k • 30

prithivMLmods/VibeThinker-3B-GGUF

Text Generation • 3B • Updated 22 days ago • 56.9k • 68

vcruz305/Ornith-1.0-35B-AEON-Ultimate-Uncensored-GGUF

Text Generation • 35B • Updated 6 days ago • 13.7k • 10

GZGavinZhao/Leanstral-1.5-119B-A6B-GGUF

119B • Updated 2 days ago • 1.13k • 4

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Sep 25, 2024 • 34k • 34

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 13.9k • 732

Bahushruth/Qwen3.6-35B-A3B-abliterated-v4-GGUF

Text Generation • 35B • Updated 5 days ago • 29.3k • 6

prithivMLmods/Q3.5-9B-DS-v4-Flash-v2.0-GGUF

Image-Text-to-Text • 9B • Updated 6 days ago • 570 • 3

Anonymouse123/fable-traces-Q4_K_M-GGUF

Text Generation • 4B • Updated 5 days ago • 922 • 3

IntelligentEstate/Baby_Grok3-1.5b-iQ4_K_M-GGUF

2B • Updated Feb 23, 2025 • 84 • 23

huihui-ai/BaronLLM_Offensive_Security-abliterated-GGUF

Text Generation • 8B • Updated Jun 11, 2025 • 174 • 47

ruv/ruvltra-claude-code

Text Generation • 0.5B • Updated Mar 28 • 8.46k • 187

prithivMLmods/Holo-3.1-9B-GGUF

Image-Text-to-Text • 9B • Updated Jun 2 • 102k • 10

semparuthiveeran/VibeThinker-3B-Q4_K_M-GGUF

Text Generation • 3B • Updated 21 days ago • 78.2k • 3

sasa2000/SmallThinker-4BA0.6B-Instruct-REAP-0.125-Q8_0-GGUF

Text Generation • 4B • Updated 6 days ago • 186 • 2

UraionLabs/Uraion-Agent-Small

Text Generation • 2B • Updated 5 days ago • 7.15k • 2

ankk98/dspark-gemma4-12b-block7-Q4_0-GGUF

3B • Updated 8 days ago • 2.68k • 4

wepiqx/Ornith-1.0-9B-ASHQ1-MTP-GGUF

Text Generation • 9B • Updated 7 days ago • 773 • 3

prithivMLmods/Q3.5-9B-GLM-5.1-v2.0-GGUF

Image-Text-to-Text • 9B • Updated 6 days ago • 782 • 2

ZeroXClem/Qwen3.5-9B-Fable-5-Quad-Stock-Q3_K_M-GGUF

Text Generation • 9B • Updated 5 days ago • 273 • 2

ZeroXClem/Qwen3.5-9B-Fable-5-Quad-Stock-Q4_0-GGUF

Text Generation • 9B • Updated 5 days ago • 264 • 2

ZeroXClem/Qwen3.5-9B-Fable-5-Quad-Stock-Q4_K_M-GGUF

Text Generation • 9B • Updated 5 days ago • 505 • 2