Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

43,010

Base only

Active filters: bitsandbytes

RayNene/adaption_multi_agent_fraud_bench

Updated Aug 12 • 4 • 3

unsloth/Qwen3.8-27B-unsloth-bnb-4bit

27B • Updated about 1 month ago • 277k • 16

unsloth/llama-3-8b-bnb-4bit

Text Generation • 8B • Updated Jan 7, 2025 • 15.1k • 206

RichardErkhov/huihui-ai_-_Llama-3.2-3B-Instruct-abliterated-8bits

3B • Updated Oct 26, 2024 • 11 • 1

unsloth/SmolLM2-1.7B-Instruct-bnb-4bit

Text Generation • 2B • Updated Oct 31, 2024 • 1.28k • 3

unsloth/Qwen2.5-Coder-32B-bnb-4bit

Text Generation • 34B • Updated Nov 12, 2024 • 109 • 6

secemp9/TraceBack-12b

Text Generation • 13B • Updated Mar 14, 2025 • 47 • 34

RichardErkhov/darkc0de_-_BuddyGlass_v0.3_Xortron7MethedUpSwitchedUp-8bits

8B • Updated Mar 29, 2025 • 28 • 1

unsloth/Qwen3-14B-bnb-4bit

15B • Updated May 13, 2025 • 12.1k • 7

unsloth/Phi-4-mini-reasoning-unsloth-bnb-4bit

Text Generation • 4B • Updated May 1, 2025 • 812 • 9

unsloth/Phi-4-reasoning-plus-unsloth-bnb-4bit

Text Generation • 15B • Updated May 1, 2025 • 120 • 4

elementalsouls/Arch_nemesisv0.2

Text Generation • 7B • Updated May 31, 2025 • 6 • 1

169Pi/Alpie-Core

Text Generation • Updated Jun 19 • 55 • 9

unsloth/gpt-oss-120b-unsloth-bnb-4bit

Text Generation • 117B • Updated Aug 8, 2025 • 4.87k • 20

detoxio-test/Qwen2.5-1.5B-Instruct_Jailbroken

Text Generation • 2B • Updated Aug 29, 2025 • 24 • 1

vpakarinen/qwen3-4b-lora-uncensored-thinking

Text Generation • Updated 5 days ago • 19 • 1

unsloth/Z-Image-Turbo-unsloth-bnb-4bit

Text-to-Image • 3B • Updated Jan 9 • 7.97k • 7

KrishnaHuYaar/Fitness-Mistral-7B-Instruct-v0.1

Text Generation • 7B • Updated Jan 10 • 2

gokhanarkan/sommo-7b-v1

Text Generation • 8B • Updated Jan 13 • 16 • 2

EricRollei/HunyuanImage-3.0-Instruct-NF4-v2

Text-to-Image • 83B • Updated Feb 22 • 226 • 7

Vishalshendge3198/orpheus-3b-tts-german-emotional-merged

Text-to-Speech • 3B • Updated Mar 21 • 1

empero-ai/openNemo-Cascade-2-30B-A3B

Text Generation • 32B • Updated Mar 24 • 62 • 11

tantk/vibevoice-1.5b-bnb-4bit

Text-to-Speech • 2B • Updated Apr 2 • 8 • 1

unsloth/gemma-4-31B-it-unsloth-bnb-4bit

Image-Text-to-Text • 31B • Updated Jul 17 • 19.2k • 25

Aero-Ex/KIMODO-Meta3_llm2vec_NF4

8B • Updated Apr 4 • 13.3k • 9

rajveer43/gemma-4-E4B-medical-legal-finance-qa

Text Generation • 8B • Updated Apr 12 • 280 • 13

cloverxion/gemma3-text-generative-1B-IT

Text Generation • 1B • Updated Apr 12 • 14 • 1

dong16/HunyuanImage-3-NF4-v2

Text-to-Image • 83B • Updated Apr 27 • 4 • 1

kelvinmbewe/ZambiaSocialBERT

Text Classification • 0.2B • Updated May 17 • 22 • 1

aguken-ai/Qwen-3-TTS-12Hz-0.6B-Base-hi-LoRA-Finetuned-BNB-NF4

Text-to-Speech • 0.9B • Updated May 26 • 92 • 9