inference-optimization/TinyQwen3-KV-Cache-Only
Text Generation • 2.64M • Updated • 171 • 1
Edit Models filters
Showing models from
Tasks
Parameters
Inference Providers
Hardware
Models
499
Active filters: inference-optimization
inference-optimization/Qwen3-Next-80B-A3B-Thinking-quantized.w8a8
Updated
inference-optimization/DeepSeek-V3-debug-multiply
1B • Updated • 35
inference-optimization/DeepSeek-V3-debug-add
1B • Updated • 24
inference-optimization/DeepSeek-V3-debug-empty
1B • Updated • 1.72k
inference-optimization/Qwen3-0.6B-debug-multiply
0.6B • Updated • 23
inference-optimization/Qwen3-0.6B-debug-add
0.6B • Updated • 18
inference-optimization/Qwen3-0.6B-W4A16-G128
0.6B • Updated • 1.09k
inference-optimization/Qwen3-0.6B-debug-multiply-W4A16-G128
0.6B • Updated • 24
inference-optimization/Qwen3-0.6B-debug-add-W4A16-G128
0.6B • Updated • 18
inference-optimization/Qwen3-0.6B-FP8_BLOCK
0.6B • Updated • 322
inference-optimization/Qwen3-0.6B-debug-multiply-FP8_BLOCK
0.6B • Updated • 40
inference-optimization/Qwen3-0.6B-debug-add-FP8_BLOCK
0.6B • Updated • 29
inference-optimization/DeepSeek-V3-debug-empty-NVFP4A16
0.9B • Updated • 1.17k
inference-optimization/DeepSeek-V3-debug-add-NVFP4A16
0.9B • Updated • 31
inference-optimization/DeepSeek-V3-debug-multiply-NVFP4A16
0.9B • Updated • 35
inference-optimization/DeepSeek-V3-debug-empty-FP8_DYNAMIC
1B • Updated • 988
inference-optimization/DeepSeek-V3-debug-add-FP8_DYNAMIC
1B • Updated • 35
inference-optimization/DeepSeek-V3-debug-multiply-FP8_DYNAMIC
1B • Updated • 114
inference-optimization/Ministral-3-14B-Instruct-2512.w4a16
Updated • 22
inference-optimization/Ministral-3-14B-Instruct-2512.w8a8
Updated • 11
inference-optimization/Qwen3-Coder-Next.w4a16
Text Generation • 12B • Updated • 384 • 1
inference-optimization/Qwen3-30B-A3B-Instruct-2507-FP8-Block
31B • Updated • 21
inference-optimization/gpt-oss-20b-FP8-Dynamic
21B • Updated • 18 • 1
inference-optimization/sarvam-30b-NVFP4
Text Generation • 19B • Updated • 34 • 1
inference-optimization/sarvam-105b-NVFP4
61B • Updated • 20 • 1
inference-optimization/gpt-oss-120b-ckpt3-speculator.eagle3
0.9B • Updated • 28
inference-optimization/gpt-oss-120b-ckpt4-speculator.eagle3
0.9B • Updated • 28
inference-optimization/gpt-oss-120b-from-qwen235b-ckpt4-speculator.eagle3
0.9B • Updated • 33
inference-optimization/Mistral3_speculator_dummy
2B • Updated • 28