Inference Optimization

community

AI & ML interests

None defined yet.

Recent Activity

ChibuUkachi updated a model about 5 hours ago

inference-optimization/ctest-Qwen3.6-27B-speculator-regen.dflash

ChibuUkachi published a model about 5 hours ago

inference-optimization/ctest-Qwen3.6-27B-speculator-regen.dflash

ChibuUkachi published a dataset about 15 hours ago

inference-optimization/Qwen_3.6B_Regenerated

View all activity

inference-optimization 's models 360

inference-optimization/llama3_8b_6.0_bits_mode_hybrid_stiched

6B • Updated 23 days ago • 53

inference-optimization/qwen3-8b-peagle-speculators

Updated 23 days ago

inference-optimization/peagle-gemma4

2B • Updated 24 days ago • 4

inference-optimization/ctest-Qwen3.5-9B-speculator.dflash

2B • Updated 25 days ago • 89

inference-optimization/MiniMax-M2.5-BF16

Text Generation • 229B • Updated 25 days ago • 219

inference-optimization/ctest-Qwen3-8B-speculator.dflash

2B • Updated 25 days ago • 67

inference-optimization/DeepSeek-V4-Flash-bf16-NVFP4-FP8-BLOCK

inference-optimization/DeepSeek-V4-Flash-bf16

inference-optimization/DeepSeek-V4-Flash-5layers-nvfp4moe

20B • Updated Apr 28 • 7

inference-optimization/DeepSeek-V4-Flash-bf16-dequantized-5layers

34B • Updated Apr 28 • 3

inference-optimization/Qwen3-30B-A3B-Instruct-2507-7-bits-mode-noise-per-tensor

26B • Updated Apr 23 • 15

inference-optimization/Qwen3-30B-A3B-Instruct-2507-7-bits-mode-hybrid-per-tensor

27B • Updated Apr 23 • 14

inference-optimization/Qwen3-30B-A3B-Instruct-2507-7-bits-mode-heuristic-per-tensor

27B • Updated Apr 23 • 12

inference-optimization/Qwen3-30B-A3B-Instruct-2507-6.5-bits-mode-noise-per-tensor

25B • Updated Apr 23 • 12

inference-optimization/Qwen3-30B-A3B-Instruct-2507-6.5-bits-mode-hybrid-per-tensor

25B • Updated Apr 23 • 12

inference-optimization/Qwen3-30B-A3B-Instruct-2507-6.5-bits-mode-heuristic-per-tensor

25B • Updated Apr 23 • 14

inference-optimization/Qwen3-30B-A3B-Instruct-2507-6-bits-mode-noise-per-tensor

23B • Updated Apr 23 • 14

inference-optimization/Qwen3-30B-A3B-Instruct-2507-6-bits-mode-hybrid-per-tensor

23B • Updated Apr 23 • 14

inference-optimization/Qwen3-30B-A3B-Instruct-2507-6-bits-mode-heuristic-per-tensor

23B • Updated Apr 23 • 12

inference-optimization/Qwen3-30B-A3B-Instruct-2507-5.5-bits-mode-noise-per-tensor

21B • Updated Apr 23 • 16

inference-optimization/Qwen3-30B-A3B-Instruct-2507-5.5-bits-mode-hybrid-per-tensor

21B • Updated Apr 23 • 12

inference-optimization/Qwen3-30B-A3B-Instruct-2507-5.5-bits-mode-heuristic-per-tensor

21B • Updated Apr 23 • 12

inference-optimization/Qwen3-30B-A3B-Instruct-2507-5-bits-mode-noise-per-tensor

19B • Updated Apr 23 • 13

inference-optimization/Qwen3-30B-A3B-Instruct-2507-5-bits-mode-hybrid-per-tensor

19B • Updated Apr 23 • 12

inference-optimization/Qwen3-30B-A3B-Instruct-2507-5-bits-mode-heuristic-per-tensor

19B • Updated Apr 23 • 25

inference-optimization/Qwen3.6-35B-A3B-NVFP4

Updated Apr 23 • 8

inference-optimization/Qwen3-30B-A3B-7-bits-mode-noise-per-tensor

27B • Updated Apr 22 • 4

inference-optimization/Qwen3-30B-A3B-7-bits-mode-hybrid-per-tensor

27B • Updated Apr 22 • 4

inference-optimization/Qwen3-30B-A3B-7-bits-mode-heuristic-per-tensor

27B • Updated Apr 22 • 3

inference-optimization/Qwen3-30B-A3B-6.5-bits-mode-noise-per-tensor

25B • Updated Apr 22 • 5