Mukul
mtcl
AI & ML interests
None yet
Recent Activity
new activity about 3 hours ago
unsloth/Qwen3.6-27B-NVFP4:3090 Question new activity 7 days ago
kodelow/Hy3-NVFP4-W4A16:Will it fit in 2X6K Pros? new activity 19 days ago
unsloth/GLM-5.2-GGUF:GLM-5.2 GGUF Benchmarks!Organizations
None yet
3090 Question
3
#12 opened about 20 hours ago
by
mtcl
Will it fit in 2X6K Pros?
👍 1
12
#1 opened 7 days ago
by
mtcl
GLM-5.2 GGUF Benchmarks!
❤️🔥 14
26
#3 opened 25 days ago
by
danielhanchen
Could you provide INT4 quantized version
1
#2 opened 28 days ago
by
Fouye
KTransformers + SGLang
1
#1 opened 21 days ago
by
mtcl
startup command please
👍 2
4
#2 opened 26 days ago
by
mtcl
vllm support ?
👍 9
4
#6 opened about 1 month ago
by
sdd5125
thank you for ggufs
🤝 1
#1 opened 30 days ago
by
mtcl
tool call parser and reasoning parser
👍 1
2
#4 opened about 1 month ago
by
mtcl
Vllm and SgLang command please
👍 1
5
#1 opened about 1 month ago
by
mtcl
nvidia/DeepSeek-V4-flash-NVFP4
6
#1 opened about 2 months ago
by
mtcl
Docker Image
8
#1 opened about 2 months ago
by
mtcl
Worse than (smaller) MiniMax M2.7??
17
#2 opened 3 months ago
by deleted
Unable to run on 2x RTX Pro 6000 (DEEP_GEMM problem)
➕ 10
17
#15 opened 3 months ago
by
stev236
Running on 2 RTX Pro 6000 Blackwell GPUs at ~30 tps (Instructions that worked for me)
👍❤️ 7
10
#17 opened 2 months ago
by
CarouselAether
2x Nvidia 6000 Pros
3
#2 opened 2 months ago
by
mtcl
Will it work on 2X6000 Pros
6
#1 opened 3 months ago
by
mtcl
Can I deploy it with sglang at my 8*4090 ubuntu sever?
10
#1 opened 3 months ago
by
marshal007
Context Length for 2X6000 Pros (2x96 = 192GB VRAM)
5
#2 opened 3 months ago
by
mtcl
really awesome speeds! running at 256k context.
🔥 1
6
#11 opened 3 months ago
by
mtcl