casperhansen/Qwen3.6-35B-A3B-MXFP4xMXFP8
36B • Updated • 227
casperhansen
casperhansen
AI & ML interests
Creator of AutoAWQ
Recent Activity
updated a model 14 days ago
casperhansen/Qwen3.6-35B-A3B-MXFP4xMXFP8 published a model 18 days ago
casperhansen/Qwen3.6-35B-A3B-MXFP4xMXFP8 updated a model 20 days ago
casperhansen/Qwen3.5-0.8B-MXFP4xMXFP8Organizations
casperhansen/Qwen3.5-0.8B-MXFP4xMXFP8
0.9B • Updated • 35
casperhansen/Qwen3.5-0.8B-INT-W8A8
0.9B • Updated • 900
casperhansen/Qwen3.6-35B-A3B-INT4-RTN
Image-Text-to-Text • 37B • Updated • 55
casperhansen/Mistral-Small-3.1-24B-Base-2503-Text-Only
24B • Updated • 65
casperhansen/deepseek-r1-distill-qwen-1.5b-awq
2B • Updated • 679 • 3
casperhansen/deepseek-r1-distill-qwen-7b-awq
8B • Updated • 1.77k • 9
casperhansen/deepseek-r1-distill-llama-8b-awq
8B • Updated • 1.78k • 3
casperhansen/deepseek-r1-distill-qwen-14b-awq
15B • Updated • 21.6k • 14
casperhansen/deepseek-r1-distill-llama-70b-awq
71B • Updated • 9.87k • 16
casperhansen/deepseek-r1-distill-qwen-32b-awq
33B • Updated • 45.5k • 11
casperhansen/mistral-small-24b-instruct-2501-awq
24B • Updated • 2.34k • 9
casperhansen/qwq-32b-preview-awq
33B • Updated • 9 • 1
casperhansen/llama-3.3-70b-instruct-awq
Text Generation • 71B • Updated • 528k • 46
casperhansen/llama-3.2-3b-instruct-awq
3B • Updated • 2.22k
casperhansen/llama-3.2-1b-instruct-awq
1B • Updated • 407
casperhansen/minicpm3-4b-awq
4B • Updated • 77
casperhansen/mistral-nemo-instruct-2407-awq
Text Generation • 12B • Updated • 9.9k • 12
casperhansen/mistral-large-instruct-2407-awq
Text Generation • 123B • Updated • 1.11k • 5
casperhansen/smollm-1.7b-instruct-awq
Text Generation • 2B • Updated • 7
casperhansen/llava-v1.6-mistral-7b-hf-awq
Image-Text-to-Text • 8B • Updated • 94 • 2
casperhansen/llama3-llava-next-8b-awq
Image-Text-to-Text • 8B • Updated • 8
casperhansen/qwen2-0.5b-instruct-awq
Text Generation • 0.6B • Updated • 13
casperhansen/deepseek-coder-v2-instruct-awq
Text Generation • 236B • Updated • 45.3k • 11
casperhansen/llama-3-8b-instruct-awq
Text Generation • 8B • Updated • 336k • 31
casperhansen/llama-3-70b-instruct-awq
Text Generation • 71B • Updated • 1.25k • 71
casperhansen/llama-3-70b-fp16
Text Generation • 71B • Updated • 16 • • 4
casperhansen/llama-3-8b-fp16
Text Generation • 8B • Updated • 145 • • 5
casperhansen/gemma-7b-it-awq
Text Generation • 9B • Updated • 15 • 2
casperhansen/mistral-instruct-v0.2-gemvfast-awq
Text Generation • 14B • Updated • 10