Inference Optimized Checkpoints (with Model Optimizer)
Collection
A collection of generative models quantized and optimized for inference with Model Optimizer. • 65 items • Updated • 157
Ben Appleby
halcyonhal
AI & ML interests
None yet
Recent Activity
upvoted a collection 27 days ago
Inference Optimized Checkpoints (with Model Optimizer) commentedon an article about 1 month ago
Stop benchmarking inference providers liked a model 3 months ago
mratsim/MiniMax-M2.5-FP8-INT4-AWQOrganizations
None yet
upvoted a collection 27 days ago
commented on Stop benchmarking inference providers about 1 month ago
Have you compared models served by an inference provider to evals run direct against the model? Some data to support the crux of your argument would be good.
liked a
model 3 months ago
updated a
model 6 months ago
published a
model 6 months ago
updated a
model 6 months ago
updated a
Space 6 months ago
published a
Space 6 months ago
published a
model 6 months ago