APEX Quants (GGUF)
Collection
MoE models quantized with the APEX Quantization technique ( https://github.com/mudler/apex-quant ) • 42 items • Updated • 127
fkun
freykun
AI & ML interests
Personal Use
Recent Activity
upvoted a collection 4 days ago
APEX Quants (GGUF)Organizations
None yet
upvoted a collection 4 days ago
llama.cpp crash: missing tensor 'blk.40.attn_norm.weight' (Incorrect GGUF Metadata)
🤝 1
2
#1 opened 14 days ago
by freykun
llama.cpp crash: missing tensor 'blk.40.attn_norm.weight' (Incorrect GGUF Metadata)
#2 opened 14 days ago
by freykun
Does not work with latest llama.cpp
➕ 1
2
#1 opened 15 days ago
by 
pcomte
updated a
collection 18 days ago
liked a
model 18 days ago
liked a
model about 1 month ago
updated a
model 7 months ago
published a
model 7 months ago
liked a
Space 10 months ago
liked a
dataset 10 months ago
liked 2
models 11 months ago
updated a
model 11 months ago
liked a
model 11 months ago
published a
model 11 months ago
upvoted a collection over 1 year ago
commented on Remote VAEs for decoding with Inference Endpoints 🤗 over 1 year ago
Alright, I'll give it another read.
Thank you.
commented on Remote VAEs for decoding with Inference Endpoints 🤗 over 1 year ago
Hello there.
Very nice implementation, works flawlessly, 2-4 seconds to decode, depending on image size.
Simple question, is there a possibility to create a local endpoint on other machine (not HF) and use it as vae-decode machine?
So a Comfy Ui implementation for example.
updated a
collection over 1 year ago