IST Austria Distributed Algorithms and Systems Lab

university

https://ist.ac.at/en/research/alistarh-group/

https://github.com/IST-DASLab

AI & ML interests

None defined yet.

Recent Activity

kwanhee updated a model about 3 hours ago

ISTA-DASLab/Qwen3.5-397B-A17B-P48NVFP4-MoESQ

kwanhee updated a model about 3 hours ago

ISTA-DASLab/Qwen3-30B-A3B-P48NVFP4-MoESQ

kwanhee updated a model about 3 hours ago

ISTA-DASLab/Kimi-K2.5-P48NVFP4-MoESQ

View all activity

Papers

WUSH-KV: KV Cache Quantization with Data-Adaptive Transforms

Disaggregated Quantization: Specializing LLM Prefill and Decode

View all Papers

ISTA-DASLab 's papers 16

Submitted by

Jiale Chen

WUSH-KV: KV Cache Quantization with Data-Adaptive Transforms

ISTA-DASLab

IST Austria Distributed Algorithms and Systems Lab

2

Submitted by

Andrei Panferov

Disaggregated Quantization: Specializing LLM Prefill and Decode

ISTA-DASLab

IST Austria Distributed Algorithms and Systems Lab

Submitted by

Jiale Chen

GPTQ-2D: Cubic-Time Two-Sided Adaptive Rounding

ISTA-DASLab

IST Austria Distributed Algorithms and Systems Lab

2

Submitted by

Ionut Modoranu

MatryoshkaLoRA: Learning Accurate Hierarchical Low-Rank Representations for LLM Fine-Tuning

ISTA-DASLab

IST Austria Distributed Algorithms and Systems Lab

GSQ: Highly-Accurate Low-Precision Scalar Quantization for LLMs via Gumbel-Softmax Sampling

ISTA-DASLab

IST Austria Distributed Algorithms and Systems Lab

MatGPTQ: Accurate and Efficient Post-Training Matryoshka Quantization

ISTA-DASLab

IST Austria Distributed Algorithms and Systems Lab

Submitted by

Ionut Modoranu

DASH: Faster Shampoo via Batched Block Preconditioning and Efficient Inverse-Root Solvers

ISTA-DASLab

IST Austria Distributed Algorithms and Systems Lab

Submitted by

Andrei Panferov

Quartet II: Accurate LLM Pre-Training in NVFP4 by Improved Unbiased Gradient Estimation

ISTA-DASLab

IST Austria Distributed Algorithms and Systems Lab

Submitted by

Jiale Chen

WUSH: Near-Optimal Adaptive Transforms for LLM Quantization

ISTA-DASLab

IST Austria Distributed Algorithms and Systems Lab

CAGE: Curvature-Aware Gradient Estimation For Accurate Quantization-Aware Training

ISTA-DASLab

IST Austria Distributed Algorithms and Systems Lab

Submitted by

Denis Kuznedelev

Bridging the Gap Between Promise and Performance for Microscaling FP4 Quantization

ISTA-DASLab

IST Austria Distributed Algorithms and Systems Lab

Submitted by

Jiale Chen

The Geometry of LLM Quantization: GPTQ as Babai's Nearest Plane Algorithm

ISTA-DASLab

IST Austria Distributed Algorithms and Systems Lab