QuEST: Stable Training of LLMs with 1-Bit Weights and Activations

Authors: Panferov, Andrei, Chen, Jiale, Tabesh, Soroush, Castro, Roberto L., Nikdan, Mahdi, Alistarh, Dan

Subject Terms: Computer Science - Machine Learning

Access URL: http://arxiv.org/abs/2502.05003

Pushing the Limits of Large Language Model Quantization via the Linearity Theorem

Authors: Malinovskii, Vladimir, Panferov, Andrei, Ilin, Ivan, Guo, Han, Richtárik, Peter, Alistarh, Dan

Subject Terms: Computer Science - Machine Learning

Access URL: http://arxiv.org/abs/2411.17525

Panza: Design and Analysis of a Fully-Local Personalized Text Writing Assistant

Authors: Nicolicioiu, Armand, Iofinova, Eugenia, Jovanovic, Andrej, Kurtic, Eldar, Nikdan, Mahdi, Panferov, Andrei, Markov, Ilia, Shavit, Nir, Alistarh, Dan

Subject Terms: Computer Science - Computation and Language, Computer Science - Artificial Intelligence, Computer Science - Human-Computer Interaction, Computer Science - Machine Learning

Access URL: http://arxiv.org/abs/2407.10994

Extreme Compression of Large Language Models via Additive Quantization

Authors: Egiazarian, Vage, Panferov, Andrei, Kuznedelev, Denis, Frantar, Elias, Babenko, Artem, Alistarh, Dan

Subject Terms: Computer Science - Machine Learning, Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2401.06118

Correlated Quantization for Faster Nonconvex Distributed Optimization

Authors: Panferov, Andrei, Demidovich, Yury, Rammal, Ahmad, Richtárik, Peter

Subject Terms: Computer Science - Machine Learning, Computer Science - Artificial Intelligence, Computer Science - Distributed, Parallel, and Cluster Computing, Mathematics - Optimization and Control

Access URL: http://arxiv.org/abs/2401.05518