Low-Rank Approximation for Sparse Attention in Multi-Modal LLMs

Bibliographic Details
Title: Low-Rank Approximation for Sparse Attention in Multi-Modal LLMs
Authors: Song, Lin, Chen, Yukang, Yang, Shuai, Ding, Xiaohan, Ge, Yixiao, Chen, Ying-Cong, Shan, Ying
Source: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) CVPR Computer Vision and Pattern Recognition (CVPR), 2024 IEEE/CVF Conference on. :13763-13773 Jun, 2024
Relation: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Database: IEEE Xplore Digital Library