V$^2$R-Bench: Holistically Evaluating LVLM Robustness to Fundamental Visual Variations

Authors: Fan, Zhiyuan, Wang, Yumeng, Polisetty, Sandeep, Fung, Yi R.

Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Artificial Intelligence

Access URL: http://arxiv.org/abs/2504.16727

TAMP: Token-Adaptive Layerwise Pruning in Multimodal Large Language Models

Authors: Lee, Jaewoo, Xuan, Keyang, Ekbote, Chanakya, Polisetty, Sandeep, Fung, Yi R., Liang, Paul Pu

Subject Terms: Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2504.09897

Alice: Proactive Learning with Teacher's Demonstrations for Weak-to-Strong Generalization

Authors: Wu, Shujin, Qian, Cheng, Fung, Yi R., Liang, Paul Pu, Ji, Heng

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2504.07316

Scaling Laws of Synthetic Data for Language Models

Authors: Qin, Zeyu, Dong, Qingxiu, Zhang, Xingxing, Dong, Li, Huang, Xiaolong, Yang, Ziyi, Khademi, Mahmoud, Zhang, Dongdong, Awadalla, Hany Hassan, Fung, Yi R., Chen, Weizhu, Cheng, Minhao, Wei, Furu

Subject Terms: Computer Science - Computation and Language, Computer Science - Artificial Intelligence

Access URL: http://arxiv.org/abs/2503.19551

MimeQA: Towards Socially-Intelligent Nonverbal Foundation Models

Authors: Li, Hengzhi, Tjandrasuwita, Megan, Fung, Yi R., Solar-Lezama, Armando, Liang, Paul Pu

Subject Terms: Computer Science - Computation and Language, Computer Science - Artificial Intelligence, Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2502.16671

The Law of Knowledge Overshadowing: Towards Understanding, Predicting, and Preventing LLM Hallucination

Authors: Zhang, Yuji, Li, Sha, Qian, Cheng, Liu, Jiateng, Yu, Pengfei, Han, Chi, Fung, Yi R., McKeown, Kathleen, Zhai, Chengxiang, Li, Manling, Ji, Heng

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2502.16143

VLM$^2$-Bench: A Closer Look at How Well VLMs Implicitly Link Explicit Matching Visual Cues

Authors: Zhang, Jianshu, Yao, Dongyu, Pi, Renjie, Liang, Paul Pu, Fung, Yi R.

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2502.12084

Self-Correction is More than Refinement: A Learning Framework for Visual and Language Reasoning Tasks

Authors: He, Jiayi, Lin, Hehai, Wang, Qingyun, Fung, Yi, Ji, Heng

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2410.04055

Implementation of Cloth Estimation in 2D-3D Human Body Regression Model

Authors: Wei, Fung Yi, Lim, King Hann, Sien Phang, Jonathan Then, Pang, Po Ken

Source: 2024 International Conference on Green Energy, Computing and Sustainable Technology (GECOST) Green Energy, Computing and Sustainable Technology (GECOST), 2024 International Conference on. :224-228 Jan, 2024

Relation: 2024 International Conference on Green Energy, Computing and Sustainable Technology (GECOST)

Knowledge Overshadowing Causes Amalgamated Hallucination in Large Language Models

Authors: Zhang, Yuji, Li, Sha, Liu, Jiateng, Yu, Pengfei, Fung, Yi R., Li, Jing, Li, Manling, Ji, Heng

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2407.08039

MACAROON: Training Vision-Language Models To Be Your Engaged Partners

Authors: Wu, Shujin, Fung, Yi R., Li, Sha, Wan, Yixin, Chang, Kai-Wei, Ji, Heng

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2406.14137

From Pixels to Insights: A Survey on Automatic Chart Understanding in the Era of Large Foundation Models

Authors: Huang, Kung-Hsiang, Chan, Hou Pong, Fung, Yi R., Qiu, Haoyi, Zhou, Mingyang, Joty, Shafiq, Chang, Shih-Fu, Ji, Heng

Subject Terms: Computer Science - Computation and Language, Computer Science - Artificial Intelligence, Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2403.12027

LEMMA: Towards LVLM-Enhanced Multimodal Misinformation Detection with External Knowledge Augmentation

Authors: Xuan, Keyang, Yi, Li, Yang, Fan, Wu, Ruochen, Fung, Yi R., Ji, Heng

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2402.11943

Persona-DB: Efficient Large Language Model Personalization for Response Prediction with Collaborative Data Refinement

Authors: Sun, Chenkai, Yang, Ke, Reddy, Revanth Gangi, Fung, Yi R., Chan, Hou Pong, Small, Kevin, Zhai, ChengXiang, Ji, Heng

Subject Terms: Computer Science - Computation and Language, Computer Science - Artificial Intelligence, Computer Science - Information Retrieval

Access URL: http://arxiv.org/abs/2402.11060

Massively Multi-Cultural Knowledge Acquisition & LM Benchmarking

Authors: Fung, Yi, Zhao, Ruining, Doo, Jae, Sun, Chenkai, Ji, Heng

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2402.09369

If LLM Is the Wizard, Then Code Is the Wand: A Survey on How Code Empowers Large Language Models to Serve as Intelligent Agents

Authors: Yang, Ke, Liu, Jiateng, Wu, John, Yang, Chaoqi, Fung, Yi R., Li, Sha, Huang, Zixuan, Cao, Xu, Wang, Xingyao, Wang, Yiquan, Ji, Heng, Zhai, Chengxiang

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2401.00812

Do LVLMs Understand Charts? Analyzing and Correcting Factual Errors in Chart Captioning

Authors: Huang, Kung-Hsiang, Zhou, Mingyang, Chan, Hou Pong, Fung, Yi R., Wang, Zhenhailong, Zhang, Lingyu, Chang, Shih-Fu, Ji, Heng

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2312.10160

R-Tuning: Instructing Large Language Models to Say `I Don't Know'

Authors: Zhang, Hanning, Diao, Shizhe, Lin, Yong, Fung, Yi R., Lian, Qing, Wang, Xingyao, Chen, Yangyi, Ji, Heng, Zhang, Tong

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2311.09677

Defining a New NLP Playground

Authors: Li, Sha, Han, Chi, Yu, Pengfei, Edwards, Carl, Li, Manling, Wang, Xingyao, Fung, Yi R., Yu, Charles, Tetreault, Joel R., Hovy, Eduard H., Ji, Heng

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2310.20633

Decoding the Silent Majority: Inducing Belief Augmented Social Graph with Large Language Model for Response Forecasting

Authors: Sun, Chenkai, Li, Jinning, Fung, Yi R., Chan, Hou Pong, Abdelzaher, Tarek, Zhai, ChengXiang, Ji, Heng

Subject Terms: Computer Science - Computation and Language, Computer Science - Artificial Intelligence, Computer Science - Machine Learning

Access URL: http://arxiv.org/abs/2310.13297