Promptriever: Instruction-Trained Retrievers Can Be Prompted Like Language Models

Authors: Weller, Orion, Van Durme, Benjamin, Lawrie, Dawn, Paranjape, Ashwin, Zhang, Yuhao, Hessel, Jack

Subject Terms: Computer Science - Information Retrieval, Computer Science - Computation and Language, Computer Science - Machine Learning

Access URL: http://arxiv.org/abs/2409.11136

WildVis: Open Source Visualizer for Million-Scale Chat Logs in the Wild

Authors: Deng, Yuntian, Zhao, Wenting, Hessel, Jack, Ren, Xiang, Cardie, Claire, Choi, Yejin

Subject Terms: Computer Science - Computation and Language, Computer Science - Artificial Intelligence, Computer Science - Human-Computer Interaction, Computer Science - Information Retrieval, Computer Science - Machine Learning

Access URL: http://arxiv.org/abs/2409.03753

The Art of Saying No: Contextual Noncompliance in Language Models

Authors: Brahman, Faeze, Kumar, Sachin, Balachandran, Vidhisha, Dasigi, Pradeep, Pyatkin, Valentina, Ravichander, Abhilasha, Wiegreffe, Sarah, Dziri, Nouha, Chandu, Khyathi, Hessel, Jack, Tsvetkov, Yulia, Smith, Noah A., Choi, Yejin, Hajishirzi, Hannaneh

Subject Terms: Computer Science - Computation and Language, Computer Science - Artificial Intelligence, Computer Science - Human-Computer Interaction

Access URL: http://arxiv.org/abs/2407.12043

Certainly Uncertain: A Benchmark and Metric for Multimodal Epistemic and Aleatoric Awareness

Authors: Chandu, Khyathi Raghavi, Li, Linjie, Awadalla, Anas, Lu, Ximing, Park, Jae Sung, Hessel, Jack, Wang, Lijuan, Choi, Yejin

Subject Terms: Computer Science - Artificial Intelligence, Computer Science - Computation and Language, Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2407.01942

Champagne: Learning Real-world Conversation from Large-Scale Web Videos

Authors: Han, Seungju, Hessel, Jack, Dziri, Nouha, Choi, Yejin, Yu, Youngjae

Source: 2023 IEEE/CVF International Conference on Computer Vision (ICCV) ICCV Computer Vision (ICCV), 2023 IEEE/CVF International Conference on. :15452-15463 Oct, 2023

Relation: 2023 IEEE/CVF International Conference on Computer Vision (ICCV)

Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images

Authors: Bitton-Guetta, Nitzan, Bitton, Yonatan, Hessel, Jack, Schmidt, Ludwig, Elovici, Yuval, Stanovsky, Gabriel, Schwartz, Roy

Source: 2023 IEEE/CVF International Conference on Computer Vision (ICCV) ICCV Computer Vision (ICCV), 2023 IEEE/CVF International Conference on. :2616-2627 Oct, 2023

Relation: 2023 IEEE/CVF International Conference on Computer Vision (ICCV)

How to Train Your Fact Verifier: Knowledge Transfer with Multimodal Open Models

Authors: Lee, Jaeyoung, Lu, Ximing, Hessel, Jack, Brahman, Faeze, Yu, Youngjae, Bisk, Yonatan, Choi, Yejin, Gabriel, Saadia

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2407.00369

Selective Vision is the Challenge for Visual Reasoning: A Benchmark for Visual Argument Understanding

Authors: Chung, Jiwan, Lee, Sungjae, Kim, Minseo, Han, Seungju, Yousefpour, Ashkan, Hessel, Jack, Yu, Youngjae

Subject Terms: Computer Science - Computation and Language, Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2406.18925

WildChat: 1M ChatGPT Interaction Logs in the Wild

Authors: Zhao, Wenting, Ren, Xiang, Hessel, Jack, Cardie, Claire, Choi, Yejin, Deng, Yuntian

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2405.01470

Fusing Pre-Trained Language Models with Multimodal Prompts through Reinforcement Learning

Authors: Yu, Youngjae, Chung, Jiwan, Yun, Heeseung, Hessel, Jack, Park, Jae Sung, Lu, Ximing, Zellers, Rowan, Ammanabrolu, Prithviraj, Bras, Ronan Le, Kim, Gunhee, Choi, Yejin

Source: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) CVPR Computer Vision and Pattern Recognition (CVPR), 2023 IEEE/CVF Conference on. :10845-10856 Jun, 2023

Relation: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Selective 'Selective Prediction': Reducing Unnecessary Abstention in Vision-Language Reasoning

Authors: Srinivasan, Tejas, Hessel, Jack, Gupta, Tanmay, Lin, Bill Yuchen, Choi, Yejin, Thomason, Jesse, Chandu, Khyathi Raghavi

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2402.15610

L3GO: Language Agents with Chain-of-3D-Thoughts for Generating Unconventional Objects

Authors: Yamada, Yutaro, Chandu, Khyathi, Lin, Yuchen, Hessel, Jack, Yildirim, Ilker, Choi, Yejin

Subject Terms: Computer Science - Artificial Intelligence

Access URL: http://arxiv.org/abs/2402.09052

Deal, or no deal (or who knows)? Forecasting Uncertainty in Conversations using Large Language Models

Authors: Sicilia, Anthony, Kim, Hyunwoo, Chandu, Khyathi Raghavi, Alikhani, Malihe, Hessel, Jack

Subject Terms: Computer Science - Computation and Language, Computer Science - Artificial Intelligence, Computer Science - Machine Learning

Access URL: http://arxiv.org/abs/2402.03284

OLMo: Accelerating the Science of Language Models

Authors: Groeneveld, Dirk, Beltagy, Iz, Walsh, Pete, Bhagia, Akshita, Kinney, Rodney, Tafjord, Oyvind, Jha, Ananya Harsh, Ivison, Hamish, Magnusson, Ian, Wang, Yizhong, Arora, Shane, Atkinson, David, Authur, Russell, Chandu, Khyathi Raghavi, Cohan, Arman, Dumas, Jennifer, Elazar, Yanai, Gu, Yuling, Hessel, Jack, Khot, Tushar, Merrill, William, Morrison, Jacob, Muennighoff, Niklas, Naik, Aakanksha, Nam, Crystal, Peters, Matthew E., Pyatkin, Valentina, Ravichander, Abhilasha, Schwenk, Dustin, Shah, Saurabh, Smith, Will, Strubell, Emma, Subramani, Nishant, Wortsman, Mitchell, Dasigi, Pradeep, Lambert, Nathan, Richardson, Kyle, Zettlemoyer, Luke, Dodge, Jesse, Lo, Kyle, Soldaini, Luca, Smith, Noah A., Hajishirzi, Hannaneh

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2402.00838

NovaCOMET: Open Commonsense Foundation Models with Symbolic Knowledge Distillation

Authors: West, Peter, Bras, Ronan Le, Sorensen, Taylor, Lin, Bill Yuchen, Jiang, Liwei, Lu, Ximing, Chandu, Khyathi, Hessel, Jack, Baheti, Ashutosh, Bhagavatula, Chandra, Choi, Yejin

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2312.05979

Localized Symbolic Knowledge Distillation for Visual Commonsense Models

Authors: Park, Jae Sung, Hessel, Jack, Chandu, Khyathi Raghavi, Liang, Paul Pu, Lu, Ximing, West, Peter, Yu, Youngjae, Huang, Qiuyuan, Gao, Jianfeng, Farhadi, Ali, Choi, Yejin

Subject Terms: Computer Science - Artificial Intelligence, Computer Science - Computation and Language, Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2312.04837

UNcommonsense Reasoning: Abductive Reasoning about Uncommon Situations

Authors: Zhao, Wenting, Chiu, Justin T, Hwang, Jena D., Brahman, Faeze, Hessel, Jack, Choudhury, Sanjiban, Choi, Yejin, Li, Xiang Lorraine, Suhr, Alane

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2311.08469

Tailoring Self-Rationalizers with Multi-Reward Distillation

Authors: Ramnath, Sahana, Joshi, Brihi, Hallinan, Skyler, Lu, Ximing, Li, Liunian Harold, Chan, Aaron, Hessel, Jack, Choi, Yejin, Ren, Xiang

Source: The Twelfth International Conference on Learning Representations, 2024

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2311.02805

What's 'up' with vision-language models? Investigating their struggle with spatial reasoning

Authors: Kamath, Amita, Hessel, Jack, Chang, Kai-Wei

Subject Terms: Computer Science - Computation and Language, Computer Science - Computer Vision and Pattern Recognition, Computer Science - Machine Learning

Access URL: http://arxiv.org/abs/2310.19785

Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging

Authors: Jang, Joel, Kim, Seungone, Lin, Bill Yuchen, Wang, Yizhong, Hessel, Jack, Zettlemoyer, Luke, Hajishirzi, Hannaneh, Choi, Yejin, Ammanabrolu, Prithviraj

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2310.11564