VideoCon: Robust Video-Language Alignment via Contrast Captions

Authors: Bansal, Hritik, Bitton, Yonatan, Szpektor, Idan, Chang, Kai-Wei, Grover, Aditya

Source: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) CVPR Computer Vision and Pattern Recognition (CVPR), 2024 IEEE/CVF Conference on. :13927-13937 Jun, 2024

Relation: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

PaliGemma 2: A Family of Versatile VLMs for Transfer

Authors: Steiner, Andreas, Pinto, André Susano, Tschannen, Michael, Keysers, Daniel, Wang, Xiao, Bitton, Yonatan, Gritsenko, Alexey, Minderer, Matthias, Sherbondy, Anthony, Long, Shangbang, Qin, Siyang, Ingle, Reeve, Bugliarello, Emanuele, Kazemzadeh, Sahar, Mesnard, Thomas, Alabdulmohsin, Ibrahim, Beyer, Lucas, Zhai, Xiaohua

Subject Terms: Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2412.03555

Bridging the Visual Gap: Fine-Tuning Multimodal Models with Knowledge-Adapted Captions

Authors: Yanuka, Moran, Kish, Assaf Ben, Bitton, Yonatan, Szpektor, Idan, Giryes, Raja

Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Computation and Language, Computer Science - Machine Learning

Access URL: http://arxiv.org/abs/2411.09018

KITTEN: A Knowledge-Intensive Evaluation of Image Generation on Visual Entities

Authors: Huang, Hsin-Ping, Wang, Xinyi, Bitton, Yonatan, Taitelbaum, Hagai, Tomar, Gaurav Singh, Chang, Ming-Wei, Jia, Xuhui, Chan, Kelvin C. K., Hu, Hexiang, Su, Yu-Chuan, Yang, Ming-Hsuan

Subject Terms: Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2410.11824

NL-Eye: Abductive NLI for Images

Authors: Ventura, Mor, Toker, Michael, Calderon, Nitay, Gekhman, Zorik, Bitton, Yonatan, Reichart, Roi

Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Artificial Intelligence, Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2410.02613

Visual Riddles: a Commonsense and World Knowledge Challenge for Large Vision and Language Models

Authors: Bitton-Guetta, Nitzan, Slobodkin, Aviv, Maimon, Aviya, Habba, Eliya, Rassin, Royi, Bitton, Yonatan, Szpektor, Idan, Globerson, Amir, Elovici, Yuval

Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2407.19474

Contrastive Sequential-Diffusion Learning: Non-linear and Multi-Scene Instructional Video Synthesis

Authors: Ramos, Vasco, Bitton, Yonatan, Yarom, Michal, Szpektor, Idan, Magalhaes, Joao

Subject Terms: Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2407.11814

Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision

Authors: Zohar, Orr, Wang, Xiaohan, Bitton, Yonatan, Szpektor, Idan, Yeung-Levy, Serena

Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Artificial Intelligence

Access URL: http://arxiv.org/abs/2407.06189

Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images

Authors: Bitton-Guetta, Nitzan, Bitton, Yonatan, Hessel, Jack, Schmidt, Ludwig, Elovici, Yuval, Stanovsky, Gabriel, Schwartz, Roy

Source: 2023 IEEE/CVF International Conference on Computer Vision (ICCV) ICCV Computer Vision (ICCV), 2023 IEEE/CVF International Conference on. :2616-2627 Oct, 2023

Relation: 2023 IEEE/CVF International Conference on Computer Vision (ICCV)

Beyond Thumbs Up/Down: Untangling Challenges of Fine-Grained Feedback for Text-to-Image Generation

Authors: Collins, Katherine M., Kim, Najoung, Bitton, Yonatan, Rieser, Verena, Omidshafiei, Shayegan, Hu, Yushi, Chen, Sherol, Dutta, Senjuti, Chang, Minsuk, Lee, Kimin, Liang, Youwei, Evans, Georgina, Singla, Sahil, Li, Gang, Weller, Adrian, He, Junfeng, Ramachandran, Deepak, Dvijotham, Krishnamurthy Dj

Subject Terms: Computer Science - Machine Learning, Computer Science - Computation and Language, Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2406.16807

DataComp-LM: In search of the next generation of training sets for language models

Authors: Li, Jeffrey, Fang, Alex, Smyrnis, Georgios, Ivgi, Maor, Jordan, Matt, Gadre, Samir, Bansal, Hritik, Guha, Etash, Keh, Sedrick, Arora, Kushal, Garg, Saurabh, Xin, Rui, Muennighoff, Niklas, Heckel, Reinhard, Mercat, Jean, Chen, Mayee, Gururangan, Suchin, Wortsman, Mitchell, Albalak, Alon, Bitton, Yonatan, Nezhurina, Marianna, Abbas, Amro, Hsieh, Cheng-Yu, Ghosh, Dhruba, Gardner, Josh, Kilian, Maciej, Zhang, Hanlin, Shao, Rulin, Pratt, Sarah, Sanyal, Sunny, Ilharco, Gabriel, Daras, Giannis, Marathe, Kalyani, Gokaslan, Aaron, Zhang, Jieyu, Chandu, Khyathi, Nguyen, Thao, Vasiljevic, Igor, Kakade, Sham, Song, Shuran, Sanghavi, Sujay, Faghri, Fartash, Oh, Sewoong, Zettlemoyer, Luke, Lo, Kyle, El-Nouby, Alaaeldin, Pouransari, Hadi, Toshev, Alexander, Wang, Stephanie, Groeneveld, Dirk, Soldaini, Luca, Koh, Pang Wei, Jitsev, Jenia, Kollar, Thomas, Dimakis, Alexandros G., Carmon, Yair, Dave, Achal, Schmidt, Ludwig, Shankar, Vaishaal

Subject Terms: Computer Science - Machine Learning, Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2406.11794

VideoPhy: Evaluating Physical Commonsense for Video Generation

Authors: Bansal, Hritik, Lin, Zongyu, Xie, Tianyi, Zong, Zeshun, Yarom, Michal, Bitton, Yonatan, Jiang, Chenfanfu, Sun, Yizhou, Chang, Kai-Wei, Grover, Aditya

Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Artificial Intelligence, Computer Science - Machine Learning

Access URL: http://arxiv.org/abs/2406.03520

Generating Coherent Sequences of Visual Illustrations for Real-World Manual Tasks

Authors: Bordalo, João, Ramos, Vasco, Valério, Rodrigo, Glória-Silva, Diogo, Bitton, Yonatan, Yarom, Michal, Szpektor, Idan, Magalhaes, Joao

Subject Terms: Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2405.10122

TALC: Time-Aligned Captions for Multi-Scene Text-to-Video Generation

Authors: Bansal, Hritik, Bitton, Yonatan, Yarom, Michal, Szpektor, Idan, Grover, Aditya, Chang, Kai-Wei

Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Artificial Intelligence, Computer Science - Machine Learning

Access URL: http://arxiv.org/abs/2405.04682

ImageInWords: Unlocking Hyper-Detailed Image Descriptions

Authors: Garg, Roopal, Burns, Andrea, Ayan, Burcu Karagol, Bitton, Yonatan, Montgomery, Ceslee, Onoe, Yasumasa, Bunner, Andrew, Krishna, Ranjay, Baldridge, Jason, Soricut, Radu

Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2405.02793

DOCCI: Descriptions of Connected and Contrasting Images

Authors: Onoe, Yasumasa, Rane, Sunayana, Berger, Zachary, Bitton, Yonatan, Cho, Jaemin, Garg, Roopal, Ku, Alexander, Parekh, Zarana, Pont-Tuset, Jordi, Tanzer, Garrett, Wang, Su, Baldridge, Jason

Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Artificial Intelligence, Computer Science - Computation and Language, Computer Science - Machine Learning

Access URL: http://arxiv.org/abs/2404.19753

ParallelPARC: A Scalable Pipeline for Generating Natural-Language Analogies

Authors: Sultan, Oren, Bitton, Yonatan, Yosef, Ron, Shahaf, Dafna

Subject Terms: Computer Science - Computation and Language, Computer Science - Artificial Intelligence

Access URL: http://arxiv.org/abs/2403.01139

A Chain-of-Thought Is as Strong as Its Weakest Link: A Benchmark for Verifiers of Reasoning Chains

Authors: Jacovi, Alon, Bitton, Yonatan, Bohnet, Bernd, Herzig, Jonathan, Honovich, Or, Tseng, Michael, Collins, Michael, Aharoni, Roee, Geva, Mor

Subject Terms: Computer Science - Computation and Language

Access URL: http://arxiv.org/abs/2402.00559

Mismatch Quest: Visual and Textual Feedback for Image-Text Misalignment

Authors: Gordon, Brian, Bitton, Yonatan, Shafir, Yonatan, Garg, Roopal, Chen, Xi, Lischinski, Dani, Cohen-Or, Daniel, Szpektor, Idan

Source: ECCV 2024

Subject Terms: Computer Science - Computation and Language, Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2312.03766

VideoCon: Robust Video-Language Alignment via Contrast Captions

Authors: Bansal, Hritik, Bitton, Yonatan, Szpektor, Idan, Chang, Kai-Wei, Grover, Aditya

Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Artificial Intelligence, Computer Science - Computation and Language, Computer Science - Machine Learning

Access URL: http://arxiv.org/abs/2311.10111