Video Creation by Demonstration

Authors: Sun, Yihong, Zhou, Hao, Yuan, Liangzhe, Sun, Jennifer J., Li, Yandong, Jia, Xuhui, Adam, Hartwig, Hariharan, Bharath, Zhao, Long, Liu, Ting

Subject Terms: Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2412.09551

Distilling Vision-Language Models on Millions of Videos

Authors: Zhao, Yue, Zhao, Long, Zhou, Xingyi, Wu, Jialin, Chu, Chun-Te, Miao, Hui, Schroff, Florian, Adam, Hartwig, Liu, Ting, Gong, Boqing, Krahenbuh, Philipp, Yuan, Liangzhe

Source: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) CVPR Computer Vision and Pattern Recognition (CVPR), 2024 IEEE/CVF Conference on. :13106-13116 Jun, 2024

Relation: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Epsilon-VAE: Denoising as Visual Decoding

Authors: Zhao, Long, Woo, Sanghyun, Wan, Ziyu, Li, Yandong, Zhang, Han, Gong, Boqing, Adam, Hartwig, Jia, Xuhui, Liu, Ting

Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Artificial Intelligence, Electrical Engineering and Systems Science - Image and Video Processing

Access URL: http://arxiv.org/abs/2410.04081

PolyMaX: General Dense Prediction with Mask Transformer

Authors: Yang, Xuan, Yuan, Liangzhe, Wilber, Kimberly, Sharma, Astuti, Gu, Xiuye, Qiao, Siyuan, Debats, Stephanie, Wang, Huisheng, Adam, Hartwig, Sirotenko, Mikhail, Chen, Liang-Chieh

Source: 2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) WACV Applications of Computer Vision (WACV), 2024 IEEE/CVF Winter Conference on. :1039-1050 Jan, 2024

Relation: 2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)

Unified Visual Relationship Detection with Vision and Language Models

Authors: Zhao, Long, Yuan, Liangzhe, Gong, Boqing, Cui, Yin, Schroff, Florian, Yang, Ming-Hsuan, Adam, Hartwig, Liu, Ting

Source: 2023 IEEE/CVF International Conference on Computer Vision (ICCV) ICCV Computer Vision (ICCV), 2023 IEEE/CVF International Conference on. :6939-6950 Oct, 2023

Relation: 2023 IEEE/CVF International Conference on Computer Vision (ICCV)

Improving Zero-shot Generalization and Robustness of Multi-Modal Models

Authors: Ge, Yunhao, Ren, Jie, Gallagher, Andrew, Wang, Yuxiao, Yang, Ming-Hsuan, Adam, Hartwig, Itti, Laurent, Lakshminarayanan, Balaji, Zhao, Jiaping

Source: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) CVPR Computer Vision and Pattern Recognition (CVPR), 2023 IEEE/CVF Conference on. :11093-11101 Jun, 2023

Relation: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

VideoPrism: A Foundational Visual Encoder for Video Understanding

Authors: Zhao, Long, Gundavarapu, Nitesh B., Yuan, Liangzhe, Zhou, Hao, Yan, Shen, Sun, Jennifer J., Friedman, Luke, Qian, Rui, Weyand, Tobias, Zhao, Yue, Hornung, Rachel, Schroff, Florian, Yang, Ming-Hsuan, Ross, David A., Wang, Huisheng, Adam, Hartwig, Sirotenko, Mikhail, Liu, Ting, Gong, Boqing

Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Artificial Intelligence

Access URL: http://arxiv.org/abs/2402.13217

VideoPoet: A Large Language Model for Zero-Shot Video Generation

Authors: Kondratyuk, Dan, Yu, Lijun, Gu, Xiuye, Lezama, José, Huang, Jonathan, Schindler, Grant, Hornung, Rachel, Birodkar, Vighnesh, Yan, Jimmy, Chiu, Ming-Chang, Somandepalli, Krishna, Akbari, Hassan, Alon, Yair, Cheng, Yong, Dillon, Josh, Gupta, Agrim, Hahn, Meera, Hauth, Anja, Hendon, David, Martinez, Alonso, Minnen, David, Sirotenko, Mikhail, Sohn, Kihyuk, Yang, Xuan, Adam, Hartwig, Yang, Ming-Hsuan, Essa, Irfan, Wang, Huisheng, Ross, David A., Seybold, Bryan, Jiang, Lu

Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Artificial Intelligence

Access URL: http://arxiv.org/abs/2312.14125

PolyMaX: General Dense Prediction with Mask Transformer

Authors: Yang, Xuan, Yuan, Liangzhe, Wilber, Kimberly, Sharma, Astuti, Gu, Xiuye, Qiao, Siyuan, Debats, Stephanie, Wang, Huisheng, Adam, Hartwig, Sirotenko, Mikhail, Chen, Liang-Chieh

Subject Terms: Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2311.05770

SANPO: A Scene Understanding, Accessibility and Human Navigation Dataset

Authors: Waghmare, Sagar M., Wilber, Kimberly, Hawkey, Dave, Yang, Xuan, Wilson, Matthew, Debats, Stephanie, Nuengsigkapian, Cattalyya, Sharma, Astuti, Pandikow, Lars, Wang, Huisheng, Adam, Hartwig, Sirotenko, Mikhail

Subject Terms: Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2309.12172

VideoGLUE: Video General Understanding Evaluation of Foundation Models

Authors: Yuan, Liangzhe, Gundavarapu, Nitesh Bharadwaj, Zhao, Long, Zhou, Hao, Cui, Yin, Jiang, Lu, Yang, Xuan, Jia, Menglin, Weyand, Tobias, Friedman, Luke, Sirotenko, Mikhail, Wang, Huisheng, Schroff, Florian, Adam, Hartwig, Yang, Ming-Hsuan, Liu, Ting, Gong, Boqing

Subject Terms: Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2307.03166

CMT-DeepLab: Clustering Mask Transformers for Panoptic Segmentation

Authors: Yu, Qihang, Wang, Huiyu, Kim, Dahun, Qiao, Siyuan, Collins, Maxwell, Zhu, Yukun, Adam, Hartwig, Yuille, Alan, Chen, Liang-Chieh

Source: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) CVPR Computer Vision and Pattern Recognition (CVPR), 2022 IEEE/CVF Conference on. :2550-2560 Jun, 2022

Relation: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Contextualized Spatio-Temporal Contrastive Learning with Self-Supervision

Authors: Yuan, Liangzhe, Qian, Rui, Cui, Yin, Gong, Boqing, Schroff, Florian, Yang, Ming-Hsuan, Adam, Hartwig, Liu, Ting

Source: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) CVPR Computer Vision and Pattern Recognition (CVPR), 2022 IEEE/CVF Conference on. :13957-13966 Jun, 2022

Relation: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

TubeFormer-DeepLab: Video Mask Transformer

Authors: Kim, Dahun, Xie, Jun, Wang, Huiyu, Qiao, Siyuan, Yu, Qihang, Kim, Hong-Seok, Adam, Hartwig, Kweon, In So, Chen, Liang-Chieh

Source: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) CVPR Computer Vision and Pattern Recognition (CVPR), 2022 IEEE/CVF Conference on. :13904-13914 Jun, 2022

Relation: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Alternating Gradient Descent and Mixture-of-Experts for Integrated Multimodal Perception

Authors: Akbari, Hassan, Kondratyuk, Dan, Cui, Yin, Hornung, Rachel, Wang, Huisheng, Adam, Hartwig

Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Artificial Intelligence, Computer Science - Machine Learning, Computer Science - Multimedia, Electrical Engineering and Systems Science - Image and Video Processing

Access URL: http://arxiv.org/abs/2305.06324

Learning View-Disentangled Human Pose Representation by Contrastive Cross-View Mutual Information Maximization

Authors: Zhao, Long, Wang, Yuxiao, Zhao, Jiaping, Yuan, Liangzhe, Sun, Jennifer J., Schroff, Florian, Adam, Hartwig, Peng, Xi, Metaxas, Dimitris, Liu, Ting

Source: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) CVPR Computer Vision and Pattern Recognition (CVPR), 2021 IEEE/CVF Conference on. :12788-12797 Jun, 2021

Relation: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

ViP-DeepLab: Learning Visual Perception with Depth-aware Video Panoptic Segmentation

Authors: Qiao, Siyuan, Zhu, Yukun, Adam, Hartwig, Yuille, Alan, Chen, Liang-Chieh

Source: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) CVPR Computer Vision and Pattern Recognition (CVPR), 2021 IEEE/CVF Conference on. :3996-4007 Jun, 2021

Relation: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

MaX-DeepLab: End-to-End Panoptic Segmentation with Mask Transformers

Authors: Wang, Huiyu, Zhu, Yukun, Adam, Hartwig, Yuille, Alan, Chen, Liang-Chieh

Source: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) CVPR Computer Vision and Pattern Recognition (CVPR), 2021 IEEE/CVF Conference on. :5459-5470 Jun, 2021

Relation: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Improving Zero-shot Generalization and Robustness of Multi-modal Models

Authors: Ge, Yunhao, Ren, Jie, Gallagher, Andrew, Wang, Yuxiao, Yang, Ming-Hsuan, Adam, Hartwig, Itti, Laurent, Lakshminarayanan, Balaji, Zhao, Jiaping

Subject Terms: Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2212.01758

MOAT: Alternating Mobile Convolution and Attention Brings Strong Vision Models

Authors: Yang, Chenglin, Qiao, Siyuan, Yu, Qihang, Yuan, Xiaoding, Zhu, Yukun, Yuille, Alan, Adam, Hartwig, Chen, Liang-Chieh

Subject Terms: Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2210.01820