Describe Anything: Detailed Localized Image and Video Captioning

Authors: Lian, Long, Ding, Yifan, Ge, Yunhao, Liu, Sifei, Mao, Hanzi, Li, Boyi, Pavone, Marco, Liu, Ming-Yu, Darrell, Trevor, Yala, Adam, Cui, Yin

Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Artificial Intelligence

Access URL: http://arxiv.org/abs/2504.16072

Scaling Vision Pre-Training to 4K Resolution

Authors: Shi, Baifeng, Li, Boyi, Cai, Han, Lu, Yao, Liu, Sifei, Pavone, Marco, Kautz, Jan, Han, Song, Darrell, Trevor, Molchanov, Pavlo, Yin, Hongxu

Subject Terms: Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2503.19903

M3: 3D-Spatial MultiModal Memory

Authors: Zou, Xueyan, Song, Yuchen, Qiu, Ri-Zhao, Peng, Xuanbin, Ye, Jianglong, Liu, Sifei, Wang, Xiaolong

Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Robotics

Access URL: http://arxiv.org/abs/2503.16413

Synthesizing Consistent Novel Views via 3D Epipolar Attention without Re-Training

Authors: Ye, Botao, Liu, Sifei, Li, Xueting, Pollefeys, Marc, Yang, Ming-Hsuan

Subject Terms: Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2502.18219

Parallel Sequence Modeling via Generalized Spatial Propagation Network

Authors: Wang, Hongjun, Byeon, Wonmin, Xu, Jiarui, Gu, Jinwei, Cheung, Ka Chun, Wang, Xiaolong, Han, Kai, Kautz, Jan, Liu, Sifei

Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Machine Learning

Access URL: http://arxiv.org/abs/2501.12381

Omni-RGPT: Unifying Image and Video Region-level Understanding via Token Marks

Authors: Heo, Miran, Chen, Min-Hung, Huang, De-An, Liu, Sifei, Radhakrishnan, Subhashree, Kim, Seon Joo, Wang, Yu-Chiang Frank, Hachiuma, Ryo

Subject Terms: Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2501.08326

BlobGEN-Vid: Compositional Text-to-Video Generation with Blob Video Representations

Authors: Feng, Weixi, Liu, Chao, Liu, Sifei, Wang, William Yang, Vahdat, Arash, Nie, Weili

Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Artificial Intelligence

Access URL: http://arxiv.org/abs/2501.07647

HOIDiffusion: Generating Realistic 3D Hand-Object Interaction Data

Authors: Zhang, Mengqi, Fu, Yang, Ding, Zheng, Liu, Sifei, Tu, Zhuowen, Wang, Xiaolong

Source: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) CVPR Computer Vision and Pattern Recognition (CVPR), 2024 IEEE/CVF Conference on. :8521-8531 Jun, 2024

Relation: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

COLMAP-Free 3D Gaussian Splatting

Authors: Fu, Yang, Wang, Xiaolong, Liu, Sifei, Kulkarni, Amey, Kautz, Jan, Efros, Alexei A.

Source: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) CVPR Computer Vision and Pattern Recognition (CVPR), 2024 IEEE/CVF Conference on. :20796-20805 Jun, 2024

Relation: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Communication-Efficient Collaborative Perception via Information Filling with Codebook

Authors: Hu, Yue, Peng, Juntong, Liu, Sifei, Ge, Junhao, Liu, Si, Chen, Siheng

Source: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) CVPR Computer Vision and Pattern Recognition (CVPR), 2024 IEEE/CVF Conference on. :15481-15490 Jun, 2024

Relation: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videos

Authors: Xia, Hongchi, Fu, Yang, Liu, Sifei, Wang, Xiaolong

Source: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) CVPR Computer Vision and Pattern Recognition (CVPR), 2024 IEEE/CVF Conference on. :22378-22389 Jun, 2024

Relation: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

RegionGPT: Towards Region Understanding Vision Language Model

Authors: Guo, Qiushan, Mello, Shalini De, Yin, Hongxu, Byeon, Wonmin, Cheung, Ka Chun, Yu, Yizhou, Luo, Ping, Liu, Sifei

Source: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) CVPR Computer Vision and Pattern Recognition (CVPR), 2024 IEEE/CVF Conference on. :13796-13806 Jun, 2024

Relation: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

A Unified Approach for Text-and Image-Guided 4D Scene Generation

Authors: Zheng, Yufeng, Li, Xueting, Nagano, Koki, Liu, Sifei, Hilliges, Otmar, De Mello, Shalini

Source: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) CVPR Computer Vision and Pattern Recognition (CVPR), 2024 IEEE/CVF Conference on. :7300-7309 Jun, 2024

Relation: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

NaVILA: Legged Robot Vision-Language-Action Model for Navigation

Authors: Cheng, An-Chieh, Ji, Yandong, Yang, Zhaojing, Gongye, Zaitian, Zou, Xueyan, Kautz, Jan, Bıyık, Erdem, Yin, Hongxu, Liu, Sifei, Wang, Xiaolong

Subject Terms: Computer Science - Robotics, Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2412.04453

NVILA: Efficient Frontier Visual Language Models

Authors: Liu, Zhijian, Zhu, Ligeng, Shi, Baifeng, Zhang, Zhuoyang, Lou, Yuming, Yang, Shang, Xi, Haocheng, Cao, Shiyi, Gu, Yuxian, Li, Dacheng, Li, Xiuyu, Fang, Yunhao, Chen, Yukang, Hsieh, Cheng-Yu, Huang, De-An, Cheng, An-Chieh, Nath, Vishwesh, Hu, Jinyi, Liu, Sifei, Krishna, Ranjay, Xu, Daguang, Wang, Xiaolong, Molchanov, Pavlo, Kautz, Jan, Yin, Hongxu, Han, Song, Lu, Yao

Subject Terms: Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2412.04468

Physics-based Indirect Illumination for Inverse Rendering

Authors: Deng, Youming, Li, Xueting, Liu, Sifei, Yang, Ming-Hsuan

Source: 2024 International Conference on 3D Vision (3DV) 3DV 3D Vision (3DV), 2024 International Conference on. :1249-1258 Mar, 2024

Relation: 2024 International Conference on 3D Vision (3DV)

No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Images

Authors: Ye, Botao, Liu, Sifei, Xu, Haofei, Li, Xueting, Pollefeys, Marc, Yang, Ming-Hsuan, Peng, Songyou

Subject Terms: Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2410.24207

SSE: Multimodal Semantic Data Selection and Enrichment for Industrial-scale Data Assimilation

Authors: Shen, Maying, Chang, Nadine, Liu, Sifei, Alvarez, Jose M.

Subject Terms: Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2409.13860

GroPrompt: Efficient Grounded Prompting and Adaptation for Referring Video Object Segmentation

Authors: Lin, Ci-Siang, Liu, I-Jieh, Chen, Min-Hung, Wang, Chien-Yi, Liu, Sifei, Wang, Yu-Chiang Frank

Subject Terms: Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2406.12834

CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generation

Authors: Xu, Dejia, Nie, Weili, Liu, Chao, Liu, Sifei, Kautz, Jan, Wang, Zhangyang, Vahdat, Arash

Subject Terms: Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2406.02509