HA-VLN: A Benchmark for Human-Aware Navigation in Discrete-Continuous Environments with Dynamic Multi-Human Interactions, Real-World Validation, and an Open Leaderboard

Authors: Dong, Yifei, Wu, Fengyi, He, Qi, Li, Heng, Li, Minghan, Cheng, Zebang, Zhou, Yuxuan, Sun, Jingdong, Dai, Qi, Cheng, Zhi-Qi, Hauptmann, Alexander G

Subject Terms: Computer Science - Artificial Intelligence, Computer Science - Computer Vision and Pattern Recognition, Computer Science - Robotics

Access URL: http://arxiv.org/abs/2503.14229

The Seven Faces of Stress: Understanding Facial Activity Patterns During Cognitive Stress

Authors: Viegas, Carla, Maxion, Roy, Hauptmann, Alexander, Magalhaes, Joao

Source: 2024 IEEE 18th International Conference on Automatic Face and Gesture Recognition (FG) Automatic Face and Gesture Recognition (FG), 2024 IEEE 18th International Conference on. :1-9 May, 2024

Relation: 2024 IEEE 18th International Conference on Automatic Face and Gesture Recognition (FG)

VICAN: Very Efficient Calibration Algorithm for Large Camera Networks

Authors: Moreira, Gabriel, Marques, Manuel, Costeira, Joao Paulo, Hauptmann, Alexander

Source: 2024 IEEE International Conference on Robotics and Automation (ICRA) Robotics and Automation (ICRA), 2024 IEEE International Conference on. :18020-18026 May, 2024

Relation: 2024 IEEE International Conference on Robotics and Automation (ICRA)

Emphasizing Discriminative Features for Dataset Distillation in Complex Scenarios

Authors: Wang, Kai, Li, Zekai, Cheng, Zhi-Qi, Khaki, Samir, Sajedi, Ahmad, Vedantam, Ramakrishna, Plataniotis, Konstantinos N, Hauptmann, Alexander, You, Yang

Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Artificial Intelligence

Access URL: http://arxiv.org/abs/2410.17193

Hyperbolic vs Euclidean Embeddings in Few-Shot Learning: Two Sides of the Same Coin

Authors: Moreira, Gabriel, Marques, Manuel, Costeira, Joao Paulo, Hauptmann, Alexander

Source: 2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) WACV Applications of Computer Vision (WACV), 2024 IEEE/CVF Winter Conference on. :2071-2079 Jan, 2024

Relation: 2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)

SZTU-CMU at MER2024: Improving Emotion-LLaMA with Conv-Attention for Multimodal Emotion Recognition

Authors: Cheng, Zebang, Tu, Shuyuan, Huang, Dawei, Li, Minghan, Peng, Xiaojiang, Cheng, Zhi-Qi, Hauptmann, Alexander G.

Subject Terms: Computer Science - Multimedia, Computer Science - Computer Vision and Pattern Recognition, Computer Science - Sound, Electrical Engineering and Systems Science - Audio and Speech Processing

Access URL: http://arxiv.org/abs/2408.10500

Combo: Co-speech holistic 3D human motion generation and efficient customizable adaptation in harmony

Authors: Xu, Chao, Sun, Mingze, Cheng, Zhi-Qi, Wang, Fei, Liu, Yang, Sun, Baigui, Huang, Ruqi, Hauptmann, Alexander

Subject Terms: Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2408.09397

SHIELD: LLM-Driven Schema Induction for Predictive Analytics in EV Battery Supply Chain Disruptions

Authors: Cheng, Zhi-Qi, Dong, Yifei, Shi, Aike, Liu, Wei, Hu, Yuzhi, O'Connor, Jason, Hauptmann, Alexander G., Whitefoot, Kate S.

Subject Terms: Computer Science - Artificial Intelligence, Computer Science - Human-Computer Interaction

Access URL: http://arxiv.org/abs/2408.05357

Open-Vocabulary 3D Semantic Segmentation with Text-to-Image Diffusion Models

Authors: Zhu, Xiaoyu, Zhou, Hao, Xing, Pengfei, Zhao, Long, Xu, Hao, Liang, Junwei, Hauptmann, Alexander, Liu, Ting, Gallagher, Andrew

Subject Terms: Computer Science - Computer Vision and Pattern Recognition

Access URL: http://arxiv.org/abs/2407.13642

Multimodal Reranking for Knowledge-Intensive Visual Question Answering

Authors: Wen, Haoyang, Zhuang, Honglei, Zamani, Hamed, Hauptmann, Alexander, Bendersky, Michael

Subject Terms: Computer Science - Computation and Language, Computer Science - Artificial Intelligence

Access URL: http://arxiv.org/abs/2407.12277

Breaking The Limits of Text-conditioned 3D Motion Synthesis with Elaborative Descriptions

Authors: Qian, Yijun, Urbanek, Jack, Hauptmann, Alexander G., Won, Jungdam

Source: 2023 IEEE/CVF International Conference on Computer Vision (ICCV) ICCV Computer Vision (ICCV), 2023 IEEE/CVF International Conference on. :2306-2316 Oct, 2023

Relation: 2023 IEEE/CVF International Conference on Computer Vision (ICCV)

ChartReader: A Unified Framework for Chart Derendering and Comprehension without Heuristic Rules

Authors: Cheng, Zhi-Qi, Dai, Qi, Hauptmann, Alexander G.

Source: 2023 IEEE/CVF International Conference on Computer Vision (ICCV) ICCV Computer Vision (ICCV), 2023 IEEE/CVF International Conference on. :22145-22156 Oct, 2023

Relation: 2023 IEEE/CVF International Conference on Computer Vision (ICCV)

MetaDesigner: Advancing Artistic Typography Through AI-Driven, User-Centric, and Multilingual WordArt Synthesis

Authors: He, Jun-Yan, Cheng, Zhi-Qi, Li, Chenyang, Sun, Jingdong, He, Qi, Xiang, Wangmeng, Chen, Hanyuan, Lan, Jin-Peng, Lin, Xianhui, Zhu, Kang, Luo, Bin, Geng, Yifeng, Xie, Xuansong, Hauptmann, Alexander G.

Subject Terms: Computer Science - Artificial Intelligence, Computer Science - Human-Computer Interaction, Computer Science - Multimedia

Access URL: http://arxiv.org/abs/2406.19859

Human-Aware Vision-and-Language Navigation: Bridging Simulation to Reality with Dynamic Human Interactions

Authors: Li, Heng, Li, Minghan, Cheng, Zhi-Qi, Dong, Yifei, Zhou, Yuxuan, He, Jun-Yan, Dai, Qi, Mitamura, Teruko, Hauptmann, Alexander G.

Subject Terms: Computer Science - Artificial Intelligence, Computer Science - Computer Vision and Pattern Recognition, Computer Science - Robotics

Access URL: http://arxiv.org/abs/2406.19236

Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning

Authors: Cheng, Zebang, Cheng, Zhi-Qi, He, Jun-Yan, Sun, Jingdong, Wang, Kai, Lin, Yuxiang, Lian, Zheng, Peng, Xiaojiang, Hauptmann, Alexander

Subject Terms: Computer Science - Artificial Intelligence, Computer Science - Multimedia

Access URL: http://arxiv.org/abs/2406.11161

Learning Visual-Semantic Subspace Representations for Propositional Reasoning

Authors: Moreira, Gabriel, Hauptmann, Alexander, Marques, Manuel, Costeira, João Paulo

Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Machine Learning

Access URL: http://arxiv.org/abs/2405.16213

UMETTS: A Unified Framework for Emotional Text-to-Speech Synthesis with Multimodal Prompts

Authors: Cheng, Zhi-Qi, Li, Xiang, He, Jun-Yan, Chen, Junyao, Fan, Xiaomao, Peng, Xiaojiang, Hauptmann, Alexander G.

Subject Terms: Computer Science - Computation and Language, Computer Science - Multimedia

Access URL: http://arxiv.org/abs/2404.18398

Direct Preference Optimization of Video Large Multimodal Models from Language Model Reward

Authors: Zhang, Ruohong, Gui, Liangke, Sun, Zhiqing, Feng, Yihao, Xu, Keyang, Zhang, Yuanhan, Fu, Di, Li, Chunyuan, Hauptmann, Alexander, Bisk, Yonatan, Yang, Yiming

Subject Terms: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Artificial Intelligence

Access URL: http://arxiv.org/abs/2404.01258

STMT: A Spatial-Temporal Mesh Transformer for MoCap-Based Action Recognition

Authors: Zhu, Xiaoyu, Huang, Po-Yao, Liang, Junwei, De Melo, Celso M., Hauptmann, Alexander

Source: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) CVPR Computer Vision and Pattern Recognition (CVPR), 2023 IEEE/CVF Conference on. :1526-1536 Jun, 2023

Relation: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

MAGVIT: Masked Generative Video Transformer

Authors: Yu, Lijun, Cheng, Yong, Sohn, Kihyuk, Lezama, Jose, Zhang, Han, Chang, Huiwen, Hauptmann, Alexander G., Yang, Ming-Hsuan, Hao, Yuan, Essa, Irfan, Jiang, Lu

Source: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) CVPR Computer Vision and Pattern Recognition (CVPR), 2023 IEEE/CVF Conference on. :10459-10469 Jun, 2023

Relation: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)