Argus: Multi-View Egocentric Human Mesh Reconstruction Based on Stripped-Down Wearable mmWave Add-on

Bibliographic Details
Title: Argus: Multi-View Egocentric Human Mesh Reconstruction Based on Stripped-Down Wearable mmWave Add-on
Authors: Duan, Di, Lyu, Shengzhe, Yuan, Mu, Xue, Hongfei, Li, Tianxing, Xu, Weitao, Wu, Kaishun, Xing, Guoliang
Publication Year: 2024
Collection: Computer Science
Subject Terms: Computer Science - Human-Computer Interaction, C.3
More Details: In this paper, we propose Argus, a wearable add-on system based on stripped-down (i.e., compact, lightweight, low-power, limited-capability) mmWave radars. It is the first to achieve egocentric human mesh reconstruction in a multi-view manner. Compared with conventional frontal-view mmWave sensing solutions, it addresses several pain points, such as restricted sensing range, occlusion, and the multipath effect caused by surroundings. To overcome the limited capabilities of the stripped-down mmWave radars (with only one transmit antenna and three receive antennas), we tackle three main challenges and propose a holistic solution, including tailored hardware design, sophisticated signal processing, and a deep neural network optimized for high-dimensional complex point clouds. Extensive evaluation shows that Argus achieves performance comparable to traditional solutions based on high-capability mmWave radars, with an average vertex error of 6.5 cm, solely using stripped-down radars deployed in a multi-view configuration. It presents robustness and practicality across conditions, such as with unseen users and different host devices.
Comment: 15 pages, 25 figures
Document Type: Working Paper
Access URL: http://arxiv.org/abs/2411.00419
Accession Number: edsarx.2411.00419
Database: arXiv
More Details
Description not available.