Bibliographic Details
| Title: |
A Lightweight Multimodal Footprint Recognition Network Based on Progressive Multi-Granularity Feature Fusion. |
| Authors: |
Cao, Ruike1 (AUTHOR) p02014263@stu.ahu.edu.cn, Li, Luowei2 (AUTHOR) p02014007@stu.ahu.edu.cn, Zhang, Yan1 (AUTHOR) zhangyan@ahu.edu.cn, Wu, Jun1 (AUTHOR) junwu@ahu.edu.cn, Zhao, Xinyu1 (AUTHOR) p01914206@stu.ahu.edu.cn |
| Source: |
International Journal of Pattern Recognition & Artificial Intelligence. Nov2023, Vol. 37 Issue 14, p1-17. 17p. |
| Subject Terms: |
Footprints, Image recognition (Computer vision), Feature extraction, Muscle strength, Human body |
| Abstract: |
The main differences in images of footprints are the proportion of the parts of foot and the distribution of pressure, which can be considered as fine-grained image classification. Moreover, the deviation of human body weight and muscle strength increases the difficulty of identifying the left and right feet. While using a fine-grained image classification network to solve the footprint image classification problem is certainly a feasible approach, the number of parameters in a fine-grained image classification network is generally large, and therefore we would like to build a lightweight classification network that is suitable for several small footprint datasets. In this paper, a multimodal footprint recognition algorithm based on progressive multi-granularity feature fusion is proposed. First, the shallow dense connection network is used to extract features. The feature extraction ability of the model is improved with the help of channel splicing and feature multiplexing. Second, to learn footprint images of different granularities, the progressive training strategy and puzzle scrambler are applied to the model. Finally, factorized bilinear coding can aggregate local features to obtain more discriminative global representation features. Experiments show that our network achieves comparable classification accuracy to some fine-grained image classification models (PMG, MSEC) on the complete pressure footprint dataset, but the number of parameters in our network is greatly reduced. Meanwhile, our network also achieves good classification results on several other footprint datasets, which demonstrates the effectiveness of our network. At the same time, an ablation experiment was carried out to verify the effectiveness of the progressive strategy and the factorized bilinear coding. [ABSTRACT FROM AUTHOR] |
|
Copyright of International Journal of Pattern Recognition & Artificial Intelligence is the property of World Scientific Publishing Company and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) |
| Database: |
Business Source Complete |
