On-Chip Data Reduction and Object Detection for a Feature-Extractable CMOS Image Sensor †.

Bibliographic Details
Title: On-Chip Data Reduction and Object Detection for a Feature-Extractable CMOS Image Sensor †.
Authors: Morikaku, Yudai, Ujiie, Ryuichi, Morikawa, Daisuke, Shima, Hideki, Yoshida, Kota, Okura, Shunsuke
Source: Electronics (2079-9292); Nov2024, Vol. 13 Issue 21, p4295, 17p
Subject Terms: RECOGNITION (Psychology), IMAGE recognition (Computer vision), FEATURE extraction, DATA reduction, INTERNET of things, CMOS image sensors
Abstract: In order to improve image recognition technologies in an IoT environment, we propose a data reduction scheme for a feature-extractable CMOS image sensor and present simulation results for object recognition using feature data. We evaluated the accuracy of the simulated feature data in object recognition based on YOLOX trained with a feature dataset. According to our simulation results, the obtained object recognition accuracy was 56.6 % with the large-scale COCO dataset, even though the amount of data was reduced by 97.7 % compared to conventional RGB color images. When the dataset was replaced with the RAISE RAW image dataset for more accurate simulation, the object recognition accuracy improved to 76.3 % . Furthermore, the feature-extractable CMOS image sensor can switch its operation mode between RGB color image mode and feature data mode. When the trigger for switching from feature data mode to RGB color image mode was set to the detection of a large-sized person, the feature data achieved an accuracy of 93.5 % with the COCO dataset. [ABSTRACT FROM AUTHOR]
Copyright of Electronics (2079-9292) is the property of MDPI and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Complementary Index
More Details
ISSN:20799292
DOI:10.3390/electronics13214295
Published in:Electronics (2079-9292)
Language:English