Back to Search Start Over

On-Chip Data Reduction and Object Detection for a Feature-Extractable CMOS Image Sensor †.

Authors :
Morikaku, Yudai
Ujiie, Ryuichi
Morikawa, Daisuke
Shima, Hideki
Yoshida, Kota
Okura, Shunsuke
Source :
Electronics (2079-9292); Nov2024, Vol. 13 Issue 21, p4295, 17p
Publication Year :
2024

Abstract

In order to improve image recognition technologies in an IoT environment, we propose a data reduction scheme for a feature-extractable CMOS image sensor and present simulation results for object recognition using feature data. We evaluated the accuracy of the simulated feature data in object recognition based on YOLOX trained with a feature dataset. According to our simulation results, the obtained object recognition accuracy was 56.6 % with the large-scale COCO dataset, even though the amount of data was reduced by 97.7 % compared to conventional RGB color images. When the dataset was replaced with the RAISE RAW image dataset for more accurate simulation, the object recognition accuracy improved to 76.3 % . Furthermore, the feature-extractable CMOS image sensor can switch its operation mode between RGB color image mode and feature data mode. When the trigger for switching from feature data mode to RGB color image mode was set to the detection of a large-sized person, the feature data achieved an accuracy of 93.5 % with the COCO dataset. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
20799292
Volume :
13
Issue :
21
Database :
Complementary Index
Journal :
Electronics (2079-9292)
Publication Type :
Academic Journal
Accession number :
180781842
Full Text :
https://doi.org/10.3390/electronics13214295