Open AccessInfrared object classification with a hybrid optical convolution neural network
Author(s) -
Jianbo Chen,
Jennifer Talley,
Kevin F. Kelly
Publication year - 2021
Publication title -
applied optics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.668
H-Index - 197
eISSN - 2155-3165
pISSN - 1559-128X
DOI - 10.1364/ao.427973
Subject(s) - computer science , artificial intelligence , convolutional neural network , computer vision , detector , pixel , convolution (computer science) , object detection , artificial neural network , machine vision , transmission (telecommunications) , bandwidth (computing) , pattern recognition (psychology) , telecommunications
Recent advancements in machine vision have enabled a great range of applications from image classification to autonomous driving. However, there is still a dilemma between the pursuit of higher-resolution training images that require a detector array with more pixels on the front end, and the demands on acquisition for embedded systems restrained by power, transmission bandwidth, and storage. In this paper, a multi-pixel hybrid optical convolutional neural network machine vision system was designed and validated to perform high-speed infrared object detection. The proposed system replicates the front convolution layer in a convolutional neural network utilizing a high-speed digital micro-mirror device to display the first layer of kernels at a resolution greater than the subsequent detector. After this, further convolutions are carried out in software to perform the object recognition. An infrared vehicle dataset was used to validate the performance of the hybrid system through simulation. We also tested this in hardware by performing infrared classification on toy vehicles to showcase the feasibility of such a design.