Premium
Simultaneous sensing, readout, and classification on an intensity‐ranking image sensor
Author(s) -
Ahlberg Jörgen,
Åström Anders,
Forchheimer Robert
Publication year - 2018
Publication title -
international journal of circuit theory and applications
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.364
H-Index - 52
eISSN - 1097-007X
pISSN - 0098-9886
DOI - 10.1002/cta.2549
Subject(s) - computer science , ranking (information retrieval) , artificial intelligence , pixel , intensity (physics) , computer vision , range (aeronautics) , image (mathematics) , image sensor , pattern recognition (psychology) , event (particle physics) , image processing , engineering , optics , physics , quantum mechanics , aerospace engineering
Summary We combine the near‐sensor image processing concept with address‐event representation leading to an intensity‐ranking image sensor (IRIS) and show the benefits of using this type of sensor for image classification. The functionality of IRIS is to output pixel coordinates (X and Y values) continuously as each pixel has collected a certain number of photons. Thus, the pixel outputs will be automatically intensity ranked. By keeping track of the timing of these events, it is possible to record the full dynamic range of the image. However, in many cases, this is not necessary—the intensity ranking in itself gives the needed information for the task at hand. This paper describes techniques for classification and proposes a particular variant (groves) that fits the IRIS architecture well as it can work on the intensity rankings only. Simulation results using the CIFAR‐10 dataset compare the results of the proposed method with the more conventional ferns technique. It is concluded that the simultaneous sensing and classification obtainable with the IRIS sensor yields both fast (shorter than full exposure time) and processing‐efficient classification.