Open AccessDynamic single-photon 3D imaging with a sparsity-based neural network
Author(s) -
Gongxin Yao,
Yiwei Chen,
Chen Jiang,
Yixin Xuan,
Xiaomin Hu,
Yong Liu,
Yu Pan
Publication year - 2022
Publication title -
optics express
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.394
H-Index - 271
ISSN - 1094-4087
DOI - 10.1364/oe.471610
Subject(s) - computer science , deep learning , computation , artificial intelligence , convolutional neural network , memory footprint , high dynamic range , ranging , inference , computer vision , artificial neural network , image resolution , real time computing , dynamic range , computer engineering , algorithm , telecommunications , operating system
Deep learning is emerging as an important tool for single-photon light detection and ranging (LiDAR) with high photon efficiency and image reconstruction quality. Nevertheless, the existing deep learning methods still suffer from high memory footprint and low inference speed, which undermine their compatibility when it comes to dynamic and long-range imaging with resource-constrained devices. By exploiting the sparsity of the data, we proposed an efficient neural network architecture which significantly reduces the storage and computation overhead by skipping the inactive sites with no photon counts. In contrast with the state-of-the-art deep learning methods, our method supports one-shot processing of data frames with high spatial resolution, and achieves over 90% acceleration in computation speed without sacrificing the reconstruction quality. In addition, the speed of our method is not sensitive to the detection distance. The experiment results on public real-world dataset and our home-built system have demonstrated the outstanding dynamic imaging capability of the algorithm, which is orders of magnitude faster than the competing methods and does not require any data pruning for hardware compatibility.