Dynamic Sensor Matching for Parallel Point Cloud Data Acquisition

Based on depth perception of individual stereo cameras, spatial structures can be derived as point clouds. Thequality of such three-dimensional data is technically restricted by sensor limitations, latency of recording, andinsufficient object reconstructions caused by surface illustration. Additionally external physical effects likelighting conditions, material properties, and reflections can lead to deviations between real and virtual objectperception. Such physical influences can be seen in rendered point clouds as geometrical imaging errors onsurfaces and edges. We propose the simultaneous use of multiple and dynamically arranged cameras. Theincreased information density leads to more details in surrounding detection and object illustration. During apre-processing phase the collected data are merged and prepared. Subsequently, a logical analysis part examinesand allocates the captured images to three-dimensional space. For this purpose, it is necessary to create a newmetadata set consisting of image and localisation data. The post-processing reworks and matches the locallyassigned images. As a result, the dynamic moving images become comparable so that a more accurate point cloudcan be generated. For evaluation and better comparability we decided to use synthetically generated data sets. Ourapproach builds the foundation for dynamic and real-time based generation of digital twins with the aid of realsensor data.