Open AccessDesign and Implementation of a Mixed Reality Night Hoisting Assistance System Driven by Digital Twins
Author(s) -
Hengwei Li,
Wei Wang,
Jinping Qu,
Ang Qiu,
Chenghong Niu,
Chengyu Li
Publication year - 2022
Publication title -
journal of physics. conference series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.21
H-Index - 85
eISSN - 1742-6596
pISSN - 1742-6588
DOI - 10.1088/1742-6596/2224/1/012056
Subject(s) - computer science , visibility , synchronization (alternating current) , simulation , gesture , mixed reality , human–computer interaction , real time computing , virtual reality , computer vision , telecommunications , channel (broadcasting) , physics , optics
Hoisting at night has low visibility and high operational complexity, which has the problems of large cognitive load and high risk. With the help of digital twin (DT) and mixed reality (MR), the article designs and implements a MR night hoisting assistance system driven by DT. The system is developed on the Unity3D platform and based on the UNet networking communication mechanism. It realizes the functions of fusion highlighting, motion synchronization, multi-terminal collaboration and error display. It also has multiple interaction methods such as voice interaction, gesture recognition, and sight tracking. The research results have positive significance for improving the effect of night hoisting.