Real-Time Multimodal Defect Detection and MES Feedback on Edge Devices via Bayesian Fusion and Causal Adaptation
Author(s) -
Yong Lin,
Wendi Lin,
Yadi Lin
Publication year - 2025
Publication title -
ieee access
Language(s) - English
Resource type - Magazines
SCImago Journal Rank - 0.587
H-Index - 127
eISSN - 2169-3536
DOI - 10.1109/access.2025.3610341
Subject(s) - aerospace , bioengineering , communication, networking and broadcast technologies , components, circuits, devices and systems , computing and processing , engineered materials, dielectrics and plasmas , engineering profession , fields, waves and electromagnetics , general topics for engineers , geoscience , nuclear engineering , photonics and electrooptics , power, energy and industry applications , robotics and control systems , signal processing and analysis , transportation
Conventional single-modality or loosely coupled inspection systems often degrade under partial occlusion, transient sensor dropout, or illumination drift, and their feedback to Manufacturing Execution Systems (MES) can be delayed or non-deterministic.We present D3Lite-MES , a real-time multimodal defect detection framework that (i) aligns heterogeneous sensors at both hardware and software levels, (ii) fuses them via a Bayesian–Causal Weighted Fusion (BCWF) module, and (iii) adapts model parameters on edge devices through a lightweight causal adaptation routine. Deployed on commodity edge hardware, the system sustains line-takt operation and writes verified defect events back to MES with bounded latency. On three production lines covering [product families anonymized] , D3Lite-MES attains a mean F1 of 98.2% and mAP@0.5 of 97.6%, reducing false alarms by 98.2% compared with lightweight baselines, at an end-to-end latency of 34 ms and average power of 8.9W. Ablations show that BCWF contributes +1.7% F1 under partial observations, while causal adaptation yields +1.7% under illumination drift. The MES feedback loop decreases manual triage time by 34% and shortens recovery from minor stops by 34%.
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom