Open AccessResearch on data cleaning technology based on instance level
Author(s) -
Chuan Li,
Yunqi Hou,
Yu Zhang
Publication year - 2019
Publication title -
journal of physics. conference series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.21
H-Index - 85
eISSN - 1742-6596
pISSN - 1742-6588
DOI - 10.1088/1742-6596/1213/2/022021
Subject(s) - computer science , process (computing) , data quality , quality (philosophy) , data mining , engineering , programming language , metric (unit) , philosophy , operations management , epistemology
In the era of current data explosion, data cleaning becomes an important part of data analysis, and it is also one of the important means to improve data quality. In this paper, the concept, principle, process, detection method and related cleaning algorithm of structural data cleaning are introduced in detail through the data cleaning technology based on instance level. In view of the outstanding data quality problems based on instance level, relevant experiment is designed, the operation and verification process of structural data cleaning will explain concretely through visual programming technology and machine learning algorithm. Finally, the research of data cleaning technology in the future is prospected.