String Matching Techniques: An Empirical Assessment Based on Statistics Austria's Business Register
Author(s) -
Michaela Denk,
Peter Hackl,
Norbert Rainer
Publication year - 2016
Publication title -
austrian journal of statistics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.342
H-Index - 9
ISSN - 1026-597X
DOI - 10.17713/ajs.v34i3.415
Subject(s) - bigram , computer science , register (sociolinguistics) , matching (statistics) , statistics , data mining , database , natural language processing , mathematics , trigram , linguistics , philosophy
The maintenance and updating of Statistics Austria's business register requires a regularly matching of the register against other data sources; one of them is the register of tax units of the Austrian Federal Ministry of Finance. The matching process is based on string comparison via bigrams of enterprise names and addresses, and a quality class approach assigning pairs of register units into classes of different compliance (i.e., matching quality) based on bigram similarity values and the comparison of other matching variables, like the NACE code or the year of foundation. Based on methodological research concerning matching techniques carried out in the DIECOFIS project, an empirical comparison of the bigram method and other string matching techniques was conducted: the edit distance, the Jaro algorithm and the Jaro-Winkler algorithm, the longest common subsequence and the maximal match were selected as appropriate alternatives and evaluated in the study. This paper briefly introduces Statistics Austria's business register and the corresponding maintenance process and reports on the results of the empirical study.
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom