Open AccessApplied Webscraping in Market Research
Author(s) -
Martin Herrmann,
Markus
Publication year - 2016
Language(s) - English
Resource type - Conference proceedings
DOI - 10.4995/carma2016.2016.3131
Subject(s) - the internet , computer science , enabling , download , social media , data science , open data , data extraction , unstructured data , world wide web , product (mathematics) , market research , big data , data mining , business , marketing , psychology , geometry , mathematics , medline , political science , law , psychotherapist
Modern Webscraping tools and APIs facilitate the extraction of information from the Internet significantly, especially if the data is not offered for download in a structured format. In this abstract we outline, that Webscraping, as a common practice to load, prepare and statistically analyze specific structured or unstructured data from the Internet, has become an essential application in Marketing and Data Science. Furthermore, we emphasize the importance of Open Data and social media data as a scraping target and illustrate examples of Open Data and social media data integration, Sentiment Analysis and website content classification as a utilization of Webscraping in a Market Research environment. While we argue that Webscraping of internet data is an enabler and driver of product innovation in Market Research it should also be noted that there are some legal restrictions involved.