Open AccessDevelopment of Automated Environmental Data Collection System and Environment Statistics Dashboard
Author(s) -
Dede Yoga Paramartha,
Ana Lailatul Fitriyani,
Setia Pramana
Publication year - 2021
Publication title -
indonesian journal of statistics and applications
Language(s) - English
Resource type - Journals
ISSN - 2599-0802
DOI - 10.29244/ijsa.v5i2p314-325
Subject(s) - dashboard , environmental data , data collection , proxy (statistics) , python (programming language) , environmental monitoring , computer science , environmental science , database , statistics , environmental engineering , mathematics , machine learning , political science , law , operating system
Environmental data such as pollutants, temperature, and humidity are data that have a role in the agricultural sector in predicting rainfall conditions. In fact, pollutant data is common to be used as a proxy to see the density of industry and transportation. With this need, it is necessary to have automated data from outside websites that are able to provide data faster than satellite confirmation. Data sourced from IQair, can be used as a benchmark or confirmative data for weather and environmental statistics in Indonesia. Data is taken by scraping method on the website. Scraping is done on the API available on the website. Scraping is divided into 2 stages, the first is to determine the location in Indonesia, the second is to collect statistics such as temperature, humidity, and pollutant data (AQI). The module used in python is the scrapy module, where the crawling is effective starting from May 2020. The data is recorded every three hours for all regions of Indonesia and directly displayed by the Power BI-based dashboard. We also illustrated that AQI data can be used as a proxy for socio-economic activity and also as an indicator in monitoring green growth in Indonesia.