Open AccessTHE CHALLENGE OF MANAGING AND ANALYZING BIG DATA
Author(s) -
H. Heßling
Publication year - 2014
Publication title -
computing
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.184
H-Index - 11
eISSN - 2312-5381
pISSN - 1727-6209
DOI - 10.47839/ijc.12.3.600
Subject(s) - computer science , data science , big data , order (exchange) , scale (ratio) , exponential growth , data management , flood myth , data mining , mathematics , business , mathematical analysis , physics , finance , quantum mechanics , philosophy , theology
The amounts of data produced in science are growing exponentially. Traditional methods for storing and maintaining the enormous flood of data seem to be no longer sufficient anymore. The complexity of the data that will be distributed more and more worldwide, is going to constitute a considerable challenge for their analysis. According to Alex Szalay there soon will be produced so many data that they cannot even be stored and maintained anymore. The data have to be analyzed in real time in order to extract the relevant information. An outline of the project Large Scale Management and Analysis (LSDMA) is given. The status of our research group on distributed real-time computing is reviewed. Finally, a novel approach to time-dependent image processing based on local thermodynamical methods is presented.