Open AccessShort Term Stock Movements with Big Data and Market Sentiments Analytics
Author(s) -
Sneh Kalra,
Sachin Kumar Gupta,
Jay Shankar Prasad
Publication year - 2019
Publication title -
international journal of innovative technology and exploring engineering
Language(s) - English
Resource type - Journals
ISSN - 2278-3075
DOI - 10.35940/ijitee.i8474.078919
Subject(s) - big data , computer science , stock market , data science , sentiment analysis , analytics , spark (programming language) , predictive analytics , data analysis , term (time) , machine learning , data mining , econometrics , economics , paleontology , physics , horse , quantum mechanics , biology , programming language
Machine Learning Techniques and Big Data analytics are two central points of data science. Big Data is important for organizations to gain insights into it and machine learning techniques are one of the substantial assets for analyzing a massive amount of data. In this paper, a framework has been proposed to improve the short term stock trend prediction accuracy using Logistic Regression model by means of qualitative and quantitative data. This paper makes a comprehensive survey of stock market trend prediction with the accumulation of various data sources by applying machine learning techniques and by using big data analytics approach. The model has been implemented in Big data Framework with Hadoop and Apache Spark. For qualitative data Tweets sentiments and news sentiments has been taken in to account and for quantitative data Google trends and historical data are considered. The proposed system has enhanced the prediction accuracy about 3-4 % in comparison to existing models by supplying Google trend as input data in addition to market sentiments and historical data. The implemented model can help the investors to take short term decisions to make money in the security market and the survey would help in finding the most effective resources which overly influence the stock prices.