Open AccessResearch on Task Scheduling Strategy based on the Trustworthiness of MapReduce
Author(s) -
Jun Qin,
Yukun Song,
Ping Zong
Publication year - 2021
Language(s) - English
Resource type - Conference proceedings
DOI - 10.5121/csit.2021.111304
Subject(s) - computer science , cloudsim , cloud computing , distributed computing , scheduling (production processes) , trustworthiness , fault tolerance , task (project management) , task analysis , operating system , computer security , operations management , management , economics
With the rapid development and popularization of information technology, cloud computing technology provides a good environment for solving massive data processing. Hadoop is an open-source implementation of MapReduce and has the ability to process large amounts of data. Aiming at the shortcomings of the fault-tolerant technology in the MapReduce programming model, this paper proposes a reliability task scheduling strategy that introduces a failure recovery mechanism, evaluates the trustworthiness of resource nodes in the cloud environment, establishes a trustworthiness model, and avoids task allocation to low reliability node, causing the task to be re-executed, wasting time and resources. Finally, the simulation platform CloudSim verifies the validity and stability of the task scheduling algorithm and scheduling model proposed in this paper.