Two-level Dynamic Workflow Orchestration in the INDIGO DataCloud for Large-scale, Climate Change Data Analytics Experiments | Zendy

Marcin Płóciennik | Zendy; Sandro Fiore | Zendy; Giacinto Donvito | Zendy; Michał Owsiak | Zendy; Marco Fargetta | Zendy; R. Barbera | Zendy; Riccardo Bruno | Zendy; Emidio Giorgio | Zendy; D. N. Williams | Zendy; Giovanni Aloisio | Zendy

Open Access

Two-level Dynamic Workflow Orchestration in the INDIGO DataCloud for Large-scale, Climate Change Data Analytics Experiments

Author(s) -

Marcin Płóciennik,

Sandro Fiore,

Giacinto Donvito,

Michał Owsiak,

Marco Fargetta,

R. Barbera,

Riccardo Bruno,

Emidio Giorgio,

D. N. Williams,

Giovanni Aloisio

Publication year - 2016

Publication title -

procedia computer science

Language(s) - English

Resource type - Journals

SCImago Journal Rank - 0.334

H-Index - 76

ISSN - 1877-0509

DOI - 10.1016/j.procs.2016.05.359

Subject(s) - orchestration , computer science , workflow , cloud computing , analytics , data science , big data , provisioning , service (business) , e science , software , world wide web , software engineering , database , telecommunications , data mining , art , musical , geometry , economy , mathematics , economics , visual arts , programming language , grid , operating system

In this paper we present the approach proposed by EU H2020 INDIGO-DataCloud project to orchestrate dynamic workflows over a cloud environment. The main focus of the project is on the development of open source Platform as a Service solutions targeted at scientific communities, deployable on multiple hardware platforms, and provisioned over hybrid e-Infrastructures. The project is addressing many challenging gaps in current cloud solutions, responding to specific requirements coming from scientific communities including Life Sciences, Physical Sciences and Astronomy, Social Sciences and Humanities, and Environmental Sciences. We are presenting the ongoing work on implementing the whole software chain on the Infrastructure as a Service, PaaS and Software as a Service layers, focusing on the scenarios involving scientific workflows and big data analytics frameworks. INDIGO module for Kepler worflow system has been introduced along with the INDIGO underlying services exploited by the workflow components. A climate change data analytics experiment use case regarding the precipitation trend analysis on CMIP5 data is described, that makes use of Kepler and big data analytics services

The content you want is available to Zendy users.

Already have an account? Click here to sign in.

Having issues? You can contact us here

Accelerating Research