Premium
Tracking provenance in a virtual data grid
Author(s) -
Clifford Ben,
Foster Ian,
Voeckler JensS.,
Wilde Michael,
Zhao Yong
Publication year - 2007
Publication title -
concurrency and computation: practice and experience
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.309
H-Index - 67
eISSN - 1532-0634
pISSN - 1532-0626
DOI - 10.1002/cpe.1256
Subject(s) - computer science , metadata , set (abstract data type) , semantics (computer science) , data set , data model (gis) , computation , grid , annotation , information retrieval , database , data mining , programming language , world wide web , artificial intelligence , geometry , mathematics
The virtual data model allows data sets to be described prior to, and separately from, their physical materialization. We have implemented this model in a Virtual Data Language (VDL) and associated supporting tools, which provide for both the storage, query, and retrieval of virtual data set descriptions, and the automated, on‐demand materialization of virtual data sets. We use a standardized data provenance challenge exercise to illustrate the powerful queries that can be performed on the data maintained by these tools, which for a single virtual data set can include three elements: the computational procedure(s) that must be executed to materialize the data set, the runtime log(s) produced by the execution of the computation(s), and optional metadata annotation(s) that associate application semantics with data and procedures. Copyright © 2007 John Wiley & Sons, Ltd.