VISTA data flow system: overview | Zendy

J. P. Emerson | Zendy; Mike Irwin | Zendy; Jim Lewis | Zendy; S. T. Hodgkin | Zendy; D. W. Evans | Zendy; P. Bunclark | Zendy; R. G. McMahon | Zendy; N. C. Hambly | Zendy; Robert G. Mann | Zendy; I. A. Bond | Zendy; E. Sutorius | Zendy; M. A. Read | Zendy; P. M. Williams | Zendy; Andrew Lawrence | Zendy; Malcolm Stewart | Zendy

AI Assistant Blog Pricing

Home ZAIA Blog

Open Access

VISTA data flow system: overview

Author(s) -

J. P. Emerson,

Mike Irwin,

Jim Lewis,

S. T. Hodgkin,

D. W. Evans,

P. Bunclark,

R. G. McMahon,

N. C. Hambly,

Robert G. Mann,

I. A. Bond,

E. Sutorius,

M. A. Read,

P. M. Williams,

Andrew Lawrence,

Malcolm Stewart

Publication year - 2004

Publication title -

proceedings of spie, the international society for optical engineering/proceedings of spie

Language(s) - English

Resource type - Conference proceedings

SCImago Journal Rank - 0.192

H-Index - 176

eISSN - 1996-756X

pISSN - 0277-786X

DOI - 10.1117/12.551582

Subject(s) - computer science , pipeline (software) , context (archaeology) , observatory , data quality , data flow diagram , virtual observatory , systems engineering , database , geology , operating system , engineering , astronomy , physics , paleontology , metric (unit) , operations management

Data from the two IR survey cameras ,WFCAM (at UKIRT in the northern hemisphere) and VISTA (at ESO in the southern hemisphere) can arrive at rates approaching,1.4 TB/night for of order 10 years. Handling the data rates on a nightly basis, and the volumes of survey data accumulated over time each present new challenges. The approach adopted by the UK's VISTA Data Flow System (for WFCAM & VISTA data) is outlined, emphasizing how the design will meet the end-to-end requirements of the system, from on-site monitoring of the quality of the data acquired, removal of instrumental artefacts, astrometric and photometric calibration, to accessibilityof curated and user-specified data products in the context of the Virtual Observatory. Accompanying,papers by Irwin et al ,detail the design of the pipeline and science archive aspects of the project. Keywords: astronomical surveys, data quality control, pipeline, science archives, VISTA, WFCAM, VDFS

The content you want is available to Zendy users.

Already have an account? Click here to sign in.

Having issues? You can contact us here

Accelerating Research