A distributed data management system for data-intensive radio astronomy

Arne Grimstrup; Venkat Mahadevan; Olivier Eymere; Ken Anderson; Cameron Kiddle; Rob Simmonds; Erik Rosolowsky; Andrew R. Taylor

doi:10.1117/12.925441

24 September 2012 A distributed data management system for data-intensive radio astronomy

Arne Grimstrup, Venkat Mahadevan, Olivier Eymere, Ken Anderson, Cameron Kiddle, Rob Simmonds, Erik Rosolowsky, Andrew R. Taylor

Author Affiliations +

Proceedings Volume 8451, Software and Cyberinfrastructure for Astronomy II; 845115 (2012) https://doi.org/10.1117/12.925441
Event: SPIE Astronomical Telescopes + Instrumentation, 2012, Amsterdam, Netherlands

Abstract

The next generation of telescopes, such as the Square Kilometre Array (SKA), will generate orders of magnitude more data than previous instruments, far in excess of current storage and networking system handling abilities. To address this problem, we propose an architecture where data is distributed over several archive sites, each holding only a portion of the overall data, that provides efficient and transparent access to the archive as a whole. This paper describes that architecture in detail and the design and implementation of a prototype system, based on the Integrated Rule-Oriented Data System (iRODS) software.

Citation Download Citation

Arne Grimstrup, Venkat Mahadevan, Olivier Eymere, Ken Anderson, Cameron Kiddle, Rob Simmonds, Erik Rosolowsky, and Andrew R. Taylor "A distributed data management system for data-intensive radio astronomy", Proc. SPIE 8451, Software and Cyberinfrastructure for Astronomy II, 845115 (24 September 2012); https://doi.org/10.1117/12.925441

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available