Metadata management for CDP in object-based file system

Jie Yao; Qiang Cao; Jianzhong Huang

doi:10.1117/12.843122

23 October 2009 Metadata management for CDP in object-based file system

Jie Yao, Qiang Cao, Jianzhong Huang

Proceedings Volume 7517, Photonics and Optoelectronics Meetings (POEM) 2009: Optical Storage and New Storage Technologies; 751710 (2009) https://doi.org/10.1117/12.843122
Event: Photonics and Optoelectronics Meetings 2009, 2009, Wuhan, China

Abstract

Object-based storage system integrates advantage of both NAS and SAN, can be applied in large-capacity, low-cost and large-scale storage systems which are built from commodity devices. Continuous data protection (CDP) is a methodology that continuously captures or tracks data modifications and stores changes independent of the primary data, enabling recovery points from any point in the past. An efficient file system optimized for CDP is needed to provide CDP feature in object-based storage system. In this thesis, a new metadata management method is present. All necessary meta data information are recorded when changes happened to file system. We have a journal-like data placement algorithm to store these metadata. Secondly, this metadata management method provides both CDP feature and Object-based feature. Two type write operations are analyzed to reduce storage space consumption. Object-based data allocation algorithm can take the advantage of distributed file system to concurrently process CDP operations over storage nodes. Thirdly, history revisions and recovery operations are discussed. Finally, the experiment test result is present and analyzed.

Citation Download Citation

Jie Yao, Qiang Cao, and Jianzhong Huang "Metadata management for CDP in object-based file system", Proc. SPIE 7517, Photonics and Optoelectronics Meetings (POEM) 2009: Optical Storage and New Storage Technologies, 751710 (23 October 2009); https://doi.org/10.1117/12.843122

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available