Database Reference
In-Depth Information
Chapter 4
Big Data Storage
Abstract
In this chapter, we focus on the storage of big data. We will review
important issues including massive storage systems, distributed storage systems,
and big data storage mechanisms. On one hand, the storage infrastructure need to
provide information storage service with reliable storage space; on the other hand,
it must provide a powerful access interface for query and analysis of large amount
of data. Such a storage infrastructure generally consists of hardware infrastructure
and storage mechanisms.
4.1
Storage System for Massive Data
Data storage refers to the storage and management of large-scale datasets, while
achieving reliability and availability. A data storage system consists of two parts:
infrastructure and data storage methods or mechanisms. The hardware infrastructure
includes massive shared Information Communication Technology (ICT) resources
utilized to feedback instant demands of tasks, and such ICT resources are organized
in an elastic manner. The hardware infrastructure shall feature elasticity and
dynamic reconfiguration, to be adaptive to different application environments. Data
storage methods are deployed on the top of hardware infrastructure to maintain
large-scale datasets. Storage systems shall be equipped with many interfaces, rapid
query, or other programming models for analysis of or interaction with stored data.
The big data paradigm brings about an explosive growth of data. The sharp
growth of data has stringent requirements on storage and management. Tradition-
ally, data storage equipment is only auxiliary equipment of servers, and most of
them store, manage, look up, and analyze data with structured RDBMSs. The
GB, TB, to PB sharp growth of big data makes traditional storage equipment and
management modes inadequate. Data storage equipment is becoming increasingly
more important, and storage cost becomes the main expense of many Internet
companies. Therefore, there is a compelling need for research on data storage.
Search WWH ::
Custom Search