Database Reference
In-Depth Information
Dealing with Large Files
Large files present a special challenge for any database, such as SQL or NoSQL, and
HBase is no exception to this. This is because databases were not designed for large
files in the first place. Rather, they were designed to store column values in rows
(which are usually small strings or numbers).
Gradually, the use of databases was expanded and strings became longer. Then,
people wanted to store binary information (just because there was no other
convenient place to store it) so that they could point to one location and say with
confidence, "This is where all my data lives." Thus came the concept of a
binary
large object
(
BLOB
).
However, again, since no database was designed to store large objects, you would
have to design a custom solution based on your requirements, that is, the size of the
objects, the frequency of reads and writes, and so on.
SQL, NoSQL
and Hbase
can't store
this! What
do we do?
L
A
R
G
E
F
I
L
E
S
