Database Reference
In-Depth Information
Figure 4-3. Historical data can be ingested at high speed through direct blob ingenstion by using
the blob loader alongside Open TSDB, without needing an in-memory cache. Additional architec-
tural components are shown grayed out here for context.
When using this blob loader, no changes are needed to the TSD systems or to the UI com-
ponents since the blob loader is simply loading data in a format that Open TSDB already
uses. In fact, you can be ingesting data in the normal fashion at the same time that you are
loading historical data using the blob loader.
The blob loader accelerates data ingestion by short-circuiting the normal load path of Open
TSDB. The effect is that data can be loaded at an enormous rate because the number of data-
base operations is decreased by a large factor for data that has a sufficiently large number of
samples in each time window.
