Databases Reference
In-Depth Information
FIGURE 10.1
Components of the next-generation data warehouse.
Components of the new data warehouse
Figure 10.1
shows the high-level components that will be the foundational building blocks of the
next-generation data warehouse, which is the integration of all the data in the enterprise including Big
Data. The lowest tier represents the data, the next tier represents the technologies that will be used in
integrating the data across the multiple types and sources of data, and the topmost layer represents the
analytical layer that will be used to drive the visualization needs of the next generation of business
intelligence and analytics. Let us first look at each layer of the components in detail and then move
onto the physical architecture options.
Data layer
As discussed in prior chapters, the next-generation data warehouse will have data from across the
enterprise that will be integrated and presented to the users for business decision-making and analysis
purposes. The data layer in the new platform includes the following.
●
Legacy data
. Data from all legacy systems and applications that include structured and
semi-structured formats of data, stored online or offline, can be integrated into the data
architecture. There are lots of use cases for this data type. Seismic data, hurricane data, census
data, urban planning data, and socioeconomic data are all forms of data that have been classified
as legacy over a period of time.
●
Transactional (OLTP) data
. Data from transactional systems traditionally is loaded to the data
warehouse. Due to scalability issues, transactional data is often modeled such that not all the
data from the source systems is used in analysis. The new platform can be used to load and
