Databases Reference
In-Depth Information
FIGURE 6.1
Data warehouse 1.0 infrastructure layers.
6.
Data transformation:
●
In this step all the key staging to EDW data transformation rules are processed.
●
Data aggregations and summarizations are applied.
●
Data encryption rules are applied.
7.
Data presentation:
●
In this step the data presentation layers including views and other semantic layers are readied
for user access.
●
Data security rules are applied.
Infrastructure
The data architecture of a data warehouse is the key to the castle of knowledge that lies within, but
the infrastructure of a data warehouse is the castle. The data warehouse architecture from an infra-
structure perspective consists of the following as shown in
Figure 6.1
:
●
Source systems
—these represent the various source feeds for the data warehouse.
●
Data movement
(ETL/CDC) —this represents the primary programming techniques of moving
data within the ecosystem.
●
Databases
—there are several databases created and deployed within the data warehouse:
●
Staging areas
—these databases (in some instances, there is more than one staging database to
accommodate data from different sources) are the primary landing and preprocessing zone for
all the data that needs to be moved into the data warehouse.
