Database Reference
In-Depth Information
CHAPTER 11
Data Warehouse Patterns
SQL Server Integration Services is an excellent all-purpose ETL tool. Because of its
versatility, it is used by DBAs, developers, BI professionals, and even business prin-
cipals in many different scenarios. Sometimes it's a dump truck, used for the wholesale
movement of enormous amounts of data. Other times it's more like a scalpel, carving
out with precision just the right amount of data.
Though it is a great tool in other areas, SSIS truly excels when used as a data ware-
house ETL tool. It would be hard to argue that data warehousing isn't its primary pur-
pose in life. From native slowly changing dimension (SCD) elements to recently added
CDC processing tasks and components, SSIS has all the hooks it needs to compete with
data warehouse ETL tools at much higher price points.
In this chapter, we'll discuss design patterns applicable to loading a data warehouse
using SQL Server Integration Services. From incremental loads to error handling and
general workflow, we'll investigate methodologies and best practices that can be applied
in SSIS data warehouse ETL.
Incremental Loads
Anyone who has spent more than ten minutes working in the data warehouse space has
heard the term
incremental loa d
. Before we demonstrate design patterns for performing
incremental loads, let's first touch on the need for an incremental load.
What Is an Incremental Load?
Search WWH ::
Custom Search