Database Reference
In-Depth Information
Chapter 10
Data Warehouses and Hadoop Integration
What You Will Learn in This Chapter:
• Understanding the Current “State of the Union”
• Learning About the Challenges Faced with the Traditional Data
Warehouse
• Discovering Hadoop's Impact on Data Warehouses and Design
• Introducing Parallel Data Warehouse
• Finding Out About PDW's Architecture
• Grasping the Concepts Behind Project Polybase
• Gaining Insight on How to Use Polybase in Solutions
• Looking into the Future for Polybase
There has never been a more exciting time to be working in the analytics and
data warehousing space; and it most certainly is a
space
. Data warehouses
should be considered to be a place for free thinking—logical entities that
holistically span the business, not physical beings constrained by limits of
today's technology and yesterday's decisions. The aspiration for the new
world of data is liberty: seamless, friction free-integration across the
enterprise and beyond.
Therefore, we start by taking a deeper look at the emerging relationship
between data warehouses and Hadoop. The current methods using Sqoop
offerlimitedvalue,butbothdatawarehousevendorsandHadoopneedmore.
More importantly, business has demanded more. More so than ever, data
warehouse vendors have really had to up their game to demonstrate their
value and thought leadership to the enterprise in the face of the disruptive
technology that is Hadoop.
This chapter focuses on the changes Microsoft has been making to their data
warehouse offerings to address the challenges faced by data warehouses and
also how they are embracing Hadoop, offering industry-level innovation to
Hadoop integration with Project Polybase. Let's get started.
