Database Reference
In-Depth Information
Chapter 16
Operational Big Data Management
What You Will Learn in This Chapter
• Building Hybrid Big Data Environments
• Integrating Cloud and On-premise Solutions
• Preparing for Disaster Recovery and High Availability in Your Big Data
Environment
• Complying with Privacy Laws
• Creating Operational Analytics
Operationalizingyourbigdatasolutionincludesintegratingmultiplesources,
providing a platform for analysis and reporting, and providing analytics for
thesolutionsothatyoucanmonitorandimprovetheenvironmentasneeded.
All of this requires planning and attention to detail.
This chapter focuses on many of those things that you need to do to make
your big data implementation a success. The chapter first focuses on hybrid
big data environments, where efficient data movement is key. You will then
learn about the possibilities for backups and disaster recovery so that your
solution can withstand catastrophes. You'll also take a look at privacy issues
to ensure that you are always vigilant with personally identifiable
information (PII). The chapter then delves into the analytics you will need to
collecttoensurethatyoursolutioncangrowwiththeadditional demandsput
on it by growing data sets and user bases.
Hybrid Big Data Environments: Cloud and On-premise Solutions
Working Together
The promise of working with an elastic-scale cloud solution such as
HDInsight may be intriguing to many organizations. HDInsight in the cloud
provides your organization with significant deployment agility. It also
provides the infrastructure, high availability, and recoverability that would
otherwise take months for most organizations to build themselves.
However, your organization may have hundreds or thousands of users who
need access to that data for analysis. The result set of the processing you do
