Databases Reference
In-Depth Information
Big data also provides its own tier two storage environment. Large quantities
of unstructured data can be placed in Hadoop, which can be MapReduced later
for any meaningful insight. A number of query tools are now available for large-
scale queries on this data.
At the beginning of this chapter, we raised three questions for which we have
provided partial answers as summarized below:
Single view of the customer —We now have access to more complete data
on how customers use their products for their communications, content,
and commerce needs. As we merge this newly acquired data with
everything else, we must closely monitor how the data is being
used and how it is being aggregated. All this occurs as we radically
change the rules on data privacy, redeine MDM, and encounter new
concerns relating to data quality.
Big data quality —Customer data comes from a variety of “biased”
samples with different levels of data quality. As we homogenize this data,
we must establish conidence levels on raw data, as well as aggregations
and inferences, in order to understand and remind users of the “biases”
built into the sourced data.
Information lifecycle management —This is a lot more data than we have
ever encountered before. Our current analytics systems are not capable of
ingesting, storing, and analyzing these volumes at the required velocities.
We may decide to store only samples of the data or use Hadoop for the
storage and retrieval of large volumes of unstructured data.
We have explored a number of case studies, observations, and solutions in
the chapter. This is a new ield, and organizations are breaking new ground in
terms of Big Data governance. We are sure to ind new solutions to data quality,
MDM, data privacy, and information lifecycle management as we deal with Big
Data governance.
6.3 Journey, Milestones, and Maturity Levels
Big Data Analytics is a journey. What may be a bleeding-edge capability for one
company or industry may be the base-level criteria for staying in business for
another. This section describes a maturity model that allows us to measure the
milestones in this journey so that we can benchmark a company in comparison
with its peers. In Chapter 3, we discussed a number of business use cases. The
maturity model can be applied to each of those use cases to help us measure
 
Search WWH ::




Custom Search