Database Reference
In-Depth Information
Figure 1.10
Data evolution and rise of Big Data sources
The Big Data trend is generating an enormous amount of information from many
new sources. This data deluge requires advanced analytics and new market players
to take advantage of these opportunities and new market dynamics, which will be
discussed in the following section.
1.2.4 Emerging Big Data Ecosystem and a New Approach
to Analytics
Organizations and data collectors are realizing that the data they can gather from
individuals contains intrinsic value and, as a result, a new economy is emerging.
As this new digital economy continues to evolve, the market sees the introduction
of data vendors and data cleaners that use crowdsourcing (such as Mechanical
Turk and GalaxyZoo) to test the outcomes of machine learning techniques. Other
vendors offer added value by repackaging open source tools in a simpler way and
bringing the tools to market. Vendors such as Cloudera, Hortonworks, and Pivotal
have provided this value-add for the open source framework Hadoop.
As the new ecosystem takes shape, there are four main groups of players within
this interconnected web. These are shown in
Figure 1.11
.
•
Data devices
[shown in the (1) section of
Figure 1.11
] and the
“Sensornet” gather data from multiple locations and continuously
generate new data about this data. For each gigabyte of new data created,
an additional petabyte of data is created about that data. [2]
