Database Reference
In-Depth Information
on HDInsight may be better lived in your enterprise data warehouse that is
sitting in your data center.
Another common scenario in a hybrid environment is when data is born
on-premise and you want to take that transactional data and store it in the
cloud for additional processing. To do that, you must move a significant
amount of data from the data center to the cloud.
Getting thesehybrid solutions towork welltogether isan integral stepin the
success of your hybrid environment. Throughout this chapter, we examine
details of these two scenarios.
When customers ask about hybrid solutions, it is often recommended that
customers start with the assumption that data born in the cloud stays in
the cloud and data born on-premise stays on-premise. This advice attempts
to stem the data movement discussions and complexity of a hybrid
environment. It also just makes sense.
With the advent of phones and tablets and their applications, as well as
other cloud-based applications, a significant amount of data is being born
in the cloud today. The amount of data that requires analytics is exploding.
This data can be very large and quickly changing. On-premise traditional
solutions and organizations cannot easily handle this complexity and scale.
If possible, your organization should take advantage of cloud-based
technologies for the additional required analysis. If you are using HDInsight
and have a requirement to drive additional business intelligence (BI)
reporting from the resulting data set, look into a Windows Azure SQL
Database and Power BI Solution. With these, you can leverage your existing
SQL Server development and administration skillset, but with the power,
scalability, and cost-effectiveness of the cloud.
However, there may be a requirement that the resulting data set from
HDInsight be hosted on-premise. This can be for a variety of reasons. You
might have an existing enterprise data warehouse with which you want to
integrate. Regulatory reasons might force you to host that data on-premise.
Or you may not be able to overcome the internal politics of an organization
not quite ready to host all data outside your organization. Whatever the
reason, a hybrid solution is in your cards, and you will need to dive into the
details of the architecture.
A great deal of data is still being born on-premise within organizations.
These organizations may have identified an opportunity to use Hadoop for
