Database Reference
In-Depth Information
After all, yougettotake allthatyouhave learned aboutacquiring, cleansing,
and managing data and apply it to a set of new tools and thus enable new
scalability opportunities and new performance limits that are far beyond
what existing systems can offer. If, in addition, you are leveraging the cloud
for your biggest solutions, you will have additional opportunities to manage
data asynchronously, on-premise solutions, cloud solutions, and enterprise
BI solutions wherever they are deployed.
System Administrators
System administrators are usually concerned with ensuring that systems are
appropriately deployed and maintained and performing at peak level. In
the big data ecosystem, all of these concerns still exist with clusters of the
Hadoop nodes within a distributed file system.
Many tools require configuration to control how they scale, how they
distribute, and how they manage data across different clusters. Some of
these clusters may be on premise, some of them in the cloud, and some
of them may be a hybrid scenario where some of the machines are on
premise and others are taking advantage of cloud elasticity for seasonal or a
particular type of analytic throughput.
System administrators will have their hands full learning all the new
configuration options, configuration files, and various other information
covered earlier in this topic.
NOTE
This topic is not an exhaustive reference; you might want to use many
other configuration options to manage the environment particular to an
organization. It is important to understand all the different options,
and there are great references out there to help you do that. You should
review the platform documentation for whichever vendor you are using
(for instance, Microsoft documentation for HDInsight or the
Hortonworks documentation for the Hortonworks Data Platform).
System administrators will serve as critical partners for data developers
of the future because the data developers will rely on a certain amount
of scalability and distributed processing power for how they build their
