Database Reference
In-Depth Information
To delete the newly provisioned cluster, you can use the
Remove-AzureHDInsightCluster
command as shown here:
Remove-AzureHDInsightCluster AutomatedHDI -SubscriptionId $subid -Certificate $cert
Table
4-2
summarizes the commands available in the HDInsight cmdlet and provides a brief overview of
their functions.
Table 4-2.
HDInsight cmdlet commands
Command
Function
Add-AzureHDInsightMetastore
Customize the Hive/Oozie metadata storage location.
Add-AzureHDInsightStorage
Add a new storage account to the subscription.
New-AzureHDInsightCluster
Provision a new HDInsight cluster.
New-AzureHDInsightConfig
Used to parameterize HDInsight cluster properties like number of nodes
based on configured values.
Remove-AzureHDInsightCluster
Delete anHDInsight cluster.
Get-AzureHDInsightCluster
List the provisioned HDInsight cluster for the subscription.
Set-AzureHDInsightDefaultStorage
Set the default storage account for HDInsight cluster creations.
PowerShellcmdlets give you the flexibility of really taking advantage of the elasticity of services that Azure
HDInsight provides. You can create a PowerShell script that will spin up your Hadoop cluster when required, submit
jobs for processing, and shut the cluster down once the output is written back into Azure blob storage. This process is
possible because the storage used for input and output is Azure blob storage. As such, the cluster is needed only for
compute operations and not storage. During the creation, the cluster name and number of hosts can be specified, and
during the job submission, the input and output paths can be specified as well. One could, of course, customize these
scripts to include additional parameters such as the number of mappers, additional job arguments, and so on.
■
microsoft consultant Carl nolan has a wonderful blog about using powershell cmdlets to provide a mechanism
for managing an elastic service. You can read his blog at
http://blogs.msdn.com/b/carlnol/archive/2013/06/07/
Note
Command-Line Interface (CLI)
The command line is an open source, cross-platform interface for managing HDInsight clusters. It is implemented
in Node.js. Thus, it is usable from multiple platforms, such as Windows, Mac, Linux, and so on. The source code is
available at the GitHub web site:
The sequence of operations in CLI is pretty much the same as in PowerShell. You have to download and import
the Azure
.publishsettings
file as a persistent local config setting that the command-line interface will use for its
subsequent operations.
