Database Reference
In-Depth Information
{
public static Uri azureClusterUri
= new Uri(" https://democluster.azurehdinsight.net:443 " );
public static string clusterName = "democluster";
public static string thumbprint = "Your_Certificate_Thumbprint";
public static Guid subscriptionId = new Guid("Your_Subscription_Id");
public static string clusterUser = "admin";
public static string hadoopUser = "hdp";
public static string clusterPassword = "Your_Password";
public static string storageAccount = "democluster";
public static string storageAccountKey = "Your_storage_Key";
public static string container = "democlustercontainer";
public static string wasbPath =
"wasb://democlustercontainer@democluster.blob.core.windows.net";
}
}
Connection to the hDinsight cluster defaults to the standard Secure Sockets layer (SSl) port 443. however,
if you have a cluster prior to version 2.1, the connection is made through port 563.
Note
The constant hadoopUser is the user account that runs the Hadoop services on the NameNode. By default, this
user is hdp in an HDInsight distribution. You can always connect remotely to the NameNode and find this service
account from the Windows Services console, as shown in Figure 5-1 .
Figure 5-1. Hadoop service account
You will use these class variables henceforth in the different methods you call from your client applications.
Using them helps to improve the readability as well as the management of the code.
Adding the MapReduce Classes
Hadoop Streaming is an interface for writing MapReduce jobs in the language of your choice. Hadoop SDK for .NET is
a wrapper to Streaming that provides a convenient experience for .NET developers to develop MapReduce programs.
The jobs can be submitted for execution via the API. The command is displayed on the JobTracker web interface and
can be used for direct invocation if required.
 
 
Search WWH ::




Custom Search