Database Reference
In-Depth Information
After making these changes to Hadoop, I restart the Hadoop servers to pick up the changes. Next, I set up the Hue
configuration file under /etc/hue/conf called hue.ini. To begin, I set the secret key to a suitable alpha numeric value
for session hashing. This secret key string should be between 30 and 60 characters long, and it should be random. It is
used for Internet browser cookie session security:
secret_key=kdntwdfjgmxnsprngpwekspfnsmdpwtyiubkdn
I then define the web host and port with the following:
http_host=hc1nn
http_port=8888
I set my web services URL, which I will use later to access Hue:
webhdfs_url=http://hc1nn:50070/webhdfs/v1/
I leave the Hadoop paths as the default values; they are correct for Cloudera Hadoop CDH4:
hadoop_hdfs_home=/usr/lib/hadoop-hdfs
hadoop_bin=/usr/bin/hadoop
hadoop_conf_dir=/etc/hadoop/conf
I now define my YARN configuration as follows:
resourcemanager_host=hc1nn
resourcemanager_port=8032
submit_to=True
resourcemanager_api_url=http://localhost:8088
proxy_api_url=http://localhost:8088
history_server_api_url=http://localhost:19888
node_manager_api_url=http://localhost:8042
My liboozie section to enable the Hue Oozie browser is as follows. (If you remember, this is the Oozie URL that
was used to connect to the Oozie web browser in Chapter 5.) I connect Hue to the Oozie functionality:
oozie_url=http://localhost:11000/oozie
Sqoop2 Server Setup for Hue
Next, I install and set up the Sqoop2 server. Sqoop2 is a server-based version of Sqoop that, at the time of this writing,
does not yet have a full complement of functionals. For instance, right now Sqoop2 cannot transfer data from a
relational database to the Hadoop HBase database. Given that Hue integrates with Sqoop2, I install it so that I can
demonstrate its features via Hue.
It should also be noted at this point that Sqoop2 and Sqoop should not be installed on the same server. I have
installed Sqoop on hc1nn, while Sqoop2 is installed on hc1r1m1. Sqoop2 is installed as the Linux root user, as follows:
[root@hc1r1m1 ~]# yum install sqoop2-server
[root@hc1r1m1 ~]# yum install sqoop2-client
Search WWH ::
Custom Search