Database Reference
In-Depth Information
This action creates a STORM_HOME environment variable that points to the installation. Also, the Storm installation
binary directory has been added to the path so that the Storm executable can be located. Now, you create a Storm
working directory; I place mine under /app/storm:
[root@hc1nn app]# cd /app
[root@hc1nn app]# mkdir storm
[root@hc1nn app]# chown hadoop:hadoop storm
[root@hc1nn app]# ls -l
total 8
drwxr-xr-x. 3 hadoop hadoop 4096 Mar 15 15:38 hadoop
drwxr-xr-x. 2 hadoop hadoop 4096 Jul 27 11:38 storm
I am using my Linux hadoop user account to run Storm, but you might want to use a dedicated Storm account.
You set up the Storm configuration files under $STORM_HOME/conf. Set the following values in the file storm.yaml:
storm.zookeeper.servers:
- "hc1r1m1"
- "hc1r1m2"
- "hc1r1m3"
nimbus.host: "hc1nn"
nimbus.childopts: "-Xmx1024m -Djava.net.preferIPv4Stack=true"
ui.childopts: "-Xmx768m -Djava.net.preferIPv4Stack=true"
supervisor.childopts: "-Djava.net.preferIPv4Stack=true"
worker.childopts: "-Xmx768m -Djava.net.preferIPv4Stack=true"
storm.local.dir: "/app/storm"
These settings specify three ZooKeeper servers (hc1r1m1, hc1r1m2, hc1r1m3 ) to be the nodes on which the slave
Storm processes will run. The master (Nimbus) Storm process is set to run on the server hc1nn. Also, the Storm local
directory is defined as “ /app/storm.”
Now, it is time to check that ZooKeeper is running before you attempt to run Storm.
Start and Check Zookeeper
As the Linux root account, you start the ZooKeeper server on each slave node; root is used because these servers are
Linux-based services:
service zookeeper-server start
The configuration for the ZooKeeper server is stored under /etc/zookeeper/conf/zoo.cfg, while the logs can be
found under /var/log/zookeeper. Check the logs for errors and ensure that each ZooKeeper server is running.
Now, you use a four-letter acronym RUOK (“Are you OK?”) with each server to check that it is running correctly.
The response that you can expect is IMOK (“I am OK”).
 
Search WWH ::




Custom Search