Database Reference
In-Depth Information
Setting up Storm in the distributed mode
Perform the following steps to set up Storm in distributed mode:
1. Download the
Storm-0.9.2-incubating.zip
package from the GitHub
Storm site.
2. Create the directories
storm
and
storm/tmp
under
/usr/local
:
sudo mkdir -p /usr/local/storm/tmp
3. Create the following directories for logs:
sudo mkdir -p /mnt/abc_logs/storm/storm_logs
4. Extract the ZIP file on Nimbus and the worker machines from the directory at
/usr/local
:
sudo unzip -d /usr/local/storm/ storm-0.9.2
-incubating.zip
5. Make the following changes at
/usr/local/storm/
storm-0.9.2-incubating/conf/storm.yaml
:
◦
storm.zookeeper.servers
: This is a list of the hosts in the Zoo-
keeper cluster for the Storm cluster:
storm.zookeeper.servers:
"<IP_ADDRESS_OF_ZOOKEEPER_ENSEMBLE_NODE_1>"
"<IP_ADDRESS_OF_ZOOKEEPER_ENSEMBLE_NODE_2>"
◦
storm.zookeeper.port
: This is the port on which the Zookeeper
cluster is running:
storm.zookeeper.port: 2182
◦
storm.local.dir
: The Nimbus and the supervisor require a location
on the local disk to store a small amount of data related to configurations
and execution details of the topology. Please make sure to create the dir-
ectory and assign read/write permissions on all Storm nodes. For our in-
stallation, we are going to create this directory in the
/usr/local/
storm/tmp
location:
Search WWH ::
Custom Search