Database Reference
In-Depth Information
A high-level view of various components of
Storm
In this section, we will get you acquainted with various components of Storm, their role,
and their distribution in a Storm cluster.
A Storm cluster has three sets of nodes (which could be co-located, but are generally dis-
tributed in clusters), which are as follows:
• Nimbus
• Zookeeper
• Supervisor
The following figure shows the integration hierarchy of these nodes:
The detailed explanation of the integration hierarchy is as follows:
Nimbus node (master node, similar to Hadoop-JobTracker): This is the heart of
the Storm cluster. You can say that this is the master daemon process that is re-
sponsible for the following:
◦ Uploading and distributing various tasks across the cluster
◦ Uploading and distributing the topology jars jobs across various supervi-
sors
◦ Launching workers as per ports allocated on the supervisor nodes
◦ Monitoring the topology execution and reallocating workers whenever ne-
cessary
◦ Storm UI is also executed on the same node
Search WWH ::




Custom Search