Information Technology Reference
In-Depth Information
2. Starting the agents.
Agent node 1 (on 10.0.0.1):
$ $FLUME_HOME/bin/flume-ng agent -n agent1 -c conf -f
$FLUME_HOME/conf/flume-conf.properties
Agent node 2 (on 10.0.0.2):
$ $FLUME_HOME/bin/flume-ng agent -n agent2 -c conf -f
$FLUME_HOME/conf/flume-conf.properties
3. Starting the collector.
$ $FLUME_HOME/bin/flume-ng agent -n collector -c conf -f
$FLUME_HOME/conf/flume-conf.properties
Monitoring
One of the advantages of using a public cloud service provider is that it provides the users with
a monitoring interface to track and monitor deployed cloud services. We used Amazon EC2
to deploy the RSS web service. Figure 10.14 and Figure 10.15 show network activity of one of
the agent nodes. Figure 10.16 and Figure 10.17 show the collector node, and Figure 10.18 and
Figure 10.19 show the master HDFS node.
FIGURE 10.14 Agent 1 incoming data from RSS feed
Search WWH ::




Custom Search