Database Reference
In-Depth Information
agent2.sinks.sink2.type
=
hdfs
agent2.sinks.sink2.hdfs.path
=
/tmp/flume
agent2.sinks.sink2.hdfs.filePrefix
=
events
agent2.sinks.sink2.hdfs.fileSuffix
=
.log
agent2.sinks.sink2.hdfs.fileType
=
DataStream
agent2.channels.channel2.type
=
file
agent2.channels.channel2.checkpointDir
=
/tmp/agent2/file-channel/
checkpoint
agent2.channels.channel2.dataDirs
=
/tmp/agent2/file-channel/data
The system is illustrated in
Figure 14-4
.
Figure 14-4. Two Flume agents connected by an Avro sink-source pair
Each agent is run independently, using the same
--conf-file
parameter but different
agent
--name
parameters:
%
flume-ng agent --conf-file spool-to-hdfs-tiered.properties --name
agent1 ...
and:
