Database Reference
In-Depth Information
Sink Groups
A sink group allows multiple sinks to be treated as one, for failover or load-balancing pur-
poses (see
Figure 14-5
). If a second-tier agent is unavailable, then events will be delivered
to another second-tier agent and on to HDFS without disruption.
Figure 14-5. Using multiple sinks for load balancing or failover
To configure a sink group, the agent's
sinkgroups
property is set to define the sink
group's name; then the sink group lists the sinks in the group, and also the type of the sink
processor, which sets the policy for choosing a sink.
Example 14-5
shows the configuration
for load balancing between two Avro endpoints.
Example 14-5. A Flume configuration for load balancing between two Avro endpoints using
a sink group