Database Reference
In-Depth Information
Figure 5-2. Fair scheduler job queue
The second table is taken from the high_pool queue, and it shows that the job was submitted to this queue with
Normal priority, using the command line switch -Dmapred.fairscheduler.pool=high_pool .
Now that you've examined the schedulers in Hadoop V1, it's time to take a look at those same schedulers in
Hadoop V2. You can use the environment section in Chapter 4 to find out how to switch between versions on a single
cluster of servers. You will then see the similarities of the V1 and V2 schedulers, but also note the more advanced
interfaces that V2 offers.
Scheduling in Hadoop V2
In this section, I show how to configure the Capacity and Fair plug-in schedulers for Hadoop V2. You can find full
details at the Apache Software Foundation website ( hadoop.apache.org/docs ) by selecting your Hadoop version,
then the desired scheduling options from the menu on the left. In comparison to V1, the V2 user interface offers better
functionality and generally looks much more presentable. The configuration is similar, however, and the files that
need to be set up are the same.
 
Search WWH ::




Custom Search