Database Reference
In-Depth Information
<property>
<name>mapred.capacity-scheduler.queue.tqueue.init-accept-jobs-factor</name>
<value>10</value>
</property>
You can specify access controls, such as which users can submit jobs and which can administer queues, in the
conf directory file mapred-queue-acls.xml. For complete details, see the configuration guide supplied by the Apache
Software Foundation, available at hadoop.apache.org/docs/r1.2.1/; click Map Reduce (on the left), and then select
Capacity Scheduler.
Next, in mapred-queue-acls.xml, you need to specify the list of queues via the mapred.queue.names property:
<property>
<name>mapred.queue.names</name>
<value>default,tqueue</value>
</property>
Make sure that the sum of the queue capacity values in the configuration file for all the queues is 100. For
instance, both the default and tqueue queues in my configuration file have a capacity value of 50 (see below).
<property>
<name>mapred.capacity-scheduler.queue.default.capacity</name>
<value>50</value>
</property>
<property>
<name>mapred.capacity-scheduler.queue.tqueue.capacity</name>
<value>50</value>
</property>
After you add the configuration for the Capacity scheduler, it will become visible within the system when the Map
Reduce servers are restarted. They can be checked via the Job Tracker user interface. For example, to check the jobs
on the name node hc1nn server, use the URL http://hc1nn:50030/jobtracker.jsp .
Figure 5-1 shows a list of queues, along with their attributes, for the Capacity scheduler on the name node hc1nn
server. Notice the scheduling configuration of the two queues—default and tqueue.
 
Search WWH ::




Custom Search