Database Reference
In-Depth Information
As described earlier, Capacity is designed for multiple tenancy and is queue-based, with queues shared among
cluster tenants. A configuration file for the queue configuration, called capacity-scheduler.xml, is supplied in the conf
directory as well. The file contains the configuration for the default queue:
[hadoop@hc1nn conf]$ pwd
/usr/local/hadoop/conf
[hadoop@hc1nn conf]$ ls -l capacity-scheduler.xml
-rw-rw-r--. 1 hadoop hadoop 7457 Jul 23 2013 capacity-scheduler.xml
To demonstrate an example of a Hadoop V1 Capacity scheduling queue, I have set up a new queue called
“tqueue” in this file, with the following configuration. The configuration file, which you can copy, shows the attributes
that can be set for the queue. The default queue already exists; the new tqueue queue is added:
<!-- Set up test queue -->
<property>
<name>mapred.capacity-scheduler.queue.tqueue.capacity</name>
<value>50</value>
</property>
<property>
<name>mapred.capacity-scheduler.queue.tqueue.maximum-capacity</name>
<value>100</value>
</property>
<property>
<name>mapred.capacity-scheduler.queue.tqueue.supports-priority</name>
<value>true</value>
</property>
<property>
<name>mapred.capacity-scheduler.queue.tqueue.minimum-user-limit-percent</name>
<value>20</value>
</property>
<property>
<name>mapred.capacity-scheduler.queue.tqueue.user-limit-factor</name>
<value>1</value>
</property>
<property>
<name>mapred.capacity-scheduler.queue.tqueue.maximum-initialized-active-tasks</name>
<value>200000</value>
</property>
<property>
<name>mapred.capacity-scheduler.queue.tqueue.maximum-initialized-active-tasks-per-user</name>
<value>100000</value>
</property>
 
Search WWH ::




Custom Search