Database Reference
In-Depth Information
<property>
<name>mapred.queue.default.acl-submit-job</name>
<value>jonesb</value>
</property>
<property>
<name>mapred.queue.high_pool.acl-administer-jobs</name>
<value>hadoop</value>
</property>
<property>
<name>mapred.queue.low_pool.acl-administer-jobs</name>
<value>smitha</value>
</property>
<property>
<name>mapred.queue.default.acl-administer-jobs</name>
<value>jonesb</value>
</property>
There is already a configuration file provided for this scheduler in the installation configuration directory:
[hadoop@hc1nn conf]$ pwd
/usr/local/hadoop/conf
[hadoop@hc1nn conf]$ ls -l fair-scheduler.xml
-rw-rw-r--. 1 hadoop hadoop 327 Jul 23 2013 fair-scheduler.xml
I add the following configuration to this file to specify the fair scheduler pools high_pool , low_pool , and default
queues, as well as their attributes, such as the minimum and maximum number of Map and Reduce function
instances, as follows:
<pool name="high_pool">
<minMaps>10</minMaps>
<minReduces>10</minReduces>
<maxMaps>50</maxMaps>
<maxReduces>50</maxReduces>
<maxRunningJobs>1000</maxRunningJobs>
<weight>3</weight>
</pool>
<pool name="low_pool">
<minMaps>10</minMaps>
<minReduces>10</minReduces>
<maxMaps>50</maxMaps>
<maxReduces>50</maxReduces>
<maxRunningJobs>1000</maxRunningJobs>
<weight>1</weight>
</pool>
 
Search WWH ::




Custom Search