Database Reference
In-Depth Information
Counter
Description
Reduce output records
(
REDUCE_OUTPUT_RECORDS
)
The number of reduce output records produced by all the maps
in the job. Incremented every time the
collect()
method is
called on a reducer's
OutputCollector
.
Reduce shuffle bytes
(
REDUCE_SHUFFLE_BYTES
)
The number of bytes of map output copied by the shuffle to re-
ducers.
Spilled records (
SPILLED_RECORDS
)
The number of records spilled to disk in all map and reduce
tasks in the job.
CPU milliseconds
(
CPU_MILLISECONDS
)
The cumulative CPU time for a task in milliseconds, as reported
by
/proc/cpuinfo
.
Physical memory bytes
(
PHYSICAL_MEMORY_BYTES
)
The physical memory being used by a task in bytes, as reported
by
/proc/meminfo
.
Virtual memory bytes
(
VIRTUAL_MEMORY_BYTES
)
The virtual memory being used by a task in bytes, as reported
by
/proc/meminfo
.
Committed heap bytes
(
COMMITTED_HEAP_BYTES
)
The total amount of memory available in the JVM in bytes, as
reported by
Runtime.getRuntime().totalMemory()
.
GC time milliseconds
(
GC_TIME_MILLIS
)
The elapsed time for garbage collection in tasks in milliseconds,
as reported by
GarbageCollector-
MXBean.getCollectionTime()
.
Shuffled maps (
SHUFFLED_MAPS
)
The number of map output files transferred to reducers by the
shuffle (see
Shuffle and Sort
).
Failed shuffle (
FAILED_SHUFFLE
)
The number of map output copy failures during the shuffle.
Merged map outputs
(
MERGED_MAP_OUTPUTS
)
The number of map outputs that have been merged on the re-
duce side of the shuffle.
