Storing and Configuring Data with Hadoop, YARN, and ZooKeeper - Big Data Made Easy: A Working Guide to the Complete Hadoop Toolset

Database Reference

In-Depth Information

14/03/16 14:08:19 INFO mapred.JobClient: map 50% reduce 0%

14/03/16 14:08:23 INFO mapred.JobClient: map 75% reduce 0%

14/03/16 14:08:26 INFO mapred.JobClient: map 75% reduce 25%

14/03/16 14:08:28 INFO mapred.JobClient: map 87% reduce 25%

14/03/16 14:08:29 INFO mapred.JobClient: map 100% reduce 25%

14/03/16 14:08:33 INFO mapred.JobClient: map 100% reduce 100%

14/03/16 14:08:34 INFO mapred.JobClient: Job complete: job_201403161357_0002

14/03/16 14:08:34 INFO mapred.JobClient: Counters: 29

14/03/16 14:08:34 INFO mapred.JobClient: Job Counters

14/03/16 14:08:34 INFO mapred.JobClient: Launched reduce tasks=1

14/03/16 14:08:34 INFO mapred.JobClient: SLOTS_MILLIS_MAPS=77595

14/03/16 14:08:34 INFO mapred.JobClient: Total time spent by all reduces

waiting after reserving slots (ms)=0

14/03/16 14:08:34 INFO mapred.JobClient: Total time spent by all maps

waiting after reserving slots (ms)=0

14/03/16 14:08:34 INFO mapred.JobClient: Launched map tasks=8

14/03/16 14:08:34 INFO mapred.JobClient: Data-local map tasks=8

14/03/16 14:08:34 INFO mapred.JobClient: SLOTS_MILLIS_REDUCES=15037

14/03/16 14:08:34 INFO mapred.JobClient: File Output Format Counters

14/03/16 14:08:34 INFO mapred.JobClient: Bytes Written=769870

14/03/16 14:08:34 INFO mapred.JobClient: FileSystemCounters

14/03/16 14:08:34 INFO mapred.JobClient: FILE_BYTES_READ=1878599

14/03/16 14:08:34 INFO mapred.JobClient: HDFS_BYTES_READ=3947632

14/03/16 14:08:34 INFO mapred.JobClient: FILE_BYTES_WRITTEN=4251698

14/03/16 14:08:34 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=769870

14/03/16 14:08:34 INFO mapred.JobClient: File Input Format Counters

14/03/16 14:08:34 INFO mapred.JobClient: Bytes Read=3946741

14/03/16 14:08:34 INFO mapred.JobClient: Map-Reduce Framework

14/03/16 14:08:34 INFO mapred.JobClient: Map output materialized

bytes=1878641

14/03/16 14:08:34 INFO mapred.JobClient: Map input records=72369

14/03/16 14:08:34 INFO mapred.JobClient: Reduce shuffle bytes=1878641

14/03/16 14:08:34 INFO mapred.JobClient: Spilled Records=256702

14/03/16 14:08:34 INFO mapred.JobClient: Map output bytes=6493886

14/03/16 14:08:34 INFO mapred.JobClient: CPU time spent (ms)=25930

14/03/16 14:08:34 INFO mapred.JobClient: Total committed heap usage

(bytes)=1277771776

14/03/16 14:08:34 INFO mapred.JobClient: Combine input records=667092

14/03/16 14:08:34 INFO mapred.JobClient: SPLIT_RAW_BYTES=891

14/03/16 14:08:34 INFO mapred.JobClient: Reduce input records=128351

14/03/16 14:08:34 INFO mapred.JobClient: Reduce input groups=67721

14/03/16 14:08:34 INFO mapred.JobClient: Combine output records=128351

14/03/16 14:08:34 INFO mapred.JobClient: Physical memory (bytes)

snapshot=1508696064

14/03/16 14:08:34 INFO mapred.JobClient: Reduce output records=67721

14/03/16 14:08:34 INFO mapred.JobClient: Virtual memory (bytes)

snapshot=4710014976

14/03/16 14:08:34 INFO mapred.JobClient: Map output records=667092

Big Data Made Easy: A Working Guide to the Complete Hadoop Toolset

Search WWH ::

Custom Search

Home