Database Reference
In-Depth Information
Figure 6-3
.
The extracted tarball distribution in a local folder
Understanding Pig
Figure 6-4
shows Pig architecture and various components of Apache Pig. It depicts
how Pig scripts get compiled and converted into a MapReduce job. With Pig's architec-
ture, a written Pig script would get compiled into MapReduce programs and submitted
by the Hadoop job manager as a MapReduce job. The Grunt command shell is a
command-line interface for running Pig scripts and the Pig API can be used for build-
ing custom implementations.
Figure 6-4
.
Apache Pig components and MapReduce job transformation
Before we start on examples, let's discuss these two modes and then a few import-
ant Pig commands and data types that we will be using in upcoming exercises in this
chapter.
