Database Reference
In-Depth Information
Figure 10-36. Filter Columns step to eliminate unneeded columns
The next step is to sort the data and specify the order in which the columns will be sorted; Figure 10-37 shows a
compounded sorting key of manufacturer, model, and price.
Figure 10-37. Sort step to put columns in desired order
Finally, the data is stored via a results step, which specifies where the Map Reduce job will store its data and what
the field separator will be, as shown in Figure 10-38 . I use the default storage method of PigStorage and instruct the
data to be stored in the directory /data/talend/result/. Because this is a Map Reduce job, a successful outcome will
create a part file.
Figure 10-38. Results step provides for storage of the data
 
Search WWH ::




Custom Search