Database Reference
In-Depth Information
Figure 11-19. Talend-Hive database connection
Some variables have been added to set the memory used by the Talend Map Reduce jobs in terms of map
and reduce functions. A value of 1000 MB is set for each function via the variables mapred.job.map.memory.mb
and mapred.job.reduce.memory.mb . To check this connection before saving it, I click the Check button. In case of
problems, I first ensure that the cluster is functioning without error, that HDFS is accessible, and that Hive can be
accessed and have Hive QL scripts run against it. (You also might use the Hue interface for this.) The connection
works, so I save it. It subsequently will appear in the Repository pane.
By expanding the objects under the Hive database connection in the Repository pane, I can view a table to the
column level, as shown in Figure 11-20 .
Search WWH ::




Custom Search