ETL with Hadoop - Big Data Made Easy: A Working Guide to the Complete Hadoop Toolset

Database Reference

In-Depth Information

■ If you plan to access MySQL with PDI, you also need to install a MySQL jar file from http://dev.mysql.com/

downloads/connector/j/ called mysql-connector-java-5.1.32-bin.jar into the PDI directory data-integration\lib.

Note

I am using CDH5, so I also need to add the following to the copy of yarn-site.xml in the PDI plug-in directory that

was copied from Hadoop. This helps the Pentaho libraries locate the YARN server:

<name>yarn.resourcemanager.hostname</name>

</property>

Running the Data Integrator

You start PDI on Windows by using the Spoon.bat script, which starts the Spoon client application, as shown in

Figure 10-3 . This is where you create your Map Reduce jobs.

Figure 10-3. Pentaho's Spoon main window

Search WWH ::

Custom Search

Home