ETL with Hadoop - Big Data Made Easy: A Working Guide to the Complete Hadoop Toolset - page 319

All of the pricing information is the same because this is a small sample of the pricing test data. The output data
has been formatted with separator vertical (“|”) characters.
This simple example reflects only a small portion of the available Talend functionality, but it shows the potential
for building Map Reduce jobs using a drag-and-drop approach. Remember also that there is still more functionality
in the Talend Enterprise application. With the Enterprise application, you can build traditional Map Reduce jobs by
using a Map Reduce job type and specifying the functionality of the mapper and reducer components of the job.

Potential Errors
Here are some of the errors I encountered when developing this example, as well as their solutions. Check the Talend
forum at www.talendforge.org/forum for past issues encountered and to ask questions if you cannot find a solution
to your problem.
When I installed Talend on a Windows 7 machine, it crashed on startup, with the following error message:

Java was started but returned exit code = 1
C:\Windows\system32\javaw.exe
-Xms154m
-Xmx2536m
-XX:MaxPermSize=3256m

This problem was caused by a Windows patch called kb2977629. My solution was to remove the patch by
following these steps:

1. Select the Start button.

2. Click Control Panel.

3. Click Programs.

4. Under Programs and Features, Click View Installed Updates.

5. Search for kb2977629 and uninstall.

6. Restart Windows.

There was a permissions problem with HDFS when I was running Talend from Linux, which caused the following
error message:

cause:org.apache.hadoop.security.AccessControlException: Permission denied:
user=hadoop, access=WRITE, inode="/tmp/hadoop-yarn":yarn:supergroup:drwxr-xr-x

To fix the problem, I use the Linux su command to change the user to the YARN Linux user, and then used the
HDFS file system chmod command to change the permissions of the directory, as follows:

[root@hc2nn ~]# su - yarn
[yarn@hc2nn ~]$ hdfs dfs -chmod -R 777 /tmp/hadoop-yarn

The following memory-based error occurred because the maximum memory specified for Application Master
component on YARN was less than the level that was needed.

PriviledgedActionException as:hadoop (auth:SIMPLE) cause:java.io.IOException:
org.apache.hadoop.yarn.exceptions.InvalidResourceRequestException:
Invalid resource request, requested memory < 0, or requested memory > max configured,
requestedMemory=1536, maxMemory=1035