Not a valid JAR when running HADOOP example
Solution 1
I had the same problem. Here is the solution.
OS - Ubuntu 14.04 64-bit
Java - OpenJDK 7
Hadoop - Hadoop 2.4.1
Step 1: create a hdfs directory for input: hadoop dfs -mkdir -p /usr/local/hadoop/input
Step 2: now paste the jar file into this folder using hadoop command.
hadoop dfs -copyFromLocal /home/hduser/Desktop/sample.txt /usr/local/hadoop/input
Step 3: Go to $HADOOP_HOME/share/hadoop/mapreduce folder in terminal.
cd $HADOOP_HOME/share/hadoop/mapreduce
hadoop jar hadoop-mapreduce-examples-2.4.1.jar wordcount /usr/local/hadoop/input/sample.txt /usr/local/hadoop/output
Here /usr/local/hadoop/output folder will be created. Each time you have to give a new name.
NOTE: you cannot simply list the folders input and output using ls
in terminal.
Step 4: To view the output, use this:
hadoop dfs -cat /usr/local/hadoop/output/part-r-00000
Solution 2
I was also following the same tutorial and faced same issue with my latest install (hadoop 2.7.1). I had to change it from
$ /bin/hadoop jar hadoop*examples*.jar wordcount /user/hduser/gutenberg /user/hduser/gutenberg-output
to
$ /bin/hadoop jar ./share/hadoop/mapreduce/hadoop-*-examples*.jar wordcount /user/hduser/gutenberg /user/hduser/gutenberg-output
Related videos on Youtube
Comments
-
A J over 1 year
I have installed hadoop-2.4.0 in my 14.04 LTS,
I have followed this link, I have done upto start and stop services successfully,
but when I tried to execute example,
$ /bin/hadoop jar hadoop*examples*.jar wordcount /user/hduser/gutenberg /user/hduser/gutenberg-output
and I am getting response as,
Not a valid JAR: /hadoop*examples*.jar
EDIT 1
I have installed JAVA 7(i.e JDK 1.7) and when I used Hadoop-1.0.3 it works fine.
Problem cause when I try to execute with Hadoop-2.4.0.
NOTE
From this tutorial my system differ the following,
- I am using JAVA 7 instead of JAVA 6.
- I am using Hadoop 2.4.0 instead of Hadoop-1.0.3
- I am usinh Ubuntu 14.04 instead of Ubuntu 10.04.
And I can successfully execute HAdoop-1.0.3 with JAVA 7 on 14.04.
My question why can't I run the same for Hadoop-2.4.0.
-
A J over 9 yearsI didn't followed exactly the same as tutorial said, I am using Oracle Java(JDK 1.7) and I am using Hadoop 2.4.0, actually my problem isn't that.. I can do with Hadoop 1.0.3 sucessfully.. When I do with Hadoop 2.4.0 am getting this problem...
-
A J over 9 yearsI have update my question, please take a look @Tim
-
Tim over 9 yearsDoes this work? codesfusion.blogspot.co.uk/2013/10/…
-
A J over 9 yearsI followed this only, I got error when i run example...
-
kishorer747 over 9 years@ARUL, instead of using
hadoop*examples*.jar
, you need to use this jarhadoop-mapreduce-examples-2.4.1.jar
in the folder $HADOOP_HOME/share/hadoop/mapreduce. You are getting the error because you are not specifying the path for jar. So navigate to the folder usingcd $HADOOP_HOME/share/hadoop/mapreduce
and then run the jar. It works fine. -
David Foerster over 7 yearsWelcome to Ask Ubuntu! I recommend editing this answer to expand it with specific details about what to edit and how. (See also How do I write a good answer? for general advice about what sorts of answers are considered most valuable on Ask Ubuntu.)