30 Jun

Hadoop yarn distributed shell example on MAC

I have installed hadoop via HomeBrew.

Command:

hadoop org.apache.hadoop.yarn.applications.distributedshell.Client -jar /usr/local/Cellar/hadoop/2.7.0/libexec/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.0.jar -num_containers 1 -shell_command ls

check output from:

lessĀ /usr/local/Cellar/hadoop/2.7.0/libexec/logs/userlogs/application_<jobid>/container_<jobid>_01_000002/stdout