currently, i'm using eclipse develop hadoop demo. 've run , tested using hadoop standalone mode.
but want compile hadoop demo jar file deploy in distributed mode wordcount example.
anyone can guide me how it?
right click on file on project explorer -> export -> generate runnable jar file
select class of main method (used driver class).
copy jar file master node of cluster.
then, go path hadoop installed on master node , run
bin/hadoop jar jarfile.jar /hdfs/input/path /hdfs/output/path for more options , details, read this tutorial (for new api / yarn).
you have update configuration files first, /etc/hosts, setup passwordless ssh between cluster nodes , update $hadoop_home/conf/... files (in old api @ least).
Comments
Post a Comment