i have tried following both spark 1.4.0 , 1.4.1 on mac. downloading package type = 'source code [can build several hadoop versions' , download type http://ftp.wayne.edu/apache/spark/spark-1.4.1/spark-1.4.1.tgz.
when run ./bin/sparkr in terminal, error message saying "~assembly/target/scala-2.10" not found. ideas?
if want directly use sparkr, need download binary package pre-built specific hadoop version. run on laptop can use hadoop version http://www.apache.org/dyn/closer.cgi/spark/spark-1.4.1/spark-1.4.1-bin-hadoop2.4.tgz (which hadoop 2.4) should fine.
if want use source package, need build spark before running script. can command looks build/mvn -dskiptests -psparkr package. more instructions @ https://github.com/apache/spark/tree/master/r#sparkr-development , http://spark.apache.org/docs/latest/building-spark.html
Comments
Post a Comment