i want read parquet file. write code in spark-shell:
val logfile = "hdfs://byd0085/" val sqlcontext=new org.apache.spark.sql.sqlcontext(sc) val parquetfile = sqlcontext.parquetfile(logfile) parquetfile.registertemptable("parquetfile") by calling parquetfile.registertemptable("parquetfile"), there error error: value registertemptable not member of org.apache.spark.sql.schemardd . parquetfile indeed schemardd , registertemptable indeed function of org.apache.spark.sql.schemardd. i'm new scala , spark , can't figure out reason. can help?
spark version 1.0.0 scala version 2.10.4
Comments
Post a Comment