这几天想研究下kudu,感觉是下一代的存储系统
[mw_shl_code=scala,true]object Kudu_test extends App with Serializable {
import org.apache.kudu.client._
import org.apache.kudu.spark.kudu._
import org.apache.spark.sql.SparkSession val ss = new SparkSession.Builder()
.master("spark://192.168.0.104:7077")
.config("spark.sql.warehouse.dir","/user/hive/warehouse")
.getOrCreate()
val df = ss.read.options(
Map("kudu.master" -> "192.168.0.104:7051",
"kudu.table" -> "impala::kudu_db.user_info")).kudu
df.select("receivername").show()
ss.stop()
}[/mw_shl_code]
很简单连接测试代码,maven也配置好了,但是运行报错:java.lang.ClassNotFoundException: org.apache.kudu.spark.kudu.KuduPartition
github上下载的kudu的源码也没有找到kudupartition类,哪位遇到了还望给我慷慨解惑
|
|