spark读取hbase数据报错java.io.NotSerializableException: org.apache.hadoop.hba...

遇到此问题整理下，加入下面代码即解决

spark读取hbase数据
老是报错
15/01/08 10:30:27 ERROR Executor: Exception in task 0.0 in stage 1.0 (TID 1)
java.io.NotSerializableException: org.apache.hadoop.hbase.io.ImmutableBytesWritable
但如果这个表的记录为0，则不报错，只要有数据就报错

class MyRegistrator extends KryoRegistrator {
override def registerClasses(kryo: Kryo) {
kryo.register(classOf[org.apache.hadoop.hbase.io.ImmutableBytesWritable])
kryo.register(classOf[org.apache.hadoop.hbase.client.Result])

}
}
复制代码

然后

System.setProperty("spark.serializer","org.apache.spark.serializer.KryoSerializer")
System.setProperty("spark.kryo.registrator", "MyRegistrator")
复制代码

bioger_hit 发表于 2015-1-8 12:23
然后

• System.setProperty("spark.serializer","org.apache.spark.serializer.KryoSerializer")
• System.setProperty("spark.kryo.registrator", "MyRegistrator")
  

上面这两行代码位置是不是放错了？