xiaobaiyang 发表于 2015-10-13 22:29:50

spark启动错误

我执行spark-shell时，包如下问题：
15/10/13 22:17:43 INFO SparkUI: Started SparkUI at http://hadoop0:4040
15/10/13 22:17:51 INFO Executor: Using REPL class URI: http://192.168.80.10:34246
15/10/13 22:17:52 INFO AkkaUtils: Connecting to HeartbeatReceiver: akka.tcp://sparkDriver@hadoop0:45293/user/HeartbeatReceiver
15/10/13 22:18:15 ERROR OneForOneStrategy:
java.lang.NullPointerException
      at org.apache.spark.storage.BlockManagerMasterActor.org$apache$spark$storage$BlockManagerMasterActor$$heartbeatReceived(BlockManagerMasterActor.scala:238)
      at org.apache.spark.storage.BlockManagerMasterActor$$anonfun$receiveWithLogging$1.applyOrElse(BlockManagerMasterActor.scala:132)
      at scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33)
      at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33)
      at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25)
      at org.apache.spark.util.ActorLogReceive$$anon$1.apply(ActorLogReceive.scala:53)
      at org.apache.spark.util.ActorLogReceive$$anon$1.apply(ActorLogReceive.scala:42)
      at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:118)
      at org.apache.spark.util.ActorLogReceive$$anon$1.applyOrElse(ActorLogReceive.scala:42)
      at akka.actor.Actor$class.aroundReceive(Actor.scala:465)
      at org.apache.spark.storage.BlockManagerMasterActor.aroundReceive(BlockManagerMasterActor.scala:41)
      at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)
      at akka.actor.ActorCell.invoke(ActorCell.scala:487)
      at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:238)
      at akka.dispatch.Mailbox.run(Mailbox.scala:220)
      at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:393)
      at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
      at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
      at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
      at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
15/10/13 22:18:16 INFO NettyBlockTransferService: Server created on 48317
15/10/13 22:18:16 INFO BlockManagerMaster: Trying to register BlockManager
15/10/13 22:18:16 INFO BlockManagerMasterActor: Registering block manager localhost:48317 with 267.3 MB RAM, BlockManagerId(<driver>, localhost, 48317)


15/10/13 22:18:44 WARN AkkaUtils: Error sending message in 1 attempts
java.util.concurrent.TimeoutException: Futures timed out after
      at scala.concurrent.impl.Promise$DefaultPromise.ready(Promise.scala:219)
      at scala.concurrent.impl.Promise$DefaultPromise.result(Promise.scala:223)
      at scala.concurrent.Await$$anonfun$result$1.apply(package.scala:107)
      at scala.concurrent.BlockContext$DefaultBlockContext$.blockOn(BlockContext.scala:53)
      at scala.concurrent.Await$.result(package.scala:107)
      at org.apache.spark.util.AkkaUtils$.askWithReply(AkkaUtils.scala:187)
      at org.apache.spark.executor.Executor$$anon$1.run(Executor.scala:398)
warning: there were 1 deprecation warning(s); re-run with -deprecation for details



求大神看一下，该怎样解决

leo_1989 发表于 2015-10-14 13:08:12

启动错误，什么是shell。自己写的，还是spark单纯的启动

xiaobaiyang 发表于 2015-10-14 21:17:49

leo_1989 发表于 2015-10-14 13:08
启动错误，什么是shell。自己写的，还是spark单纯的启动

是单纯的启动

Alkaloid0515 发表于 2015-10-14 21:35:15

xiaobaiyang 发表于 2015-10-14 21:17
是单纯的启动

同一个错误原因比较多。
Spark写HBase报错
http://www.aboutyun.com/thread-9629-1-1.html

也报错ERROR OneForOneStrategy:
应该是楼主配置的问题，最好找个标准文档




页: [1]
查看完整版本: spark启动错误