大数据架构：flume-ng+Kafka+Storm+HDFS 实时系统组合

2015-05-07 17:59:51,612 (lifecycleSupervisor-1-1) [ERROR - org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:253)] Unable to start SinkRunner: { policy:org.apache.flume.sink.DefaultSinkProcessor@4083633f counterGroup:{ name:null counters:{} } } - Exception follows.
java.lang.NoSuchMethodError: scala.Predef$.augmentString(Ljava/lang/String;)Ljava/lang/String;
        at kafka.utils.VerifiableProperties.getShortInRange(VerifiableProperties.scala:85)
        at kafka.producer.SyncProducerConfigShared$class.$init$(SyncProducerConfig.scala:53)
        at kafka.producer.ProducerConfig.<init>(ProducerConfig.scala:52)
        at kafka.producer.ProducerConfig.<init>(ProducerConfig.scala:56)
        at org.apache.flume.plugins.KafkaSink.start(KafkaSink.java:97)
        at org.apache.flume.sink.DefaultSinkProcessor.start(DefaultSinkProcessor.java:46)
        at org.apache.flume.SinkRunner.start(SinkRunner.java:79)
        at org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:251)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
2015-05-07 17:59:51,615 (lifecycleSupervisor-1-1) [ERROR - org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:264)] Unsuccessful attempt to shutdown component: {} due to missing dependencies. Please shutdown the agentor disable this component, or the agent will bein an undefined state.
java.lang.NullPointerException
        at org.apache.flume.plugins.KafkaSink.stop(KafkaSink.java:170)
        at org.apache.flume.sink.DefaultSinkProcessor.stop(DefaultSinkProcessor.java:53)
        at org.apache.flume.SinkRunner.stop(SinkRunner.java:115)
        at org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:259)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)


启动flume的时候报错 不知道是什么问题 麻烦大神能够帮帮忙 ！！！flume-1.5.2  kafka_2.11-0.8.2.1

./flume-ng agent -n producer -c ../conf/ -f ../conf/flume-conf-producer.properties -Dflume.root.logger=INFO,console &

aliece 发表于 2015-5-7 19:18
2015-05-07 17:59:51,612 (lifecycleSupervisor-1-1) [ERROR - org.apache.flume.lifecycle.LifecycleSuper ...

是自己写的吗？这个组件不能启动，可能缺依赖
Unable to start SinkRunner:

yuwenge 发表于 2015-5-7 19:31
是自己写的吗？这个组件不能启动，可能缺依赖
Unable to start SinkRunner:

不是自己写的 照着帖子一步步走的～～～Unable to start SinkRunner也是后面抱的错引起的啊

大神，你太流弊了，膜拜一下

感谢分享，多多向前辈学习！！

干货，好东西!

很全的资料，非常感谢！

不错！

确实很好的文章，很感谢楼主分享

还没理解过过来，感谢楼主分享