spark和flume结合时的问题

报错信息，求解决啊

我的网盘上有，如果想用的话可以从上面下载，链接 http://pan.baidu.com/s/1eS1qoyY

在类中没有发现有用到这个jar包

fengfengda 发表于 2017-9-13 19:37
在类中没有发现有用到这个jar包

既然报错说明用到了，把这个包添加进来。

spark新版本的包中不包含logging类，如果想用的话，要自己打个logging包放上去，才可以正常使用

java.lang.NoClassDefFoundError: org/spark-project/guava/util/concurrent/ThreadFactoryBuilder个是少哪个jar包啊

fengfengda 发表于 2017-9-14 10:36
java.lang.NoClassDefFoundError: org/spark-project/guava/util/concurrent/ThreadFactoryBuilder个是少哪 ...

应该是这个包
com.google.guava_1.6.0.jar

[mw_shl_code=java,true]Files contained in com.google.guava_1.6.0.jar:

.svn/all-wcprops
.svn/entries
META-INF/.svn/all-wcprops
META-INF/.svn/entries
META-INF/.svn/text-base/MANIFEST.MF.svn-base
META-INF/MANIFEST.MF
OSGI-INF/.svn/all-wcprops
OSGI-INF/.svn/entries
OSGI-INF/l10n/.svn/all-wcprops
OSGI-INF/l10n/.svn/entries
OSGI-INF/l10n/.svn/text-base/bundle.properties.svn-base
OSGI-INF/l10n/bundle.properties
com.google.common.annotations.Beta.class
com.google.common.annotations.GwtCompatible.class
com.google.common.annotations.GwtIncompatible.class
com.google.common.annotations.VisibleForTesting.class
com.google.common.base.CaseFormat.class
com.google.common.base.CharMatcher.class
com.google.common.base.Charsets.class
com.google.common.base.Defaults.class
com.google.common.base.Equivalence.class
com.google.common.base.Equivalences.class
com.google.common.base.FinalizablePhantomReference.class
com.google.common.base.FinalizableReference.class
com.google.common.base.FinalizableReferenceQueue.class
com.google.common.base.FinalizableSoftReference.class
com.google.common.base.FinalizableWeakReference.class
com.google.common.base.Function.class
com.google.common.base.Functions.class
com.google.common.base.Joiner.class
com.google.common.base.Objects.class
com.google.common.base.Platform.class
com.google.common.base.Preconditions.class
com.google.common.base.Predicate.class
com.google.common.base.Predicates.class
com.google.common.base.Service.class
com.google.common.base.Splitter.class
com.google.common.base.Strings.class
com.google.common.base.Supplier.class
com.google.common.base.Suppliers.class
com.google.common.base.Throwables.class
com.google.common.base.internal.Finalizer.class
com.google.common.base.package-info.class
com.google.common.collect.AbstractBiMap.class
com.google.common.collect.AbstractIndexedIterator.class
com.google.common.collect.AbstractIterator.class
com.google.common.collect.AbstractListMultimap.class
com.google.common.collect.AbstractMapBasedMultiset.class
com.google.common.collect.AbstractMapEntry.class
com.google.common.collect.AbstractMultimap.class
com.google.common.collect.AbstractMultiset.class
com.google.common.collect.AbstractSetMultimap.class
com.google.common.collect.AbstractSortedSetMultimap.class
com.google.common.collect.ArrayListMultimap.class
com.google.common.collect.AsynchronousComputationException.class
com.google.common.collect.BiMap.class
com.google.common.collect.ByFunctionOrdering.class
com.google.common.collect.ClassToInstanceMap.class
com.google.common.collect.Collections2.class
com.google.common.collect.ComparatorOrdering.class
com.google.common.collect.ComparisonChain.class
com.google.common.collect.CompoundOrdering.class
com.google.common.collect.ComputationException.class
com.google.common.collect.ComputingConcurrentHashMap.class
com.google.common.collect.ConcurrentHashMultiset.class
com.google.common.collect.Constraint.class
com.google.common.collect.Constraints.class
com.google.common.collect.CustomConcurrentHashMap.class
com.google.common.collect.EmptyImmutableList.class
com.google.common.collect.EmptyImmutableListMultimap.class
com.google.common.collect.EmptyImmutableMap.class
com.google.common.collect.EmptyImmutableMultiset.class
com.google.common.collect.EmptyImmutableSet.class
com.google.common.collect.EmptyImmutableSetMultimap.class
com.google.common.collect.EmptyImmutableSortedSet.class
com.google.common.collect.EnumBiMap.class
com.google.common.collect.EnumHashBiMap.class
com.google.common.collect.EnumMultiset.class
com.google.common.collect.ExpirationTimer.class
com.google.common.collect.ExplicitOrderedImmutableSortedSet.class
com.google.common.collect.ExplicitOrdering.class
com.google.common.collect.ForwardingCollection.class
com.google.common.collect.ForwardingConcurrentMap.class
com.google.common.collect.ForwardingIterator.class
com.google.common.collect.ForwardingList.class
com.google.common.collect.ForwardingListIterator.class
com.google.common.collect.ForwardingListMultimap.class
com.google.common.collect.ForwardingMap.class
com.google.common.collect.ForwardingMapEntry.class
com.google.common.collect.ForwardingMultimap.class
com.google.common.collect.ForwardingMultiset.class
com.google.common.collect.ForwardingObject.class
com.google.common.collect.ForwardingQueue.class
com.google.common.collect.ForwardingSet.class
com.google.common.collect.ForwardingSetMultimap.class
com.google.common.collect.ForwardingSortedMap.class
com.google.common.collect.ForwardingSortedSet.class
com.google.common.collect.ForwardingSortedSetMultimap.class
com.google.common.collect.HashBiMap.class
com.google.common.collect.HashMultimap.class
com.google.common.collect.HashMultiset.class
com.google.common.collect.Hashing.class
com.google.common.collect.ImmutableAsList.class
com.google.common.collect.ImmutableBiMap.class
com.google.common.collect.ImmutableClassToInstanceMap.class
com.google.common.collect.ImmutableCollection.class
com.google.common.collect.ImmutableEntry.class
com.google.common.collect.ImmutableEnumSet.class
com.google.common.collect.ImmutableList.class
com.google.common.collect.ImmutableListMultimap.class
com.google.common.collect.ImmutableMap.class
com.google.common.collect.ImmutableMultimap.class
com.google.common.collect.ImmutableMultiset.class
com.google.common.collect.ImmutableSet.class
com.google.common.collect.ImmutableSetMultimap.class
com.google.common.collect.ImmutableSortedAsList.class
com.google.common.collect.ImmutableSortedMap.class
com.google.common.collect.ImmutableSortedMapFauxverideShim.class
com.google.common.collect.ImmutableSortedSet.class
com.google.common.collect.ImmutableSortedSetFauxverideShim.class
com.google.common.collect.Interner.class
com.google.common.collect.Interners.class
com.google.common.collect.Iterables.class
com.google.common.collect.Iterators.class
com.google.common.collect.LexicographicalOrdering.class
com.google.common.collect.LinkedHashMultimap.class
com.google.common.collect.LinkedHashMultiset.class
com.google.common.collect.LinkedListMultimap.class
com.google.common.collect.ListMultimap.class
com.google.common.collect.Lists.class
com.google.common.collect.MapConstraint.class
com.google.common.collect.MapConstraints.class
com.google.common.collect.MapDifference.class
com.google.common.collect.MapMaker.class
com.google.common.collect.Maps.class
com.google.common.collect.Multimap.class
com.google.common.collect.Multimaps.class
com.google.common.collect.Multiset.class
com.google.common.collect.Multisets.class
com.google.common.collect.MutableClassToInstanceMap.class
com.google.common.collect.NaturalOrdering.class
com.google.common.collect.NullOutputException.class
com.google.common.collect.NullsFirstOrdering.class
com.google.common.collect.NullsLastOrdering.class
com.google.common.collect.ObjectArrays.class
com.google.common.collect.Ordering.class
com.google.common.collect.PeekingIterator.class
com.google.common.collect.Platform.class
com.google.common.collect.RegularImmutableBiMap.class
com.google.common.collect.RegularImmutableList.class
com.google.common.collect.RegularImmutableMap.class
com.google.common.collect.RegularImmutableSet.class
com.google.common.collect.RegularImmutableSortedSet.class
com.google.common.collect.ReverseNaturalOrdering.class
com.google.common.collect.ReverseOrdering.class
com.google.common.collect.Serialization.class
com.google.common.collect.SetMultimap.class
com.google.common.collect.Sets.class
com.google.common.collect.SingletonImmutableList.class
com.google.common.collect.SingletonImmutableMap.class
com.google.common.collect.SingletonImmutableSet.class
com.google.common.collect.SortedSetMultimap.class
com.google.common.collect.Synchronized.class
com.google.common.collect.TreeMultimap.class
com.google.common.collect.TreeMultiset.class
com.google.common.collect.UnmodifiableIterator.class
com.google.common.collect.UsingToStringOrdering.class
com.google.common.collect.package-info.class
com.google.common.io.AppendableWriter.class
com.google.common.io.ByteArrayDataInput.class
com.google.common.io.ByteArrayDataOutput.class
com.google.common.io.ByteProcessor.class
com.google.common.io.ByteStreams.class
com.google.common.io.CharStreams.class
com.google.common.io.Closeables.class
com.google.common.io.CountingInputStream.class
com.google.common.io.CountingOutputStream.class
com.google.common.io.FileBackedOutputStream.class
com.google.common.io.Files.class
com.google.common.io.Flushables.class
com.google.common.io.InputSupplier.class
com.google.common.io.LimitInputStream.class
com.google.common.io.LineBuffer.class
com.google.common.io.LineProcessor.class
com.google.common.io.LineReader.class
com.google.common.io.MultiInputStream.class
com.google.common.io.MultiReader.class
com.google.common.io.NullOutputStream.class
com.google.common.io.OutputSupplier.class
com.google.common.io.PatternFilenameFilter.class
com.google.common.io.Resources.class
com.google.common.io.package-info.class
com.google.common.net.HostSpecifier.class
com.google.common.net.InetAddresses.class
com.google.common.net.InternetDomainName.class
com.google.common.net.TldPatterns.class
com.google.common.net.package-info.class
com.google.common.primitives.Booleans.class
com.google.common.primitives.Bytes.class
com.google.common.primitives.Chars.class
com.google.common.primitives.Doubles.class
com.google.common.primitives.Floats.class
com.google.common.primitives.Ints.class
com.google.common.primitives.Longs.class
com.google.common.primitives.Primitives.class
com.google.common.primitives.Shorts.class
com.google.common.primitives.SignedBytes.class
com.google.common.primitives.UnsignedBytes.class
com.google.common.primitives.package-info.class
com.google.common.util.concurrent.AbstractCheckedFuture.class
com.google.common.util.concurrent.AbstractExecutionThreadService.class
com.google.common.util.concurrent.AbstractFuture.class
com.google.common.util.concurrent.AbstractIdleService.class
com.google.common.util.concurrent.AbstractListenableFuture.class
com.google.common.util.concurrent.AbstractService.class
com.google.common.util.concurrent.Callables.class
com.google.common.util.concurrent.CheckedFuture.class
com.google.common.util.concurrent.ExecutionList.class
com.google.common.util.concurrent.FakeTimeLimiter.class
com.google.common.util.concurrent.ForwardingBlockingQueue.class
com.google.common.util.concurrent.ForwardingFuture.class
com.google.common.util.concurrent.ForwardingListenableFuture.class
com.google.common.util.concurrent.ForwardingService.class
com.google.common.util.concurrent.Futures.class
com.google.common.util.concurrent.ListenableFuture.class
com.google.common.util.concurrent.ListenableFutureTask.class
com.google.common.util.concurrent.MoreExecutors.class
com.google.common.util.concurrent.SimpleTimeLimiter.class
com.google.common.util.concurrent.ThreadFactoryBuilder.class
com.google.common.util.concurrent.TimeLimiter.class
com.google.common.util.concurrent.UncheckedTimeoutException.class
com.google.common.util.concurrent.UninterruptibleFuture.class
com.google.common.util.concurrent.ValueFuture.class
com.google.common.util.concurrent.package-info.class[/mw_shl_code]


原文地址http://www.java2s.com/Code/Jar/c/Downloadcomgoogleguava160jar.htm
http://www.java2s.com/Code/Jar/c/Downloadcomgoogleguava160jar.htm

nextuser 发表于 2017-9-14 14:36
应该是这个包
com.google.guava_1.6.0.jar

感觉不是呢

换了一个依赖，依赖是libraryDependencies += "org.apache.spark" % "spark-streaming-flume_2.11" % "2.0.2"以上的问题都不存在了