分享

基于Spark2.0安装Zeppelin

问题导读:
1.下载安装zeppelin
2.修改配置文件并启动

3.启动异常与解决方案



下载安装zeppelin
下载zeppelin官方地址:zeppelin.apache.org
自己选择需要的版本下载 (本次使用的是0.7.2)
解压 tar zxvf zeppelin-0.7.2-bin-all.tgz

修改配置文件
[mw_shl_code=shell,true]cp zeppelin-env.sh.template zeppelin-env.sh
cp zeppelin-site.xml.template zeppelin-site.xml
修改 zeppelin-env.sh
export SPARK_HOME=/opt/cloudera/parcels/SPARK2/lib/spark2
export HADOOP_CONF_DIR=/opt/cloudera/parcels/CDH/lib/hadoop
export ZEPPELIN_INTP_CLASSPATH_OVERRIDES=/etc/hive/conf
export MASTER="yarn-client"
export ZEPPELIN_PID_DIR=/var/run/zeppelin
export ZEPPELIN_LOG_DIR=/var/log/zeppelin
export ZEPPELIN_CLASSPATH="${SPARK_CLASSPATH}"
修改 zeppelin-site.xml
<property>
  <name>zeppelin.server.port</name>
  <value>7080</value>
  <description>Server port.</description>
</property>[/mw_shl_code]

启动异常与解决方案

问题一:java.lang.NoSuchMethodError: org.apache.hadoop.io.retry.RetryPolicies.retryOtherThanRemoteException
(Lorg/apache/hadoop/io/retry/RetryPolicy;Ljava/util/Map;)Lorg/apache/hadoop/io/retry/RetryPolicy;
解决方案:[mw_shl_code=shell,true]替换hadoop jar
mv zeppelin-0.7.2-bin-all/lib/hadoop-annotations-*.jar /opt/zeppelin-0.7.2-bin-all/lib/hadoop-annotations-*.jar.bak
mv zeppelin-0.7.2-bin-all/lib/hadoop-auth-*.jar /opt/zeppelin-0.7.2-bin-all/lib/hadoop-auth-*.jar.bak
mv zeppelin-0.7.2-bin-all/lib/hadoop-common-*.jar /opt/zeppelin-0.7.2-bin-all/lib/hadoop-common-*.jar.bak
cp /opt/cloudera/parcels/CDH/lib/hadoop/lib/hadoop-annotations-*.jar /opt/zeppelin-0.7.2-bin-all/lib
cp /opt/cloudera/parcels/CDH/lib/hadoop/lib/hadoop-auth-*.jar /opt/zeppelin-0.7.2-bin-all/lib
cp /opt/cloudera/parcels/CDH/lib/hadoop/lib/hadoop-common-*.jar /opt/zeppelin-0.7.2-bin-all/lib[/mw_shl_code]问题二:com.fasterxml.jackson.databind.JsonMappingException: Jackson version is too old 2.5.3
解决方案:[mw_shl_code=shell,true]替换Jackson jar
mv zeppelin-0.7.2-bin-all/lib/jackson-annotations-2.5.3.jar /opt/zeppelin-0.7.2-bin-all/lib/jackson-annotations-2.5.3.jar.bak
mv zeppelin-0.7.2-bin-all/lib/jackson-core-2.5.3.jar /opt/zeppelin-0.7.2-bin-all/lib/jackson-core-2.5.3.jar
mv zeppelin-0.7.2-bin-all/lib/jackson-databind-2.5.3.jar /opt/zeppelin-0.7.2-bin-all/lib/jackson-databind-2.5.3.jar.bak
cp /opt/cloudera/parcels/SPARK2/lib/spark2/jars/jackson-annotations-2.6.5.jar /opt/zeppelin-0.7.2-bin-all/lib
cp /opt/cloudera/parcels/SPARK2/lib/spark2/jars/jackson-core-2.6.5.jar /opt/zeppelin-0.7.2-bin-all/lib
cp /opt/cloudera/parcels/SPARK2/lib/spark2/jars/jackson-databind-2.6.5.jar /opt/zeppelin-0.7.2-bin-all/lib[/mw_shl_code]

已有(1)人评论

跳转到指定楼层
您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

关闭

推荐上一条 /2 下一条