|NO.Z.00017|——————————|Deployment|——|Hadoop&OLAP数据库管理系统.v17|---------------------------------|Kylin.


[BigDataHadoop：Hadoop&OLAP数据库管理系统.V17]                           [Deployment.OLAP数据库管理系统][|Kylin：Kylin安装配置|]







一、Kylin安装环境准备：依赖环境
软件版本
Hive2.3.7
Hadoop2.9.2
HBase1.3.1
Zookeeper3.4.14
Kafka1.0.2
Spark2.4.5
二、集群规划
serverHadoop01hadoop02hadoop03
HDFSNameNode✔

DataNode✔✔✔
YarnResourceManager

✔
NodeManager✔✔✔
JobHistoryServer✔

HBaseHmaster✔

HRegionServer✔✔✔
HiveHive
✔
HiveMetastore

✔
Zookeeper✔✔✔
Kafka✔✔✔
Kylin
✔
三、HBase配置文件参数
### --- 注意：要求hbase的hbase.zookeeper.quorum值必须只能是host1、host2、... ### --- 不允许出现host:2181；hbase-site.xml文件：  ~~~     # 修改hbase配置文件 [root@hadoop01 ~]# vim /opt/yanqi/servers/hbase-1.3.1/conf/hbase-site.xml
<configuration>          <!-- 指定hbase在HDFS上存储的路径 -->         <property>                 <name>hbase.rootdir</name>                 <value>hdfs://hadoop01:9000/hbase</value>         </property>          <!-- 指定hbase是分布式的 -->         <property>                 <name>hbase.cluster.distributed</name>                 <value>true</value>         </property>          <!-- 指定zk的地址，多个用“,”分割 -->         <property>                 <name>hbase.zookeeper.quorum</name>                 <value>hadoop01,hadoop02,hadoop03</value>         </property>  </configuration>
四、Kylin配置资源准备
### --- 下载kylin版本包并解压到安装目录  ~~~     # 下载kylin版本包 [root@hadoop01 software]# wget https://archive.apache.org/dist/kylin/apache-kylin-3.1.1/apache-kylin-3.1.1-bin-hbase1x.tar.gz ~~~     # 解压版本包 [root@hadoop01 software]# tar -zxvf apache-kylin-3.1.1-bin-hbase1x.tar.gz -C ../servers/ ~~~     # 修改配置目录名称 [root@hadoop01 ~]# cd /opt/yanqi/servers/ [root@hadoop01 servers]# mv apache-kylin-3.1.1-bin-hbase1x kylin-3.1.1
### --- 添加环境变量，并使之生效  ~~~     # 配置kylin系统环境变量 [root@hadoop01 ~]# vim /etc/profile ##KYLIN_HOME export KYLIN_HOME=/opt/yanqi/servers/kylin-3.1.1 export PATH=$PATH:$KYLIN_HOME/bin
~~~     # 使环境变量生效  [root@hadoop01 ~]# source /etc/profile
五、kylin安装部署
### --- 增加kylin依赖组件的配置  ~~~     # 添加kylin依赖组件 [root@hadoop01 ~]# cd $KYLIN_HOME/conf  [root@hadoop01 conf]# ln -s $HADOOP_HOME/etc/hadoop/hdfs-site.xml hdfs-site.xml [root@hadoop01 conf]# ln -s $HADOOP_HOME/etc/hadoop/core-site.xml core-site.xml [root@hadoop01 conf]# ln -s $HBASE_HOME/conf/hbase-site.xml hbase-site.xml [root@hadoop01 conf]# ln -s $HIVE_HOME/conf/hive-site.xml hive-site.xml [root@hadoop01 conf]# ln -s $SPARK_HOME/conf/spark-defaults.conf spark-defaults.conf
### --- 修改 kylin.sh  ~~~     # 修改kylin.sh配置文件 [root@hadoop01 ~]# vim $KYLIN_HOME/bin/kylin.sh ~~~第21~24行添加如下内容： export HADOOP_HOME=/opt/yanqi/servers/hadoop-2.9.2 export HIVE_HOME=/opt/yanqi/servers/hive-2.3.7 export HBASE_HOME=/opt/yanqi/servers/hbase-1.3.1 export SPARK_HOME=/opt/yanqi/servers/spark-2.4.5
### --- 检查依赖  [root@hadoop01 ~]# $KYLIN_HOME/bin/check-env.sh  ~~~输出参数  Retrieving hadoop conf dir... ...................................................[PASS] KYLIN_HOME is set to /opt/yanqi/servers/kylin-3.1.1 Checking HBase ...................................................[PASS] Checking hive ...................................................[PASS] Checking hadoop shell ...................................................[PASS] Checking hdfs working dir ...................................................[PASS] Retrieving Spark dependency... ...................................................[PASS] Retrieving Flink dependency... Optional dependency flink not found, if you need this; set FLINK_HOME, or run bin/download-flink.sh ...................................................[PASS] Retrieving kafka dependency... ...................................................[PASS]  Checking environment finished successfully. To check again, run 'bin/check-env.sh' manually.
六、启动集群
### --- 启动 zookeeper（Hadoop01）  ~~~     # 启动zookeeper集群 [root@hadoop01 ~]# ./zk.sh start
### --- 启动 HDFS（Hadoop01）  ~~~     # 启动hdfs服务：Hadoop01 [root@hadoop01 ~]# start-dfs.sh
### --- 启动 YARN （Hadoop01）  ~~~     # 启动yarn服务：Hadoop01 [root@hadoop01 ~]# start-yarn.sh
### --- 启动 HBase（Hadoop01）  ~~~     # 启动HBase服务：Hadoop01 [root@hadoop01 ~]# start-hbase.sh
### --- 启动 metastore（Hadoop01、Hadoop03）  ~~~     # 启动hive-metastore服务：Hadoop01、Hadoop03 [root@hadoop01 ~]# nohup hive --service metastore & ~~~     # 查看metastore进程 [root@hadoop01 ~]# lsof -i:9083
### --- 启动Yarn history server（Hadoop01）  ~~~     # 启动yarn history server：Hadoop01 [root@hadoop01 ~]# mr-jobhistory-daemon.sh start historyserver
### --- 启动 kylin（Hadoop01）  ~~~     # 启动kylin服务：Hadoop01 [root@hadoop01 ~]# kylin.sh start
七、访问kylin-UI管理界面：登录 Kylin Web界面
URLhttp://hadoop01:7070/kylin
默认用户名ADMIN
默认密码KYLIN                                                      备注：用户名和密码都必须是大写
八、通过Chrome访问：http://hadoop01:7070/kylin：Kylin初始界面九、Kylin管理界面
附录一：报错处理一：
### --- 报错想象  [root@hadoop01 ~]# $KYLIN_HOME/bin/check-env.sh /opt/yanqi/servers/kylin-3.1.1/bin/check-port-availability.sh: line 30: netstat: command not found 
### --- 报错分析  net-tools工具未安装
### --- 解决方案  [root@hadoop01 ~]#  yum -y install net-tools







===============================END===============================

Walter Savage Landor:strove with none,for none was worth my strife.Nature I loved and, next to Nature, Art:I warm'd both hands before the fire of life.It sinks, and I am ready to depart                                                                                                                                                   ——W.S.Landor



来自为知笔记(Wiz)