apache-kylin-4.0.4-bin-spark3（使用mysql存储元数据）下载安装部署

1.下载kylin

下载地址：下载 Apache Kylin | Apache Kylin

2.解压安装

tar -zxvf /opt/modules/apache-kylin-4.0.4-bin-spark3 -C /opt/installs

3.配置环境

vi /etc/profile
export KYLIN_HOME=/opt/installs/apache-kylin-4.0.4-bin-spark3/
export PATH=$PATH:$KYLIN_HOME/bin
export HADOOP_CONF_DIR=/opt/installs/hadoop3.1.4/etc/hadoop
export HIVE_HOME=/opt/installs/hive

4.mysql进行的操作

（1）降低密码难度

mysql -u root -p << EOF
SET GLOBAL validate_password.policy = LOW;
SET GLOBAL validate_password.length = 4;
FLUSH PRIVILEGES;
EOF

（2）创建用户

mysql -u root -p << EOF
CREATE DATABASE IF NOT EXISTS kylin DEFAULT CHARACTER SET utf8 COLLATE utf8_general_ci;
CREATE USER IF NOT EXISTS 'kylin'@'localhost' IDENTIFIED BY '123456';
GRANT ALL PRIVILEGES ON kylin.* TO 'kylin'@'localhost';
FLUSH PRIVILEGES;
EOF

（3）验证是否成功

mysql -u kylin -p123456 -e "SHOW DATABASES;"

5.更新kylin.propreties配置

cat > $KYLIN_HOME/conf/kylin.properties << 'EOF'
# Zookeeper
kylin.env.zookeeper-connect-string=hadoop11:2181,hadoop12:2181,hadoop13:2181

# Hadoop 配置目录
kylin.env.hadoop-conf-dir=/opt/installs/hadoop3.1.4/etc/hadoop

# 使用 MySQL 作为元数据存储
kylin.metadata.url=kylin_metadata@jdbc,driverClassName=com.mysql.cj.jdbc.Driver,url=jdbc:mysql://localhost:3306/kylin?useSSL=false&allowPublicKeyRetrieval=true&characterEncoding=utf8,username=kylin,password=123456

# 运行模式
kylin.env.mode=ALL
kylin.server.mode=all
kylin.server.port=7070

# Hive 配置
kylin.source.hive.database-for-flat-table=default

# Spark 配置
kylin.engine.spark-conf.spark.master=yarn
kylin.engine.spark-conf.spark.submit.deployMode=cluster
EOF

6.复制jdbc驱动器

把jdbc驱动器如mysql-connector-java-8.0.26.jar粘贴到kylin的bin目录下

7.启动命令

start-all.sh(启动hdfs和yarn)

hive-service-manager.sh start (启动hive)

zk.sh（启动zookeeper）

kylin.sh start(启动kylin)

8.我遇到的报错

Caused by: java.lang.ClassNotFoundException: org.apache.commons.configuration.ConfigurationException

解决：

wget -P /opt/installs/apache-kylin-4.0.4-bin-spark3/tomcat/webapps/kylin/WEB-INF/lib/ \
  https://repo1.maven.org/maven2/commons-configuration/commons-configuration/2.10/commons-configuration-2.10.jar

wget https://repo1.maven.org/maven2/commons-lang/commons-lang/2.6/commons-lang-2.6.jar
wget https://repo1.maven.org/maven2/commons-logging/commons-logging/1.2/commons-logging-1.2.jar
wget https://repo1.maven.org/maven2/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar