This is an automated email from the ASF dual-hosted git repository.
xxyu pushed a commit to branch document
in repository https://gitbox.apache.org/repos/asf/kylin.git
The following commit(s) were added to refs/heads/document by this push:
new da65735 Added some tips on spark
da65735 is described below
commit da657352d5e15b3011d7b7850ae8e9c99140c477
Author: yaqian.zhang <[email protected]>
AuthorDate: Wed Jan 19 17:05:44 2022 +0800
Added some tips on spark
---
website/_dev/index.cn.md | 2 +-
website/_dev/index.md | 2 +-
website/_docs/install/index.cn.md | 14 ++++++++------
website/_docs/install/index.md | 12 +++++++++---
4 files changed, 19 insertions(+), 11 deletions(-)
diff --git a/website/_dev/index.cn.md b/website/_dev/index.cn.md
index 2648688..b70a471 100644
--- a/website/_dev/index.cn.md
+++ b/website/_dev/index.cn.md
@@ -15,7 +15,7 @@ Apache Kylin 一直寻求的不只是代码的贡献，还寻求使用文档，
### 源仓库
Apache Kylin™ 源码使用 Git version control 进行版本控制：
Commits [总结](https://github.com/apache/kylin/commits/master)
-源仓库：[https://github.com/apache/kylin ](https://github.com/apache/kylin )
+源仓库：[https://github.com/apache/kylin](https://github.com/apache/kylin)
Gitbox 的镜像：[https://gitbox.apache.org/repos/asf?p=kylin.git
](https://gitbox.apache.org/repos/asf?p=kylin.git )
### CI 和代码分析
diff --git a/website/_dev/index.md b/website/_dev/index.md
index ffdd74f..0915d42 100644
--- a/website/_dev/index.md
+++ b/website/_dev/index.md
@@ -15,7 +15,7 @@ Check out the [How to
Contribute](/development/howto_contribute.html) document.
### Source Repository
Apache Kylin™ source code is version controlled using Git version control:
Commits [Summary](https://github.com/apache/kylin/commits/main)
-Source Repo: [https://github.com/apache/kylin
](https://github.com/apache/kylin )
+Source Repo: [https://github.com/apache/kylin](https://github.com/apache/kylin)
Mirrored to Gitbox: [https://gitbox.apache.org/repos/asf?p=kylin.git
](https://gitbox.apache.org/repos/asf?p=kylin.git )
### CI and Code Analysis
diff --git a/website/_docs/install/index.cn.md
b/website/_docs/install/index.cn.md
index cd2adb9..a371978 100644
--- a/website/_docs/install/index.cn.md
+++ b/website/_docs/install/index.cn.md
@@ -9,8 +9,8 @@ permalink: /cn/docs/install/index.html
* Hadoop: cdh5.x, cdh6.x, hdp2.x, EMR5.x, EMR6.x, HDI4.x
* Hive: 0.13 - 1.2.1+
-* Spark: 2.4.7
-* Mysql: 5.1.17及以上
+* Spark: 2.4.7/3.1.1
+* Mysql: 5.1.17 及以上
* JDK: 1.8+
* OS: Linux only, CentOS 6.5+ or Ubuntu 16.0.4+
@@ -54,7 +54,9 @@ export KYLIN_HOME=`pwd`
$KYLIN_HOME/bin/download-spark.sh
```
-或者配置 SPARK_HOME 指向环境中的 spark2.4.7 的路径。
+download-spark.sh 脚本只能下载 spark2.4.7, 如果您使用的 kylin 二进制包以 spark3 为后缀，您需要从[Spark
官方网站](https://spark.apache.org/)下载 spark3.1.1 的二进制包。
+建议将 spark 二进制包解压后放置在 ${KYLIN_HOME} 目录下，并重命名为 spark，以避免兼容性问题。详情请查看：[Refactor
hive and hadoop
dependency](https://cwiki.apache.org/confluence/display/KYLIN/KIP+10+refactor+hive+and+hadoop+dependency)
+如果您自定义配置了 ${SPARK_HOME} 指向环境中的 spark2.4.7/spark3.1.1，请保证环境中的 spark
是可以正常提交以及执行任务的。
- 配置 Mysql 元数据
@@ -65,7 +67,7 @@
kylin.metadata.url=kylin_metadata@jdbc,driverClassName=com.mysql.jdbc.Driver,url
kylin.env.zookeeper-connect-string=ip
```
-你需要修改其中的 Mysql 用户名和密码，以及存储元数据的database和table。并将 mysql jdbc connector 放在
`$KYLIN_HOME/ext` 目录下，没有该目录时请自行创建。
+你需要修改其中的 Mysql 用户名和密码，以及存储元数据的 database 和 table。并将 mysql jdbc connector 放在
`$KYLIN_HOME/ext` 目录下，没有该目录时请自行创建。
请参考 [配置 Mysql 为 Metastore](/_docs40/tutorial/mysql_metastore.html) 了解 Mysql
作为 Metastore 的详细配置。
### Kylin tarball 目录
@@ -80,8 +82,8 @@ kylin.env.zookeeper-connect-string=ip
### 为某些环境执行额外步骤
对于 CDH6.x, EMR5.x, EMR6.x 的 hadoop 环境，在启动 kylin 之前需要执行一些额外的步骤。
-CDH6.x 环境请查看文档:
https://cwiki.apache.org/confluence/display/KYLIN/Deploy+Kylin+4+on+CDH+6
-EMR 环境请查看文档:
https://cwiki.apache.org/confluence/display/KYLIN/Deploy+Kylin+4+on+AWS+EMR
+CDH6.x 环境请查看文档: [Deploy Kylin4 on
CDH6](https://cwiki.apache.org/confluence/display/KYLIN/Deploy+Kylin+4+on+CDH+6)
+EMR 环境请查看文档: [Deploy Kylin4 on AWS
EMR](https://cwiki.apache.org/confluence/display/KYLIN/Deploy+Kylin+4+on+AWS+EMR)
### 检查运行环境
diff --git a/website/_docs/install/index.md b/website/_docs/install/index.md
index 0df5b3f..5d3fb22 100644
--- a/website/_docs/install/index.md
+++ b/website/_docs/install/index.md
@@ -9,8 +9,8 @@ permalink: /docs/install/index.html
* Hadoop: cdh5.x, cdh6.x, hdp2.x, EMR5.x, EMR6.x, HDI4.x
* Hive: 0.13 - 1.2.1+
-* Spark: 2.4.7
-* Mysql: 5.1.17及以上
+* Spark: 2.4.7/3.1.1
+* Mysql: 5.1.7 and above
* JDK: 1.8+
* OS: Linux only, CentOS 6.5+ or Ubuntu 16.0.4+
@@ -58,7 +58,13 @@ export KYLIN_HOME=`pwd`
$KYLIN_HOME/bin/download-spark.sh
```
-Or configure SPARK_HOME points to the path of spark2.4.7/3.1.1 in the
environment.
+The script `download-spark.sh` can only download `spark2.4.7`.
+
+If the kylin binary package you use is suffixed with spark3, you need to
download `spark3.1.1` binary package from [spark
website](https://spark.apache.org/).
+
+It is recommended to unzip the spark binary package and put it into
${KYLIN_HOME} directory, then rename it `spark` to avoid compatibility
problems. For details, please check:
+
+If you customize the configuration of `SPARK_HOME` points to
spark2.4.7/spark3.1.1 in your environment. Please ensure that your SPARK_HOME
in the environment can submit and execute tasks normally.
- Configure MySQL metastore
