Author: lidong
Date: Thu Jan 20 14:13:27 2022
New Revision: 1897252
URL: http://svn.apache.org/viewvc?rev=1897252&view=rev
Log:
Added some tips on spark
Modified:
kylin/site/cn/development/index.html
kylin/site/cn/docs/install/index.html
kylin/site/development/index.html
kylin/site/docs/install/index.html
kylin/site/feed.xml
Modified: kylin/site/cn/development/index.html
URL:
http://svn.apache.org/viewvc/kylin/site/cn/development/index.html?rev=1897252&r1=1897251&r2=1897252&view=diff
==============================================================================
--- kylin/site/cn/development/index.html (original)
+++ kylin/site/cn/development/index.html Thu Jan 20 14:13:27 2022
@@ -192,7 +192,7 @@ var _hmt = _hmt || [];
<h3 id="section-1">æºä»åº</h3>
<p>Apache Kylin⢠æºç ä½¿ç¨ Git version control è¿è¡çæ¬æ§å¶ï¼<br />
Commits <a href="https://github.com/apache/kylin/commits/master">æ»ç»</a>
<br />
-æºä»åºï¼<a
href="https://github.com/apache/kylin">https://github.com/apache/kylin </a>
<br />
+æºä»åºï¼<a
href="https://github.com/apache/kylin">https://github.com/apache/kylin</a><br />
Gitbox çéåï¼<a
href="https://gitbox.apache.org/repos/asf?p=kylin.git">https://gitbox.apache.org/repos/asf?p=kylin.git
</a></p>
<h3 id="ci-">CI å代ç åæ</h3>
Modified: kylin/site/cn/docs/install/index.html
URL:
http://svn.apache.org/viewvc/kylin/site/cn/docs/install/index.html?rev=1897252&r1=1897251&r2=1897252&view=diff
==============================================================================
--- kylin/site/cn/docs/install/index.html (original)
+++ kylin/site/cn/docs/install/index.html Thu Jan 20 14:13:27 2022
@@ -185,8 +185,8 @@ var _hmt = _hmt || [];
<ul>
<li>Hadoop: cdh5.x, cdh6.x, hdp2.x, EMR5.x, EMR6.x, HDI4.x</li>
<li>Hive: 0.13 - 1.2.1+</li>
- <li>Spark: 2.4.7</li>
- <li>Mysql: 5.1.17å以ä¸</li>
+ <li>Spark: 2.4.7/3.1.1</li>
+ <li>Mysql: 5.1.17 å以ä¸</li>
<li>JDK: 1.8+</li>
<li>OS: Linux only, CentOS 6.5+ or Ubuntu 16.0.4+</li>
</ul>
@@ -235,7 +235,9 @@ wget http://mirror.bit.edu.cn/apache/kyl
</code></pre>
</div>
-<p>æè
é
ç½® SPARK_HOME æåç¯å¢ä¸ç spark2.4.7 çè·¯å¾ã</p>
+<p>download-spark.sh èæ¬åªè½ä¸è½½ spark2.4.7, 妿æ¨ä½¿ç¨ç kylin
äºè¿å¶å
以 spark3 为åç¼ï¼æ¨éè¦ä»<a
href="https://spark.apache.org/">Spark 宿¹ç½ç«</a>ä¸è½½ spark3.1.1
çäºè¿å¶å
ã<br />
+å»ºè®®å° spark äºè¿å¶å
è§£ååæ¾ç½®å¨ ${KYLIN_HOME}
ç®å½ä¸ï¼å¹¶éå½å为 sparkï¼ä»¥é¿å
å
¼å®¹æ§é®é¢ã详æ
请æ¥çï¼<a
href="https://cwiki.apache.org/confluence/display/KYLIN/KIP+10+refactor+hive+and+hadoop+dependency">Refactor
hive and hadoop dependency</a><br />
+妿æ¨èªå®ä¹é
ç½®äº ${SPARK_HOME} æåç¯å¢ä¸ç
spark2.4.7/spark3.1.1ï¼è¯·ä¿è¯ç¯å¢ä¸ç spark
æ¯å¯ä»¥æ£å¸¸æäº¤ä»¥åæ§è¡ä»»å¡çã</p>
<ul>
<li>é
ç½® Mysql å
æ°æ®</li>
@@ -248,7 +250,7 @@ kylin.env.zookeeper-connect-string<span
</code></pre>
</div>
-<p>ä½ éè¦ä¿®æ¹å
¶ä¸ç Mysql ç¨æ·ååå¯ç ï¼ä»¥ååå¨å
æ°æ®çdatabaseåtableãå¹¶å° mysql jdbc connector æ¾å¨ <code
class="highlighter-rouge">$KYLIN_HOME/ext</code>
ç®å½ä¸ï¼æ²¡æè¯¥ç®å½æ¶è¯·èªè¡å建ã<br />
+<p>ä½ éè¦ä¿®æ¹å
¶ä¸ç Mysql ç¨æ·ååå¯ç ï¼ä»¥ååå¨å
æ°æ®ç database å tableãå¹¶å° mysql jdbc connector æ¾å¨ <code
class="highlighter-rouge">$KYLIN_HOME/ext</code>
ç®å½ä¸ï¼æ²¡æè¯¥ç®å½æ¶è¯·èªè¡å建ã<br />
请åè <a href="/_docs40/tutorial/mysql_metastore.html">é
置 Mysql 为
Metastore</a> äºè§£ Mysql ä½ä¸º Metastore ç详ç»é
ç½®ã</p>
<h3 id="kylin-tarball-">Kylin tarball ç®å½</h3>
@@ -265,8 +267,8 @@ kylin.env.zookeeper-connect-string<span
<h3 id="section-2">为æäºç¯å¢æ§è¡é¢å¤æ¥éª¤</h3>
<p>å¯¹äº CDH6.x, EMR5.x, EMR6.x ç hadoop ç¯å¢ï¼å¨å¯å¨ kylin
ä¹åéè¦æ§è¡ä¸äºé¢å¤çæ¥éª¤ã<br />
-CDH6.x ç¯å¢è¯·æ¥çææ¡£:
https://cwiki.apache.org/confluence/display/KYLIN/Deploy+Kylin+4+on+CDH+6<br />
-EMR ç¯å¢è¯·æ¥çææ¡£:
https://cwiki.apache.org/confluence/display/KYLIN/Deploy+Kylin+4+on+AWS+EMR</p>
+CDH6.x ç¯å¢è¯·æ¥çææ¡£: <a
href="https://cwiki.apache.org/confluence/display/KYLIN/Deploy+Kylin+4+on+CDH+6">Deploy
Kylin4 on CDH6</a><br />
+EMR ç¯å¢è¯·æ¥çææ¡£: <a
href="https://cwiki.apache.org/confluence/display/KYLIN/Deploy+Kylin+4+on+AWS+EMR">Deploy
Kylin4 on AWS EMR</a></p>
<h3 id="section-3">æ£æ¥è¿è¡ç¯å¢</h3>
Modified: kylin/site/development/index.html
URL:
http://svn.apache.org/viewvc/kylin/site/development/index.html?rev=1897252&r1=1897251&r2=1897252&view=diff
==============================================================================
--- kylin/site/development/index.html (original)
+++ kylin/site/development/index.html Thu Jan 20 14:13:27 2022
@@ -197,7 +197,7 @@ var _hmt = _hmt || [];
<h3 id="source-repository">Source Repository</h3>
<p>Apache Kylin⢠source code is version controlled using Git version
control:<br />
Commits <a href="https://github.com/apache/kylin/commits/main">Summary</a><br
/>
-Source Repo: <a
href="https://github.com/apache/kylin">https://github.com/apache/kylin </a>
<br />
+Source Repo: <a
href="https://github.com/apache/kylin">https://github.com/apache/kylin</a><br />
Mirrored to Gitbox: <a
href="https://gitbox.apache.org/repos/asf?p=kylin.git">https://gitbox.apache.org/repos/asf?p=kylin.git
</a></p>
<h3 id="ci-and-code-analysis">CI and Code Analysis</h3>
Modified: kylin/site/docs/install/index.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/install/index.html?rev=1897252&r1=1897251&r2=1897252&view=diff
==============================================================================
--- kylin/site/docs/install/index.html (original)
+++ kylin/site/docs/install/index.html Thu Jan 20 14:13:27 2022
@@ -192,8 +192,8 @@ var _hmt = _hmt || [];
<ul>
<li>Hadoop: cdh5.x, cdh6.x, hdp2.x, EMR5.x, EMR6.x, HDI4.x</li>
<li>Hive: 0.13 - 1.2.1+</li>
- <li>Spark: 2.4.7</li>
- <li>Mysql: 5.1.17å以ä¸</li>
+ <li>Spark: 2.4.7/3.1.1</li>
+ <li>Mysql: 5.1.7 and above</li>
<li>JDK: 1.8+</li>
<li>OS: Linux only, CentOS 6.5+ or Ubuntu 16.0.4+</li>
</ul>
@@ -242,7 +242,13 @@ wget http://mirror.bit.edu.cn/apache/kyl
</code></pre>
</div>
-<p>Or configure SPARK_HOME points to the path of spark2.4.7/3.1.1 in the
environment.</p>
+<p>The script <code class="highlighter-rouge">download-spark.sh</code> can
only download <code class="highlighter-rouge">spark2.4.7</code>.</p>
+
+<p>If the kylin binary package you use is suffixed with spark3, you need to
download <code class="highlighter-rouge">spark3.1.1</code> binary package from
<a href="https://spark.apache.org/">spark website</a>.</p>
+
+<p>It is recommended to unzip the spark binary package and put it into
${KYLIN_HOME} directory, then rename it <code
class="highlighter-rouge">spark</code> to avoid compatibility problems. For
details, please check:</p>
+
+<p>If you customize the configuration of <code
class="highlighter-rouge">SPARK_HOME</code> points to spark2.4.7/spark3.1.1 in
your environment. Please ensure that your SPARK_HOME in the environment can
submit and execute tasks normally.</p>
<ul>
<li>Configure MySQL metastore</li>
Modified: kylin/site/feed.xml
URL:
http://svn.apache.org/viewvc/kylin/site/feed.xml?rev=1897252&r1=1897251&r2=1897252&view=diff
==============================================================================
--- kylin/site/feed.xml (original)
+++ kylin/site/feed.xml Thu Jan 20 14:13:27 2022
@@ -19,8 +19,8 @@
<description>Apache Kylin Home</description>
<link>http://kylin.apache.org/</link>
<atom:link href="http://kylin.apache.org/feed.xml" rel="self"
type="application/rss+xml"/>
- <pubDate>Wed, 19 Jan 2022 03:07:12 -0800</pubDate>
- <lastBuildDate>Wed, 19 Jan 2022 03:07:12 -0800</lastBuildDate>
+ <pubDate>Thu, 20 Jan 2022 05:59:54 -0800</pubDate>
+ <lastBuildDate>Thu, 20 Jan 2022 05:59:54 -0800</lastBuildDate>
<generator>Jekyll v2.5.3</generator>
<item>