This is an automated email from the ASF dual-hosted git repository.
xxyu pushed a change to branch kylin5
in repository https://gitbox.apache.org/repos/asf/kylin.git
from 1e1cd474b3 KYLIN-5309 exclude columns frontend
new 774ae7d5cc KYLIN-5406 add exception catch in
AbstractDefaultSchedulerRunner's run
new 5506681519 KYLIN-5408 fix snyk vulnerabilities, upgrade ivy from 2.5.0
to 2.5.1 in spark and exclusion from hive-exec
new a1591a7e33 [DIRTY] Fix when loading data to second storage is
completed first, the segment status is still LOADING, not ONLINE(TIERED STORAGE)
new 417f47fa7a KYLIN-5409 avoid permission denied job retry
new e10de8726f KYLIN-5410 Fix vulnerability, upgrade jackson-databind
new a3e33dd13c KYLIN-5411 Add check-env for zstd native lib loading test
new 090e3a6c7f KYLIN-5412 add condition to calcite project merge rule to
fix OOM
new 79b7b13a38 KYLIN-5413 disable sample data when has no data query
permission
new 80feb3dfdd KYLIN-5411 Move zstd lib checking to check-1700 stage
new 454b104d4f [DIRTY] Fix sumLC null val
new b34babb851 KYLIN-5409 avoid permission denied job retry
new 15ff1d04cb KYLIN-5415 Rename the merge rule parameters to conform open
source requirement
new 881e9617c1 [DIRTY] Revert "[DIRTY] Fix sumLC null val"
new 5e55b761ea KYLIN-5416 ensure at least one worker was registered before
dict lock added
new 63db1633ed [DIRTY] fix check style and UT
The 15 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
build/sbin/check-1700-spark-kystorage.sh | 31 ++
pom.xml | 16 +-
.../org/apache/kylin/common/KylinConfigBase.java | 12 +-
.../common/persistence/metadata/jdbc/JdbcUtil.java | 2 +-
.../persistence/metadata/jdbc/JdbcUtilTest.java | 6 +-
.../org/apache/kylin/job/common/SegmentUtil.java | 11 +-
.../runners/AbstractDefaultSchedulerRunner.java | 2 +
.../org/apache/kylin/job/common/SegmentsTest.java | 40 ++-
.../kylin/metrics/HdfsCapacityMetricsTest.java | 10 +-
.../apache/kylin/rest/service/TableService.java | 12 +-
.../rest/service/StreamingTableServiceTest.java | 27 +-
.../kylin/query/engine/SqlToRelNodeTest.java | 48 +++
.../kylin/streaming/StreamingMergeEntryTest.java | 23 +-
.../apache/kylin/query/engine/SqlToRelNodeTest.xml | 26 ++
.../kylin/query/engine/SumExprPlannerTest.xml | 36 +-
.../apache/kylin/rest/service/ModelService.java | 2 +-
.../kylin/rest/service/TableServiceTest.java | 56 ++-
.../kap/query/optrule/KapProjectMergeRule.java | 14 +-
.../engine/spark/application/SparkApplication.java | 29 ++
.../engine/spark/builder/SnapshotBuilder.scala | 110 +++---
.../job/stage/build/FlatTableAndDictBase.scala | 38 +-
.../org/apache/spark/application/JobWorker.scala | 8 +-
...eStat.scala => TestBuildDictLockConflict.scala} | 50 ++-
.../apache/spark/application/TestJobMonitor.scala | 2 +-
.../apache/spark/application/TestJobWorker.scala | 396 ++++++++++++++++++++-
src/spark-project/spark-common/pom.xml | 6 +
src/tool/pom.xml | 5 +
.../ZstdLibLoadableTestTool.java} | 30 +-
.../org/apache/kylin/tool/MetadataToolTest.java | 28 +-
.../tool/setup/ZstdLibLoadableTestToolTest.java} | 30 +-
30 files changed, 938 insertions(+), 168 deletions(-)
copy
src/spark-project/engine-spark/src/test/scala/org/apache/kylin/engine/spark/builder/{TestDimensionTableStat.scala
=> TestBuildDictLockConflict.scala} (57%)
copy src/tool/src/main/java/org/apache/kylin/tool/{JobDiagInfoCLI.java =>
setup/ZstdLibLoadableTestTool.java} (62%)
copy
src/{core-common/src/test/java/org/apache/kylin/common/util/MapUtilTest.java =>
tool/src/test/java/org/apache/kylin/tool/setup/ZstdLibLoadableTestToolTest.java}
(57%)
