[GitHub] [hudi] xushiyan merged pull request #3671: [HUDI-2418] Support HiveSchemaProvider

2021-12-05 Thread GitBox
xushiyan merged pull request #3671: URL: https://github.com/apache/hudi/pull/3671 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr

[hudi] branch master updated: [HUDI-2418] Support HiveSchemaProvider (#3671)

2021-12-05 Thread xushiyan
This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 734c9f5 [HUDI-2418] Support HiveSchemaProvider

[jira] [Closed] (HUDI-2418) Support HiveSchemaProvider

2021-12-05 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2418. > Support HiveSchemaProvider > --- > > Key: HUDI-2418 >

[jira] [Resolved] (HUDI-2418) Support HiveSchemaProvider

2021-12-05 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-2418. -- > Support HiveSchemaProvider > --- > > Key: HUDI-2418 >

[GitHub] [hudi] xushiyan commented on issue #4170: [SUPPORT] Understanding Clustering Behavior

2021-12-05 Thread GitBox
xushiyan commented on issue #4170: URL: https://github.com/apache/hudi/issues/4170#issuecomment-986185794 @li36909 @yihua can you share some insights here please? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [hudi] xushiyan edited a comment on issue #4170: [SUPPORT] Understanding Clustering Behavior

2021-12-05 Thread GitBox
xushiyan edited a comment on issue #4170: URL: https://github.com/apache/hudi/issues/4170#issuecomment-986185794 @lw309637554 @yihua can you share some insights here please? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

[GitHub] [hudi] hudi-bot commented on pull request #4181: [HUDI-2900] Fix corrupt block end position

2021-12-05 Thread GitBox
hudi-bot commented on pull request #4181: URL: https://github.com/apache/hudi/pull/4181#issuecomment-986186277 ## CI report: * 279bc7602551e0b3c5987917051f59a9e2b13143 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4181: [HUDI-2900] Fix corrupt block end position

2021-12-05 Thread GitBox
hudi-bot removed a comment on pull request #4181: URL: https://github.com/apache/hudi/pull/4181#issuecomment-986181867 ## CI report: * 014eb29699116b93c91af926594035c63fc09fff Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[jira] [Assigned] (HUDI-2811) Support Spark 3.2 and Parquet 1.12.x

2021-12-05 Thread Yann Byron (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yann Byron reassigned HUDI-2811: Assignee: Yann Byron > Support Spark 3.2 and Parquet 1.12.x >

[GitHub] [hudi] YannByron commented on issue #4200: spark-sql query timestamp partition error

2021-12-05 Thread GitBox
YannByron commented on issue #4200: URL: https://github.com/apache/hudi/issues/4200#issuecomment-986191020 @forest455 as @xushiyan commented above, try this in the master (0.10). If there is still a problem, please provide the whole codes so that i can reproduce this issue well. -- T

[GitHub] [hudi] BenjMaq commented on issue #4207: [SUPPORT] Hudi 0.10.0 throws java.lang.NoSuchMethodError: com.amazonaws.http.AmazonHttpClient.disableStrictHostnameVerification

2021-12-05 Thread GitBox
BenjMaq commented on issue #4207: URL: https://github.com/apache/hudi/issues/4207#issuecomment-986194050 Hi @xushiyan , it's from the `0.10.0-rc2` version. Should I try the latest one (`0.10.0-rc3`) that was pushed yesterday? For the environment, it's not on EMR. We have our own Spark cl

[GitHub] [hudi] BenjMaq commented on issue #4208: [SUPPORT] On Hudi 0.9.0 - Alter table throws java.lang.NoSuchMethodException: org.apache.hadoop.hive.ql.metadata.Hive.alterTable(java.lang.String, org

2021-12-05 Thread GitBox
BenjMaq commented on issue #4208: URL: https://github.com/apache/hudi/issues/4208#issuecomment-986195268 @xushiyan , I have updated the description to add the create table statement. For the environment, it's not on EMR. We have our own Spark cluster built on EC2 machines (cluster standalo

[GitHub] [hudi] danny0405 commented on issue #4219: [SUPPORT] Flink SQL: NoSuchMethodError: com.esotericsoftware.kryo.Kryo$DefaultInstantiatorStrategy.(Lorg/objenesis/strategy/InstantiatorStrate

2021-12-05 Thread GitBox
danny0405 commented on issue #4219: URL: https://github.com/apache/hudi/issues/4219#issuecomment-986202556 We didn't meet this error after https://github.com/apache/hudi/commit/38585e4e57c86e0846b5561c4d1750676d88e5f4, i see that you scala version is 2.12, how do you include your flink bun

[jira] [Created] (HUDI-2940) Support sync database and table created by Flink catalog to hive

2021-12-05 Thread dalongliu (Jira)
dalongliu created HUDI-2940: --- Summary: Support sync database and table created by Flink catalog to hive Key: HUDI-2940 URL: https://issues.apache.org/jira/browse/HUDI-2940 Project: Apache Hudi Iss

[jira] [Updated] (HUDI-2940) Support sync database and table created by Flink catalog to hive

2021-12-05 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dalongliu updated HUDI-2940: Description: As above title says, we should support sync database and table created by Flink catalog to hive

[GitHub] [hudi] hudi-bot removed a comment on pull request #4175: [HUDI-2883] WIP Refactor hive sync tool / config to use reflection and standardize configs

2021-12-05 Thread GitBox
hudi-bot removed a comment on pull request #4175: URL: https://github.com/apache/hudi/pull/4175#issuecomment-985986534 ## CI report: * 92baf390f22bc9578344d8933621ff0e3778b007 UNKNOWN * 9f46362ccd219c83a73cc70e6648b62c3d45f4fe Azure: [FAILURE](https://dev.azure.com/apache-hudi

[GitHub] [hudi] hudi-bot commented on pull request #4175: [HUDI-2883] WIP Refactor hive sync tool / config to use reflection and standardize configs

2021-12-05 Thread GitBox
hudi-bot commented on pull request #4175: URL: https://github.com/apache/hudi/pull/4175#issuecomment-986295889 ## CI report: * 92baf390f22bc9578344d8933621ff0e3778b007 UNKNOWN * 9f46362ccd219c83a73cc70e6648b62c3d45f4fe Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/

[GitHub] [hudi] xushiyan commented on issue #4163: [SUPPORT] Pending Clustering may stain the ActiveTimeLine and lead to incomplete query results

2021-12-05 Thread GitBox
xushiyan commented on issue #4163: URL: https://github.com/apache/hudi/issues/4163#issuecomment-986296171 @zhangyue19921010 thank you for the detailed analysis! the fix makes sense: archival should not act on commits that are after pending clustering. will check out the PR soon. cc @nsi

[GitHub] [hudi] hudi-bot commented on pull request #4175: [HUDI-2883] WIP Refactor hive sync tool / config to use reflection and standardize configs

2021-12-05 Thread GitBox
hudi-bot commented on pull request #4175: URL: https://github.com/apache/hudi/pull/4175#issuecomment-986296186 ## CI report: * 92baf390f22bc9578344d8933621ff0e3778b007 UNKNOWN * 9f46362ccd219c83a73cc70e6648b62c3d45f4fe Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/

[GitHub] [hudi] hudi-bot removed a comment on pull request #4175: [HUDI-2883] WIP Refactor hive sync tool / config to use reflection and standardize configs

2021-12-05 Thread GitBox
hudi-bot removed a comment on pull request #4175: URL: https://github.com/apache/hudi/pull/4175#issuecomment-986295889 ## CI report: * 92baf390f22bc9578344d8933621ff0e3778b007 UNKNOWN * 9f46362ccd219c83a73cc70e6648b62c3d45f4fe Azure: [FAILURE](https://dev.azure.com/apache-hudi

[GitHub] [hudi] xushiyan commented on a change in pull request #4172: [HUDI-2892][BUG]Pending Clustering may stain the ActiveTimeLine and lead to incomplete query results

2021-12-05 Thread GitBox
xushiyan commented on a change in pull request #4172: URL: https://github.com/apache/hudi/pull/4172#discussion_r762617715 ## File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/io/TestHoodieTimelineArchiveLog.java ## @@ -243,6 +243,36 @@ public void testArch

[GitHub] [hudi] hudi-bot removed a comment on pull request #4175: [HUDI-2883] WIP Refactor hive sync tool / config to use reflection and standardize configs

2021-12-05 Thread GitBox
hudi-bot removed a comment on pull request #4175: URL: https://github.com/apache/hudi/pull/4175#issuecomment-986296186 ## CI report: * 92baf390f22bc9578344d8933621ff0e3778b007 UNKNOWN * 9f46362ccd219c83a73cc70e6648b62c3d45f4fe Azure: [FAILURE](https://dev.azure.com/apache-hudi

[GitHub] [hudi] hudi-bot commented on pull request #4175: [HUDI-2883] WIP Refactor hive sync tool / config to use reflection and standardize configs

2021-12-05 Thread GitBox
hudi-bot commented on pull request #4175: URL: https://github.com/apache/hudi/pull/4175#issuecomment-986304526 ## CI report: * 92baf390f22bc9578344d8933621ff0e3778b007 UNKNOWN * 9fea2ce96a31a13811a8c52133b642dcd1881b33 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/

[GitHub] [hudi] kazdy commented on issue #3724: [SUPPORT] Spark start reading stream from hudi dataset starting from given commit time

2021-12-05 Thread GitBox
kazdy commented on issue #3724: URL: https://github.com/apache/hudi/issues/3724#issuecomment-986309728 I'm closing this issue after reading the Hudi code. Hudi Incremental Query reads data only if available in commits, so you're not going to get all the data from the table (which wa

[GitHub] [hudi] kazdy closed issue #3724: [SUPPORT] Spark start reading stream from hudi dataset starting from given commit time

2021-12-05 Thread GitBox
kazdy closed issue #3724: URL: https://github.com/apache/hudi/issues/3724 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi

[GitHub] [hudi] xushiyan commented on issue #4162: [SUPPORT] First written data disappears when I append second data for schema evolution in example code.

2021-12-05 Thread GitBox
xushiyan commented on issue #4162: URL: https://github.com/apache/hudi/issues/4162#issuecomment-986327002 @yyar the spark shell environment shows it's spark 3.2, probably causing different behavior from your intellij environment where spark 3.0.x was used. in 0.9 and 0.8, spark 3.2 wasn't

[jira] [Created] (HUDI-2941) Show _hoodie_operation in spark sql results

2021-12-05 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2941: Summary: Show _hoodie_operation in spark sql results Key: HUDI-2941 URL: https://issues.apache.org/jira/browse/HUDI-2941 Project: Apache Hudi Issue Type: Improvement

[GitHub] [hudi] xushiyan commented on issue #4160: [SUPPORT] The query results of the Hive and Spark columns are different

2021-12-05 Thread GitBox
xushiyan commented on issue #4160: URL: https://github.com/apache/hudi/issues/4160#issuecomment-986359608 @mincwang makes sense. tracking this in https://issues.apache.org/jira/browse/HUDI-2941 -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hudi] xushiyan closed issue #4160: [SUPPORT] The query results of the Hive and Spark columns are different

2021-12-05 Thread GitBox
xushiyan closed issue #4160: URL: https://github.com/apache/hudi/issues/4160 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@h

[jira] [Updated] (HUDI-2941) Show _hoodie_operation in spark sql results

2021-12-05 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2941: - Labels: user-support-issues (was: ) > Show _hoodie_operation in spark sql results > -

[GitHub] [hudi] esaeki closed issue #4174: Cannot delete data; Illegal character error

2021-12-05 Thread GitBox
esaeki closed issue #4174: URL: https://github.com/apache/hudi/issues/4174 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hud

[GitHub] [hudi] esaeki commented on issue #4174: Cannot delete data; Illegal character error

2021-12-05 Thread GitBox
esaeki commented on issue #4174: URL: https://github.com/apache/hudi/issues/4174#issuecomment-986362755 Thank you for your reply. This issue has already resolved. I used '-' instead of '_' for the name of Glue table. -- This is an automated message from the Apache Git Service. To respond

[GitHub] [hudi] boneanxs commented on pull request #4014: [HUDI-2779] Cache BaseDir if HudiTableNotFound Exception thrown

2021-12-05 Thread GitBox
boneanxs commented on pull request #4014: URL: https://github.com/apache/hudi/pull/4014#issuecomment-986363754 Hi @codope, Could you pls review this again? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hudi] dragonly opened a new pull request #4220: Update quick-start-guide.md

2021-12-05 Thread GitBox
dragonly opened a new pull request #4220: URL: https://github.com/apache/hudi/pull/4220 Fix url links and shell comment style. ## What is the purpose of the pull request This pull request fixes broken url and comment styles. ## Brief change log - change quick-star

[GitHub] [hudi] Coreixwumo opened a new issue #4221: [SUPPORT] hudi mor table has a lack of data

2021-12-05 Thread GitBox
Coreixwumo opened a new issue #4221: URL: https://github.com/apache/hudi/issues/4221 hi there is some problems while i use mor table with flink, but with the same schema cow table is ok ,here is my create table sql: create table hudi.corgi_PayOrder_logic_mor( `id` STRING,

[GitHub] [hudi] YuweiXiao opened a new pull request #4222: [HUDI-2849] improve SparkUI job description for write path

2021-12-05 Thread GitBox
YuweiXiao opened a new pull request #4222: URL: https://github.com/apache/hudi/pull/4222 ## What is the purpose of the pull request The pull request improve the job description of SparkUI for writing hudi. Before: ![image](https://user-images.githubusercontent.com/9959868/

[jira] [Updated] (HUDI-2849) Improve job/stage description in spark UI for hudi write

2021-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2849: - Labels: pull-request-available (was: ) > Improve job/stage description in spark UI for hudi write

[GitHub] [hudi] hudi-bot commented on pull request #4222: [HUDI-2849] improve SparkUI job description for write path

2021-12-05 Thread GitBox
hudi-bot commented on pull request #4222: URL: https://github.com/apache/hudi/pull/4222#issuecomment-986389417 ## CI report: * 9b30498cb6205e12cb859dd8fe4654ec952f63e0 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` r

[GitHub] [hudi] hudi-bot commented on pull request #4222: [HUDI-2849] improve SparkUI job description for write path

2021-12-05 Thread GitBox
hudi-bot commented on pull request #4222: URL: https://github.com/apache/hudi/pull/4222#issuecomment-986390295 ## CI report: * 9b30498cb6205e12cb859dd8fe4654ec952f63e0 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4222: [HUDI-2849] improve SparkUI job description for write path

2021-12-05 Thread GitBox
hudi-bot removed a comment on pull request #4222: URL: https://github.com/apache/hudi/pull/4222#issuecomment-986389417 ## CI report: * 9b30498cb6205e12cb859dd8fe4654ec952f63e0 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] punish-yh commented on issue #4204: [SUPPORT] FlinkSQL write to Hudi, throw InvalidAvroMagicException: Not an Avro data file

2021-12-05 Thread GitBox
punish-yh commented on issue #4204: URL: https://github.com/apache/hudi/issues/4204#issuecomment-986398538 I deleted metadata , it's seems to be normal. thank you -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [hudi] hudi-bot removed a comment on pull request #4222: [HUDI-2849] improve SparkUI job description for write path

2021-12-05 Thread GitBox
hudi-bot removed a comment on pull request #4222: URL: https://github.com/apache/hudi/pull/4222#issuecomment-986390295 ## CI report: * 9b30498cb6205e12cb859dd8fe4654ec952f63e0 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4222: [HUDI-2849] improve SparkUI job description for write path

2021-12-05 Thread GitBox
hudi-bot commented on pull request #4222: URL: https://github.com/apache/hudi/pull/4222#issuecomment-986406347 ## CI report: * 9b30498cb6205e12cb859dd8fe4654ec952f63e0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] danny0405 closed issue #4204: [SUPPORT] FlinkSQL write to Hudi, throw InvalidAvroMagicException: Not an Avro data file

2021-12-05 Thread GitBox
danny0405 closed issue #4204: URL: https://github.com/apache/hudi/issues/4204 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@

[GitHub] [hudi] forest455 commented on issue #4200: spark-sql query timestamp partition error

2021-12-05 Thread GitBox
forest455 commented on issue #4200: URL: https://github.com/apache/hudi/issues/4200#issuecomment-986450794 Thanks. I use hudi-0.10.0 I modified HoodieSparkUtils.scala and it works now, but not sure it's right. ![IMG_20211206_130258](https://user-images.githubusercontent.com/95

[GitHub] [hudi] tieke1121 opened a new issue #4223: [SUPPORT]

2021-12-05 Thread GitBox
tieke1121 opened a new issue #4223: URL: https://github.com/apache/hudi/issues/4223 HI , I am using Flink to consume data from Kafka and use Side Outputs # feature to collect different business data . then sink to different hudi table sink . after i submit job on yarn ,then generate

[GitHub] [hudi] tieke1121 closed issue #4223: [SUPPORT]

2021-12-05 Thread GitBox
tieke1121 closed issue #4223: URL: https://github.com/apache/hudi/issues/4223 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@

[GitHub] [hudi] tieke1121 commented on issue #4223: [SUPPORT]

2021-12-05 Thread GitBox
tieke1121 commented on issue #4223: URL: https://github.com/apache/hudi/issues/4223#issuecomment-986481274 ingestion.sql --start[accesscard_dynamicaccountinfo] SELECT id AS uuid, id_old, id_base, account_id, dynamic_date , comsume_no, dynamic_sum, beforedynamic_sum, afterdy

[GitHub] [hudi] yihua commented on a change in pull request #4220: Update quick-start-guide.md

2021-12-05 Thread GitBox
yihua commented on a change in pull request #4220: URL: https://github.com/apache/hudi/pull/4220#discussion_r762734756 ## File path: website/versioned_docs/version-0.9.0/quick-start-guide.md ## @@ -166,7 +166,7 @@ values={[ ```python # pyspark - // No separate create table

[GitHub] [hudi] tieke1121 commented on issue #4223: [SUPPORT] Flink hudi Sink

2021-12-05 Thread GitBox
tieke1121 commented on issue #4223: URL: https://github.com/apache/hudi/issues/4223#issuecomment-986485165 main code : ![image](https://user-images.githubusercontent.com/6927930/144800135-b11c8f99-88b4-4aa4-ae16-15e7dfa8c62f.png) -- This is an automated message from the Apache Git

[GitHub] [hudi] hudi-bot commented on pull request #4172: [HUDI-2892][BUG]Pending Clustering may stain the ActiveTimeLine and lead to incomplete query results

2021-12-05 Thread GitBox
hudi-bot commented on pull request #4172: URL: https://github.com/apache/hudi/pull/4172#issuecomment-986485576 ## CI report: * bb29721e619d7e04e926613d8b7992db95eb3306 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4172: [HUDI-2892][BUG]Pending Clustering may stain the ActiveTimeLine and lead to incomplete query results

2021-12-05 Thread GitBox
hudi-bot removed a comment on pull request #4172: URL: https://github.com/apache/hudi/pull/4172#issuecomment-983350101 ## CI report: * bb29721e619d7e04e926613d8b7992db95eb3306 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot removed a comment on pull request #4172: [HUDI-2892][BUG]Pending Clustering may stain the ActiveTimeLine and lead to incomplete query results

2021-12-05 Thread GitBox
hudi-bot removed a comment on pull request #4172: URL: https://github.com/apache/hudi/pull/4172#issuecomment-986485576 ## CI report: * bb29721e619d7e04e926613d8b7992db95eb3306 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4172: [HUDI-2892][BUG]Pending Clustering may stain the ActiveTimeLine and lead to incomplete query results

2021-12-05 Thread GitBox
hudi-bot commented on pull request #4172: URL: https://github.com/apache/hudi/pull/4172#issuecomment-986486728 ## CI report: * bb29721e619d7e04e926613d8b7992db95eb3306 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4172: [HUDI-2892][BUG]Pending Clustering may stain the ActiveTimeLine and lead to incomplete query results

2021-12-05 Thread GitBox
hudi-bot removed a comment on pull request #4172: URL: https://github.com/apache/hudi/pull/4172#issuecomment-986486728 ## CI report: * bb29721e619d7e04e926613d8b7992db95eb3306 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4172: [HUDI-2892][BUG]Pending Clustering may stain the ActiveTimeLine and lead to incomplete query results

2021-12-05 Thread GitBox
hudi-bot commented on pull request #4172: URL: https://github.com/apache/hudi/pull/4172#issuecomment-986487952 ## CI report: * bb29721e619d7e04e926613d8b7992db95eb3306 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] yihua commented on pull request #4192: [HUDI-2916] Add IssueNavigationLink for IDEA

2021-12-05 Thread GitBox
yihua commented on pull request #4192: URL: https://github.com/apache/hudi/pull/4192#issuecomment-986488848 @leesf LGTM. This is a neat improvement on navigating to Jira tickets and PRs :) -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [hudi] yihua merged pull request #4192: [HUDI-2916] Add IssueNavigationLink for IDEA

2021-12-05 Thread GitBox
yihua merged pull request #4192: URL: https://github.com/apache/hudi/pull/4192 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...

[hudi] branch master updated (734c9f5 -> f0e46bf)

2021-12-05 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 734c9f5 [HUDI-2418] Support HiveSchemaProvider (#3671) add f0e46bf [HUDI-2916] Add IssueNavigationLink for IDEA (

[GitHub] [hudi] zhangyue19921010 commented on issue #4163: [SUPPORT] Pending Clustering may stain the ActiveTimeLine and lead to incomplete query results

2021-12-05 Thread GitBox
zhangyue19921010 commented on issue #4163: URL: https://github.com/apache/hudi/issues/4163#issuecomment-986489474 Hi @xushiyan Thanks for your attention and review :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

[GitHub] [hudi] yyar commented on issue #4162: [SUPPORT] First written data disappears when I append second data for schema evolution in example code.

2021-12-05 Thread GitBox
yyar commented on issue #4162: URL: https://github.com/apache/hudi/issues/4162#issuecomment-986498066 @xushiyan You're right. When I ran spark-shell in 3.0.1, this behavior doesn't appear and it happens in 3.2.0. One strange point is when I ran using sbt. I will check running in sbt and re

[GitHub] [hudi] zhangyue19921010 removed a comment on pull request #4078: [HUDI-2833] Clean up unused archive files instead of expanding indefinitely.

2021-12-05 Thread GitBox
zhangyue19921010 removed a comment on pull request #4078: URL: https://github.com/apache/hudi/pull/4078#issuecomment-981424079 Hi @codope would you like to take a look at this pr? Really appreciate it if you could give me a hand :> -- This is an automated message from the Apache Git Serv

[GitHub] [hudi] hudi-bot commented on pull request #4078: [HUDI-2833] Clean up unused archive files instead of expanding indefinitely.

2021-12-05 Thread GitBox
hudi-bot commented on pull request #4078: URL: https://github.com/apache/hudi/pull/4078#issuecomment-986500602 ## CI report: * 2846e886798cbd4fc8e0e2df4a3f80e072a05a46 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4078: [HUDI-2833] Clean up unused archive files instead of expanding indefinitely.

2021-12-05 Thread GitBox
hudi-bot removed a comment on pull request #4078: URL: https://github.com/apache/hudi/pull/4078#issuecomment-976157991 ## CI report: * 2846e886798cbd4fc8e0e2df4a3f80e072a05a46 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] xuzifu666 opened a new pull request #4224: add error message log in HoodieCombineHiveInputFormat

2021-12-05 Thread GitBox
xuzifu666 opened a new pull request #4224: URL: https://github.com/apache/hudi/pull/4224 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpo

[GitHub] [hudi] hudi-bot commented on pull request #4078: [HUDI-2833] Clean up unused archive files instead of expanding indefinitely.

2021-12-05 Thread GitBox
hudi-bot commented on pull request #4078: URL: https://github.com/apache/hudi/pull/4078#issuecomment-986502163 ## CI report: * 2846e886798cbd4fc8e0e2df4a3f80e072a05a46 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4078: [HUDI-2833] Clean up unused archive files instead of expanding indefinitely.

2021-12-05 Thread GitBox
hudi-bot removed a comment on pull request #4078: URL: https://github.com/apache/hudi/pull/4078#issuecomment-986500602 ## CI report: * 2846e886798cbd4fc8e0e2df4a3f80e072a05a46 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4224: add error message log in HoodieCombineHiveInputFormat

2021-12-05 Thread GitBox
hudi-bot commented on pull request #4224: URL: https://github.com/apache/hudi/pull/4224#issuecomment-986503879 ## CI report: * 81a459a3ebfcbb5d91a8d1f370c0b9135fc4eada UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` r

[jira] [Created] (HUDI-2942) HoodieCombineHiveInputFormat need add error info in hive integration

2021-12-05 Thread xy (Jira)
xy created HUDI-2942: Summary: HoodieCombineHiveInputFormat need add error info in hive integration Key: HUDI-2942 URL: https://issues.apache.org/jira/browse/HUDI-2942 Project: Apache Hudi Issue Type: I

[GitHub] [hudi] hudi-bot removed a comment on pull request #4078: [HUDI-2833] Clean up unused archive files instead of expanding indefinitely.

2021-12-05 Thread GitBox
hudi-bot removed a comment on pull request #4078: URL: https://github.com/apache/hudi/pull/4078#issuecomment-986502163 ## CI report: * 2846e886798cbd4fc8e0e2df4a3f80e072a05a46 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4078: [HUDI-2833] Clean up unused archive files instead of expanding indefinitely.

2021-12-05 Thread GitBox
hudi-bot commented on pull request #4078: URL: https://github.com/apache/hudi/pull/4078#issuecomment-986505254 ## CI report: * 2846e886798cbd4fc8e0e2df4a3f80e072a05a46 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4224: [HUDI-2942] add error message log in HoodieCombineHiveInputFormat

2021-12-05 Thread GitBox
hudi-bot removed a comment on pull request #4224: URL: https://github.com/apache/hudi/pull/4224#issuecomment-986503879 ## CI report: * 81a459a3ebfcbb5d91a8d1f370c0b9135fc4eada UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4224: [HUDI-2942] add error message log in HoodieCombineHiveInputFormat

2021-12-05 Thread GitBox
hudi-bot commented on pull request #4224: URL: https://github.com/apache/hudi/pull/4224#issuecomment-986505387 ## CI report: * 81a459a3ebfcbb5d91a8d1f370c0b9135fc4eada Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[jira] [Updated] (HUDI-2942) HoodieCombineHiveInputFormat need add error info in hive integration

2021-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2942: - Labels: pull-request-available (was: ) > HoodieCombineHiveInputFormat need add error info in hive

[GitHub] [hudi] hudi-bot commented on pull request #4078: [HUDI-2833] Clean up unused archive files instead of expanding indefinitely.

2021-12-05 Thread GitBox
hudi-bot commented on pull request #4078: URL: https://github.com/apache/hudi/pull/4078#issuecomment-986506637 ## CI report: * 9df4e2775262fb1216d0d5911984bea39fc05452 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4078: [HUDI-2833] Clean up unused archive files instead of expanding indefinitely.

2021-12-05 Thread GitBox
hudi-bot removed a comment on pull request #4078: URL: https://github.com/apache/hudi/pull/4078#issuecomment-986505254 ## CI report: * 2846e886798cbd4fc8e0e2df4a3f80e072a05a46 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] zhangyue19921010 commented on pull request #4078: [HUDI-2833] Clean up unused archive files instead of expanding indefinitely.

2021-12-05 Thread GitBox
zhangyue19921010 commented on pull request #4078: URL: https://github.com/apache/hudi/pull/4078#issuecomment-986509055 Hi @bhasudha. Sorry to bother you. Would you mind to take a look at this hudi on S3 related issue? Really appreciate it if you could help me. By the way we have deplo

[GitHub] [hudi] hudi-bot commented on pull request #4078: [HUDI-2833] Clean up unused archive files instead of expanding indefinitely.

2021-12-05 Thread GitBox
hudi-bot commented on pull request #4078: URL: https://github.com/apache/hudi/pull/4078#issuecomment-986509207 ## CI report: * 9df4e2775262fb1216d0d5911984bea39fc05452 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4078: [HUDI-2833] Clean up unused archive files instead of expanding indefinitely.

2021-12-05 Thread GitBox
hudi-bot removed a comment on pull request #4078: URL: https://github.com/apache/hudi/pull/4078#issuecomment-986506637 ## CI report: * 9df4e2775262fb1216d0d5911984bea39fc05452 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[jira] [Assigned] (HUDI-2922) Improve Use Cases

2021-12-05 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller reassigned HUDI-2922: - Assignee: Kyle Weller > Improve Use Cases > - > > Key: HUDI-2922

[jira] [Updated] (HUDI-2922) Improve Use Cases

2021-12-05 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2922: -- Fix Version/s: 0.10.0 > Improve Use Cases > - > > Key: HUDI-2922 >

[jira] [Updated] (HUDI-2922) Improve Use Cases

2021-12-05 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2922: -- Priority: Minor (was: Major) > Improve Use Cases > - > > Key: HUDI-2922

[GitHub] [hudi] kywe665 opened a new pull request #4225: [HUDI-2922] - Docs - Improve Hudi use cases

2021-12-05 Thread GitBox
kywe665 opened a new pull request #4225: URL: https://github.com/apache/hudi/pull/4225 ## What is the purpose of the pull request Enhance the Hudi Use Cases doc ## Brief change log - Updated Hudi use cases doc - fixed minor typo in clustering doc ## Verify

[jira] [Updated] (HUDI-2922) Improve Use Cases

2021-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2922: - Labels: pull-request-available (was: ) > Improve Use Cases > - > >

[GitHub] [hudi] hudi-bot commented on pull request #4172: [HUDI-2892][BUG]Pending Clustering may stain the ActiveTimeLine and lead to incomplete query results

2021-12-05 Thread GitBox
hudi-bot commented on pull request #4172: URL: https://github.com/apache/hudi/pull/4172#issuecomment-986518165 ## CI report: * 8740fecc1391600a836eb6158c31ab7416f57eec UNKNOWN * f65e6971ee3e9659155c6b453dec2c60e22fd29d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/

[GitHub] [hudi] hudi-bot removed a comment on pull request #4172: [HUDI-2892][BUG]Pending Clustering may stain the ActiveTimeLine and lead to incomplete query results

2021-12-05 Thread GitBox
hudi-bot removed a comment on pull request #4172: URL: https://github.com/apache/hudi/pull/4172#issuecomment-986487952 ## CI report: * bb29721e619d7e04e926613d8b7992db95eb3306 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] zhangyue19921010 commented on pull request #4172: [HUDI-2892][BUG]Pending Clustering may stain the ActiveTimeLine and lead to incomplete query results

2021-12-05 Thread GitBox
zhangyue19921010 commented on pull request #4172: URL: https://github.com/apache/hudi/pull/4172#issuecomment-986519194 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[GitHub] [hudi] hudi-bot removed a comment on pull request #4172: [HUDI-2892][BUG]Pending Clustering may stain the ActiveTimeLine and lead to incomplete query results

2021-12-05 Thread GitBox
hudi-bot removed a comment on pull request #4172: URL: https://github.com/apache/hudi/pull/4172#issuecomment-986518165 ## CI report: * 8740fecc1391600a836eb6158c31ab7416f57eec UNKNOWN * f65e6971ee3e9659155c6b453dec2c60e22fd29d Azure: [FAILURE](https://dev.azure.com/apache-hudi

[GitHub] [hudi] hudi-bot commented on pull request #4172: [HUDI-2892][BUG]Pending Clustering may stain the ActiveTimeLine and lead to incomplete query results

2021-12-05 Thread GitBox
hudi-bot commented on pull request #4172: URL: https://github.com/apache/hudi/pull/4172#issuecomment-986519506 ## CI report: * 8740fecc1391600a836eb6158c31ab7416f57eec UNKNOWN * f65e6971ee3e9659155c6b453dec2c60e22fd29d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/