[GitHub] [hudi] danny0405 merged pull request #4167: [HUDI-2880] Fixing loading of props from default dir

danny0405 merged pull request #4167: URL: https://github.com/apache/hudi/pull/4167 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[hudi] branch master updated (9b254b6 -> f4c25ba)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 9b254b6 Revert "[HUDI-2856] Bit cask disk map delete modified (#4116)" (#4171) add f4c25ba [HUDI-2880] Fixin

[jira] [Resolved] (HUDI-2880) Error reading in properties from dfs in Spark Shell

[ https://issues.apache.org/jira/browse/HUDI-2880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-2880. -- > Error reading in properties from dfs in Spark Shell > ---

[jira] [Commented] (HUDI-2880) Error reading in properties from dfs in Spark Shell

[ https://issues.apache.org/jira/browse/HUDI-2880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17451591#comment-17451591 ] Danny Chen commented on HUDI-2880: -- Fixed via master branch: f4c25ba3fd11e2da1adcf2e08996

[GitHub] [hudi] zhangyue19921010 commented on pull request #4172: [HUDI-2892][BUG]Pending Clustering may stain the ActiveTimeLine and lead to incomplete query results

zhangyue19921010 commented on pull request #4172: URL: https://github.com/apache/hudi/pull/4172#issuecomment-983394131 cc @lw309637554 and @satishkotha Looking for clustering function experts for help :) It seems a bug which needs to be fixed. Would you mind to take a look? Thanks in a

[GitHub] [hudi] hudi-bot commented on pull request #4175: [HUDI-2883] Refactor hive sync tool / config to use reflection and standardize configs

hudi-bot commented on pull request #4175: URL: https://github.com/apache/hudi/pull/4175#issuecomment-983404527 ## CI report: * c1738f4df051621cc349f95457f5e65dfe276cec Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4175: [HUDI-2883] Refactor hive sync tool / config to use reflection and standardize configs

hudi-bot removed a comment on pull request #4175: URL: https://github.com/apache/hudi/pull/4175#issuecomment-983365431 ## CI report: * c1738f4df051621cc349f95457f5e65dfe276cec Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] xiarixiaoyao commented on issue #4135: [SUPPORT] Zordering clustering on a moderate size dataset taking large amounts of time.

xiarixiaoyao commented on issue #4135: URL: https://github.com/apache/hudi/issues/4135#issuecomment-983424937 @vinothchandar The current cluster mechanism just can't support concurrency very well. Even if you use ordinary sorting (not z-order / Hilbert), there also exsit this probl

[GitHub] [hudi] xiarixiaoyao commented on pull request #4139: [HUDI-2876] for hive/presto hudi should remove the temp file which cr…

xiarixiaoyao commented on pull request #4139: URL: https://github.com/apache/hudi/pull/4139#issuecomment-983426494 kindly ping @leesf @nsivabalan could you pls help me review this pr. -- This is an automated message from the Apache Git Service. To respond to the message, please log o

[GitHub] [hudi] hudi-bot removed a comment on pull request #4175: [HUDI-2883] Refactor hive sync tool / config to use reflection and standardize configs

hudi-bot removed a comment on pull request #4175: URL: https://github.com/apache/hudi/pull/4175#issuecomment-983404527 ## CI report: * c1738f4df051621cc349f95457f5e65dfe276cec Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4175: [HUDI-2883] Refactor hive sync tool / config to use reflection and standardize configs

hudi-bot commented on pull request #4175: URL: https://github.com/apache/hudi/pull/4175#issuecomment-983433224 ## CI report: * c1738f4df051621cc349f95457f5e65dfe276cec Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[jira] [Commented] (HUDI-2781) Test 0.10 RC for Spark 3.x

[ https://issues.apache.org/jira/browse/HUDI-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17451641#comment-17451641 ] Yann Byron commented on HUDI-2781: -- [~xushiyan]  Environment:     spark 3.0.3, hive3.1.

[GitHub] [hudi] hudi-bot removed a comment on pull request #4175: [HUDI-2883] Refactor hive sync tool / config to use reflection and standardize configs

hudi-bot removed a comment on pull request #4175: URL: https://github.com/apache/hudi/pull/4175#issuecomment-983433224 ## CI report: * c1738f4df051621cc349f95457f5e65dfe276cec Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4175: [HUDI-2883] Refactor hive sync tool / config to use reflection and standardize configs

hudi-bot commented on pull request #4175: URL: https://github.com/apache/hudi/pull/4175#issuecomment-983435541 ## CI report: * c1738f4df051621cc349f95457f5e65dfe276cec Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4175: [HUDI-2883] Refactor hive sync tool / config to use reflection and standardize configs

hudi-bot removed a comment on pull request #4175: URL: https://github.com/apache/hudi/pull/4175#issuecomment-983435541 ## CI report: * c1738f4df051621cc349f95457f5e65dfe276cec Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4175: [HUDI-2883] Refactor hive sync tool / config to use reflection and standardize configs

hudi-bot commented on pull request #4175: URL: https://github.com/apache/hudi/pull/4175#issuecomment-983457360 ## CI report: * edc7087b751940625db4566dd3f4e9e77bf26aa7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r760045330 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieIndexConfig.java ## @@ -54,7 +63,7 @@ .key("hoodie.index.ty

[jira] [Created] (HUDI-2900) Fix corrupt block end position

Danny Chen created HUDI-2900: Summary: Fix corrupt block end position Key: HUDI-2900 URL: https://issues.apache.org/jira/browse/HUDI-2900 Project: Apache Hudi Issue Type: Bug Components

[GitHub] [hudi] Coreixwumo commented on issue #3999: [SUPPORT] errors while using flink on hudi mor table

Coreixwumo commented on issue #3999: URL: https://github.com/apache/hudi/issues/3999#issuecomment-983502056 @xushiyan it works, thanks very march! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [hudi] codejoyan opened a new issue #4176: [SUPPORT]

codejoyan opened a new issue #4176: URL: https://github.com/apache/hudi/issues/4176 Hudi - 0.9.0 Spark - 2.4.7 I created a Hudi COW table and trying to do Hive sync. Getting the below error. Please suggest the workaround and also any other way to hive sync for an already exist

[GitHub] [hudi] codejoyan commented on issue #4176: [SUPPORT]

codejoyan commented on issue #4176: URL: https://github.com/apache/hudi/issues/4176#issuecomment-983561312 It looks to me as a jar mismatch issue. But what is the suggestion in case we face jar mismatch issues? -- This is an automated message from the Apache Git Service. To respond to th

[GitHub] [hudi] codejoyan opened a new issue #4177: [SUPPORT]

codejoyan opened a new issue #4177: URL: https://github.com/apache/hudi/issues/4177 Facing an issue with 0.9.0 hudi version I bulk inserted into a hudi table (say 100 partitions). Then I am trying to upsert data to the last partition. But instead of upserting, by mistake I used b

[GitHub] [hudi] hudi-bot commented on pull request #4173: [MINOR] [WIP] Check on TestHBaseIndex

hudi-bot commented on pull request #4173: URL: https://github.com/apache/hudi/pull/4173#issuecomment-983578486 ## CI report: * e44ac377bd15d4e66bbf641ec5bf18253dadc01b Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4173: [MINOR] [WIP] Check on TestHBaseIndex

hudi-bot removed a comment on pull request #4173: URL: https://github.com/apache/hudi/pull/4173#issuecomment-983336858 ## CI report: * e44ac377bd15d4e66bbf641ec5bf18253dadc01b Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[jira] [Created] (HUDI-2901) Fixed the bug clustering jobs are not running in parallel

tao meng created HUDI-2901: -- Summary: Fixed the bug clustering jobs are not running in parallel Key: HUDI-2901 URL: https://issues.apache.org/jira/browse/HUDI-2901 Project: Apache Hudi Issue Type: B

[GitHub] [hudi] hudi-bot removed a comment on pull request #4173: [MINOR] [WIP] Check on TestHBaseIndex

hudi-bot removed a comment on pull request #4173: URL: https://github.com/apache/hudi/pull/4173#issuecomment-983578486 ## CI report: * e44ac377bd15d4e66bbf641ec5bf18253dadc01b Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4173: [MINOR] [WIP] Check on TestHBaseIndex

hudi-bot commented on pull request #4173: URL: https://github.com/apache/hudi/pull/4173#issuecomment-983586391 ## CI report: * e44ac377bd15d4e66bbf641ec5bf18253dadc01b Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] boneanxs commented on a change in pull request #4014: [HUDI-2779] Cache BaseDir if HudiTableNotFound Exception thrown

boneanxs commented on a change in pull request #4014: URL: https://github.com/apache/hudi/pull/4014#discussion_r760148712 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieROTablePathFilter.java ## @@ -173,6 +173,13 @@ public boolean accept(Path path) {

[GitHub] [hudi] xiarixiaoyao opened a new pull request #4178: [HUDI-2901] Fixed the bug clustering jobs cannot running in parallel

xiarixiaoyao opened a new pull request #4178: URL: https://github.com/apache/hudi/pull/4178 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* Fixed the bug clu

[jira] [Updated] (HUDI-2901) Fixed the bug clustering jobs are not running in parallel

[ https://issues.apache.org/jira/browse/HUDI-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2901: - Labels: pull-request-available (was: ) > Fixed the bug clustering jobs are not running in paralle

[GitHub] [hudi] boneanxs commented on a change in pull request #4014: [HUDI-2779] Cache BaseDir if HudiTableNotFound Exception thrown

boneanxs commented on a change in pull request #4014: URL: https://github.com/apache/hudi/pull/4014#discussion_r760151618 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieROTablePathFilter.java ## @@ -231,6 +240,12 @@ public boolean accept(Path path) {

[GitHub] [hudi] hudi-bot commented on pull request #4178: [HUDI-2901] Fixed the bug clustering jobs cannot running in parallel

hudi-bot commented on pull request #4178: URL: https://github.com/apache/hudi/pull/4178#issuecomment-983609460 ## CI report: * c454677b96fab062cf31634426646d741ac9dbe5 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4014: [HUDI-2779] Cache BaseDir if HudiTableNotFound Exception thrown

hudi-bot removed a comment on pull request #4014: URL: https://github.com/apache/hudi/pull/4014#issuecomment-977692550 ## CI report: * 476cd38123d0c6303b844767ab2e48219a149320 UNKNOWN * a752e0a1c2367e9e1cfe54ecfd40e7b02ab64b5e Azure: [SUCCESS](https://dev.azure.com/apache-hudi

[GitHub] [hudi] hudi-bot commented on pull request #4014: [HUDI-2779] Cache BaseDir if HudiTableNotFound Exception thrown

hudi-bot commented on pull request #4014: URL: https://github.com/apache/hudi/pull/4014#issuecomment-983611140 ## CI report: * 476cd38123d0c6303b844767ab2e48219a149320 UNKNOWN * a752e0a1c2367e9e1cfe54ecfd40e7b02ab64b5e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/

[GitHub] [hudi] hudi-bot removed a comment on pull request #4178: [HUDI-2901] Fixed the bug clustering jobs cannot running in parallel

hudi-bot removed a comment on pull request #4178: URL: https://github.com/apache/hudi/pull/4178#issuecomment-983609460 ## CI report: * c454677b96fab062cf31634426646d741ac9dbe5 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4178: [HUDI-2901] Fixed the bug clustering jobs cannot running in parallel

hudi-bot commented on pull request #4178: URL: https://github.com/apache/hudi/pull/4178#issuecomment-983611320 ## CI report: * c454677b96fab062cf31634426646d741ac9dbe5 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] xiarixiaoyao commented on pull request #4178: [HUDI-2901] Fixed the bug clustering jobs cannot running in parallel

xiarixiaoyao commented on pull request #4178: URL: https://github.com/apache/hudi/pull/4178#issuecomment-983611796 @vinothchandar @leesf could you pls help me review this pr. thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hudi] hudi-bot commented on pull request #4173: [MINOR] [WIP] Check on TestHBaseIndex

hudi-bot commented on pull request #4173: URL: https://github.com/apache/hudi/pull/4173#issuecomment-983627070 ## CI report: * 66c6b0d67d07d6eed59b3653c91dbacd87c05501 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4173: [MINOR] [WIP] Check on TestHBaseIndex

hudi-bot removed a comment on pull request #4173: URL: https://github.com/apache/hudi/pull/4173#issuecomment-983586391 ## CI report: * e44ac377bd15d4e66bbf641ec5bf18253dadc01b Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[jira] [Assigned] (HUDI-2894) Metadata table read after compaction fails in S3

[ https://issues.apache.org/jira/browse/HUDI-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-2894: - Assignee: Manoj Govindassamy > Metadata table read after compaction fails in S3 >

[jira] [Commented] (HUDI-2894) Metadata table read after compaction fails in S3

[ https://issues.apache.org/jira/browse/HUDI-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17451832#comment-17451832 ] sivabalan narayanan commented on HUDI-2894: --- Updates: We tried adding a retry l

[jira] [Comment Edited] (HUDI-2894) Metadata table read after compaction fails in S3

[ https://issues.apache.org/jira/browse/HUDI-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17451323#comment-17451323 ] sivabalan narayanan edited comment on HUDI-2894 at 12/1/21, 1:44 PM: ---

[jira] [Comment Edited] (HUDI-2894) Metadata table read after compaction fails in S3

[ https://issues.apache.org/jira/browse/HUDI-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17451832#comment-17451832 ] sivabalan narayanan edited comment on HUDI-2894 at 12/1/21, 1:45 PM: ---

[jira] [Comment Edited] (HUDI-2894) Metadata table read after compaction fails in S3

[ https://issues.apache.org/jira/browse/HUDI-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17451832#comment-17451832 ] sivabalan narayanan edited comment on HUDI-2894 at 12/1/21, 1:45 PM: ---

[GitHub] [hudi] zzzhy opened a new pull request #4179: fix the wrong usage of timestamp length variable bug

zzzhy opened a new pull request #4179: URL: https://github.com/apache/hudi/pull/4179 ## What is the purpose of the pull request *This pull request fix the wrong usage of timestamp variable bug* ## Brief change log - *change the compare subject from timestamp string to the

[GitHub] [hudi] hudi-bot commented on pull request #4179: fix the wrong usage of timestamp length variable bug

hudi-bot commented on pull request #4179: URL: https://github.com/apache/hudi/pull/4179#issuecomment-983661691 ## CI report: * ffdf5ee6c364d06cf3dd40f523b36c4eadad24eb UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` r

[jira] [Created] (HUDI-2902) Metadata table virtual keys are not effective in base files

sivabalan narayanan created HUDI-2902: - Summary: Metadata table virtual keys are not effective in base files Key: HUDI-2902 URL: https://issues.apache.org/jira/browse/HUDI-2902 Project: Apache Hud

[jira] [Assigned] (HUDI-2902) Metadata table virtual keys are not effective in base files

[ https://issues.apache.org/jira/browse/HUDI-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-2902: - Assignee: Manoj Govindassamy > Metadata table virtual keys are not effective in b

[jira] [Updated] (HUDI-2902) Metadata table virtual keys are not effective in base files

[ https://issues.apache.org/jira/browse/HUDI-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2902: -- Fix Version/s: 0.10.0 > Metadata table virtual keys are not effective in base files > --

[jira] [Updated] (HUDI-2902) Metadata table virtual keys are not effective in base files

[ https://issues.apache.org/jira/browse/HUDI-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2902: -- Priority: Blocker (was: Major) > Metadata table virtual keys are not effective in base

[GitHub] [hudi] hudi-bot removed a comment on pull request #4014: [HUDI-2779] Cache BaseDir if HudiTableNotFound Exception thrown

hudi-bot removed a comment on pull request #4014: URL: https://github.com/apache/hudi/pull/4014#issuecomment-983611140 ## CI report: * 476cd38123d0c6303b844767ab2e48219a149320 UNKNOWN * a752e0a1c2367e9e1cfe54ecfd40e7b02ab64b5e Azure: [SUCCESS](https://dev.azure.com/apache-hudi

[GitHub] [hudi] hudi-bot commented on pull request #4014: [HUDI-2779] Cache BaseDir if HudiTableNotFound Exception thrown

hudi-bot commented on pull request #4014: URL: https://github.com/apache/hudi/pull/4014#issuecomment-983663665 ## CI report: * 476cd38123d0c6303b844767ab2e48219a149320 UNKNOWN * a752e0a1c2367e9e1cfe54ecfd40e7b02ab64b5e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/

[GitHub] [hudi] hudi-bot removed a comment on pull request #4179: fix the wrong usage of timestamp length variable bug

hudi-bot removed a comment on pull request #4179: URL: https://github.com/apache/hudi/pull/4179#issuecomment-983661691 ## CI report: * ffdf5ee6c364d06cf3dd40f523b36c4eadad24eb UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4179: fix the wrong usage of timestamp length variable bug

hudi-bot commented on pull request #4179: URL: https://github.com/apache/hudi/pull/4179#issuecomment-983668254 ## CI report: * ffdf5ee6c364d06cf3dd40f523b36c4eadad24eb Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4178: [HUDI-2901] Fixed the bug clustering jobs cannot running in parallel

hudi-bot removed a comment on pull request #4178: URL: https://github.com/apache/hudi/pull/4178#issuecomment-983611320 ## CI report: * c454677b96fab062cf31634426646d741ac9dbe5 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4178: [HUDI-2901] Fixed the bug clustering jobs cannot running in parallel

hudi-bot commented on pull request #4178: URL: https://github.com/apache/hudi/pull/4178#issuecomment-983676154 ## CI report: * c454677b96fab062cf31634426646d741ac9dbe5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] minihippo commented on a change in pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

minihippo commented on a change in pull request #3173: URL: https://github.com/apache/hudi/pull/3173#discussion_r760226513 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieIndexConfig.java ## @@ -200,6 +209,48 @@ .defaultValue("tru

[GitHub] [hudi] YannByron opened a new pull request #4180: [MINOR] get table schema from the last commit with data written

YannByron opened a new pull request #4180: URL: https://github.com/apache/hudi/pull/4180 If the last operation is `delete_partition`, the `HoodieCommitMetadata` object from the last commit will has an empty getFileIdAndRelativePaths. So we can't get the table schema from it. So, i w

[GitHub] [hudi] hudi-bot commented on pull request #4180: [MINOR] get table schema from the last commit with data written

hudi-bot commented on pull request #4180: URL: https://github.com/apache/hudi/pull/4180#issuecomment-983706061 ## CI report: * 9f3823cd34b2f073cc5dd097790ff2762371880b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` r

[GitHub] [hudi] minihippo commented on a change in pull request #4152: [HUDI-2881] Compact the file group with larger log files to reduce wr…

minihippo commented on a change in pull request #4152: URL: https://github.com/apache/hudi/pull/4152#discussion_r760248613 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/compact/strategy/LogFileSizeThresholdBasedCompactionStrategy.java

[GitHub] [hudi] minihippo commented on a change in pull request #4152: [HUDI-2881] Compact the file group with larger log files to reduce wr…

minihippo commented on a change in pull request #4152: URL: https://github.com/apache/hudi/pull/4152#discussion_r760248760 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieCompactionConfig.java ## @@ -166,6 +166,11 @@ .withDocument

[GitHub] [hudi] hudi-bot commented on pull request #4180: [MINOR] get table schema from the last commit with data written

hudi-bot commented on pull request #4180: URL: https://github.com/apache/hudi/pull/4180#issuecomment-983708621 ## CI report: * 9f3823cd34b2f073cc5dd097790ff2762371880b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4180: [MINOR] get table schema from the last commit with data written

hudi-bot removed a comment on pull request #4180: URL: https://github.com/apache/hudi/pull/4180#issuecomment-983706061 ## CI report: * 9f3823cd34b2f073cc5dd097790ff2762371880b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot removed a comment on pull request #4152: [HUDI-2881] Compact the file group with larger log files to reduce wr…

hudi-bot removed a comment on pull request #4152: URL: https://github.com/apache/hudi/pull/4152#issuecomment-981756626 ## CI report: * 51e4a9e874a5b1c578ba6508fbf2652714c9626c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4152: [HUDI-2881] Compact the file group with larger log files to reduce wr…

hudi-bot commented on pull request #4152: URL: https://github.com/apache/hudi/pull/4152#issuecomment-983711087 ## CI report: * 51e4a9e874a5b1c578ba6508fbf2652714c9626c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot commented on pull request #4152: [HUDI-2881] Compact the file group with larger log files to reduce wr…

hudi-bot commented on pull request #4152: URL: https://github.com/apache/hudi/pull/4152#issuecomment-983713579 ## CI report: * 51e4a9e874a5b1c578ba6508fbf2652714c9626c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4152: [HUDI-2881] Compact the file group with larger log files to reduce wr…

hudi-bot removed a comment on pull request #4152: URL: https://github.com/apache/hudi/pull/4152#issuecomment-983711087 ## CI report: * 51e4a9e874a5b1c578ba6508fbf2652714c9626c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] leesf commented on a change in pull request #4152: [HUDI-2881] Compact the file group with larger log files to reduce wr…

leesf commented on a change in pull request #4152: URL: https://github.com/apache/hudi/pull/4152#discussion_r760260198 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/compact/strategy/LogFileSizeBasedCompactionStrategy.java ## @@ -39,8 +

[GitHub] [hudi] hudi-bot removed a comment on pull request #4179: fix the wrong usage of timestamp variable bug

hudi-bot removed a comment on pull request #4179: URL: https://github.com/apache/hudi/pull/4179#issuecomment-983668254 ## CI report: * ffdf5ee6c364d06cf3dd40f523b36c4eadad24eb Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4179: fix the wrong usage of timestamp variable bug

hudi-bot commented on pull request #4179: URL: https://github.com/apache/hudi/pull/4179#issuecomment-983721370 ## CI report: * ffdf5ee6c364d06cf3dd40f523b36c4eadad24eb Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] leesf commented on a change in pull request #4139: [HUDI-2876] for hive/presto hudi should remove the temp file which cr…

leesf commented on a change in pull request #4139: URL: https://github.com/apache/hudi/pull/4139#discussion_r760264687 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/realtime/RealtimeCompactedRecordReader.java ## @@ -188,6 +189,7 @@ public long getPos() thro

[GitHub] [hudi] leesf commented on pull request #4180: [MINOR] get table schema from the last commit with data written

leesf commented on pull request #4180: URL: https://github.com/apache/hudi/pull/4180#issuecomment-983724692 > So, i wanna find the last commit which data is written to. I think this should not be a minor and worth filing a jira ticket. -- This is an automated message from the Apach

[GitHub] [hudi] hudi-bot removed a comment on pull request #4014: [HUDI-2779] Cache BaseDir if HudiTableNotFound Exception thrown

hudi-bot removed a comment on pull request #4014: URL: https://github.com/apache/hudi/pull/4014#issuecomment-983663665 ## CI report: * 476cd38123d0c6303b844767ab2e48219a149320 UNKNOWN * a752e0a1c2367e9e1cfe54ecfd40e7b02ab64b5e Azure: [SUCCESS](https://dev.azure.com/apache-hudi

[GitHub] [hudi] hudi-bot commented on pull request #4014: [HUDI-2779] Cache BaseDir if HudiTableNotFound Exception thrown

hudi-bot commented on pull request #4014: URL: https://github.com/apache/hudi/pull/4014#issuecomment-983729264 ## CI report: * 476cd38123d0c6303b844767ab2e48219a149320 UNKNOWN * ed0d854d9cc1be0b2e0c52f8fe3184cbacb1aaa6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/

[GitHub] [hudi] minihippo commented on a change in pull request #4152: [HUDI-2881] Compact the file group with larger log files to reduce wr…

minihippo commented on a change in pull request #4152: URL: https://github.com/apache/hudi/pull/4152#discussion_r760272304 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/compact/strategy/LogFileSizeBasedCompactionStrategy.java ## @@ -39

[GitHub] [hudi] hudi-bot commented on pull request #4152: [HUDI-2881] Compact the file group with larger log files to reduce wr…

hudi-bot commented on pull request #4152: URL: https://github.com/apache/hudi/pull/4152#issuecomment-983732406 ## CI report: * 51e4a9e874a5b1c578ba6508fbf2652714c9626c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4152: [HUDI-2881] Compact the file group with larger log files to reduce wr…

hudi-bot removed a comment on pull request #4152: URL: https://github.com/apache/hudi/pull/4152#issuecomment-983713579 ## CI report: * 51e4a9e874a5b1c578ba6508fbf2652714c9626c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4152: [HUDI-2881] Compact the file group with larger log files to reduce wr…

hudi-bot commented on pull request #4152: URL: https://github.com/apache/hudi/pull/4152#issuecomment-983735256 ## CI report: * 360acc1684b502ca6209efa3f6daa55a6ab6ace4 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4152: [HUDI-2881] Compact the file group with larger log files to reduce wr…

hudi-bot removed a comment on pull request #4152: URL: https://github.com/apache/hudi/pull/4152#issuecomment-983732406 ## CI report: * 51e4a9e874a5b1c578ba6508fbf2652714c9626c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot removed a comment on pull request #4014: [HUDI-2779] Cache BaseDir if HudiTableNotFound Exception thrown

hudi-bot removed a comment on pull request #4014: URL: https://github.com/apache/hudi/pull/4014#issuecomment-983729264 ## CI report: * 476cd38123d0c6303b844767ab2e48219a149320 UNKNOWN * ed0d854d9cc1be0b2e0c52f8fe3184cbacb1aaa6 Azure: [FAILURE](https://dev.azure.com/apache-hudi

[GitHub] [hudi] hudi-bot commented on pull request #4014: [HUDI-2779] Cache BaseDir if HudiTableNotFound Exception thrown

hudi-bot commented on pull request #4014: URL: https://github.com/apache/hudi/pull/4014#issuecomment-983758117 ## CI report: * 476cd38123d0c6303b844767ab2e48219a149320 UNKNOWN * ed0d854d9cc1be0b2e0c52f8fe3184cbacb1aaa6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/

[GitHub] [hudi] hudi-bot commented on pull request #4014: [HUDI-2779] Cache BaseDir if HudiTableNotFound Exception thrown

hudi-bot commented on pull request #4014: URL: https://github.com/apache/hudi/pull/4014#issuecomment-983760794 ## CI report: * 476cd38123d0c6303b844767ab2e48219a149320 UNKNOWN * d3de6ffe7f4d60ff102be081b18eaa0311854d2f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/

[GitHub] [hudi] hudi-bot removed a comment on pull request #4014: [HUDI-2779] Cache BaseDir if HudiTableNotFound Exception thrown

hudi-bot removed a comment on pull request #4014: URL: https://github.com/apache/hudi/pull/4014#issuecomment-983758117 ## CI report: * 476cd38123d0c6303b844767ab2e48219a149320 UNKNOWN * ed0d854d9cc1be0b2e0c52f8fe3184cbacb1aaa6 Azure: [FAILURE](https://dev.azure.com/apache-hudi

[GitHub] [hudi] hudi-bot commented on pull request #4180: [MINOR] get table schema from the last commit with data written

hudi-bot commented on pull request #4180: URL: https://github.com/apache/hudi/pull/4180#issuecomment-983772080 ## CI report: * 9f3823cd34b2f073cc5dd097790ff2762371880b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4180: [MINOR] get table schema from the last commit with data written

hudi-bot removed a comment on pull request #4180: URL: https://github.com/apache/hudi/pull/4180#issuecomment-983708621 ## CI report: * 9f3823cd34b2f073cc5dd097790ff2762371880b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] lsyldliu opened a new pull request #4181: [HUDI-2900] Fix corrupt block end position

lsyldliu opened a new pull request #4181: URL: https://github.com/apache/hudi/pull/4181 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpos

[jira] [Updated] (HUDI-2900) Fix corrupt block end position

[ https://issues.apache.org/jira/browse/HUDI-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2900: - Labels: pull-request-available (was: ) > Fix corrupt block end position > ---

[GitHub] [hudi] YannByron commented on pull request #4180: [MINOR] get table schema from the last commit with data written

YannByron commented on pull request #4180: URL: https://github.com/apache/hudi/pull/4180#issuecomment-983776166 > > So, i wanna find the last commit which data is written to. > > I think this should not be a minor and worth filing a jira ticket. ok, a little lazy ~ -- This i

[GitHub] [hudi] hudi-bot commented on pull request #4181: [HUDI-2900] Fix corrupt block end position

hudi-bot commented on pull request #4181: URL: https://github.com/apache/hudi/pull/4181#issuecomment-983777031 ## CI report: * 35824d896e84f7af3d1149c385d57f4c905b81fc UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4152: [HUDI-2881] Compact the file group with larger log files to reduce wr…

hudi-bot removed a comment on pull request #4152: URL: https://github.com/apache/hudi/pull/4152#issuecomment-983735256 ## CI report: * 360acc1684b502ca6209efa3f6daa55a6ab6ace4 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4152: [HUDI-2881] Compact the file group with larger log files to reduce wr…

hudi-bot commented on pull request #4152: URL: https://github.com/apache/hudi/pull/4152#issuecomment-983779435 ## CI report: * 360acc1684b502ca6209efa3f6daa55a6ab6ace4 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4181: [HUDI-2900] Fix corrupt block end position

hudi-bot commented on pull request #4181: URL: https://github.com/apache/hudi/pull/4181#issuecomment-983779561 ## CI report: * 35824d896e84f7af3d1149c385d57f4c905b81fc Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4181: [HUDI-2900] Fix corrupt block end position

hudi-bot removed a comment on pull request #4181: URL: https://github.com/apache/hudi/pull/4181#issuecomment-983777031 ## CI report: * 35824d896e84f7af3d1149c385d57f4c905b81fc UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[jira] [Created] (HUDI-2903) get table schema from the last commit with data written

Yann Byron created HUDI-2903: Summary: get table schema from the last commit with data written Key: HUDI-2903 URL: https://issues.apache.org/jira/browse/HUDI-2903 Project: Apache Hudi Issue Type:

[GitHub] [hudi] YannByron commented on pull request #4180: [HUDI-2903] get table schema from the last commit with data written

YannByron commented on pull request #4180: URL: https://github.com/apache/hudi/pull/4180#issuecomment-983781810 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[GitHub] [hudi] hudi-bot removed a comment on pull request #4180: [HUDI-2903] get table schema from the last commit with data written

hudi-bot removed a comment on pull request #4180: URL: https://github.com/apache/hudi/pull/4180#issuecomment-983772080 ## CI report: * 9f3823cd34b2f073cc5dd097790ff2762371880b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4180: [HUDI-2903] get table schema from the last commit with data written

hudi-bot commented on pull request #4180: URL: https://github.com/apache/hudi/pull/4180#issuecomment-983781965 ## CI report: * 9f3823cd34b2f073cc5dd097790ff2762371880b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4181: [HUDI-2900] Fix corrupt block end position

hudi-bot removed a comment on pull request #4181: URL: https://github.com/apache/hudi/pull/4181#issuecomment-983779561 ## CI report: * 35824d896e84f7af3d1149c385d57f4c905b81fc Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4181: [HUDI-2900] Fix corrupt block end position

hudi-bot commented on pull request #4181: URL: https://github.com/apache/hudi/pull/4181#issuecomment-983813227 ## CI report: * 35824d896e84f7af3d1149c385d57f4c905b81fc Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4181: [HUDI-2900] Fix corrupt block end position

hudi-bot removed a comment on pull request #4181: URL: https://github.com/apache/hudi/pull/4181#issuecomment-983813227 ## CI report: * 35824d896e84f7af3d1149c385d57f4c905b81fc Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

  1   2   3   >