[GitHub] [hudi] wangxianghu commented on pull request #5033: [HUDI-3619] Fix HoodieOperation fromValue using wrong constant value

wangxianghu commented on pull request #5033: URL: https://github.com/apache/hudi/pull/5033#issuecomment-1067640393 hi @ljl1988com please check whether the reasion of ci failure is related to this change -- This is an automated message from the Apache Git Service. To respond to the messa

[GitHub] [hudi] wangxianghu commented on a change in pull request #5032: [HUDI-3607] Support backend switch in HoodieFlinkStreamer

wangxianghu commented on a change in pull request #5032: URL: https://github.com/apache/hudi/pull/5032#discussion_r826652952 ## File path: hudi-flink/src/main/java/org/apache/hudi/util/FlinkStateBackendConverter.java ## @@ -0,0 +1,41 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] wangxianghu commented on a change in pull request #5032: [HUDI-3607] Support backend switch in HoodieFlinkStreamer

wangxianghu commented on a change in pull request #5032: URL: https://github.com/apache/hudi/pull/5032#discussion_r826654421 ## File path: hudi-flink/src/main/java/org/apache/hudi/streamer/FlinkStreamerConfig.java ## @@ -53,6 +56,10 @@ @Parameter(names = {"--flink-checkpoin

[GitHub] [hudi] wangxianghu commented on pull request #5031: [HUDI-3523] Introduce AddColumnSchemaPostProcessor to support add column to a given schema

wangxianghu commented on pull request #5031: URL: https://github.com/apache/hudi/pull/5031#issuecomment-1067661400 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [hudi] hudi-bot removed a comment on pull request #5031: [HUDI-3523] Introduce AddColumnSchemaPostProcessor to support add column to a given schema

hudi-bot removed a comment on pull request #5031: URL: https://github.com/apache/hudi/pull/5031#issuecomment-1066560588 ## CI report: * ef59e8cc44406e42c05ee5c538753f6656aa8bd0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5031: [HUDI-3523] Introduce AddColumnSchemaPostProcessor to support add column to a given schema

hudi-bot commented on pull request #5031: URL: https://github.com/apache/hudi/pull/5031#issuecomment-1067662681 ## CI report: * ef59e8cc44406e42c05ee5c538753f6656aa8bd0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] wangxianghu commented on pull request #5017: [HUDI-3606] Add `org.objenesis:objenesis` to hudi-timeline-server-bundle pom

wangxianghu commented on pull request #5017: URL: https://github.com/apache/hudi/pull/5017#issuecomment-1067663129 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [hudi] hudi-bot commented on pull request #5017: [HUDI-3606] Add `org.objenesis:objenesis` to hudi-timeline-server-bundle pom

hudi-bot commented on pull request #5017: URL: https://github.com/apache/hudi/pull/5017#issuecomment-1067664528 ## CI report: * d1211dd592bcb9e3df60b80b9585d2eda9f0b8ab Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5017: [HUDI-3606] Add `org.objenesis:objenesis` to hudi-timeline-server-bundle pom

hudi-bot removed a comment on pull request #5017: URL: https://github.com/apache/hudi/pull/5017#issuecomment-1064873400 ## CI report: * d1211dd592bcb9e3df60b80b9585d2eda9f0b8ab Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4987: [HUDI-3547] Introduce MaxwellSourcePostProcessor to extract data from Maxwell json string

hudi-bot removed a comment on pull request #4987: URL: https://github.com/apache/hudi/pull/4987#issuecomment-1067623861 ## CI report: * 84d9028db0242b31b9fcee5cc27a361bd3c987ae UNKNOWN * e44cfa5367f2c0b43246aa0cdd6b3fe83f22fc7f UNKNOWN * 05858e09bcdb7381be01f3fe9d213089316ed

[GitHub] [hudi] hudi-bot commented on pull request #4987: [HUDI-3547] Introduce MaxwellSourcePostProcessor to extract data from Maxwell json string

hudi-bot commented on pull request #4987: URL: https://github.com/apache/hudi/pull/4987#issuecomment-1067666260 ## CI report: * 84d9028db0242b31b9fcee5cc27a361bd3c987ae UNKNOWN * e44cfa5367f2c0b43246aa0cdd6b3fe83f22fc7f UNKNOWN * fe5eb55a4a5a840b49a6bd209ac3e84f4245b72d Azur

[GitHub] [hudi] wangxianghu commented on pull request #4987: [HUDI-3547] Introduce MaxwellSourcePostProcessor to extract data from Maxwell json string

wangxianghu commented on pull request #4987: URL: https://github.com/apache/hudi/pull/4987#issuecomment-1067666960 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [hudi] hudi-bot removed a comment on pull request #4987: [HUDI-3547] Introduce MaxwellSourcePostProcessor to extract data from Maxwell json string

hudi-bot removed a comment on pull request #4987: URL: https://github.com/apache/hudi/pull/4987#issuecomment-1067666260 ## CI report: * 84d9028db0242b31b9fcee5cc27a361bd3c987ae UNKNOWN * e44cfa5367f2c0b43246aa0cdd6b3fe83f22fc7f UNKNOWN * fe5eb55a4a5a840b49a6bd209ac3e84f4245b

[GitHub] [hudi] hudi-bot commented on pull request #4987: [HUDI-3547] Introduce MaxwellSourcePostProcessor to extract data from Maxwell json string

hudi-bot commented on pull request #4987: URL: https://github.com/apache/hudi/pull/4987#issuecomment-1067668123 ## CI report: * 84d9028db0242b31b9fcee5cc27a361bd3c987ae UNKNOWN * e44cfa5367f2c0b43246aa0cdd6b3fe83f22fc7f UNKNOWN * fe5eb55a4a5a840b49a6bd209ac3e84f4245b72d Azur

[GitHub] [hudi] peanut-chenzhong commented on pull request #5042: Three bulk_insert files are concurrently submitted and executed with a difference of 2s, the insert fails occasionally.

peanut-chenzhong commented on pull request #5042: URL: https://github.com/apache/hudi/pull/5042#issuecomment-1067706183 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[GitHub] [hudi] hudi-bot commented on pull request #5042: Three bulk_insert files are concurrently submitted and executed with a difference of 2s, the insert fails occasionally.

hudi-bot commented on pull request #5042: URL: https://github.com/apache/hudi/pull/5042#issuecomment-1067707324 ## CI report: * 36bcc00ceb0677c697d741c7c88ff7ae146152ef Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5042: Three bulk_insert files are concurrently submitted and executed with a difference of 2s, the insert fails occasionally.

hudi-bot removed a comment on pull request #5042: URL: https://github.com/apache/hudi/pull/5042#issuecomment-1067540435 ## CI report: * 36bcc00ceb0677c697d741c7c88ff7ae146152ef Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5017: [HUDI-3606] Add `org.objenesis:objenesis` to hudi-timeline-server-bundle pom

hudi-bot commented on pull request #5017: URL: https://github.com/apache/hudi/pull/5017#issuecomment-1067721089 ## CI report: * d1211dd592bcb9e3df60b80b9585d2eda9f0b8ab Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5017: [HUDI-3606] Add `org.objenesis:objenesis` to hudi-timeline-server-bundle pom

hudi-bot removed a comment on pull request #5017: URL: https://github.com/apache/hudi/pull/5017#issuecomment-1067664528 ## CI report: * d1211dd592bcb9e3df60b80b9585d2eda9f0b8ab Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #5031: [HUDI-3523] Introduce AddColumnSchemaPostProcessor to support add column to a given schema

hudi-bot removed a comment on pull request #5031: URL: https://github.com/apache/hudi/pull/5031#issuecomment-1067662681 ## CI report: * ef59e8cc44406e42c05ee5c538753f6656aa8bd0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5031: [HUDI-3523] Introduce AddColumnSchemaPostProcessor to support add column to a given schema

hudi-bot commented on pull request #5031: URL: https://github.com/apache/hudi/pull/5031#issuecomment-1067723569 ## CI report: * ef59e8cc44406e42c05ee5c538753f6656aa8bd0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4987: [HUDI-3547] Introduce MaxwellSourcePostProcessor to extract data from Maxwell json string

hudi-bot removed a comment on pull request #4987: URL: https://github.com/apache/hudi/pull/4987#issuecomment-1067668123 ## CI report: * 84d9028db0242b31b9fcee5cc27a361bd3c987ae UNKNOWN * e44cfa5367f2c0b43246aa0cdd6b3fe83f22fc7f UNKNOWN * fe5eb55a4a5a840b49a6bd209ac3e84f4245b

[GitHub] [hudi] hudi-bot commented on pull request #4987: [HUDI-3547] Introduce MaxwellSourcePostProcessor to extract data from Maxwell json string

hudi-bot commented on pull request #4987: URL: https://github.com/apache/hudi/pull/4987#issuecomment-1067764744 ## CI report: * 84d9028db0242b31b9fcee5cc27a361bd3c987ae UNKNOWN * e44cfa5367f2c0b43246aa0cdd6b3fe83f22fc7f UNKNOWN * fe5eb55a4a5a840b49a6bd209ac3e84f4245b72d Azur

[GitHub] [hudi] wangxianghu commented on pull request #4987: [HUDI-3547] Introduce MaxwellSourcePostProcessor to extract data from Maxwell json string

wangxianghu commented on pull request #4987: URL: https://github.com/apache/hudi/pull/4987#issuecomment-1067771034 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [hudi] hudi-bot removed a comment on pull request #4987: [HUDI-3547] Introduce MaxwellSourcePostProcessor to extract data from Maxwell json string

hudi-bot removed a comment on pull request #4987: URL: https://github.com/apache/hudi/pull/4987#issuecomment-1067764744 ## CI report: * 84d9028db0242b31b9fcee5cc27a361bd3c987ae UNKNOWN * e44cfa5367f2c0b43246aa0cdd6b3fe83f22fc7f UNKNOWN * fe5eb55a4a5a840b49a6bd209ac3e84f4245b

[GitHub] [hudi] hudi-bot commented on pull request #4987: [HUDI-3547] Introduce MaxwellSourcePostProcessor to extract data from Maxwell json string

hudi-bot commented on pull request #4987: URL: https://github.com/apache/hudi/pull/4987#issuecomment-1067773345 ## CI report: * 84d9028db0242b31b9fcee5cc27a361bd3c987ae UNKNOWN * e44cfa5367f2c0b43246aa0cdd6b3fe83f22fc7f UNKNOWN * fe5eb55a4a5a840b49a6bd209ac3e84f4245b72d Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #5042: Three bulk_insert files are concurrently submitted and executed with a difference of 2s, the insert fails occasionally.

hudi-bot removed a comment on pull request #5042: URL: https://github.com/apache/hudi/pull/5042#issuecomment-1067707324 ## CI report: * 36bcc00ceb0677c697d741c7c88ff7ae146152ef Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5042: Three bulk_insert files are concurrently submitted and executed with a difference of 2s, the insert fails occasionally.

hudi-bot commented on pull request #5042: URL: https://github.com/apache/hudi/pull/5042#issuecomment-1067799417 ## CI report: * 36bcc00ceb0677c697d741c7c88ff7ae146152ef Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[jira] [Updated] (HUDI-3633) TypedProperties can not set non-string values using its original type

[ https://issues.apache.org/jira/browse/HUDI-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3633: -- Summary: TypedProperties can not set non-string values using its original type (was: ypedProperties can

[jira] [Created] (HUDI-3633) ypedProperties can not set non-string values using its original type

Sagar Sumit created HUDI-3633: - Summary: ypedProperties can not set non-string values using its original type Key: HUDI-3633 URL: https://issues.apache.org/jira/browse/HUDI-3633 Project: Apache Hudi

[GitHub] [hudi] codope commented on issue #5026: [SUPPORT] TypedProperties can not set non-string values using its original type

codope commented on issue #5026: URL: https://github.com/apache/hudi/issues/5026#issuecomment-1067800671 The reason we expect String values is because we need to store some of these props in HoodieTableConfig. The `store` method expects that props key as well as values are strings. Created

[GitHub] [hudi] codope opened a new pull request #5045: [HUDI-3633] Allow non-string values to be set in TypedProperties

codope opened a new pull request #5045: URL: https://github.com/apache/hudi/pull/5045 ## What is the purpose of the pull request `TypedProperties` invokes `Properties#stringPropertynames()` which expects that key and values should be strings. It causes keys with non-string values to

[jira] [Updated] (HUDI-3633) TypedProperties can not set non-string values using its original type

[ https://issues.apache.org/jira/browse/HUDI-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3633: - Labels: pull-request-available (was: ) > TypedProperties can not set non-string values using its

[GitHub] [hudi] hudi-bot commented on pull request #5045: [HUDI-3633] Allow non-string values to be set in TypedProperties

hudi-bot commented on pull request #5045: URL: https://github.com/apache/hudi/pull/5045#issuecomment-1067813856 ## CI report: * ec5bb04aa1f2671485087d9f14568661efc4aa3e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot commented on pull request #5045: [HUDI-3633] Allow non-string values to be set in TypedProperties

hudi-bot commented on pull request #5045: URL: https://github.com/apache/hudi/pull/5045#issuecomment-1067817045 ## CI report: * ec5bb04aa1f2671485087d9f14568661efc4aa3e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5045: [HUDI-3633] Allow non-string values to be set in TypedProperties

hudi-bot removed a comment on pull request #5045: URL: https://github.com/apache/hudi/pull/5045#issuecomment-1067813856 ## CI report: * ec5bb04aa1f2671485087d9f14568661efc4aa3e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] ljl1988com commented on pull request #5033: [HUDI-3619] Fix HoodieOperation fromValue using wrong constant value

ljl1988com commented on pull request #5033: URL: https://github.com/apache/hudi/pull/5033#issuecomment-1067830073 @wangxianghu I run unit test locally. I find `HoodieOperation` is like `RowKind` in flink. I will change the value 4 into 3. -- This is an automated message from the Apache G

[GitHub] [hudi] hudi-bot removed a comment on pull request #5033: [HUDI-3619] Fix HoodieOperation fromValue using wrong constant value

hudi-bot removed a comment on pull request #5033: URL: https://github.com/apache/hudi/pull/5033#issuecomment-1066824135 ## CI report: * 65c9388c448eb2a7605ef9c2d9a60e2d80b43d66 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5033: [HUDI-3619] Fix HoodieOperation fromValue using wrong constant value

hudi-bot commented on pull request #5033: URL: https://github.com/apache/hudi/pull/5033#issuecomment-1067833989 ## CI report: * 65c9388c448eb2a7605ef9c2d9a60e2d80b43d66 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5033: [HUDI-3619] Fix HoodieOperation fromValue using wrong constant value

hudi-bot removed a comment on pull request #5033: URL: https://github.com/apache/hudi/pull/5033#issuecomment-1067833989 ## CI report: * 65c9388c448eb2a7605ef9c2d9a60e2d80b43d66 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5033: [HUDI-3619] Fix HoodieOperation fromValue using wrong constant value

hudi-bot commented on pull request #5033: URL: https://github.com/apache/hudi/pull/5033#issuecomment-1067836724 ## CI report: * 65c9388c448eb2a7605ef9c2d9a60e2d80b43d66 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] liujinhui1994 opened a new issue #5046: [SUPPORT] Structured streaming MOR writes to hudi, the task will not be aborted after failure

liujinhui1994 opened a new issue #5046: URL: https://github.com/apache/hudi/issues/5046 **_Tips before filing an issue_** - Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)? - Join the mailing list to engage in conversations and get faster support at dev-su

[GitHub] [hudi] liujinhui1994 commented on issue #5046: [SUPPORT] Structured streaming MOR writes to hudi, the task will not be aborted after failure

liujinhui1994 commented on issue #5046: URL: https://github.com/apache/hudi/issues/5046#issuecomment-1067839946  -- This is an automated message from the Apache Git Service.

[GitHub] [hudi] liujinhui1994 commented on issue #5046: [SUPPORT] Structured streaming MOR writes to hudi, the task will not be aborted after failure

liujinhui1994 commented on issue #5046: URL: https://github.com/apache/hudi/issues/5046#issuecomment-1067844165  -- This is an automated message from the Apache Git Service.

[GitHub] [hudi] liujinhui1994 commented on issue #5046: [SUPPORT] Structured streaming MOR writes to hudi, the task will not be aborted after failure

liujinhui1994 commented on issue #5046: URL: https://github.com/apache/hudi/issues/5046#issuecomment-1067845624 dataFrame.writeStream().format("org.apache.hudi") .option("hoodie.datasource.write.recordkey.field", cfg.pk) .option("hoodie.datasource.write.partitionpath.fi

[GitHub] [hudi] liujinhui1994 removed a comment on issue #5046: [SUPPORT] Structured streaming MOR writes to hudi, the task will not be aborted after failure

liujinhui1994 removed a comment on issue #5046: URL: https://github.com/apache/hudi/issues/5046#issuecomment-1067845624 dataFrame.writeStream().format("org.apache.hudi") .option("hoodie.datasource.write.recordkey.field", cfg.pk) .option("hoodie.datasource.write.partitio

[GitHub] [hudi] liujinhui1994 commented on issue #5046: [SUPPORT] Structured streaming MOR writes to hudi, the task will not be aborted after failure

liujinhui1994 commented on issue #5046: URL: https://github.com/apache/hudi/issues/5046#issuecomment-1067846182  -- This is an automated message from the Apache Git Service.

[GitHub] [hudi] hudi-bot removed a comment on pull request #4987: [HUDI-3547] Introduce MaxwellSourcePostProcessor to extract data from Maxwell json string

hudi-bot removed a comment on pull request #4987: URL: https://github.com/apache/hudi/pull/4987#issuecomment-1067773345 ## CI report: * 84d9028db0242b31b9fcee5cc27a361bd3c987ae UNKNOWN * e44cfa5367f2c0b43246aa0cdd6b3fe83f22fc7f UNKNOWN * fe5eb55a4a5a840b49a6bd209ac3e84f4245b

[GitHub] [hudi] hudi-bot commented on pull request #4987: [HUDI-3547] Introduce MaxwellSourcePostProcessor to extract data from Maxwell json string

hudi-bot commented on pull request #4987: URL: https://github.com/apache/hudi/pull/4987#issuecomment-1067849958 ## CI report: * 84d9028db0242b31b9fcee5cc27a361bd3c987ae UNKNOWN * e44cfa5367f2c0b43246aa0cdd6b3fe83f22fc7f UNKNOWN * fe5eb55a4a5a840b49a6bd209ac3e84f4245b72d Azur

[GitHub] [hudi] wangxianghu commented on pull request #5045: [HUDI-3633] Allow non-string values to be set in TypedProperties

wangxianghu commented on pull request #5045: URL: https://github.com/apache/hudi/pull/5045#issuecomment-1067854086 hi @codope This patch solved issue https://github.com/apache/hudi/issues/5026 but if the user use ``` typedProperties.put("key", 123); ``` the kv still lost

[GitHub] [hudi] wangxianghu merged pull request #4987: [HUDI-3547] Introduce MaxwellSourcePostProcessor to extract data from Maxwell json string

wangxianghu merged pull request #4987: URL: https://github.com/apache/hudi/pull/4987 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsub

[GitHub] [hudi] wangxianghu merged pull request #5017: [HUDI-3606] Add `org.objenesis:objenesis` to hudi-timeline-server-bundle pom

wangxianghu merged pull request #5017: URL: https://github.com/apache/hudi/pull/5017 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsub

[GitHub] [hudi] wangxianghu edited a comment on pull request #5045: [HUDI-3633] Allow non-string values to be set in TypedProperties

wangxianghu edited a comment on pull request #5045: URL: https://github.com/apache/hudi/pull/5045#issuecomment-1067854086 hi @codope This patch solved issue https://github.com/apache/hudi/issues/5026 but if the user use ``` typedProperties.put("key", 123); ``` the kv still l

[hudi] branch master updated (d40adfa -> 3b59b76)

This is an automated email from the ASF dual-hosted git repository. wangxianghu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from d40adfa [HUDI-3620] Adding spark3.2.0 profile (#5038) add 3b59b76 [HUDI-3547] Introduce MaxwellSourcePostPr

[hudi] branch master updated (3b59b76 -> 6ed7106)

This is an automated email from the ASF dual-hosted git repository. wangxianghu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 3b59b76 [HUDI-3547] Introduce MaxwellSourcePostProcessor to extract data from Maxwell json string (#4987) a

[GitHub] [hudi] wangxianghu edited a comment on pull request #5045: [HUDI-3633] Allow non-string values to be set in TypedProperties

wangxianghu edited a comment on pull request #5045: URL: https://github.com/apache/hudi/pull/5045#issuecomment-1067854086 hi @codope This patch solved issue https://github.com/apache/hudi/issues/5026 but if the user use ``` typedProperties.put("key", 123); ``` the kv still l

[GitHub] [hudi] hudi-bot commented on pull request #5045: [HUDI-3633] Allow non-string values to be set in TypedProperties

hudi-bot commented on pull request #5045: URL: https://github.com/apache/hudi/pull/5045#issuecomment-1067887691 ## CI report: * ec5bb04aa1f2671485087d9f14568661efc4aa3e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5045: [HUDI-3633] Allow non-string values to be set in TypedProperties

hudi-bot removed a comment on pull request #5045: URL: https://github.com/apache/hudi/pull/5045#issuecomment-1067817045 ## CI report: * ec5bb04aa1f2671485087d9f14568661efc4aa3e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] codope commented on pull request #5045: [HUDI-3633] Allow non-string values to be set in TypedProperties

codope commented on pull request #5045: URL: https://github.com/apache/hudi/pull/5045#issuecomment-1067895022 > may be we should override java.util.Properties#getProperty(java.lang.String) to ignore the string type check the getProperty method in java.util.Properties We could do

[GitHub] [hudi] hudi-bot removed a comment on pull request #5033: [HUDI-3619] Fix HoodieOperation fromValue using wrong constant value

hudi-bot removed a comment on pull request #5033: URL: https://github.com/apache/hudi/pull/5033#issuecomment-1067836724 ## CI report: * 65c9388c448eb2a7605ef9c2d9a60e2d80b43d66 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5033: [HUDI-3619] Fix HoodieOperation fromValue using wrong constant value

hudi-bot commented on pull request #5033: URL: https://github.com/apache/hudi/pull/5033#issuecomment-1067904079 ## CI report: * 29ef92bdcc30d897537a02bd2057614a9ddb0ed1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] wangxianghu commented on pull request #5045: [HUDI-3633] Allow non-string values to be set in TypedProperties

wangxianghu commented on pull request #5045: URL: https://github.com/apache/hudi/pull/5045#issuecomment-1067914420 > > may be we should override java.util.Properties#getProperty(java.lang.String) to ignore the string type check > > the getProperty method in java.util.Properties >

[GitHub] [hudi] wangxianghu removed a comment on pull request #5045: [HUDI-3633] Allow non-string values to be set in TypedProperties

wangxianghu removed a comment on pull request #5045: URL: https://github.com/apache/hudi/pull/5045#issuecomment-1067914420 > > may be we should override java.util.Properties#getProperty(java.lang.String) to ignore the string type check > > the getProperty method in java.util.Properties

[GitHub] [hudi] wangxianghu commented on pull request #5045: [HUDI-3633] Allow non-string values to be set in TypedProperties

wangxianghu commented on pull request #5045: URL: https://github.com/apache/hudi/pull/5045#issuecomment-1067916034 > > may be we should override java.util.Properties#getProperty(java.lang.String) to ignore the string type check > > the getProperty method in java.util.Properties >

[GitHub] [hudi] liujinhui1994 commented on issue #5046: [SUPPORT] Structured streaming MOR writes to hudi, the task will not be aborted after failure

liujinhui1994 commented on issue #5046: URL: https://github.com/apache/hudi/issues/5046#issuecomment-1067927010 https://issues.apache.org/jira/browse/HUDI-3467 It seems to be similar to this problem, which is currently encountered in our production environment. Don't know if there is a q

[GitHub] [hudi] codope commented on pull request #5045: [HUDI-3633] Allow non-string values to be set in TypedProperties

codope commented on pull request #5045: URL: https://github.com/apache/hudi/pull/5045#issuecomment-1067929525 > Still the `TypedProperties` constructor takes a `Properties` argument and calling `defaults.getProperty` won't have the desired effect. -- This is an automated message

[GitHub] [hudi] wangxianghu merged pull request #5033: [HUDI-3619] Fix HoodieOperation fromValue using wrong constant value

wangxianghu merged pull request #5033: URL: https://github.com/apache/hudi/pull/5033 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsub

[hudi] branch master updated (6ed7106 -> 9bdda2a)

This is an automated email from the ASF dual-hosted git repository. wangxianghu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 6ed7106 [HUDI-3606] Add `org.objenesis:objenesis` to hudi-timeline-server-bundle pom (#5017) add 9bdda2a [

[jira] [Closed] (HUDI-3619) Fix HoodieOperation fromValue using wrong constant value

[ https://issues.apache.org/jira/browse/HUDI-3619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianghu Wang closed HUDI-3619. -- Fix Version/s: 0.11.0 Resolution: Fixed > Fix HoodieOperation fromValue using wrong constant val

[jira] [Closed] (HUDI-3547) Introduce MaxwellSourcePostProcessor to extract data from Maxwell json string

[ https://issues.apache.org/jira/browse/HUDI-3547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianghu Wang closed HUDI-3547. -- Resolution: Fixed > Introduce MaxwellSourcePostProcessor to extract data from Maxwell json string >

[GitHub] [hudi] srinikandi opened a new issue #5047: [SUPPORT]

srinikandi opened a new issue #5047: URL: https://github.com/apache/hudi/issues/5047 Hi I have been using Apache Hudi Connector for Glue (hudi 0.90 version) and facing small file creation problem while inserting data into a hudi table. The input file is about 17 GB with 313 parquet part

[jira] [Created] (HUDI-3634) Could read empty or partial HoodieCommitMetaData in downstream if using HDFS

Hui An created HUDI-3634: Summary: Could read empty or partial HoodieCommitMetaData in downstream if using HDFS Key: HUDI-3634 URL: https://issues.apache.org/jira/browse/HUDI-3634 Project: Apache Hudi

[jira] [Updated] (HUDI-3634) Could read empty or partial HoodieCommitMetaData in downstream if using HDFS

[ https://issues.apache.org/jira/browse/HUDI-3634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui An updated HUDI-3634: - Component/s: timeline-server > Could read empty or partial HoodieCommitMetaData in downstream if using HDFS >

[jira] [Updated] (HUDI-3634) Could read empty or partial HoodieCommitMetaData in downstream if using HDFS

[ https://issues.apache.org/jira/browse/HUDI-3634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui An updated HUDI-3634: - Description: If we're using Incremental query to continues read the HUDI upstream, it could miss some batches As

[GitHub] [hudi] hudi-bot commented on pull request #5045: [HUDI-3633] Allow non-string values to be set in TypedProperties

hudi-bot commented on pull request #5045: URL: https://github.com/apache/hudi/pull/5045#issuecomment-1067998516 ## CI report: * ec5bb04aa1f2671485087d9f14568661efc4aa3e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5045: [HUDI-3633] Allow non-string values to be set in TypedProperties

hudi-bot removed a comment on pull request #5045: URL: https://github.com/apache/hudi/pull/5045#issuecomment-1067887691 ## CI report: * ec5bb04aa1f2671485087d9f14568661efc4aa3e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[jira] [Updated] (HUDI-3634) Could read empty or partial HoodieCommitMetaData in downstream if using HDFS

[ https://issues.apache.org/jira/browse/HUDI-3634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui An updated HUDI-3634: - Description: If we're using Incremental query to continues read the HUDI upstream, it could miss some batches As

[GitHub] [hudi] hudi-bot commented on pull request #5045: [HUDI-3633] Allow non-string values to be set in TypedProperties

hudi-bot commented on pull request #5045: URL: https://github.com/apache/hudi/pull/5045#issuecomment-1068001528 ## CI report: * ec5bb04aa1f2671485087d9f14568661efc4aa3e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5045: [HUDI-3633] Allow non-string values to be set in TypedProperties

hudi-bot removed a comment on pull request #5045: URL: https://github.com/apache/hudi/pull/5045#issuecomment-1067998516 ## CI report: * ec5bb04aa1f2671485087d9f14568661efc4aa3e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] boneanxs opened a new pull request #5048: [HUDI-3634] Could read empty or partial HoodieCommitMetaData in downstream if using HDFS

boneanxs opened a new pull request #5048: URL: https://github.com/apache/hudi/pull/5048 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpos

[jira] [Updated] (HUDI-3634) Could read empty or partial HoodieCommitMetaData in downstream if using HDFS

[ https://issues.apache.org/jira/browse/HUDI-3634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3634: - Labels: pull-request-available (was: ) > Could read empty or partial HoodieCommitMetaData in down

[GitHub] [hudi] hudi-bot commented on pull request #5048: [HUDI-3634] Could read empty or partial HoodieCommitMetaData in downstream if using HDFS

hudi-bot commented on pull request #5048: URL: https://github.com/apache/hudi/pull/5048#issuecomment-1068004606 ## CI report: * b03f1f3473fd3e520ece280026e48b831c6fe78e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot removed a comment on pull request #5048: [HUDI-3634] Could read empty or partial HoodieCommitMetaData in downstream if using HDFS

hudi-bot removed a comment on pull request #5048: URL: https://github.com/apache/hudi/pull/5048#issuecomment-1068004606 ## CI report: * b03f1f3473fd3e520ece280026e48b831c6fe78e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #5048: [HUDI-3634] Could read empty or partial HoodieCommitMetaData in downstream if using HDFS

hudi-bot commented on pull request #5048: URL: https://github.com/apache/hudi/pull/5048#issuecomment-1068007627 ## CI report: * b03f1f3473fd3e520ece280026e48b831c6fe78e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[jira] [Commented] (HUDI-3634) Could read empty or partial HoodieCommitMetaData in downstream if using HDFS

[ https://issues.apache.org/jira/browse/HUDI-3634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17506916#comment-17506916 ] Hui An commented on HUDI-3634: -- Some logs about this issue: The upstream completed commit at

[GitHub] [hudi] xushiyan closed issue #5035: [FEATURE REQUEST] Support nessie

xushiyan closed issue #5035: URL: https://github.com/apache/hudi/issues/5035 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@h

[GitHub] [hudi] xushiyan commented on issue #5035: [FEATURE REQUEST] Support nessie

xushiyan commented on issue #5035: URL: https://github.com/apache/hudi/issues/5035#issuecomment-1068026754 @melin this was already filed. thanks. https://issues.apache.org/jira/browse/HUDI-1455 -- This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [hudi] ngonik commented on issue #5036: [SUPPORT] AWS DMS and Deletes on S3 with Hudi

ngonik commented on issue #5036: URL: https://github.com/apache/hudi/issues/5036#issuecomment-1068027062 I wasn't aware that Postgres had a REPLICATE IDENTITY table parameter. https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Source.PostgreSQL.html#CHAP_Source.PostgreSQL.Advanced

[GitHub] [hudi] xushiyan edited a comment on issue #5035: [FEATURE REQUEST] Support nessie

xushiyan edited a comment on issue #5035: URL: https://github.com/apache/hudi/issues/5035#issuecomment-1068026754 @melin this was already filed. thanks. https://issues.apache.org/jira/browse/HUDI-1455 previous discussion https://github.com/apache/hudi/issues/2330#issuecomment-743

[GitHub] [hudi] xushiyan commented on issue #4992: Hudi How to support HDFS kerberos permission verification

xushiyan commented on issue #4992: URL: https://github.com/apache/hudi/issues/4992#issuecomment-1068036658 @liuyaolin would you like to file a JIRA with more details of how this config work with Kerberos? including some context and example use case. It would be even better for you to take

[GitHub] [hudi] xushiyan commented on issue #5024: [SUPPORT] Spark SQL to query metadata such as hudi table snapshot

xushiyan commented on issue #5024: URL: https://github.com/apache/hudi/issues/5024#issuecomment-1068039258 > https://issues.apache.org/jira/browse/HUDI-3511 This jira for call procedure command to obtain meta information through SparkSQL. thanks! -- This is an automated message fr

[GitHub] [hudi] xushiyan closed issue #5024: [SUPPORT] Spark SQL to query metadata such as hudi table snapshot

xushiyan closed issue #5024: URL: https://github.com/apache/hudi/issues/5024 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@h

[jira] [Updated] (HUDI-3511) Support Metadata command based on Call Produce Command

[ https://issues.apache.org/jira/browse/HUDI-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3511: - Fix Version/s: 0.12.0 > Support Metadata command based on Call Produce Command > -

[GitHub] [hudi] xushiyan commented on issue #5021: [FEATURE REQUEST] Support for Presto/Athena to make updates to Hudi Tables

xushiyan commented on issue #5021: URL: https://github.com/apache/hudi/issues/5021#issuecomment-1068041397 @umehrot2 @zhedoubushishi does EMR team have this on roadmap? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Assigned] (HUDI-3632) ensure Deltastreamer writes succeed if a target base path exists, but w/ no contents

[ https://issues.apache.org/jira/browse/HUDI-3632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-3632: - Assignee: sivabalan narayanan > ensure Deltastreamer writes succeed if a target b

[jira] [Updated] (HUDI-3632) ensure Deltastreamer writes succeed if a target base path exists, but w/ no contents

[ https://issues.apache.org/jira/browse/HUDI-3632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-3632: -- Fix Version/s: 0.11.0 > ensure Deltastreamer writes succeed if a target base path exists

[jira] [Closed] (HUDI-3623) Remove hive sync node from regular yamls (non hive yamls)

[ https://issues.apache.org/jira/browse/HUDI-3623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-3623. - Resolution: Fixed > Remove hive sync node from regular yamls (non hive yamls) > --

[jira] [Closed] (HUDI-3621) DeltaStreamer throws NPE when there is no new data to consume and clustering is enabled

[ https://issues.apache.org/jira/browse/HUDI-3621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-3621. - Resolution: Fixed > DeltaStreamer throws NPE when there is no new data to consume and clus

[jira] [Updated] (HUDI-3623) Remove hive sync node from regular yamls (non hive yamls)

[ https://issues.apache.org/jira/browse/HUDI-3623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-3623: -- Labels: hudi-on-call pull-request-available (was: pull-request-available) > Remove hive

[GitHub] [hudi] yuzhaojing commented on a change in pull request #4309: [HUDI-3016][RFC-43] Proposal to implement Compaction/Clustering Servi…

yuzhaojing commented on a change in pull request #4309: URL: https://github.com/apache/hudi/pull/4309#discussion_r825724005 ## File path: rfc/rfc-43/rfc-43.md ## @@ -0,0 +1,222 @@ + +# RFC-43: Implement Compaction/Clustering Service for Hudi + +## Proposers +- @yuzhaojing + +##

  1   2   3   4   >