[jira] [Updated] (HUDI-7143) schema evolution triggers a CDC query exception

[ https://issues.apache.org/jira/browse/HUDI-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j updated HUDI-7143: --- Description: {code:sql} sparkSession.sql("CREATE TABLE if not exists hudi_ut_schema_evolution (id INT, versio

[jira] [Created] (HUDI-7143) schema evolution triggers a CDC query exception

loukey_j created HUDI-7143: -- Summary: schema evolution triggers a CDC query exception Key: HUDI-7143 URL: https://issues.apache.org/jira/browse/HUDI-7143 Project: Apache Hudi Issue Type: Bug

[jira] [Commented] (HUDI-7131) The requested schema is not compatible with the file schema

[ https://issues.apache.org/jira/browse/HUDI-7131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17789922#comment-17789922 ] loukey_j commented on HUDI-7131: [~xushiyan] please take a look > The requested schema i

[jira] [Updated] (HUDI-7134) After deleting the field and re-executing the merge, the result is not as expected.

[ https://issues.apache.org/jira/browse/HUDI-7134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j updated HUDI-7134: --- Description: You can reproduce the problem by following the steps below. The value of add1 in step 7 is not a

[jira] [Created] (HUDI-7134) After deleting the field and re-executing the merge, the result is not as expected.

loukey_j created HUDI-7134: -- Summary: After deleting the field and re-executing the merge, the result is not as expected. Key: HUDI-7134 URL: https://issues.apache.org/jira/browse/HUDI-7134 Project: Apache H

[jira] [Commented] (HUDI-7131) The requested schema is not compatible with the file schema

[ https://issues.apache.org/jira/browse/HUDI-7131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17788667#comment-17788667 ] loukey_j commented on HUDI-7131: sorry, I didn't notice that I converted inc_day to date t

[jira] [Commented] (HUDI-7131) The requested schema is not compatible with the file schema

[ https://issues.apache.org/jira/browse/HUDI-7131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17788607#comment-17788607 ] loukey_j commented on HUDI-7131: The schema of the table has not changed, only the partiti

[jira] [Updated] (HUDI-7131) The requested schema is not compatible with the file schema

[ https://issues.apache.org/jira/browse/HUDI-7131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j updated HUDI-7131: --- Affects Version/s: 0.14.0 > The requested schema is not compatible with the file schema >

[jira] [Created] (HUDI-7131) The requested schema is not compatible with the file schema

loukey_j created HUDI-7131: -- Summary: The requested schema is not compatible with the file schema Key: HUDI-7131 URL: https://issues.apache.org/jira/browse/HUDI-7131 Project: Apache Hudi Issue Type

[jira] [Assigned] (HUDI-5837) Spark ctas error

[ https://issues.apache.org/jira/browse/HUDI-5837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j reassigned HUDI-5837: -- Assignee: loukey_j > Spark ctas error > > > Key: HUDI-5837 >

[jira] [Created] (HUDI-5837) Spark ctas error

loukey_j created HUDI-5837: -- Summary: Spark ctas error Key: HUDI-5837 URL: https://issues.apache.org/jira/browse/HUDI-5837 Project: Apache Hudi Issue Type: Improvement Reporter: loukey_j

[jira] [Created] (HUDI-5801) Speed metaTable initializeFileGroups

loukey_j created HUDI-5801: -- Summary: Speed metaTable initializeFileGroups Key: HUDI-5801 URL: https://issues.apache.org/jira/browse/HUDI-5801 Project: Apache Hudi Issue Type: Improvement

[jira] [Created] (HUDI-5671) BucketIndexPartitioner partition algorithm skew

loukey_j created HUDI-5671: -- Summary: BucketIndexPartitioner partition algorithm skew Key: HUDI-5671 URL: https://issues.apache.org/jira/browse/HUDI-5671 Project: Apache Hudi Issue Type: Improvement

[jira] [Updated] (HUDI-5568) incorrect use of fileSystemView

[ https://issues.apache.org/jira/browse/HUDI-5568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j updated HUDI-5568: --- Summary: incorrect use of fileSystemView (was: incorrect use of FileSystemView) > incorrect use of fileSy

[jira] [Assigned] (HUDI-5568) incorrect use of FileSystemView

[ https://issues.apache.org/jira/browse/HUDI-5568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j reassigned HUDI-5568: -- Assignee: loukey_j > incorrect use of FileSystemView > > >

[jira] [Created] (HUDI-5568) incorrect use of FileSystemView

loukey_j created HUDI-5568: -- Summary: incorrect use of FileSystemView Key: HUDI-5568 URL: https://issues.apache.org/jira/browse/HUDI-5568 Project: Apache Hudi Issue Type: Improvement Comp

[jira] [Created] (HUDI-5441) different buckets for different partitions

loukey_j created HUDI-5441: -- Summary: different buckets for different partitions Key: HUDI-5441 URL: https://issues.apache.org/jira/browse/HUDI-5441 Project: Apache Hudi Issue Type: Improvement

[jira] [Created] (HUDI-5373) Different fileids are assigned to the same bucket

loukey_j created HUDI-5373: -- Summary: Different fileids are assigned to the same bucket Key: HUDI-5373 URL: https://issues.apache.org/jira/browse/HUDI-5373 Project: Apache Hudi Issue Type: Bug

[jira] [Assigned] (HUDI-5373) Different fileids are assigned to the same bucket

[ https://issues.apache.org/jira/browse/HUDI-5373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j reassigned HUDI-5373: -- Assignee: loukey_j > Different fileids are assigned to the same bucket > -

[jira] [Updated] (HUDI-5240) Clean content when recursive Invocation inflate

[ https://issues.apache.org/jira/browse/HUDI-5240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j updated HUDI-5240: --- Attachment: image-2022-11-18-14-57-06-393.png Description: !image-2022-11-18-14-57-06-393.png! > Clean co

[jira] [Assigned] (HUDI-5240) Clean content when recursive Invocation inflate

[ https://issues.apache.org/jira/browse/HUDI-5240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j reassigned HUDI-5240: -- Assignee: loukey_j > Clean content when recursive Invocation inflate >

[jira] [Created] (HUDI-5240) Clean content when recursive Invocation inflate

loukey_j created HUDI-5240: -- Summary: Clean content when recursive Invocation inflate Key: HUDI-5240 URL: https://issues.apache.org/jira/browse/HUDI-5240 Project: Apache Hudi Issue Type: Bug

[jira] [Assigned] (HUDI-4869) Fix test for HUDI-4780

[ https://issues.apache.org/jira/browse/HUDI-4869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j reassigned HUDI-4869: -- Assignee: loukey_j > Fix test for HUDI-4780 > -- > > Key: HUDI-4869

[jira] [Updated] (HUDI-4869) Fix test for HUDI-4780

[ https://issues.apache.org/jira/browse/HUDI-4869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j updated HUDI-4869: --- Summary: Fix test for HUDI-4780 (was: Add test for HUDI-4780) > Fix test for HUDI-4780 >

[jira] [Created] (HUDI-4869) Add test for HUDI-4780

loukey_j created HUDI-4869: -- Summary: Add test for HUDI-4780 Key: HUDI-4869 URL: https://issues.apache.org/jira/browse/HUDI-4869 Project: Apache Hudi Issue Type: Test Reporter: loukey_j

[jira] [Assigned] (HUDI-4790) A more effective HoodieMergeHandler for COW table with parquet

[ https://issues.apache.org/jira/browse/HUDI-4790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j reassigned HUDI-4790: -- Assignee: loukey_j > A more effective HoodieMergeHandler for COW table with parquet >

[jira] [Created] (HUDI-4790) A more effective HoodieMergeHandler for COW table with parquet

loukey_j created HUDI-4790: -- Summary: A more effective HoodieMergeHandler for COW table with parquet Key: HUDI-4790 URL: https://issues.apache.org/jira/browse/HUDI-4790 Project: Apache Hudi Issue

[jira] [Assigned] (HUDI-4780) hoodie.logfile.max.size It does not take effect, causing the log file to be too large

[ https://issues.apache.org/jira/browse/HUDI-4780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j reassigned HUDI-4780: -- Assignee: loukey_j > hoodie.logfile.max.size It does not take effect, causing the log file to be > to

[jira] [Created] (HUDI-4780) hoodie.logfile.max.size It does not take effect, causing the log file to be too large

loukey_j created HUDI-4780: -- Summary: hoodie.logfile.max.size It does not take effect, causing the log file to be too large Key: HUDI-4780 URL: https://issues.apache.org/jira/browse/HUDI-4780 Project: Apach

[jira] [Updated] (HUDI-4259) flink create avro schema not conformance to standards

[ https://issues.apache.org/jira/browse/HUDI-4259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j updated HUDI-4259: --- Description: [https://avro.apache.org/docs/current/spec.html#schema_complex] * A name and namespace are both

[jira] [Updated] (HUDI-4259) flink create avro schema not conformance to standards

[ https://issues.apache.org/jira/browse/HUDI-4259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j updated HUDI-4259: --- Summary: flink create avro schema not conformance to standards (was: hudi flink convert avro schema not con

[jira] [Updated] (HUDI-4260) change FlinkOptions#KEYGEN_CLASS_NAME to no default value

[ https://issues.apache.org/jira/browse/HUDI-4260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j updated HUDI-4260: --- Summary: change FlinkOptions#KEYGEN_CLASS_NAME to no default value (was: change FlinkOptions#KEYGEN_CLASS_NAM

[jira] [Created] (HUDI-4260) change FlinkOptions#KEYGEN_CLASS_NAME without a default value

loukey_j created HUDI-4260: -- Summary: change FlinkOptions#KEYGEN_CLASS_NAME without a default value Key: HUDI-4260 URL: https://issues.apache.org/jira/browse/HUDI-4260 Project: Apache Hudi Issue Ty

[jira] [Created] (HUDI-4259) hudi flink convert avro schema not conformance to standards

loukey_j created HUDI-4259: -- Summary: hudi flink convert avro schema not conformance to standards Key: HUDI-4259 URL: https://issues.apache.org/jira/browse/HUDI-4259 Project: Apache Hudi Issue Typ

[jira] [Updated] (HUDI-4133) Spark query mor by snapshot query lost data

[ https://issues.apache.org/jira/browse/HUDI-4133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j updated HUDI-4133: --- Summary: Spark query mor by snapshot query lost data (was: Sprak query mor by snapshot query lost data )

[jira] [Updated] (HUDI-4133) Sprak query mor by snapshot query lost data

[ https://issues.apache.org/jira/browse/HUDI-4133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j updated HUDI-4133: --- Component/s: flink spark-sql > Sprak query mor by snapshot query lost data > --

[jira] [Assigned] (HUDI-4133) Sprak query mor by snapshot query lost data

[ https://issues.apache.org/jira/browse/HUDI-4133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j reassigned HUDI-4133: -- Assignee: loukey_j > Sprak query mor by snapshot query lost data > --

[jira] [Created] (HUDI-4133) Sprak query mor by snapshot query lost data

loukey_j created HUDI-4133: -- Summary: Sprak query mor by snapshot query lost data Key: HUDI-4133 URL: https://issues.apache.org/jira/browse/HUDI-4133 Project: Apache Hudi Issue Type: Bug

[jira] [Resolved] (HUDI-4108) Clean the marker files before starting new flink compaction

[ https://issues.apache.org/jira/browse/HUDI-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j resolved HUDI-4108. > Clean the marker files before starting new flink compaction >

[jira] [Updated] (HUDI-4108) Clean the marker files before staring new flink compaction

[ https://issues.apache.org/jira/browse/HUDI-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j updated HUDI-4108: --- Summary: Clean the marker files before staring new flink compaction (was: Mor table haven't deletes the mark

[jira] [Updated] (HUDI-4108) Clean the marker files before starting new flink compaction

[ https://issues.apache.org/jira/browse/HUDI-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j updated HUDI-4108: --- Summary: Clean the marker files before starting new flink compaction (was: Clean the marker files before star

[jira] [Updated] (HUDI-4108) Mor table haven't deletes the marker directory when finished compaction in flink

[ https://issues.apache.org/jira/browse/HUDI-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j updated HUDI-4108: --- Description: Caused by: org.apache.hadoop.ipc.RemoteException: /xxx/.hoodie/.temp/20220513175804790/kafka_ts=2

[jira] [Assigned] (HUDI-4108) Mor table haven't deletes the marker directory when finished compaction in flink

[ https://issues.apache.org/jira/browse/HUDI-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j reassigned HUDI-4108: -- Assignee: loukey_j > Mor table haven't deletes the marker directory when finished compaction in > fli

[jira] [Created] (HUDI-4108) Mor table haven't deletes the marker directory when finished compaction in flink

loukey_j created HUDI-4108: -- Summary: Mor table haven't deletes the marker directory when finished compaction in flink Key: HUDI-4108 URL: https://issues.apache.org/jira/browse/HUDI-4108 Project: Apache Hud

[jira] [Assigned] (HUDI-3962) flink cdc sink hudi failed to add hive partition fields for hive sync

[ https://issues.apache.org/jira/browse/HUDI-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j reassigned HUDI-3962: -- Assignee: loukey_j > flink cdc sink hudi failed to add hive partition fields for hive sync > --

[jira] [Assigned] (HUDI-3962) flink cdc sink hudi failed to add hive partition fields for hive sync

[ https://issues.apache.org/jira/browse/HUDI-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j reassigned HUDI-3962: -- Assignee: (was: loukey_j) > flink cdc sink hudi failed to add hive partition fields for hive sync >

[jira] [Assigned] (HUDI-3962) flink cdc sink hudi failed to add hive partition fields for hive sync

[ https://issues.apache.org/jira/browse/HUDI-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j reassigned HUDI-3962: -- Assignee: loukey_j > flink cdc sink hudi failed to add hive partition fields for hive sync > --

[jira] [Created] (HUDI-3440) HoodieSortedMergeHandle#close write data disorder

loukey_j created HUDI-3440: -- Summary: HoodieSortedMergeHandle#close write data disorder Key: HUDI-3440 URL: https://issues.apache.org/jira/browse/HUDI-3440 Project: Apache Hudi Issue Type: Task

[jira] [Closed] (HUDI-1421) Improvement of failure recovery for HoodieFlinkStreamer

[ https://issues.apache.org/jira/browse/HUDI-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j closed HUDI-1421. -- Resolution: Fixed > Improvement of failure recovery for HoodieFlinkStreamer > --

[jira] [Created] (HUDI-1931) BucketAssignFunction use wrong state

loukey_j created HUDI-1931: -- Summary: BucketAssignFunction use wrong state Key: HUDI-1931 URL: https://issues.apache.org/jira/browse/HUDI-1931 Project: Apache Hudi Issue Type: Improvement

[jira] [Assigned] (HUDI-1421) Improvement of failure recovery for HoodieFlinkStreamer

[ https://issues.apache.org/jira/browse/HUDI-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j reassigned HUDI-1421: -- Assignee: loukey_j > Improvement of failure recovery for HoodieFlinkStreamer >