[jira] [Closed] (HUDI-3857) NoSuchMethodError: Continuous deltastreamer test with async compaction fails on EMR spark

2022-04-11 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit closed HUDI-3857. - Resolution: Cannot Reproduce This happens with EMR spark. It does not reproduce with OSS spark. Either use

[GitHub] [hudi] hudi-bot commented on pull request #5296: [HUDI-3855] Fixing `FILENAME_METADATA_FIELD` not being correctly updated in `HoodieMergeHandle`

2022-04-11 Thread GitBox
hudi-bot commented on PR #5296: URL: https://github.com/apache/hudi/pull/5296#issuecomment-1096197206 ## CI report: * e5d566882c6f3ed58a65a01065f0ae99dfb420b2 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8002

[jira] [Updated] (HUDI-3843) Make Flink 1.13.x 1.14.x build with scala 2.11

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3843: - Reviewers: Ethan Guo > Make Flink 1.13.x 1.14.x build with scala 2.11 > --

[jira] [Updated] (HUDI-3859) Remove parquet-avro from utilities-slim

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3859: - Status: Patch Available (was: In Progress) > Remove parquet-avro from utilities-slim > --

[jira] [Updated] (HUDI-3855) Hudi's metadata field "_hoodie_file_name" not updated in MergeHandle

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3855: - Reviewers: Raymond Xu, sivabalan narayanan > Hudi's metadata field "_hoodie_file_name" not updated in Merg

[jira] [Updated] (HUDI-3738) Perf comparison between parquet and hudi for COW snapshot and MOR read optimized

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3738: - Reviewers: sivabalan narayanan > Perf comparison between parquet and hudi for COW snapshot and MOR read >

[jira] [Updated] (HUDI-3839) List of MT partitions to be updated is selected incorrectly

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3839: - Reviewers: Sagar Sumit > List of MT partitions to be updated is selected incorrectly > ---

[jira] [Updated] (HUDI-3855) Hudi's metadata field "_hoodie_file_name" not updated in MergeHandle

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3855: - Status: Patch Available (was: In Progress) > Hudi's metadata field "_hoodie_file_name" not updated in Mer

[GitHub] [hudi] hudi-bot commented on pull request #5279: [HUDI-3843] Make flink profiles build with scala-2.11

2022-04-11 Thread GitBox
hudi-bot commented on PR #5279: URL: https://github.com/apache/hudi/pull/5279#issuecomment-1096192323 ## CI report: * a6ad82e1a6d7c392f1f1b53937f4c5395b620c05 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=800

[jira] [Updated] (HUDI-3855) Hudi's metadata field "_hoodie_file_name" not updated in MergeHandle

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3855: - Status: In Progress (was: Open) > Hudi's metadata field "_hoodie_file_name" not updated in MergeHandle >

[GitHub] [hudi] easonwood commented on issue #5290: [SUPPORT] Problems in handling column deletions in Hudi

2022-04-11 Thread GitBox
easonwood commented on issue #5290: URL: https://github.com/apache/hudi/issues/5290#issuecomment-1096191600 It seems this error does not influence the result. Data loaded to Hudi successfully. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hudi] hudi-bot commented on pull request #4724: [HUDI-2815] add partial overwrite payload to support partial overwrit…

2022-04-11 Thread GitBox
hudi-bot commented on PR #4724: URL: https://github.com/apache/hudi/pull/4724#issuecomment-1096191258 ## CI report: * 20b1ee41afcb4cc5328bfb30e51e5a37bf0d46c7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7999

[GitHub] [hudi] hudi-bot commented on pull request #5279: [HUDI-3843] Make flink profiles build with scala-2.11

2022-04-11 Thread GitBox
hudi-bot commented on PR #5279: URL: https://github.com/apache/hudi/pull/5279#issuecomment-1096187448 ## CI report: * 9a6be184e3833e071054afc5d0db55bb2336dd5c Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=799

[GitHub] [hudi] hudi-bot commented on pull request #5297: [HUDI-3859] Fix spark profiles and utilities-slim dep

2022-04-11 Thread GitBox
hudi-bot commented on PR #5297: URL: https://github.com/apache/hudi/pull/5297#issuecomment-1096182625 ## CI report: * cc81ebb8f2b84b9ada13927de9c30a1b69864f2f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8003

[GitHub] [hudi] zhilinli123 commented on issue #4881: Full incremental Enable index loading to discover duplicate data(index.bootstrap.enabled)

2022-04-11 Thread GitBox
zhilinli123 commented on issue #4881: URL: https://github.com/apache/hudi/issues/4881#issuecomment-1096179551 @nsivabalan Will the current issue be fixed when the next version is released -- This is an automated message from the Apache Git Service. To respond to the message, please log o

[GitHub] [hudi] hudi-bot commented on pull request #5297: [HUDI-3859] Fix spark profiles and utilities-slim dep

2022-04-11 Thread GitBox
hudi-bot commented on PR #5297: URL: https://github.com/apache/hudi/pull/5297#issuecomment-1096178036 ## CI report: * cc81ebb8f2b84b9ada13927de9c30a1b69864f2f UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[jira] [Updated] (HUDI-3859) Remove parquet-avro from utilities-slim

2022-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3859: - Labels: pull-request-available (was: ) > Remove parquet-avro from utilities-slim > --

[GitHub] [hudi] xushiyan opened a new pull request, #5297: [HUDI-3859] Fix spark profiles and utilities-slim dep

2022-04-11 Thread GitBox
xushiyan opened a new pull request, #5297: URL: https://github.com/apache/hudi/pull/5297 ## Committer checklist - [ ] Has a corresponding JIRA in PR title & commit - [ ] Commit message is descriptive of the change - [ ] CI is green - [ ] Necessary doc

[GitHub] [hudi] hudi-bot commented on pull request #5296: [HUDI-3855] Fixing `FILENAME_METADATA_FIELD` not being correctly updated in `HoodieMergeHandle`

2022-04-11 Thread GitBox
hudi-bot commented on PR #5296: URL: https://github.com/apache/hudi/pull/5296#issuecomment-1096165047 ## CI report: * e5d566882c6f3ed58a65a01065f0ae99dfb420b2 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8002

[jira] [Updated] (HUDI-3845) Fix delete mor table's partition with urlencode's error

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3845: - Priority: Critical (was: Major) > Fix delete mor table's partition with urlencode's error > -

[jira] [Updated] (HUDI-3845) Fix delete mor table's partition with urlencode's error

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3845: - Fix Version/s: 0.12.0 > Fix delete mor table's partition with urlencode's error >

[GitHub] [hudi] hudi-bot commented on pull request #5296: [HUDI-3855] Fixing `FILENAME_METADATA_FIELD` not being correctly updated in `HoodieMergeHandle`

2022-04-11 Thread GitBox
hudi-bot commented on PR #5296: URL: https://github.com/apache/hudi/pull/5296#issuecomment-1096159804 ## CI report: * e5d566882c6f3ed58a65a01065f0ae99dfb420b2 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[jira] [Updated] (HUDI-3855) Hudi's metadata field "_hoodie_file_name" not updated in MergeHandle

2022-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3855: - Labels: pull-request-available (was: ) > Hudi's metadata field "_hoodie_file_name" not updated in

[GitHub] [hudi] alexeykudinkin opened a new pull request, #5296: [HUDI-3855] Fixing `FILENAME_METADATA_FIELD` not being correctly updated in `HoodieMergeHandle`

2022-04-11 Thread GitBox
alexeykudinkin opened a new pull request, #5296: URL: https://github.com/apache/hudi/pull/5296 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[jira] [Assigned] (HUDI-3819) upgrade spring cve-2022-22965

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-3819: Assignee: Sagar Sumit (was: Raymond Xu) > upgrade spring cve-2022-22965 >

[jira] [Updated] (HUDI-3819) upgrade spring cve-2022-22965

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3819: - Reviewers: Raymond Xu (was: Sagar Sumit) > upgrade spring cve-2022-22965 > -

[jira] [Updated] (HUDI-3819) upgrade spring cve-2022-22965

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3819: - Status: In Progress (was: Open) > upgrade spring cve-2022-22965 > - > >

[jira] [Updated] (HUDI-3859) Remove parquet-avro from utilities-slim

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3859: - Status: In Progress (was: Open) > Remove parquet-avro from utilities-slim > -

[jira] [Updated] (HUDI-3746) CI ignored test failure in TestDataSkippingUtils

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3746: - Priority: Blocker (was: Major) > CI ignored test failure in TestDataSkippingUtils > -

[jira] [Updated] (HUDI-3746) CI ignored test failure in TestDataSkippingUtils

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3746: - Fix Version/s: 0.12.0 (was: 0.11.0) > CI ignored test failure in TestDataSkippingUt

[jira] [Updated] (HUDI-1976) Upgrade hive, jackson, log4j, hadoop to remove vulnerability

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1976: - Component/s: dependencies > Upgrade hive, jackson, log4j, hadoop to remove vulnerability > ---

[jira] [Updated] (HUDI-1976) Upgrade hive, jackson, log4j, hadoop to remove vulnerability

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1976: - Issue Type: Improvement (was: Task) > Upgrade hive, jackson, log4j, hadoop to remove vulnerability >

[jira] [Updated] (HUDI-1976) Upgrade hive, jackson, log4j, hadoop to remove vulnerability

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1976: - Fix Version/s: 0.12.0 (was: 0.11.0) > Upgrade hive, jackson, log4j, hadoop to remov

[jira] [Assigned] (HUDI-3096) fixed the bug that the cow table(contains decimalType) write by flink cannot be read by spark

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-3096: Assignee: Tao Meng > fixed the bug that the cow table(contains decimalType) write by flink cannot

[jira] [Closed] (HUDI-3096) fixed the bug that the cow table(contains decimalType) write by flink cannot be read by spark

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-3096. Resolution: Fixed > fixed the bug that the cow table(contains decimalType) write by flink cannot > be read

[jira] [Updated] (HUDI-3680) Update docs to reflect new Bundles Spark compatibility

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3680: - Story Points: 1 (was: 2) > Update docs to reflect new Bundles Spark compatibility >

[GitHub] [hudi] hudi-bot commented on pull request #5295: [HUDI-3858]Shade javax.servlet for hudi-spark-bundle

2022-04-11 Thread GitBox
hudi-bot commented on PR #5295: URL: https://github.com/apache/hudi/pull/5295#issuecomment-1096115125 ## CI report: * c900ecc8741fdcab9c1a4c156e410d6e8462a457 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7998

[jira] [Commented] (HUDI-3749) Run latest hudi w/ EMR spark and report to aws folks

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520924#comment-17520924 ] Raymond Xu commented on HUDI-3749: -- [~shivnarayan] what's the done criteria for this tick

[jira] [Updated] (HUDI-2606) Ensure query engines not access MDT if disabled

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2606: - Reviewers: Ethan Guo (was: Ethan Guo, sivabalan narayanan) > Ensure query engines not access MDT if disab

[jira] [Updated] (HUDI-3826) Commands deleting partitions do so incorrectly

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3826: - Reviewers: Alexey Kudinkin > Commands deleting partitions do so incorrectly >

[jira] [Assigned] (HUDI-3707) Fix deltastreamer test with schema provider and transformer enabled

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-3707: Assignee: Sagar Sumit > Fix deltastreamer test with schema provider and transformer enabled > -

[jira] [Updated] (HUDI-3819) upgrade spring cve-2022-22965

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3819: - Reviewers: Sagar Sumit > upgrade spring cve-2022-22965 > - > >

[jira] [Assigned] (HUDI-1602) Corrupted Avro schema extracted from parquet file

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-1602: Assignee: Sagar Sumit > Corrupted Avro schema extracted from parquet file > ---

[jira] [Assigned] (HUDI-3819) upgrade spring cve-2022-22965

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-3819: Assignee: Raymond Xu > upgrade spring cve-2022-22965 > - > >

[jira] [Updated] (HUDI-3859) Remove parquet-avro from utilities-slim

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3859: - Reviewers: Ethan Guo > Remove parquet-avro from utilities-slim > --- >

[jira] [Assigned] (HUDI-3752) Update website content based on 0.11 new features

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-3752: Assignee: Raymond Xu > Update website content based on 0.11 new features >

[jira] [Assigned] (HUDI-3859) Remove parquet-avro from utilities-slim

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-3859: Assignee: Raymond Xu > Remove parquet-avro from utilities-slim > --

[jira] [Updated] (HUDI-3859) Remove parquet-avro from utilities-slim

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3859: - Sprint: Hudi-Sprint-Apr-12 > Remove parquet-avro from utilities-slim > ---

[jira] [Updated] (HUDI-3859) Remove parquet-avro from utilities-slim

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3859: - Story Points: 0.5 > Remove parquet-avro from utilities-slim > --- > >

[jira] [Updated] (HUDI-3859) Remove parquet-avro from utilities-slim

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3859: - Component/s: dependencies > Remove parquet-avro from utilities-slim >

[jira] [Created] (HUDI-3859) Remove parquet-avro from utilities-slim

2022-04-11 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-3859: Summary: Remove parquet-avro from utilities-slim Key: HUDI-3859 URL: https://issues.apache.org/jira/browse/HUDI-3859 Project: Apache Hudi Issue Type: Improvement

[jira] [Updated] (HUDI-3859) Remove parquet-avro from utilities-slim

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3859: - Fix Version/s: 0.11.0 > Remove parquet-avro from utilities-slim > ---

[jira] [Updated] (HUDI-1602) Corrupted Avro schema extracted from parquet file

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1602: - Story Points: 0.5 > Corrupted Avro schema extracted from parquet file > --

[jira] [Updated] (HUDI-3838) Make Drop partition column config work with deltastreamer

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3838: - Story Points: 1 > Make Drop partition column config work with deltastreamer >

[jira] [Updated] (HUDI-3724) Too many open files w/ COW spark long running tests

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3724: - Story Points: 1 > Too many open files w/ COW spark long running tests > --

[jira] [Updated] (HUDI-3843) Make Flink 1.13.x 1.14.x build with scala 2.11

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3843: - Story Points: 0.5 > Make Flink 1.13.x 1.14.x build with scala 2.11 > -

[jira] [Updated] (HUDI-3738) Perf comparison between parquet and hudi for COW snapshot and MOR read optimized

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3738: - Story Points: 1 > Perf comparison between parquet and hudi for COW snapshot and MOR read > optimized > --

[jira] [Updated] (HUDI-3752) Update website content based on 0.11 new features

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3752: - Sprint: Hudi-Sprint-Apr-12 > Update website content based on 0.11 new features > -

[jira] [Updated] (HUDI-3752) Update website content based on 0.11 new features

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3752: - Story Points: 2 > Update website content based on 0.11 new features >

[jira] [Updated] (HUDI-3819) upgrade spring cve-2022-22965

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3819: - Story Points: 0.5 > upgrade spring cve-2022-22965 > - > > Key:

[jira] [Updated] (HUDI-3749) Run latest hudi w/ EMR spark and report to aws folks

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3749: - Sprint: Hudi-Sprint-Mar-22, Hudi-Sprint-Apr-12 (was: Hudi-Sprint-Mar-22) > Run latest hudi w/ EMR spark a

[jira] [Updated] (HUDI-3749) Run latest hudi w/ EMR spark and report to aws folks

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3749: - Story Points: 1 > Run latest hudi w/ EMR spark and report to aws folks > -

[jira] [Updated] (HUDI-1605) Add more documentation around archival process and configs

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1605: - Sprint: Hudi-Sprint-Apr-12 > Add more documentation around archival process and configs >

[jira] [Updated] (HUDI-3707) Fix deltastreamer test with schema provider and transformer enabled

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3707: - Story Points: 2 > Fix deltastreamer test with schema provider and transformer enabled > --

[jira] [Updated] (HUDI-3036) Enhance Cleaner Docs

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3036: - Sprint: Hudi-Sprint-Apr-12 > Enhance Cleaner Docs > > > Key: HUDI-303

[jira] [Updated] (HUDI-3855) Hudi's metadata field "_hoodie_file_name" not updated in MergeHandle

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3855: - Story Points: 1 > Hudi's metadata field "_hoodie_file_name" not updated in MergeHandle > -

[jira] [Updated] (HUDI-3036) Enhance Cleaner Docs

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3036: - Story Points: 0 > Enhance Cleaner Docs > > > Key: HUDI-3036 >

[jira] [Updated] (HUDI-1605) Add more documentation around archival process and configs

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1605: - Story Points: 0 > Add more documentation around archival process and configs > ---

[jira] [Updated] (HUDI-3749) Run latest hudi w/ EMR spark and report to aws folks

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3749: - Priority: Blocker (was: Critical) > Run latest hudi w/ EMR spark and report to aws folks > --

[jira] [Updated] (HUDI-2946) Upgrade maven plugin to make Hudi be compatible with higher Java versions

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2946: - Priority: Critical (was: Major) > Upgrade maven plugin to make Hudi be compatible with higher Java versio

[jira] [Updated] (HUDI-2946) Upgrade maven plugin to make Hudi be compatible with higher Java versions

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2946: - Component/s: dependencies > Upgrade maven plugin to make Hudi be compatible with higher Java versions > --

[jira] [Updated] (HUDI-2946) Upgrade maven plugin to make Hudi be compatible with higher Java versions

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2946: - Fix Version/s: 0.12.0 (was: 0.11.0) > Upgrade maven plugin to make Hudi be compatib

[jira] [Updated] (HUDI-3036) Enhance Cleaner Docs

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3036: - Priority: Blocker (was: Major) > Enhance Cleaner Docs > > > Key: HUD

[jira] [Updated] (HUDI-3067) "Table already exists" error with multiple writers and dynamodb

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3067: - Fix Version/s: 0.12.0 (was: 0.11.0) > "Table already exists" error with multiple wr

[jira] [Updated] (HUDI-3067) "Table already exists" error with multiple writers and dynamodb

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3067: - Priority: Critical (was: Major) > "Table already exists" error with multiple writers and dynamodb > -

[jira] [Updated] (HUDI-3752) Update website content based on 0.11 new features

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3752: - Priority: Blocker (was: Major) > Update website content based on 0.11 new features >

[jira] [Closed] (HUDI-3344) Standard code format for HoodieDataSourceExample.scala

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-3344. Reviewers: sivabalan narayanan Resolution: Done > Standard code format for HoodieDataSourceExample.scal

[jira] [Assigned] (HUDI-3344) Standard code format for HoodieDataSourceExample.scala

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-3344: Assignee: qian > Standard code format for HoodieDataSourceExample.scala >

[jira] [Updated] (HUDI-3344) Standard code format for HoodieDataSourceExample.scala

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3344: - Component/s: code-quality > Standard code format for HoodieDataSourceExample.scala >

[jira] [Updated] (HUDI-3344) Standard code format for HoodieDataSourceExample.scala

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3344: - Priority: Minor (was: Major) > Standard code format for HoodieDataSourceExample.scala >

[jira] [Updated] (HUDI-3344) Standard code format for HoodieDataSourceExample.scala

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3344: - Priority: Trivial (was: Minor) > Standard code format for HoodieDataSourceExample.scala > --

[jira] [Updated] (HUDI-3344) Standard code format for HoodieDataSourceExample.scala

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3344: - Fix Version/s: 0.12.0 (was: 0.11.0) > Standard code format for HoodieDataSourceExam

[jira] [Updated] (HUDI-3344) Standard code format for HoodieDataSourceExample.scala

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3344: - Fix Version/s: 0.11.0 (was: 0.12.0) > Standard code format for HoodieDataSourceExam

[jira] [Updated] (HUDI-1605) Add more documentation around archival process and configs

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1605: - Priority: Blocker (was: Minor) > Add more documentation around archival process and configs > ---

[jira] [Updated] (HUDI-3577) NPE in HoodieTimelineArchiver

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3577: - Story Points: 0.5 > NPE in HoodieTimelineArchiver > - > > Key:

[jira] [Updated] (HUDI-3804) Partition metadata is not properly created for Column Stats

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3804: - Sprint: (was: Cont' improve - 2022/03/7) > Partition metadata is not properly created for Column Stats >

[jira] [Updated] (HUDI-3810) Enabling point look ups does an extra full scan in addition to point look up for log reader readers with metadata

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3810: - Sprint: (was: Cont' improve - 2022/03/7) > Enabling point look ups does an extra full scan in addition t

[jira] [Updated] (HUDI-3647) Ignore errors if metadata table has not been initialized fully

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3647: - Sprint: Hudi-Sprint-Apr-12 > Ignore errors if metadata table has not been initialized fully >

[jira] [Updated] (HUDI-3707) Fix deltastreamer test with schema provider and transformer enabled

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3707: - Sprint: Hudi-Sprint-Apr-12 > Fix deltastreamer test with schema provider and transformer enabled > ---

[jira] [Updated] (HUDI-1602) Corrupted Avro schema extracted from parquet file

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1602: - Sprint: Hudi-Sprint-Apr-12 > Corrupted Avro schema extracted from parquet file > -

[jira] [Updated] (HUDI-3819) upgrade spring cve-2022-22965

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3819: - Sprint: Hudi-Sprint-Apr-12 > upgrade spring cve-2022-22965 > - > >

[jira] [Updated] (HUDI-3855) Hudi's metadata field "_hoodie_file_name" not updated in MergeHandle

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3855: - Sprint: Hudi-Sprint-Apr-12 > Hudi's metadata field "_hoodie_file_name" not updated in MergeHandle > --

[jira] [Updated] (HUDI-3013) Docs for Presto and Hudi

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3013: - Sprint: Hudi-Sprint-Mar-14, Hudi-Sprint-Mar-21, Hudi-Sprint-Mar-22, Hudi-Sprint-Apr-05, Hudi-Sprint-Apr-6

[jira] [Updated] (HUDI-3724) Too many open files w/ COW spark long running tests

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3724: - Sprint: Hudi-Sprint-Mar-22, Hudi-Sprint-Apr-05, Hudi-Sprint-Apr-6 (was: Hudi-Sprint-Mar-22, Hudi-Sprint-A

[jira] [Updated] (HUDI-3857) NoSuchMethodError: Continuous deltastreamer test with async compaction fails on EMR spark

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3857: - Sprint: Hudi-Sprint-Apr-05, Hudi-Sprint-Apr-6 (was: Hudi-Sprint-Apr-05) > NoSuchMethodError: Continuous d

[jira] [Updated] (HUDI-3738) Perf comparison between parquet and hudi for COW snapshot and MOR read optimized

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3738: - Sprint: Hudi-Sprint-Mar-22, Hudi-Sprint-Apr-05, Hudi-Sprint-Apr-6 (was: Hudi-Sprint-Mar-22, Hudi-Sprint-A

[jira] [Updated] (HUDI-3799) Understand reason behind "Not an avro data file" with hudi

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3799: - Sprint: Hudi-Sprint-Apr-05, Hudi-Sprint-Apr-6 (was: Hudi-Sprint-Apr-05) > Understand reason behind "Not a

[jira] [Updated] (HUDI-3806) Improve HoodieBloomIndex using bloom_filter and col_stats in MDT

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3806: - Sprint: Hudi-Sprint-Apr-05, Hudi-Sprint-Apr-6 (was: Hudi-Sprint-Apr-05) > Improve HoodieBloomIndex using

[jira] [Updated] (HUDI-3207) Hudi Trino connector PR review

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3207: - Sprint: Hudi-Sprint-Jan-10, Hudi-Sprint-Jan-18, Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7,

[jira] [Updated] (HUDI-2606) Ensure query engines not access MDT if disabled

2022-04-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2606: - Sprint: Hudi-Sprint-Feb-14, Hudi-Sprint-Feb-22, Hudi-Sprint-Mar-01, Hudi-Sprint-Mar-07, Hudi-Sprint-Mar-14

  1   2   3   4   >