[jira] [Commented] (HUDI-1588) Support multiple ordering fields via payload class config
[ https://issues.apache.org/jira/browse/HUDI-1588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511618#comment-17511618 ] Pratyaksh Sharma commented on HUDI-1588: [~xushiyan] Let us push it to 0.12 > Support multiple ordering fields via payload class config > - > > Key: HUDI-1588 > URL: https://issues.apache.org/jira/browse/HUDI-1588 > Project: Apache Hudi > Issue Type: Improvement > Components: writer-core >Affects Versions: 0.9.0 >Reporter: Raymond Xu >Assignee: Pratyaksh Sharma >Priority: Major > Fix For: 0.12.0 > > > To make configuration simpler, we want to deprecate --source-ordering-field > config and combine it with payload class config so that users can plug in > custom payload class that handles record ordering. Also the logic can be > extended to look up for multiple fields for ordering. > > Discussion thread > https://lists.apache.org/thread.html/r884e47f21ce1f3f09ef12722fa05ba9900ba12429935c10167b9fce6%40%3Cdev.hudi.apache.org%3E -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [hudi] codope opened a new pull request #5117: [WIP] Fix glob nd hive sync in deltastreamer tests
codope opened a new pull request #5117: URL: https://github.com/apache/hudi/pull/5117 ## What is the purpose of the pull request *(For example: This pull request adds quick-start document.)* ## Brief change log *(for example:)* - *Modify AnnotationLocation checkstyle rule in checkstyle.xml* ## Verify this pull request *(Please pick either of the following options)* This pull request is a trivial rework / code cleanup without any test coverage. *(or)* This pull request is already covered by existing tests, such as *(please describe tests)*. (or) This change added tests and can be verified as follows: *(example:)* - *Added integration tests for end-to-end.* - *Added HoodieClientWriteTest to verify the change.* - *Manually verified the change by running a job locally.* ## Committer checklist - [ ] Has a corresponding JIRA in PR title & commit - [ ] Commit message is descriptive of the change - [ ] CI is green - [ ] Necessary doc changes done or have another open PR - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5117: [WIP] Fix glob nd hive sync in deltastreamer tests
hudi-bot commented on pull request #5117: URL: https://github.com/apache/hudi/pull/5117#issuecomment-1077313148 ## CI report: * 13d5a7a9a6164492ce93b09ccc53d118e79147a2 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5115: [HUDI-3693]error will be occured when writing data into hudi using flink job more than once in same flink session
hudi-bot commented on pull request #5115: URL: https://github.com/apache/hudi/pull/5115#issuecomment-1077315585 ## CI report: * 73e20318935ea2f2d1a090051a03fc2d5c307376 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7271) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5117: [WIP] Fix glob nd hive sync in deltastreamer tests
hudi-bot commented on pull request #5117: URL: https://github.com/apache/hudi/pull/5117#issuecomment-1077315606 ## CI report: * 13d5a7a9a6164492ce93b09ccc53d118e79147a2 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7274) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5115: [HUDI-3693]error will be occured when writing data into hudi using flink job more than once in same flink session
hudi-bot removed a comment on pull request #5115: URL: https://github.com/apache/hudi/pull/5115#issuecomment-1077259357 ## CI report: * 73e20318935ea2f2d1a090051a03fc2d5c307376 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7271) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5117: [WIP] Fix glob nd hive sync in deltastreamer tests
hudi-bot removed a comment on pull request #5117: URL: https://github.com/apache/hudi/pull/5117#issuecomment-1077313148 ## CI report: * 13d5a7a9a6164492ce93b09ccc53d118e79147a2 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] xushiyan commented on pull request #5117: [WIP] Fix glob nd hive sync in deltastreamer tests
xushiyan commented on pull request #5117: URL: https://github.com/apache/hudi/pull/5117#issuecomment-1077319673 the CI will fail. but if you can put screenshots showing which testcases become passing with this patch, would be great -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5104: [WIP] Different CI fixes - for verification only
hudi-bot removed a comment on pull request #5104: URL: https://github.com/apache/hudi/pull/5104#issuecomment-1077263500 ## CI report: * c3577736f121bf544f2f24e6f6af12cfbb4dbf72 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7269) * b9559f24b359eb3c123cfbca901e0489c85f569f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7272) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5104: [WIP] Different CI fixes - for verification only
hudi-bot commented on pull request #5104: URL: https://github.com/apache/hudi/pull/5104#issuecomment-1077320238 ## CI report: * b9559f24b359eb3c123cfbca901e0489c85f569f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7272) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] fireking77 commented on issue #4609: [SUPPORT] Got exception while using clustering with z-order
fireking77 commented on issue #4609: URL: https://github.com/apache/hudi/issues/4609#issuecomment-1077335913 > @xiarixiaoyao Upon checking with our internal infra team, we found that it was due to some incorrect configuration in our spark cluster. This issue is resolved now. Thanks for your time. Very sorry to bother you about this. @ravs11 May I ask what was the infra issue? - I am facing with the same problem. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5117: [WIP] Fix glob nd hive sync in deltastreamer tests
hudi-bot commented on pull request #5117: URL: https://github.com/apache/hudi/pull/5117#issuecomment-1077357020 ## CI report: * 13d5a7a9a6164492ce93b09ccc53d118e79147a2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7274) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5117: [WIP] Fix glob nd hive sync in deltastreamer tests
hudi-bot removed a comment on pull request #5117: URL: https://github.com/apache/hudi/pull/5117#issuecomment-1077315606 ## CI report: * 13d5a7a9a6164492ce93b09ccc53d118e79147a2 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7274) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] xushiyan commented on pull request #5106: [minor] Checks the data block type for archived timeline
xushiyan commented on pull request #5106: URL: https://github.com/apache/hudi/pull/5106#issuecomment-1077373737 hey @danny0405 this does not look like a minor change. can we have a jira to track what was the issue and what was the fix please? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5117: [WIP] Fix glob nd hive sync in deltastreamer tests
hudi-bot commented on pull request #5117: URL: https://github.com/apache/hudi/pull/5117#issuecomment-1077378078 ## CI report: * 13d5a7a9a6164492ce93b09ccc53d118e79147a2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7274) * 2f7204b3eb3dcef3825941a19c0dd0d642d4 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5117: [WIP] Fix glob nd hive sync in deltastreamer tests
hudi-bot removed a comment on pull request #5117: URL: https://github.com/apache/hudi/pull/5117#issuecomment-1077357020 ## CI report: * 13d5a7a9a6164492ce93b09ccc53d118e79147a2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7274) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5087: [HUDI-3614] [DO_NOT_MERGE]Replace List with HoodieData in HoodieFlink/JavaTable and commit executors
hudi-bot commented on pull request #5087: URL: https://github.com/apache/hudi/pull/5087#issuecomment-1077380485 ## CI report: * cb5e663b30f62899e8f518b378fa4061b2416f77 UNKNOWN * 8b37774b40dd55ecee05497a4513d06c0233b04f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7233) * 170a4c1691307de27e688e0b043d1477a2a9a65e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5087: [HUDI-3614] [DO_NOT_MERGE]Replace List with HoodieData in HoodieFlink/JavaTable and commit executors
hudi-bot removed a comment on pull request #5087: URL: https://github.com/apache/hudi/pull/5087#issuecomment-1076333222 ## CI report: * cb5e663b30f62899e8f518b378fa4061b2416f77 UNKNOWN * 8b37774b40dd55ecee05497a4513d06c0233b04f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7233) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5117: [WIP] Fix glob nd hive sync in deltastreamer tests
hudi-bot commented on pull request #5117: URL: https://github.com/apache/hudi/pull/5117#issuecomment-1077380616 ## CI report: * 13d5a7a9a6164492ce93b09ccc53d118e79147a2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7274) * 2f7204b3eb3dcef3825941a19c0dd0d642d4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7275) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5117: [WIP] Fix glob nd hive sync in deltastreamer tests
hudi-bot removed a comment on pull request #5117: URL: https://github.com/apache/hudi/pull/5117#issuecomment-1077378078 ## CI report: * 13d5a7a9a6164492ce93b09ccc53d118e79147a2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7274) * 2f7204b3eb3dcef3825941a19c0dd0d642d4 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
xiarixiaoyao commented on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1077382443 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
hudi-bot commented on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1077383545 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN * 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN * 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN * a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN * f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN * 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN * 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN * c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN * 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN * da322a449f6bba3177dc7fb95800eb67bbd3a27b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
hudi-bot removed a comment on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1077043430 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN * 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN * 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN * a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN * f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN * 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN * 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN * c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN * 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN * da322a449f6bba3177dc7fb95800eb67bbd3a27b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] qjqqyy commented on issue #5107: [SUPPORT] High performance costs of AvroSerializer in Datasource writing
qjqqyy commented on issue #5107:
URL: https://github.com/apache/hudi/issues/5107#issuecomment-1077384564
@YuweiXiao Hi, allow me to rephrase. This is what's actually going on in git
master (removing the adapter abstraction)
```scala
df.mapPartitions { rows =>
rows.map { row =>
new AvroSerializer().serialize(row)
}
}
```
there could be extra initialization cost for each invocation of `serialize`
but it seems to be *recreating* the AvroSerializer for each row, which I
suspect is the main culprit.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5087: [HUDI-3614] [DO_NOT_MERGE]Replace List with HoodieData in HoodieFlink/JavaTable and commit executors
hudi-bot removed a comment on pull request #5087: URL: https://github.com/apache/hudi/pull/5087#issuecomment-1077380485 ## CI report: * cb5e663b30f62899e8f518b378fa4061b2416f77 UNKNOWN * 8b37774b40dd55ecee05497a4513d06c0233b04f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7233) * 170a4c1691307de27e688e0b043d1477a2a9a65e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5087: [HUDI-3614] [DO_NOT_MERGE]Replace List with HoodieData in HoodieFlink/JavaTable and commit executors
hudi-bot commented on pull request #5087: URL: https://github.com/apache/hudi/pull/5087#issuecomment-1077392183 ## CI report: * cb5e663b30f62899e8f518b378fa4061b2416f77 UNKNOWN * 8b37774b40dd55ecee05497a4513d06c0233b04f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7233) * 170a4c1691307de27e688e0b043d1477a2a9a65e UNKNOWN * e157958ddf6adb265f9f084aa3dcb26ce0c9cb16 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5087: [HUDI-3614] [DO_NOT_MERGE]Replace List with HoodieData in HoodieFlink/JavaTable and commit executors
hudi-bot commented on pull request #5087: URL: https://github.com/apache/hudi/pull/5087#issuecomment-1077404415 ## CI report: * cb5e663b30f62899e8f518b378fa4061b2416f77 UNKNOWN * 8b37774b40dd55ecee05497a4513d06c0233b04f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7233) * 170a4c1691307de27e688e0b043d1477a2a9a65e UNKNOWN * e157958ddf6adb265f9f084aa3dcb26ce0c9cb16 UNKNOWN * 40a5d08a56d88a6f8ef0581ec778c163e4c7675c UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5087: [HUDI-3614] [DO_NOT_MERGE]Replace List with HoodieData in HoodieFlink/JavaTable and commit executors
hudi-bot removed a comment on pull request #5087: URL: https://github.com/apache/hudi/pull/5087#issuecomment-1077392183 ## CI report: * cb5e663b30f62899e8f518b378fa4061b2416f77 UNKNOWN * 8b37774b40dd55ecee05497a4513d06c0233b04f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7233) * 170a4c1691307de27e688e0b043d1477a2a9a65e UNKNOWN * e157958ddf6adb265f9f084aa3dcb26ce0c9cb16 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] YuweiXiao commented on issue #5107: [SUPPORT] High performance costs of AvroSerializer in Datasource writing
YuweiXiao commented on issue #5107: URL: https://github.com/apache/hudi/issues/5107#issuecomment-1077404381 @boneanxs True, full support of Dataset is the long term solution. In my experiment, optimizing the usage of `AvroSerializer` could save 80% costs of the source data reading. But the optimization requires modification of the `AvroSerializer` source code in the spark side. @qjqqyy Yes, each row will initialize `AvroSerializer` (variables in the lambda named `converter`) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5087: [HUDI-3614] [DO_NOT_MERGE]Replace List with HoodieData in HoodieFlink/JavaTable and commit executors
hudi-bot commented on pull request #5087: URL: https://github.com/apache/hudi/pull/5087#issuecomment-1077438543 ## CI report: * cb5e663b30f62899e8f518b378fa4061b2416f77 UNKNOWN * 8b37774b40dd55ecee05497a4513d06c0233b04f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7233) * 170a4c1691307de27e688e0b043d1477a2a9a65e UNKNOWN * e157958ddf6adb265f9f084aa3dcb26ce0c9cb16 UNKNOWN * 40a5d08a56d88a6f8ef0581ec778c163e4c7675c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7277) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5117: [HUDI-3689] Fix glob path and hive sync in deltastreamer tests
hudi-bot commented on pull request #5117: URL: https://github.com/apache/hudi/pull/5117#issuecomment-1077438810 ## CI report: * 2f7204b3eb3dcef3825941a19c0dd0d642d4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7275) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5117: [HUDI-3689] Fix glob path and hive sync in deltastreamer tests
hudi-bot removed a comment on pull request #5117: URL: https://github.com/apache/hudi/pull/5117#issuecomment-1077380616 ## CI report: * 13d5a7a9a6164492ce93b09ccc53d118e79147a2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7274) * 2f7204b3eb3dcef3825941a19c0dd0d642d4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7275) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
hudi-bot commented on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1077437931 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN * 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN * 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN * a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN * f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN * 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN * 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN * c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN * 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN * da322a449f6bba3177dc7fb95800eb67bbd3a27b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark
hudi-bot removed a comment on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1077383545 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKNOWN * 60d9cf848b623c27078e1d0b9db329eb8f4cec94 UNKNOWN * 9729597c54733bc6518b14418bdbe1cf7febb80b UNKNOWN * a543ce26adebe58f6f0954a54524a4cb393c0a0c UNKNOWN * f7a1729d2a9529f03b1f3d259b1b1ba4920f137e UNKNOWN * 1816108f1144b1c918988022fc7147fbe7bb8f9d UNKNOWN * 85cc0c336425a2b1c70694a5f4222c63f98fc3e5 UNKNOWN * c41514d513eb6adc831ea580d48a65fd77f49da6 UNKNOWN * 52b0671b08edd5d21053b4210e9001e11a7cca01 UNKNOWN * da322a449f6bba3177dc7fb95800eb67bbd3a27b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7263) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7276) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5087: [HUDI-3614] [DO_NOT_MERGE]Replace List with HoodieData in HoodieFlink/JavaTable and commit executors
hudi-bot removed a comment on pull request #5087: URL: https://github.com/apache/hudi/pull/5087#issuecomment-1077404415 ## CI report: * cb5e663b30f62899e8f518b378fa4061b2416f77 UNKNOWN * 8b37774b40dd55ecee05497a4513d06c0233b04f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7233) * 170a4c1691307de27e688e0b043d1477a2a9a65e UNKNOWN * e157958ddf6adb265f9f084aa3dcb26ce0c9cb16 UNKNOWN * 40a5d08a56d88a6f8ef0581ec778c163e4c7675c UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] danny0405 opened a new pull request #5118: [HUDI-3701] Flink bulk_insert support bucket hash index
danny0405 opened a new pull request #5118: URL: https://github.com/apache/hudi/pull/5118 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpose of the pull request *(For example: This pull request adds quick-start document.)* ## Brief change log *(for example:)* - *Modify AnnotationLocation checkstyle rule in checkstyle.xml* ## Verify this pull request *(Please pick either of the following options)* This pull request is a trivial rework / code cleanup without any test coverage. *(or)* This pull request is already covered by existing tests, such as *(please describe tests)*. (or) This change added tests and can be verified as follows: *(example:)* - *Added integration tests for end-to-end.* - *Added HoodieClientWriteTest to verify the change.* - *Manually verified the change by running a job locally.* ## Committer checklist - [ ] Has a corresponding JIRA in PR title & commit - [ ] Commit message is descriptive of the change - [ ] CI is green - [ ] Necessary doc changes done or have another open PR - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HUDI-3701) Flink bulk_insert support bucket hash index
[ https://issues.apache.org/jira/browse/HUDI-3701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3701: - Labels: pull-request-available (was: ) > Flink bulk_insert support bucket hash index > --- > > Key: HUDI-3701 > URL: https://issues.apache.org/jira/browse/HUDI-3701 > Project: Apache Hudi > Issue Type: Improvement > Components: flink >Reporter: Danny Chen >Assignee: Danny Chen >Priority: Major > Labels: pull-request-available > Fix For: 0.11.0 > > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [hudi] hudi-bot commented on pull request #5118: [HUDI-3701] Flink bulk_insert support bucket hash index
hudi-bot commented on pull request #5118: URL: https://github.com/apache/hudi/pull/5118#issuecomment-1077444725 ## CI report: * fd2f26f13b905b1622c7aa629b964bc35a36f98c UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5118: [HUDI-3701] Flink bulk_insert support bucket hash index
hudi-bot commented on pull request #5118: URL: https://github.com/apache/hudi/pull/5118#issuecomment-1077447645 ## CI report: * fd2f26f13b905b1622c7aa629b964bc35a36f98c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7278) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5118: [HUDI-3701] Flink bulk_insert support bucket hash index
hudi-bot removed a comment on pull request #5118: URL: https://github.com/apache/hudi/pull/5118#issuecomment-1077444725 ## CI report: * fd2f26f13b905b1622c7aa629b964bc35a36f98c UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Resolved] (HUDI-3702) ClassCastException throws for HoodieArchivedTimeline#loadInstants
[ https://issues.apache.org/jira/browse/HUDI-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-3702. -- > ClassCastException throws for HoodieArchivedTimeline#loadInstants > - > > Key: HUDI-3702 > URL: https://issues.apache.org/jira/browse/HUDI-3702 > Project: Apache Hudi > Issue Type: Improvement > Components: core >Reporter: Danny Chen >Priority: Major > Fix For: 0.11.0 > > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (HUDI-3702) ClassCastException throws for HoodieArchivedTimeline#loadInstants
[ https://issues.apache.org/jira/browse/HUDI-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511758#comment-17511758 ] Danny Chen commented on HUDI-3702: -- Fixed via master branch: a1c42fcc0708f1838391e3e5c3cb7541b1fcd78f > ClassCastException throws for HoodieArchivedTimeline#loadInstants > - > > Key: HUDI-3702 > URL: https://issues.apache.org/jira/browse/HUDI-3702 > Project: Apache Hudi > Issue Type: Improvement > Components: core >Reporter: Danny Chen >Priority: Major > Fix For: 0.11.0 > > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (HUDI-3702) ClassCastException throws for HoodieArchivedTimeline#loadInstants
Danny Chen created HUDI-3702: Summary: ClassCastException throws for HoodieArchivedTimeline#loadInstants Key: HUDI-3702 URL: https://issues.apache.org/jira/browse/HUDI-3702 Project: Apache Hudi Issue Type: Improvement Components: core Reporter: Danny Chen Fix For: 0.11.0 -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [hudi] danny0405 commented on pull request #5106: [minor] Checks the data block type for archived timeline
danny0405 commented on pull request #5106: URL: https://github.com/apache/hudi/pull/5106#issuecomment-1077462834 Sure, see https://issues.apache.org/jira/browse/HUDI-3702 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] codope merged pull request #5117: [HUDI-3689] Fix glob path and hive sync in deltastreamer tests
codope merged pull request #5117: URL: https://github.com/apache/hudi/pull/5117 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[hudi] branch master updated (a1c42fc -> fe2c398)
This is an automated email from the ASF dual-hosted git repository. codope pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from a1c42fc [minor] Checks the data block type for archived timeline (#5106) add fe2c398 [HUDI-3689] Fix glob path and hive sync in deltastreamer tests (#5117) No new revisions were added by this update. Summary of changes: .../realtime/TestHoodieRealtimeRecordReader.java | 59 .../functional/HoodieDeltaStreamerTestBase.java| 4 +- .../functional/TestHoodieDeltaStreamer.java| 153 +++-- .../TestHoodieDeltaStreamerWithMultiWriter.java| 18 +-- .../TestHoodieMultiTableDeltaStreamer.java | 16 +-- 5 files changed, 130 insertions(+), 120 deletions(-)
[GitHub] [hudi] danny0405 commented on issue #5107: [SUPPORT] High performance costs of AvroSerializer in Datasource writing
danny0405 commented on issue #5107: URL: https://github.com/apache/hudi/issues/5107#issuecomment-1077466306 > @boneanxs True, full support of Dataset is the long term solution. In my experiment, optimizing the usage of `AvroSerializer` could save 80% costs of the source data reading. But the optimization requires modification of the `AvroSerializer` source code in the spark side. > > @qjqqyy Yes, each row will initialize `AvroSerializer` (variables in the lambda named `converter`) Can we copy a `AvroSerializer` currently on Hudi side and just use that ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] codope closed pull request #5109: Remove glob pattern in tests
codope closed pull request #5109: URL: https://github.com/apache/hudi/pull/5109 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …
hudi-bot removed a comment on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1076085738 ## CI report: * e2c21c3c21d88585e0b490729392f34af57716ff Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7226) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …
hudi-bot commented on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1077470827 ## CI report: * e2c21c3c21d88585e0b490729392f34af57716ff Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7226) * 47508afc6fdc87a84cdae0ab5c23f67daa4bc8ff UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …
hudi-bot commented on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1077473825 ## CI report: * e2c21c3c21d88585e0b490729392f34af57716ff Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7226) * 47508afc6fdc87a84cdae0ab5c23f67daa4bc8ff Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7279) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …
hudi-bot removed a comment on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1077470827 ## CI report: * e2c21c3c21d88585e0b490729392f34af57716ff Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7226) * 47508afc6fdc87a84cdae0ab5c23f67daa4bc8ff UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HUDI-3642) NullPointerException during multi-writer conflict resolution
[
https://issues.apache.org/jira/browse/HUDI-3642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sagar Sumit updated HUDI-3642:
--
Status: Patch Available (was: In Progress)
> NullPointerException during multi-writer conflict resolution
>
>
> Key: HUDI-3642
> URL: https://issues.apache.org/jira/browse/HUDI-3642
> Project: Apache Hudi
> Issue Type: Bug
>Reporter: Ethan Guo
>Assignee: Sagar Sumit
>Priority: Blocker
> Labels: pull-request-available
> Fix For: 0.11.0
>
>
> Scenario: multi-writer test, one writer doing ingesting with Deltastreamer
> continuous mode, COW, inserts, async clustering and cleaning (partitions
> under 2022/1, 2022/2), another writer with Spark datasource doing backfills
> to different partitions (2021/12).
> 0.10.0 no MT, clustering instant is inflight (failing it in the middle before
> upgrade) ➝ 0.11 MT, with multi-writer configuration the same as before.
> For 0.10.0, we hit this NPE from backfill job. Need to see if this can
> happen for latest master.
> {code:java}
> java.lang.NullPointerException
> at
> org.apache.hudi.client.transaction.ConcurrentOperation.init(ConcurrentOperation.java:121)
> at
> org.apache.hudi.client.transaction.ConcurrentOperation.(ConcurrentOperation.java:61)
> at
> org.apache.hudi.client.utils.TransactionUtils.lambda$resolveWriteConflictIfAny$0(TransactionUtils.java:69)
> at
> java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384)
> at
> java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:743)
> at
> java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:647)
> at
> org.apache.hudi.client.utils.TransactionUtils.resolveWriteConflictIfAny(TransactionUtils.java:67)
> at
> org.apache.hudi.client.SparkRDDWriteClient.preCommit(SparkRDDWriteClient.java:501)
> at
> org.apache.hudi.client.AbstractHoodieWriteClient.commitStats(AbstractHoodieWriteClient.java:195)
> at
> org.apache.hudi.client.SparkRDDWriteClient.commit(SparkRDDWriteClient.java:124)
> at
> org.apache.hudi.HoodieSparkSqlWriter$.commitAndPerformPostOperations(HoodieSparkSqlWriter.scala:633)
> at
> org.apache.hudi.HoodieSparkSqlWriter$.write(HoodieSparkSqlWriter.scala:284)
> at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:164)
> at
> org.apache.spark.sql.execution.datasources.SaveIntoDataSourceCommand.run(SaveIntoDataSourceCommand.scala:46)
> at
> org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:70)
> at
> org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult(commands.scala:68)
> at
> org.apache.spark.sql.execution.command.ExecutedCommandExec.doExecute(commands.scala:90)
> at
> org.apache.spark.sql.execution.SparkPlan.$anonfun$execute$1(SparkPlan.scala:180)
> at
> org.apache.spark.sql.execution.SparkPlan.$anonfun$executeQuery$1(SparkPlan.scala:218)
> at
> org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
> at
> org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:215)
> at org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:176)
> at
> org.apache.spark.sql.execution.QueryExecution.toRdd$lzycompute(QueryExecution.scala:132)
> at
> org.apache.spark.sql.execution.QueryExecution.toRdd(QueryExecution.scala:131)
> at
> org.apache.spark.sql.DataFrameWriter.$anonfun$runCommand$1(DataFrameWriter.scala:989)
> at
> org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$5(SQLExecution.scala:103)
> at
> org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:163)
> at
> org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$1(SQLExecution.scala:90)
> at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:775)
> at
> org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:64)
> at
> org.apache.spark.sql.DataFrameWriter.runCommand(DataFrameWriter.scala:989)
> at
> org.apache.spark.sql.DataFrameWriter.saveToV1Source(DataFrameWriter.scala:438)
> at
> org.apache.spark.sql.DataFrameWriter.saveInternal(DataFrameWriter.scala:415)
> at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:293)
> at $anonfun$res0$1(backfill_before.scala:57)
> at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:158)
> ... 60 elided {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Updated] (HUDI-3642) NullPointerException during multi-writer conflict resolution
[
https://issues.apache.org/jira/browse/HUDI-3642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sagar Sumit updated HUDI-3642:
--
Status: In Progress (was: Open)
> NullPointerException during multi-writer conflict resolution
>
>
> Key: HUDI-3642
> URL: https://issues.apache.org/jira/browse/HUDI-3642
> Project: Apache Hudi
> Issue Type: Bug
>Reporter: Ethan Guo
>Assignee: Sagar Sumit
>Priority: Blocker
> Labels: pull-request-available
> Fix For: 0.11.0
>
>
> Scenario: multi-writer test, one writer doing ingesting with Deltastreamer
> continuous mode, COW, inserts, async clustering and cleaning (partitions
> under 2022/1, 2022/2), another writer with Spark datasource doing backfills
> to different partitions (2021/12).
> 0.10.0 no MT, clustering instant is inflight (failing it in the middle before
> upgrade) ➝ 0.11 MT, with multi-writer configuration the same as before.
> For 0.10.0, we hit this NPE from backfill job. Need to see if this can
> happen for latest master.
> {code:java}
> java.lang.NullPointerException
> at
> org.apache.hudi.client.transaction.ConcurrentOperation.init(ConcurrentOperation.java:121)
> at
> org.apache.hudi.client.transaction.ConcurrentOperation.(ConcurrentOperation.java:61)
> at
> org.apache.hudi.client.utils.TransactionUtils.lambda$resolveWriteConflictIfAny$0(TransactionUtils.java:69)
> at
> java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384)
> at
> java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:743)
> at
> java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:647)
> at
> org.apache.hudi.client.utils.TransactionUtils.resolveWriteConflictIfAny(TransactionUtils.java:67)
> at
> org.apache.hudi.client.SparkRDDWriteClient.preCommit(SparkRDDWriteClient.java:501)
> at
> org.apache.hudi.client.AbstractHoodieWriteClient.commitStats(AbstractHoodieWriteClient.java:195)
> at
> org.apache.hudi.client.SparkRDDWriteClient.commit(SparkRDDWriteClient.java:124)
> at
> org.apache.hudi.HoodieSparkSqlWriter$.commitAndPerformPostOperations(HoodieSparkSqlWriter.scala:633)
> at
> org.apache.hudi.HoodieSparkSqlWriter$.write(HoodieSparkSqlWriter.scala:284)
> at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:164)
> at
> org.apache.spark.sql.execution.datasources.SaveIntoDataSourceCommand.run(SaveIntoDataSourceCommand.scala:46)
> at
> org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:70)
> at
> org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult(commands.scala:68)
> at
> org.apache.spark.sql.execution.command.ExecutedCommandExec.doExecute(commands.scala:90)
> at
> org.apache.spark.sql.execution.SparkPlan.$anonfun$execute$1(SparkPlan.scala:180)
> at
> org.apache.spark.sql.execution.SparkPlan.$anonfun$executeQuery$1(SparkPlan.scala:218)
> at
> org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
> at
> org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:215)
> at org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:176)
> at
> org.apache.spark.sql.execution.QueryExecution.toRdd$lzycompute(QueryExecution.scala:132)
> at
> org.apache.spark.sql.execution.QueryExecution.toRdd(QueryExecution.scala:131)
> at
> org.apache.spark.sql.DataFrameWriter.$anonfun$runCommand$1(DataFrameWriter.scala:989)
> at
> org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$5(SQLExecution.scala:103)
> at
> org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:163)
> at
> org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$1(SQLExecution.scala:90)
> at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:775)
> at
> org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:64)
> at
> org.apache.spark.sql.DataFrameWriter.runCommand(DataFrameWriter.scala:989)
> at
> org.apache.spark.sql.DataFrameWriter.saveToV1Source(DataFrameWriter.scala:438)
> at
> org.apache.spark.sql.DataFrameWriter.saveInternal(DataFrameWriter.scala:415)
> at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:293)
> at $anonfun$res0$1(backfill_before.scala:57)
> at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:158)
> ... 60 elided {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Closed] (HUDI-3642) NullPointerException during multi-writer conflict resolution
[
https://issues.apache.org/jira/browse/HUDI-3642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sagar Sumit closed HUDI-3642.
-
Resolution: Fixed
> NullPointerException during multi-writer conflict resolution
>
>
> Key: HUDI-3642
> URL: https://issues.apache.org/jira/browse/HUDI-3642
> Project: Apache Hudi
> Issue Type: Bug
>Reporter: Ethan Guo
>Assignee: Sagar Sumit
>Priority: Blocker
> Labels: pull-request-available
> Fix For: 0.11.0
>
>
> Scenario: multi-writer test, one writer doing ingesting with Deltastreamer
> continuous mode, COW, inserts, async clustering and cleaning (partitions
> under 2022/1, 2022/2), another writer with Spark datasource doing backfills
> to different partitions (2021/12).
> 0.10.0 no MT, clustering instant is inflight (failing it in the middle before
> upgrade) ➝ 0.11 MT, with multi-writer configuration the same as before.
> For 0.10.0, we hit this NPE from backfill job. Need to see if this can
> happen for latest master.
> {code:java}
> java.lang.NullPointerException
> at
> org.apache.hudi.client.transaction.ConcurrentOperation.init(ConcurrentOperation.java:121)
> at
> org.apache.hudi.client.transaction.ConcurrentOperation.(ConcurrentOperation.java:61)
> at
> org.apache.hudi.client.utils.TransactionUtils.lambda$resolveWriteConflictIfAny$0(TransactionUtils.java:69)
> at
> java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384)
> at
> java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:743)
> at
> java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:647)
> at
> org.apache.hudi.client.utils.TransactionUtils.resolveWriteConflictIfAny(TransactionUtils.java:67)
> at
> org.apache.hudi.client.SparkRDDWriteClient.preCommit(SparkRDDWriteClient.java:501)
> at
> org.apache.hudi.client.AbstractHoodieWriteClient.commitStats(AbstractHoodieWriteClient.java:195)
> at
> org.apache.hudi.client.SparkRDDWriteClient.commit(SparkRDDWriteClient.java:124)
> at
> org.apache.hudi.HoodieSparkSqlWriter$.commitAndPerformPostOperations(HoodieSparkSqlWriter.scala:633)
> at
> org.apache.hudi.HoodieSparkSqlWriter$.write(HoodieSparkSqlWriter.scala:284)
> at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:164)
> at
> org.apache.spark.sql.execution.datasources.SaveIntoDataSourceCommand.run(SaveIntoDataSourceCommand.scala:46)
> at
> org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:70)
> at
> org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult(commands.scala:68)
> at
> org.apache.spark.sql.execution.command.ExecutedCommandExec.doExecute(commands.scala:90)
> at
> org.apache.spark.sql.execution.SparkPlan.$anonfun$execute$1(SparkPlan.scala:180)
> at
> org.apache.spark.sql.execution.SparkPlan.$anonfun$executeQuery$1(SparkPlan.scala:218)
> at
> org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
> at
> org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:215)
> at org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:176)
> at
> org.apache.spark.sql.execution.QueryExecution.toRdd$lzycompute(QueryExecution.scala:132)
> at
> org.apache.spark.sql.execution.QueryExecution.toRdd(QueryExecution.scala:131)
> at
> org.apache.spark.sql.DataFrameWriter.$anonfun$runCommand$1(DataFrameWriter.scala:989)
> at
> org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$5(SQLExecution.scala:103)
> at
> org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:163)
> at
> org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$1(SQLExecution.scala:90)
> at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:775)
> at
> org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:64)
> at
> org.apache.spark.sql.DataFrameWriter.runCommand(DataFrameWriter.scala:989)
> at
> org.apache.spark.sql.DataFrameWriter.saveToV1Source(DataFrameWriter.scala:438)
> at
> org.apache.spark.sql.DataFrameWriter.saveInternal(DataFrameWriter.scala:415)
> at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:293)
> at $anonfun$res0$1(backfill_before.scala:57)
> at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:158)
> ... 60 elided {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[GitHub] [hudi] hudi-bot removed a comment on pull request #5104: [WIP] Different CI fixes - for verification only
hudi-bot removed a comment on pull request #5104: URL: https://github.com/apache/hudi/pull/5104#issuecomment-1077320238 ## CI report: * b9559f24b359eb3c123cfbca901e0489c85f569f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7272) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5104: [WIP] Different CI fixes - for verification only
hudi-bot commented on pull request #5104: URL: https://github.com/apache/hudi/pull/5104#issuecomment-1077494323 ## CI report: * b9559f24b359eb3c123cfbca901e0489c85f569f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7272) * 8dfa954c583c8c765bbd2f75ec43512e687af3d1 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5104: [WIP] Different CI fixes - for verification only
hudi-bot removed a comment on pull request #5104: URL: https://github.com/apache/hudi/pull/5104#issuecomment-1077494323 ## CI report: * b9559f24b359eb3c123cfbca901e0489c85f569f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7272) * 8dfa954c583c8c765bbd2f75ec43512e687af3d1 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5104: [WIP] Different CI fixes - for verification only
hudi-bot commented on pull request #5104: URL: https://github.com/apache/hudi/pull/5104#issuecomment-1077497052 ## CI report: * b9559f24b359eb3c123cfbca901e0489c85f569f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7272) * 8dfa954c583c8c765bbd2f75ec43512e687af3d1 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7281) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5118: [HUDI-3701] Flink bulk_insert support bucket hash index
hudi-bot removed a comment on pull request #5118: URL: https://github.com/apache/hudi/pull/5118#issuecomment-1077447645 ## CI report: * fd2f26f13b905b1622c7aa629b964bc35a36f98c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7278) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5118: [HUDI-3701] Flink bulk_insert support bucket hash index
hudi-bot commented on pull request #5118: URL: https://github.com/apache/hudi/pull/5118#issuecomment-1077499840 ## CI report: * fd2f26f13b905b1622c7aa629b964bc35a36f98c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7278) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4693: [WIP][HUDI-3175][RFC-45] Implement async metadata indexing
hudi-bot removed a comment on pull request #4693: URL: https://github.com/apache/hudi/pull/4693#issuecomment-1073760182 ## CI report: * 1f9e535ef629c8b35c5edc2cfd5687b2d55c29f2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7124) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4693: [WIP][HUDI-3175][RFC-45] Implement async metadata indexing
hudi-bot commented on pull request #4693: URL: https://github.com/apache/hudi/pull/4693#issuecomment-1077501985 ## CI report: * 1f9e535ef629c8b35c5edc2cfd5687b2d55c29f2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7124) * e58990e296aa5125807a4b96269fa7a06c885e69 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4693: [WIP][HUDI-3175][RFC-45] Implement async metadata indexing
hudi-bot removed a comment on pull request #4693: URL: https://github.com/apache/hudi/pull/4693#issuecomment-1077501985 ## CI report: * 1f9e535ef629c8b35c5edc2cfd5687b2d55c29f2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7124) * e58990e296aa5125807a4b96269fa7a06c885e69 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4693: [WIP][HUDI-3175][RFC-45] Implement async metadata indexing
hudi-bot commented on pull request #4693: URL: https://github.com/apache/hudi/pull/4693#issuecomment-1077504732 ## CI report: * 1f9e535ef629c8b35c5edc2cfd5687b2d55c29f2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7124) * e58990e296aa5125807a4b96269fa7a06c885e69 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7282) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] qjqqyy commented on issue #5107: [SUPPORT] High performance costs of AvroSerializer in Datasource writing
qjqqyy commented on issue #5107:
URL: https://github.com/apache/hudi/issues/5107#issuecomment-1077508202
> @qjqqyy Yes, each row will initialize `AvroSerializer` (variables in the
lambda named `converter`)
the reason why `converter` is re-initialized for each row is because a `new
AvroSerializer()` (explicit object creation) is happening for each row.
I did some tests, exact same dataset.
git master
https://user-images.githubusercontent.com/8439769/159903075-067f3271-1ac0-4919-be25-8429d515fbae.png";>
with the patch from earlier comment
https://user-images.githubusercontent.com/8439769/159903248-06f45a7a-301e-40b3-a2ca-36cdf988766f.png";>
Seems like it's a regression introduced in #4789
* before: 1 invocation of `new AvroSerializer()` for each partition
* after: 1 invocation of `new AvroSerializer()` for each row
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[jira] [Updated] (HUDI-3702) ClassCastException throws for HoodieArchivedTimeline#loadInstants
[ https://issues.apache.org/jira/browse/HUDI-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3702: - Component/s: flink > ClassCastException throws for HoodieArchivedTimeline#loadInstants > - > > Key: HUDI-3702 > URL: https://issues.apache.org/jira/browse/HUDI-3702 > Project: Apache Hudi > Issue Type: Improvement > Components: core, flink >Reporter: Danny Chen >Priority: Major > Fix For: 0.11.0 > > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Closed] (HUDI-3702) ClassCastException throws for HoodieArchivedTimeline#loadInstants
[ https://issues.apache.org/jira/browse/HUDI-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-3702. Assignee: Danny Chen Resolution: Fixed > ClassCastException throws for HoodieArchivedTimeline#loadInstants > - > > Key: HUDI-3702 > URL: https://issues.apache.org/jira/browse/HUDI-3702 > Project: Apache Hudi > Issue Type: Improvement > Components: core, flink >Reporter: Danny Chen >Assignee: Danny Chen >Priority: Major > Fix For: 0.11.0 > > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [hudi] hudi-bot commented on pull request #5087: [HUDI-3614] [DO_NOT_MERGE]Replace List with HoodieData in HoodieFlink/JavaTable and commit executors
hudi-bot commented on pull request #5087: URL: https://github.com/apache/hudi/pull/5087#issuecomment-1077519258 ## CI report: * cb5e663b30f62899e8f518b378fa4061b2416f77 UNKNOWN * 170a4c1691307de27e688e0b043d1477a2a9a65e UNKNOWN * e157958ddf6adb265f9f084aa3dcb26ce0c9cb16 UNKNOWN * 40a5d08a56d88a6f8ef0581ec778c163e4c7675c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7277) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5087: [HUDI-3614] [DO_NOT_MERGE]Replace List with HoodieData in HoodieFlink/JavaTable and commit executors
hudi-bot removed a comment on pull request #5087: URL: https://github.com/apache/hudi/pull/5087#issuecomment-1077438543 ## CI report: * cb5e663b30f62899e8f518b378fa4061b2416f77 UNKNOWN * 8b37774b40dd55ecee05497a4513d06c0233b04f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7233) * 170a4c1691307de27e688e0b043d1477a2a9a65e UNKNOWN * e157958ddf6adb265f9f084aa3dcb26ce0c9cb16 UNKNOWN * 40a5d08a56d88a6f8ef0581ec778c163e4c7675c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7277) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] XuQianJin-Stars opened a new pull request #5119: [WIP][website] add doc for procedures
XuQianJin-Stars opened a new pull request #5119: URL: https://github.com/apache/hudi/pull/5119 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpose of the pull request *(For example: This pull request adds quick-start document.)* ## Brief change log *(for example:)* - *Modify AnnotationLocation checkstyle rule in checkstyle.xml* ## Verify this pull request *(Please pick either of the following options)* This pull request is a trivial rework / code cleanup without any test coverage. *(or)* This pull request is already covered by existing tests, such as *(please describe tests)*. (or) This change added tests and can be verified as follows: *(example:)* - *Added integration tests for end-to-end.* - *Added HoodieClientWriteTest to verify the change.* - *Manually verified the change by running a job locally.* ## Committer checklist - [ ] Has a corresponding JIRA in PR title & commit - [ ] Commit message is descriptive of the change - [ ] CI is green - [ ] Necessary doc changes done or have another open PR - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4693: [WIP][HUDI-3175][RFC-45] Implement async metadata indexing
hudi-bot removed a comment on pull request #4693: URL: https://github.com/apache/hudi/pull/4693#issuecomment-1077504732 ## CI report: * 1f9e535ef629c8b35c5edc2cfd5687b2d55c29f2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7124) * e58990e296aa5125807a4b96269fa7a06c885e69 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7282) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4693: [WIP][HUDI-3175][RFC-45] Implement async metadata indexing
hudi-bot commented on pull request #4693: URL: https://github.com/apache/hudi/pull/4693#issuecomment-1077538114 ## CI report: * 1f9e535ef629c8b35c5edc2cfd5687b2d55c29f2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7124) * e58990e296aa5125807a4b96269fa7a06c885e69 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7282) * 32cfdbf4524384a7fb8220be6e822dc510cf173b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4693: [WIP][HUDI-3175][RFC-45] Implement async metadata indexing
hudi-bot removed a comment on pull request #4693: URL: https://github.com/apache/hudi/pull/4693#issuecomment-1077538114 ## CI report: * 1f9e535ef629c8b35c5edc2cfd5687b2d55c29f2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7124) * e58990e296aa5125807a4b96269fa7a06c885e69 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7282) * 32cfdbf4524384a7fb8220be6e822dc510cf173b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4693: [WIP][HUDI-3175][RFC-45] Implement async metadata indexing
hudi-bot commented on pull request #4693: URL: https://github.com/apache/hudi/pull/4693#issuecomment-1077540636 ## CI report: * e58990e296aa5125807a4b96269fa7a06c885e69 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7282) * 32cfdbf4524384a7fb8220be6e822dc510cf173b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …
hudi-bot commented on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1077540793 ## CI report: * 47508afc6fdc87a84cdae0ab5c23f67daa4bc8ff Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7279) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …
hudi-bot removed a comment on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1077473825 ## CI report: * e2c21c3c21d88585e0b490729392f34af57716ff Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7226) * 47508afc6fdc87a84cdae0ab5c23f67daa4bc8ff Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7279) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4693: [WIP][HUDI-3175][RFC-45] Implement async metadata indexing
hudi-bot removed a comment on pull request #4693: URL: https://github.com/apache/hudi/pull/4693#issuecomment-1077540636 ## CI report: * e58990e296aa5125807a4b96269fa7a06c885e69 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7282) * 32cfdbf4524384a7fb8220be6e822dc510cf173b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4693: [WIP][HUDI-3175][RFC-45] Implement async metadata indexing
hudi-bot commented on pull request #4693: URL: https://github.com/apache/hudi/pull/4693#issuecomment-1077556653 ## CI report: * e58990e296aa5125807a4b96269fa7a06c885e69 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7282) * 32cfdbf4524384a7fb8220be6e822dc510cf173b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7283) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] codope merged pull request #5102: [HUDI-3684] Fixing NPE in `ParquetUtils`
codope merged pull request #5102: URL: https://github.com/apache/hudi/pull/5102 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[hudi] branch master updated: [HUDI-3684] Fixing NPE in `ParquetUtils` (#5102)
This is an automated email from the ASF dual-hosted git repository.
codope pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new ccc3728 [HUDI-3684] Fixing NPE in `ParquetUtils` (#5102)
ccc3728 is described below
commit ccc3728002533978cb35b3b4c22cb4d0ef087347
Author: Alexey Kudinkin
AuthorDate: Thu Mar 24 05:07:38 2022 -0700
[HUDI-3684] Fixing NPE in `ParquetUtils` (#5102)
* Make sure nulls are properly handled in `HoodieColumnRangeMetadata`
---
.../common/model/HoodieColumnRangeMetadata.java| 58 ++
.../org/apache/hudi/common/util/ParquetUtils.java | 29 ---
.../hudi/metadata/HoodieTableMetadataUtil.java | 9 ++--
.../utilities/HoodieMetadataTableValidator.java| 4 +-
4 files changed, 75 insertions(+), 25 deletions(-)
diff --git
a/hudi-common/src/main/java/org/apache/hudi/common/model/HoodieColumnRangeMetadata.java
b/hudi-common/src/main/java/org/apache/hudi/common/model/HoodieColumnRangeMetadata.java
index d098c4f..2afbd19 100644
---
a/hudi-common/src/main/java/org/apache/hudi/common/model/HoodieColumnRangeMetadata.java
+++
b/hudi-common/src/main/java/org/apache/hudi/common/model/HoodieColumnRangeMetadata.java
@@ -18,19 +18,27 @@
package org.apache.hudi.common.model;
+import javax.annotation.Nullable;
import java.io.Serializable;
-import java.util.Arrays;
import java.util.Comparator;
import java.util.Objects;
import java.util.function.BiFunction;
+import java.util.stream.Stream;
/**
- * Hoodie Range metadata.
+ * Hoodie metadata for the column range of data stored in columnar format
(like Parquet)
+ *
+ * NOTE: {@link Comparable} is used as raw-type so that we can handle
polymorphism, where
+ *caller apriori is not aware of the type {@link
HoodieColumnRangeMetadata} is
+ *associated with
*/
-public class HoodieColumnRangeMetadata implements Serializable {
+@SuppressWarnings("rawtype")
+public class HoodieColumnRangeMetadata implements
Serializable {
private final String filePath;
private final String columnName;
+ @Nullable
private final T minValue;
+ @Nullable
private final T maxValue;
private final long nullCount;
private final long valueCount;
@@ -38,21 +46,30 @@ public class HoodieColumnRangeMetadata implements
Serializable {
private final long totalUncompressedSize;
public static final BiFunction,
HoodieColumnRangeMetadata, HoodieColumnRangeMetadata>
COLUMN_RANGE_MERGE_FUNCTION =
- (oldColumnRange, newColumnRange) -> new HoodieColumnRangeMetadata<>(
+ (oldColumnRange, newColumnRange) -> new
HoodieColumnRangeMetadata(
newColumnRange.getFilePath(),
newColumnRange.getColumnName(),
- (Comparable) Arrays.asList(oldColumnRange.getMinValue(),
newColumnRange.getMinValue())
-
.stream().filter(Objects::nonNull).min(Comparator.naturalOrder()).orElse(null),
- (Comparable) Arrays.asList(oldColumnRange.getMinValue(),
newColumnRange.getMinValue())
-
.stream().filter(Objects::nonNull).max(Comparator.naturalOrder()).orElse(null),
+ (Comparable) Stream.of(oldColumnRange.getMinValue(),
newColumnRange.getMinValue())
+ .filter(Objects::nonNull)
+ .min(Comparator.naturalOrder())
+ .orElse(null),
+ (Comparable) Stream.of(oldColumnRange.getMinValue(),
newColumnRange.getMinValue())
+ .filter(Objects::nonNull)
+ .max(Comparator.naturalOrder()).orElse(null),
oldColumnRange.getNullCount() + newColumnRange.getNullCount(),
oldColumnRange.getValueCount() + newColumnRange.getValueCount(),
oldColumnRange.getTotalSize() + newColumnRange.getTotalSize(),
oldColumnRange.getTotalUncompressedSize() +
newColumnRange.getTotalUncompressedSize()
);
- public HoodieColumnRangeMetadata(final String filePath, final String
columnName, final T minValue, final T maxValue,
- final long nullCount, long valueCount, long
totalSize, long totalUncompressedSize) {
+ private HoodieColumnRangeMetadata(String filePath,
+String columnName,
+@Nullable T minValue,
+@Nullable T maxValue,
+long nullCount,
+long valueCount,
+long totalSize,
+long totalUncompressedSize) {
this.filePath = filePath;
this.columnName = columnName;
this.minValue = minValue;
@@ -71,10 +88,12 @@ public class HoodieColumnRangeMetadata implements
Serializable {
return this.columnName;
}
+ @Nullable
public T getMinValue() {
return this.minValue;
}
+ @Nullable
public T getMaxValue() {
return this
[GitHub] [hudi] hudi-bot removed a comment on pull request #4676: [HUDI-3304] support partial update on mor table
hudi-bot removed a comment on pull request #4676: URL: https://github.com/apache/hudi/pull/4676#issuecomment-1076125475 ## CI report: * 48fda2781feed8dd80e5a6da619cf958139168ab Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7225) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4676: [HUDI-3304] support partial update on mor table
hudi-bot commented on pull request #4676: URL: https://github.com/apache/hudi/pull/4676#issuecomment-1077559508 ## CI report: * 48fda2781feed8dd80e5a6da619cf958139168ab Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7225) * f39affd6e0a1952556ba4123465d7b0b7a5e8d79 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4676: [HUDI-3304] support partial update on mor table
hudi-bot removed a comment on pull request #4676: URL: https://github.com/apache/hudi/pull/4676#issuecomment-1077559508 ## CI report: * 48fda2781feed8dd80e5a6da619cf958139168ab Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7225) * f39affd6e0a1952556ba4123465d7b0b7a5e8d79 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4676: [HUDI-3304] support partial update on mor table
hudi-bot commented on pull request #4676: URL: https://github.com/apache/hudi/pull/4676#issuecomment-1077562356 ## CI report: * 48fda2781feed8dd80e5a6da619cf958139168ab Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7225) * f39affd6e0a1952556ba4123465d7b0b7a5e8d79 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7284) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4945: [HUDI-3538] Support Compaction Command Based on Call Procedure Command for Spark SQL
hudi-bot commented on pull request #4945: URL: https://github.com/apache/hudi/pull/4945#issuecomment-1077562667 ## CI report: * 99ded14032313e545df5c560f0008a1d564db77a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7244) * 9b8546c1182d7bc9a4e95341a7c9e1d8f4e1f3a5 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4945: [HUDI-3538] Support Compaction Command Based on Call Procedure Command for Spark SQL
hudi-bot removed a comment on pull request #4945: URL: https://github.com/apache/hudi/pull/4945#issuecomment-1076469225 ## CI report: * 99ded14032313e545df5c560f0008a1d564db77a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7244) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] danny0405 commented on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …
danny0405 commented on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1077564335 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4945: [HUDI-3538] Support Compaction Command Based on Call Procedure Command for Spark SQL
hudi-bot removed a comment on pull request #4945: URL: https://github.com/apache/hudi/pull/4945#issuecomment-1077562667 ## CI report: * 99ded14032313e545df5c560f0008a1d564db77a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7244) * 9b8546c1182d7bc9a4e95341a7c9e1d8f4e1f3a5 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …
hudi-bot commented on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1077565307 ## CI report: * 47508afc6fdc87a84cdae0ab5c23f67daa4bc8ff Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7279) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7286) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …
hudi-bot removed a comment on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1077540793 ## CI report: * 47508afc6fdc87a84cdae0ab5c23f67daa4bc8ff Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7279) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4945: [HUDI-3538] Support Compaction Command Based on Call Procedure Command for Spark SQL
hudi-bot commented on pull request #4945: URL: https://github.com/apache/hudi/pull/4945#issuecomment-1077565485 ## CI report: * 99ded14032313e545df5c560f0008a1d564db77a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7244) * 9b8546c1182d7bc9a4e95341a7c9e1d8f4e1f3a5 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7285) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] xushiyan opened a new pull request #5120: [HUDI-3689] Fix UT failures in TestHoodieDeltaStreamer
xushiyan opened a new pull request #5120: URL: https://github.com/apache/hudi/pull/5120 - upgrade to 3.0.0-M5 - remove unused TestUtilHelpers.java - remove duplicate TestHiveSyncGlobalCommitTool - fix UT failure with `partition_path` not found -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5120: [HUDI-3689] Fix UT failures in TestHoodieDeltaStreamer
hudi-bot commented on pull request #5120: URL: https://github.com/apache/hudi/pull/5120#issuecomment-1077571210 ## CI report: * ead3167ac8b2ec47862d2fa8e7a55b8d1ae9374c UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5104: [WIP] Different CI fixes - for verification only
hudi-bot removed a comment on pull request #5104: URL: https://github.com/apache/hudi/pull/5104#issuecomment-1077497052 ## CI report: * b9559f24b359eb3c123cfbca901e0489c85f569f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7272) * 8dfa954c583c8c765bbd2f75ec43512e687af3d1 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7281) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5120: [HUDI-3689] Fix UT failures in TestHoodieDeltaStreamer
hudi-bot commented on pull request #5120: URL: https://github.com/apache/hudi/pull/5120#issuecomment-1077574031 ## CI report: * ead3167ac8b2ec47862d2fa8e7a55b8d1ae9374c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7288) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #5120: [HUDI-3689] Fix UT failures in TestHoodieDeltaStreamer
hudi-bot removed a comment on pull request #5120: URL: https://github.com/apache/hudi/pull/5120#issuecomment-1077571210 ## CI report: * ead3167ac8b2ec47862d2fa8e7a55b8d1ae9374c UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5104: [WIP] Different CI fixes - for verification only
hudi-bot commented on pull request #5104: URL: https://github.com/apache/hudi/pull/5104#issuecomment-1077573963 ## CI report: * 8dfa954c583c8c765bbd2f75ec43512e687af3d1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7281) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] xushiyan opened a new pull request #5121: [HUDI-3689] Remove Azure CI cache
xushiyan opened a new pull request #5121: URL: https://github.com/apache/hudi/pull/5121 The cache task does not make mvn install faster, removing it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5121: [HUDI-3689] Remove Azure CI cache
hudi-bot commented on pull request #5121: URL: https://github.com/apache/hudi/pull/5121#issuecomment-1077579331 ## CI report: * 551aefae17b9d963ee261487ad34e3a47ac17ee9 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
