[jira] [Created] (HUDI-2125) Create a public dataset and guideline/playbook for use by public

2021-07-02 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2125: - Summary: Create a public dataset and guideline/playbook for use by public Key: HUDI-2125 URL: https://issues.apache.org/jira/browse/HUDI-2125 Project: Apach

[jira] [Created] (HUDI-2140) Test failure : TestHoodieBackedMetadata.testOnlyValidPartitionsAdded

2021-07-06 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2140: - Summary: Test failure : TestHoodieBackedMetadata.testOnlyValidPartitionsAdded Key: HUDI-2140 URL: https://issues.apache.org/jira/browse/HUDI-2140 Project: A

[jira] [Updated] (HUDI-2140) Test failure : TestHoodieBackedMetadata.testOnlyValidPartitionsAdded

2021-07-06 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2140: -- Description: master is broken with this test failure:  [https://api.travis-ci.com/v3/jo

[jira] [Updated] (HUDI-2140) Test failure : TestHoodieBackedMetadata.testOnlyValidPartitionsAdded

2021-07-07 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2140: -- Status: Patch Available (was: In Progress) > Test failure : TestHoodieBackedMetadata.te

[jira] [Updated] (HUDI-2140) Test failure : TestHoodieBackedMetadata.testOnlyValidPartitionsAdded

2021-07-07 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2140: -- Status: In Progress (was: Open) > Test failure : TestHoodieBackedMetadata.testOnlyValid

[jira] [Closed] (HUDI-2140) Test failure : TestHoodieBackedMetadata.testOnlyValidPartitionsAdded

2021-07-07 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-2140. - Resolution: Fixed > Test failure : TestHoodieBackedMetadata.testOnlyValidPartitionsAdded >

[jira] [Updated] (HUDI-2140) Test failure : TestHoodieBackedMetadata.testOnlyValidPartitionsAdded

2021-07-07 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2140: -- Status: Closed (was: Patch Available) > Test failure : TestHoodieBackedMetadata.testOnl

[jira] [Reopened] (HUDI-2140) Test failure : TestHoodieBackedMetadata.testOnlyValidPartitionsAdded

2021-07-07 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reopened HUDI-2140: --- > Test failure : TestHoodieBackedMetadata.testOnlyValidPartitionsAdded > -

[jira] [Commented] (HUDI-1248) [UMBRELLA] Tests cleanup and fixes

2021-07-07 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377107#comment-17377107 ] sivabalan narayanan commented on HUDI-1248: --- [ERROR] Errors: [ERROR] TestHoodie

[jira] [Created] (HUDI-2160) [UMBRELLA] Add support to disable meta columns / virtual keys

2021-07-10 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2160: - Summary: [UMBRELLA] Add support to disable meta columns / virtual keys Key: HUDI-2160 URL: https://issues.apache.org/jira/browse/HUDI-2160 Project: Apache H

[jira] [Created] (HUDI-2161) Add support to disable meta column to BulkInsert Row Writer path

2021-07-10 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2161: - Summary: Add support to disable meta column to BulkInsert Row Writer path Key: HUDI-2161 URL: https://issues.apache.org/jira/browse/HUDI-2161 Project: Apach

[jira] [Created] (HUDI-2175) Support dynamic schemas with hudi

2021-07-13 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2175: - Summary: Support dynamic schemas with hudi Key: HUDI-2175 URL: https://issues.apache.org/jira/browse/HUDI-2175 Project: Apache Hudi Issue Type: Imp

[jira] [Updated] (HUDI-2175) Support dynamic schemas with hudi

2021-07-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2175: -- Component/s: Common Core > Support dynamic schemas with hudi > -

[jira] [Updated] (HUDI-2176) Virutal keys support for COW all operations

2021-07-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2176: -- Fix Version/s: 0.9.0 > Virutal keys support for COW all operations > ---

[jira] [Created] (HUDI-2176) Virutal keys support for COW all operations

2021-07-13 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2176: - Summary: Virutal keys support for COW all operations Key: HUDI-2176 URL: https://issues.apache.org/jira/browse/HUDI-2176 Project: Apache Hudi Issue

[jira] [Created] (HUDI-2178) Virtual keys support for Clustering

2021-07-13 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2178: - Summary: Virtual keys support for Clustering Key: HUDI-2178 URL: https://issues.apache.org/jira/browse/HUDI-2178 Project: Apache Hudi Issue Type: I

[jira] [Created] (HUDI-2177) Virtual keys support for Compaction

2021-07-13 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2177: - Summary: Virtual keys support for Compaction Key: HUDI-2177 URL: https://issues.apache.org/jira/browse/HUDI-2177 Project: Apache Hudi Issue Type: I

[jira] [Created] (HUDI-2179) Virtual keys support for Metadata table

2021-07-13 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2179: - Summary: Virtual keys support for Metadata table Key: HUDI-2179 URL: https://issues.apache.org/jira/browse/HUDI-2179 Project: Apache Hudi Issue Typ

[jira] [Updated] (HUDI-2177) Virtual keys support for Compaction

2021-07-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2177: -- Fix Version/s: 0.9.0 > Virtual keys support for Compaction > ---

[jira] [Updated] (HUDI-2179) Virtual keys support for Metadata table

2021-07-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2179: -- Fix Version/s: 0.9.0 > Virtual keys support for Metadata table > ---

[jira] [Updated] (HUDI-2178) Virtual keys support for Clustering

2021-07-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2178: -- Fix Version/s: 0.9.0 > Virtual keys support for Clustering > ---

[jira] [Commented] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17042030#comment-17042030 ] sivabalan narayanan commented on HUDI-625: -- I am getting something similar to lamb

[jira] [Commented] (HUDI-625) Address performance concerns on DiskBasedMap.get() during upsert of thin records

2020-02-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17042035#comment-17042035 ] sivabalan narayanan commented on HUDI-625: -- oh, I see you tested string, string an

[jira] [Commented] (HUDI-407) Implement a join-based index

2020-03-04 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17051802#comment-17051802 ] sivabalan narayanan commented on HUDI-407: -- yes. sure. > Implement a join-based i

[jira] [Commented] (HUDI-432) Benchmark HFile for scan vs seek

2020-03-09 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17054711#comment-17054711 ] sivabalan narayanan commented on HUDI-432: -- [~vinoth]: guess you were looking at s

[jira] [Updated] (HUDI-432) Benchmark HFile for scan vs seek

2020-03-09 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-432: - Attachment: HFile benchmark_withS3.xlsx > Benchmark HFile for scan vs seek > --

[jira] [Commented] (HUDI-432) Benchmark HFile for scan vs seek

2020-03-09 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17054712#comment-17054712 ] sivabalan narayanan commented on HUDI-432: -- Here are the S3 nos. Inclination is ar

[jira] [Updated] (HUDI-432) Benchmark HFile for scan vs seek

2020-03-09 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-432: - Attachment: Screen Shot 2020-03-09 at 12.22.54 AM.png > Benchmark HFile for scan vs seek >

[jira] [Commented] (HUDI-432) Benchmark HFile for scan vs seek

2020-03-09 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17054714#comment-17054714 ] sivabalan narayanan commented on HUDI-432: -- !Screen Shot 2020-03-09 at 12.22.54 AM

[jira] [Commented] (HUDI-432) Benchmark HFile for scan vs seek

2020-03-09 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17054719#comment-17054719 ] sivabalan narayanan commented on HUDI-432: -- yes.  > Benchmark HFile for scan vs s

[jira] [Comment Edited] (HUDI-432) Benchmark HFile for scan vs seek

2020-03-09 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17054719#comment-17054719 ] sivabalan narayanan edited comment on HUDI-432 at 3/9/20, 7:33 AM: --

[jira] [Commented] (HUDI-667) HoodieTestDataGenerator does not delete keys correctly

2020-03-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058905#comment-17058905 ] sivabalan narayanan commented on HUDI-667: -- thanks Pratyaksh for responding. [~pw

[jira] [Assigned] (HUDI-667) HoodieTestDataGenerator does not delete keys correctly

2020-03-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-667: Assignee: sivabalan narayanan > HoodieTestDataGenerator does not delete keys correct

[jira] [Resolved] (HUDI-667) HoodieTestDataGenerator does not delete keys correctly

2020-03-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-667. -- Fix Version/s: 0.6.0 Resolution: Fixed > HoodieTestDataGenerator does not delete k

[jira] [Commented] (HUDI-686) Implement BloomIndexV2 that does not depend on memory caching

2020-03-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17064472#comment-17064472 ] sivabalan narayanan commented on HUDI-686: -- Interesting impl [~vinoth] . Some init

[jira] [Commented] (HUDI-686) Implement BloomIndexV2 that does not depend on memory caching

2020-03-27 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17069083#comment-17069083 ] sivabalan narayanan commented on HUDI-686: -- yeah,  was about to respond to lander-

[jira] [Created] (HUDI-817) Wrong index filter condition check in HoodieGlobalBloomIndex

2020-04-20 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-817: Summary: Wrong index filter condition check in HoodieGlobalBloomIndex Key: HUDI-817 URL: https://issues.apache.org/jira/browse/HUDI-817 Project: Apache Hudi (

[jira] [Commented] (HUDI-351) Implement Range + Bloom Filter checking in one go to improve speed of index

2020-04-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17088208#comment-17088208 ] sivabalan narayanan commented on HUDI-351: -- [~vinoth]: Do you think we still need

[jira] [Created] (HUDI-1535) Hudi spark datasource fails w/ NoClassDefFoundError: org/apache/hudi/client/common/HoodieEngineContext

2021-01-18 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-1535: - Summary: Hudi spark datasource fails w/ NoClassDefFoundError: org/apache/hudi/client/common/HoodieEngineContext Key: HUDI-1535 URL: https://issues.apache.org/jira/browse

[jira] [Updated] (HUDI-1535) Hudi spark datasource fails w/ NoClassDefFoundError: org/apache/hudi/client/common/HoodieEngineContext

2021-01-18 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1535: -- Labels: release-blocker (was: ) > Hudi spark datasource fails w/ NoClassDefFoundError:

[jira] [Commented] (HUDI-1535) Hudi spark datasource fails w/ NoClassDefFoundError: org/apache/hudi/client/common/HoodieEngineContext

2021-01-18 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17267358#comment-17267358 ] sivabalan narayanan commented on HUDI-1535: --- I also ran test suite job and ran i

[jira] [Comment Edited] (HUDI-1535) Hudi spark datasource fails w/ NoClassDefFoundError: org/apache/hudi/client/common/HoodieEngineContext

2021-01-18 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17267358#comment-17267358 ] sivabalan narayanan edited comment on HUDI-1535 at 1/18/21, 3:34 PM: ---

[jira] [Created] (HUDI-1540) Fix commons-codec shading in hudi-spark-bundle

2021-01-19 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-1540: - Summary: Fix commons-codec shading in hudi-spark-bundle Key: HUDI-1540 URL: https://issues.apache.org/jira/browse/HUDI-1540 Project: Apache Hudi Is

[jira] [Reopened] (HUDI-1540) Fix commons-codec shading in hudi-spark-bundle

2021-01-19 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reopened HUDI-1540: --- Assignee: sivabalan narayanan > Fix commons-codec shading in hudi-spark-bundle > -

[jira] [Updated] (HUDI-1540) Fix commons-codec shading in hudi-spark-bundle

2021-01-19 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1540: -- Status: In Progress (was: Open) > Fix commons-codec shading in hudi-spark-bundle >

[jira] [Updated] (HUDI-1540) Fix commons-codec shading in hudi-spark-bundle

2021-01-19 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1540: -- Status: Patch Available (was: In Progress) > Fix commons-codec shading in hudi-spark-bu

[jira] [Updated] (HUDI-1540) Fix commons-codec shading in hudi-spark-bundle

2021-01-19 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1540: -- Status: Closed (was: Patch Available) > Fix commons-codec shading in hudi-spark-bundle

[jira] [Resolved] (HUDI-1540) Fix commons-codec shading in hudi-spark-bundle

2021-01-19 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-1540. --- Fix Version/s: 0.7.0 Resolution: Fixed > Fix commons-codec shading in hudi-spar

[jira] [Updated] (HUDI-1523) Avoid excessive mkdir calls when creating new files

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1523: -- Labels: user-support-issues (was: ) > Avoid excessive mkdir calls when creating new fil

[jira] [Assigned] (HUDI-1523) Avoid excessive mkdir calls when creating new files

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-1523: - Assignee: sivabalan narayanan > Avoid excessive mkdir calls when creating new fil

[jira] [Updated] (HUDI-1505) Allow pluggable option to write error records to side table, queue

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1505: -- Labels: user-support-issues (was: ) > Allow pluggable option to write error records to

[jira] [Updated] (HUDI-1501) Explore providing ways to auto-tune input record size based on incoming payload

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1501: -- Labels: user-support-issues (was: ) > Explore providing ways to auto-tune input record

[jira] [Updated] (HUDI-1499) Support configuration to let user override record-size estimate

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1499: -- Labels: newbie user-support-issues (was: newbie) > Support configuration to let user ov

[jira] [Assigned] (HUDI-1501) Explore providing ways to auto-tune input record size based on incoming payload

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-1501: - Assignee: sivabalan narayanan > Explore providing ways to auto-tune input record

[jira] [Closed] (HUDI-1501) Explore providing ways to auto-tune input record size based on incoming payload

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-1501. - Resolution: Duplicate https://issues.apache.org/jira/browse/HUDI-1499 > Explore providing

[jira] [Commented] (HUDI-1499) Support configuration to let user override record-size estimate

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17270128#comment-17270128 ] sivabalan narayanan commented on HUDI-1499: --- [https://github.com/apache/hudi/iss

[jira] [Assigned] (HUDI-1497) Timeout Exception during getFileStatus()

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-1497: - Assignee: Balaji Varadarajan > Timeout Exception during getFileStatus() > --

[jira] [Updated] (HUDI-1497) Timeout Exception during getFileStatus()

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1497: -- Labels: user-support-issues (was: ) > Timeout Exception during getFileStatus() > -

[jira] [Commented] (HUDI-1497) Timeout Exception during getFileStatus()

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17270131#comment-17270131 ] sivabalan narayanan commented on HUDI-1497: --- [~vbalaji]: can we close this now w

[jira] [Updated] (HUDI-1496) Seek Error when querying MOR tables in GCP

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1496: -- Labels: user-support-issues (was: ) > Seek Error when querying MOR tables in GCP >

[jira] [Updated] (HUDI-1475) Fix documentation of preCombine to clarify when this API is used by Hudi

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1475: -- Labels: user-support-issues (was: ) > Fix documentation of preCombine to clarify when t

[jira] [Updated] (HUDI-1452) RocksDB FileSystemView throwing NotSerializableError when embedded timeline server is turned off

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1452: -- Labels: user-support-issues (was: ) > RocksDB FileSystemView throwing NotSerializableEr

[jira] [Updated] (HUDI-1440) Allow option to override schema when doing spark.write

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1440: -- Labels: user-support-issues (was: ) > Allow option to override schema when doing spark.

[jira] [Updated] (HUDI-1436) Provide Option to run auto clean every nth commit.

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1436: -- Labels: user-support-issues (was: ) > Provide Option to run auto clean every nth commit

[jira] [Updated] (HUDI-1413) Need binary release of Hudi to distribute tools like hudi-cli.sh and hudi-sync

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1413: -- Labels: user-support-issues (was: ) > Need binary release of Hudi to distribute tools l

[jira] [Updated] (HUDI-1383) Incorrect partitions getting hive synced

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1383: -- Status: In Progress (was: Open) > Incorrect partitions getting hive synced > --

[jira] [Updated] (HUDI-1383) Incorrect partitions getting hive synced

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1383: -- Labels: pull-request-available user-support-issues (was: pull-request-available) > Inc

[jira] [Updated] (HUDI-1383) Incorrect partitions getting hive synced

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1383: -- Status: Closed (was: Patch Available) > Incorrect partitions getting hive synced >

[jira] [Updated] (HUDI-1383) Incorrect partitions getting hive synced

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1383: -- Status: Patch Available (was: In Progress) > Incorrect partitions getting hive synced >

[jira] [Reopened] (HUDI-1383) Incorrect partitions getting hive synced

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reopened HUDI-1383: --- > Incorrect partitions getting hive synced > > >

[jira] [Resolved] (HUDI-1383) Incorrect partitions getting hive synced

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-1383. --- Fix Version/s: (was: 0.8.0) 0.7.0 Resolution: Fixed > In

[jira] [Updated] (HUDI-1381) Schedule compaction based on time elapsed

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1381: -- Labels: pull-request-available user-support-issues (was: pull-request-available) > Sch

[jira] [Updated] (HUDI-1368) Merge On Read Snapshot Reader not working for Databricks on ADLS Gen2

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1368: -- Labels: adls user-support-issues (was: adls) > Merge On Read Snapshot Reader not workin

[jira] [Updated] (HUDI-1363) Provide Option to drop columns after they are used to generate partition or record keys

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1363: -- Labels: user-support-issues (was: pull-request-available user-support-issues) > Provid

[jira] [Updated] (HUDI-1363) Provide Option to drop columns after they are used to generate partition or record keys

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1363: -- Labels: pull-request-available user-support-issues (was: pull-request-available) > Pro

[jira] [Commented] (HUDI-1329) Support async compaction in spark DF write()

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17270149#comment-17270149 ] sivabalan narayanan commented on HUDI-1329: --- [~vbalaji]: wondering you this is c

[jira] [Commented] (HUDI-1309) Listing Metadata unreadable in S3 as the log block is deemed corrupted

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17270154#comment-17270154 ] sivabalan narayanan commented on HUDI-1309: --- [~vbalaji]: is this a user reported

[jira] [Commented] (HUDI-1308) Issues found during testing RFC-15

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17270156#comment-17270156 ] sivabalan narayanan commented on HUDI-1308: --- [~vinoth] [~vbalaji]: Can we close

[jira] [Updated] (HUDI-1290) Implement Debezium avro source for Delta Streamer

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1290: -- Labels: user-support-issues (was: ) > Implement Debezium avro source for Delta Streamer

[jira] [Commented] (HUDI-1290) Implement Debezium avro source for Delta Streamer

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17270159#comment-17270159 ] sivabalan narayanan commented on HUDI-1290: --- This issue could have some pointers

[jira] [Updated] (HUDI-1280) Add tool to capture earliest or latest offsets in kafka topics

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1280: -- Labels: user-support-issues (was: ) > Add tool to capture earliest or latest offsets in

[jira] [Updated] (HUDI-1279) Update Apache Hudi website docs to clarify the property of record_keys

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1279: -- Labels: user-support-issues (was: ) > Update Apache Hudi website docs to clarify the pr

[jira] [Updated] (HUDI-1523) Avoid excessive mkdir calls when creating new files

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1523: -- Status: New (was: Open) > Avoid excessive mkdir calls when creating new files > ---

[jira] [Updated] (HUDI-1501) Explore providing ways to auto-tune input record size based on incoming payload

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1501: -- Labels: (was: user-support-issues) > Explore providing ways to auto-tune input record

[jira] [Updated] (HUDI-1436) Provide Option to run auto clean every nth commit.

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1436: -- Labels: (was: user-support-issues) > Provide Option to run auto clean every nth commit

[jira] [Updated] (HUDI-1499) Support configuration to let user override record-size estimate

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1499: -- Labels: newbie (was: newbie user-support-issues) > Support configuration to let user ov

[jira] [Updated] (HUDI-1452) RocksDB FileSystemView throwing NotSerializableError when embedded timeline server is turned off

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1452: -- Labels: (was: user-support-issues) > RocksDB FileSystemView throwing NotSerializableEr

[jira] [Updated] (HUDI-1497) Timeout Exception during getFileStatus()

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1497: -- Labels: (was: user-support-issues) > Timeout Exception during getFileStatus() > -

[jira] [Updated] (HUDI-1381) Schedule compaction based on time elapsed

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1381: -- Labels: pull-request-available (was: pull-request-available user-support-issues) > Sch

[jira] [Updated] (HUDI-1363) Provide Option to drop columns after they are used to generate partition or record keys

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1363: -- Labels: (was: user-support-issues) > Provide Option to drop columns after they are use

[jira] [Updated] (HUDI-1278) Need a generic payload class which can skip late arriving data based on specific fields

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1278: -- Labels: user-support-issues (was: ) > Need a generic payload class which can skip late

[jira] [Comment Edited] (HUDI-1309) Listing Metadata unreadable in S3 as the log block is deemed corrupted

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17270154#comment-17270154 ] sivabalan narayanan edited comment on HUDI-1309 at 1/22/21, 2:17 PM: ---

[jira] [Comment Edited] (HUDI-1308) Issues found during testing RFC-15

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17270156#comment-17270156 ] sivabalan narayanan edited comment on HUDI-1308 at 1/22/21, 2:17 PM: ---

[jira] [Updated] (HUDI-1277) [DOC] Need documentation explaining how to write custom record payload class

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1277: -- Labels: newbie user-support-issues (was: newbie) > [DOC] Need documentation explaining

[jira] [Updated] (HUDI-1272) Add utility scripts to manage Savepoints

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1272: -- Labels: user-support-issues (was: ) > Add utility scripts to manage Savepoints > --

[jira] [Updated] (HUDI-1273) Add documentation for performing savepoints and restores

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1273: -- Labels: user-support-issues (was: ) > Add documentation for performing savepoints and r

[jira] [Updated] (HUDI-1271) Add utility scripts to perform Restores

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1271: -- Labels: user-support-issues (was: ) > Add utility scripts to perform Restores > ---

[jira] [Updated] (HUDI-1235) Default vaiue of KeyGenerator configuration is wrongly documented

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1235: -- Labels: user-support-issues (was: ) > Default vaiue of KeyGenerator configuration is wr

[jira] [Commented] (HUDI-1214) Need ability to set deltastreamer checkpoints when doing Spark datasource writes

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17270166#comment-17270166 ] sivabalan narayanan commented on HUDI-1214: --- [~vbalaji]: is this a duplicate of

[jira] [Updated] (HUDI-1214) Need ability to set deltastreamer checkpoints when doing Spark datasource writes

2021-01-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1214: -- Labels: user-support-issues (was: ) > Need ability to set deltastreamer checkpoints whe

  1   2   3   4   5   6   7   8   9   10   >