[jira] [Created] (HUDI-3362) Hudi 0.8.0 cannot roleback MoR table

2022-02-01 Thread Istvan Darvas (Jira)
Istvan Darvas created HUDI-3362: --- Summary: Hudi 0.8.0 cannot roleback MoR table Key: HUDI-3362 URL: https://issues.apache.org/jira/browse/HUDI-3362 Project: Apache Hudi Issue Type: Bug Affe

[jira] [Updated] (HUDI-3362) Hudi 0.8.0 cannot roleback MoR table

2022-02-01 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Darvas updated HUDI-3362: Description: Hi Guys,   Environment: AWS EMR 6.4 / Hudi v0.8.0 Problem: I have a MoR table wich i

[jira] [Updated] (HUDI-3362) Hudi 0.8.0 cannot roleback MoR table

2022-02-01 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Darvas updated HUDI-3362: Description: Hi Guys,   Environment: AWS EMR 6.4 / Hudi v0.8.0 Problem: I have a MoR table wich i

[jira] [Updated] (HUDI-3362) Hudi 0.8.0 cannot roleback MoR table

2022-02-01 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Darvas updated HUDI-3362: Description: Hi Guys,   Environment: AWS EMR 6.4 / Hudi v0.8.0 Problem: I have a MoR table wich i

[jira] [Updated] (HUDI-3362) Hudi 0.8.0 cannot roleback MoR table

2022-02-01 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Darvas updated HUDI-3362: Description: Hi Guys,   Environment: AWS EMR 6.4 / Hudi v0.8.0 Problem: I have a MoR table wich i

[jira] [Updated] (HUDI-3362) Hudi 0.8.0 cannot roleback MoR table

2022-02-01 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Darvas updated HUDI-3362: Description: Hi Guys,   Environment: AWS EMR 6.4 / Hudi v0.8.0 Problem: I have a MoR table wich i

[jira] [Updated] (HUDI-3362) Hudi 0.8.0 cannot roleback MoR table

2022-02-01 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Darvas updated HUDI-3362: Description: Hi Guys,   Environment: AWS EMR 6.4 / Hudi v0.8.0 Problem: I have a MoR table wich i

[jira] [Updated] (HUDI-3362) Hudi 0.8.0 cannot roleback MoR table

2022-02-01 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Darvas updated HUDI-3362: Description: Hi Guys,   Environment: AWS EMR 6.4 / Hudi v0.8.0 Problem: I have a MoR table wich i

[jira] [Updated] (HUDI-3362) Hudi 0.8.0 cannot roleback MoR table

2022-02-01 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Darvas updated HUDI-3362: Description: Hi Guys,   Environment: AWS EMR 6.4 / Hudi v0.8.0 Problem: I have a MoR table wich i

[jira] [Updated] (HUDI-3362) Hudi 0.8.0 cannot roleback CoW table

2022-02-03 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Darvas updated HUDI-3362: Summary: Hudi 0.8.0 cannot roleback CoW table (was: Hudi 0.8.0 cannot roleback MoR table) > Hudi 0

[jira] [Commented] (HUDI-3362) Hudi 0.8.0 cannot roleback CoW table

2022-02-03 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486463#comment-17486463 ] Istvan Darvas commented on HUDI-3362: - I have changed MoR => CoW it was a mistake...Yo

[jira] [Updated] (HUDI-3362) Hudi 0.8.0 cannot roleback CoW table

2022-02-03 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Darvas updated HUDI-3362: Attachment: rollback-on-a-not-damaged-table-SUCCESS.txt > Hudi 0.8.0 cannot roleback CoW table > ---

[jira] [Commented] (HUDI-3362) Hudi 0.8.0 cannot roleback CoW table

2022-02-03 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486486#comment-17486486 ] Istvan Darvas commented on HUDI-3362: - I was asked to do this:   and if you have a ta

[jira] [Updated] (HUDI-3362) Hudi 0.8.0 cannot roleback CoW table

2022-02-03 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Darvas updated HUDI-3362: Attachment: rollback-on-a-not-damaged-table-SUCCESS.pdf > Hudi 0.8.0 cannot roleback CoW table > ---

[jira] [Updated] (HUDI-3362) Hudi 0.8.0 cannot roleback CoW table

2022-02-03 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Darvas updated HUDI-3362: Description: Hi Guys,   Environment: AWS EMR 6.4 / Hudi v0.8.0 Problem: I have a CoW table wich i

[jira] [Updated] (HUDI-3362) Hudi 0.8.0 cannot roleback CoW table

2022-02-03 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Darvas updated HUDI-3362: Description: Hi Guys,   Environment: AWS EMR 6.4 / Hudi v0.8.0 Problem: I have a CoW table wich i

[jira] [Updated] (HUDI-3362) Hudi 0.8.0 cannot roleback CoW table

2022-02-03 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Darvas updated HUDI-3362: Attachment: hoodie-list.txt > Hudi 0.8.0 cannot roleback CoW table > ---

[jira] [Comment Edited] (HUDI-3362) Hudi 0.8.0 cannot roleback CoW table

2022-02-03 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486594#comment-17486594 ] Istvan Darvas edited comment on HUDI-3362 at 2/3/22, 4:53 PM: --

[jira] [Commented] (HUDI-3362) Hudi 0.8.0 cannot roleback CoW table

2022-02-03 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486594#comment-17486594 ] Istvan Darvas commented on HUDI-3362: - So with 0.8.0 i was able to restore over a succ

[jira] [Comment Edited] (HUDI-3362) Hudi 0.8.0 cannot roleback CoW table

2022-02-03 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486594#comment-17486594 ] Istvan Darvas edited comment on HUDI-3362 at 2/3/22, 4:54 PM: --

[jira] [Updated] (HUDI-3362) Hudi 0.8.0 cannot roleback CoW table

2022-02-03 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Darvas updated HUDI-3362: Attachment: rollback-on-a-not-damaged-table-over-replace-commit.pdf > Hudi 0.8.0 cannot roleback CoW

[jira] [Created] (HUDI-3490) Timestamp conversion (parquet)

2022-02-23 Thread Istvan Darvas (Jira)
Istvan Darvas created HUDI-3490: --- Summary: Timestamp conversion (parquet) Key: HUDI-3490 URL: https://issues.apache.org/jira/browse/HUDI-3490 Project: Apache Hudi Issue Type: Bug Re

[jira] [Commented] (HUDI-3490) Timestamp conversion (parquet)

2022-02-23 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17496713#comment-17496713 ] Istvan Darvas commented on HUDI-3490: - DeltaStreamer from Kafka/Json => S3/Hudi table

[jira] [Comment Edited] (HUDI-3490) Timestamp conversion (parquet)

2022-02-23 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17496713#comment-17496713 ] Istvan Darvas edited comment on HUDI-3490 at 2/23/22, 12:24 PM:

[jira] [Comment Edited] (HUDI-3490) Timestamp conversion (parquet)

2022-02-23 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17496713#comment-17496713 ] Istvan Darvas edited comment on HUDI-3490 at 2/23/22, 12:30 PM:

[jira] [Created] (HUDI-4008) Delta Streamer does not respect hoodie.datasource.write.drop.partition.columns config

2022-05-02 Thread Istvan Darvas (Jira)
Istvan Darvas created HUDI-4008: --- Summary: Delta Streamer does not respect hoodie.datasource.write.drop.partition.columns config Key: HUDI-4008 URL: https://issues.apache.org/jira/browse/HUDI-4008 Proje

[jira] [Created] (HUDI-4046) spark.read.load API

2022-05-05 Thread Istvan Darvas (Jira)
Istvan Darvas created HUDI-4046: --- Summary: spark.read.load API Key: HUDI-4046 URL: https://issues.apache.org/jira/browse/HUDI-4046 Project: Apache Hudi Issue Type: Bug Affects Versions: 0.1

[jira] [Updated] (HUDI-4046) spark.read.load API

2022-05-05 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Darvas updated HUDI-4046: Description: Hi Guys! I would like to controll the number of partions which will be read by HUDI.

[jira] [Updated] (HUDI-4046) spark.read.load API

2022-05-05 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Darvas updated HUDI-4046: Description: Hi Guys! I would like to controll the number of partions which will be read by HUDI.

[jira] [Updated] (HUDI-4046) spark.read.load API

2022-05-05 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Darvas updated HUDI-4046: Description: Hi Guys! I would like to controll the number of partions which will be read by HUDI.

[jira] [Created] (HUDI-4047) hoodie.avro.schema.validate error message refact

2022-05-05 Thread Istvan Darvas (Jira)
Istvan Darvas created HUDI-4047: --- Summary: hoodie.avro.schema.validate error message refact Key: HUDI-4047 URL: https://issues.apache.org/jira/browse/HUDI-4047 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-4047) hoodie.avro.schema.validate error message refact

2022-05-05 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Darvas updated HUDI-4047: Priority: Minor (was: Major) > hoodie.avro.schema.validate error message refact > -

[jira] [Updated] (HUDI-4047) hoodie.avro.schema.validate error message refact

2022-05-05 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Darvas updated HUDI-4047: Description: Hi Guys!   I have just used the schema validation and works as a charm, but :)   A

[jira] [Updated] (HUDI-4047) hoodie.avro.schema.validate error message refact

2022-05-06 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Darvas updated HUDI-4047: Description: Hi Guys!   I have just used the schema validation and works as a charm, but :)   A

[jira] [Created] (HUDI-4091) Timestamp micro handling

2022-05-12 Thread Istvan Darvas (Jira)
Istvan Darvas created HUDI-4091: --- Summary: Timestamp micro handling Key: HUDI-4091 URL: https://issues.apache.org/jira/browse/HUDI-4091 Project: Apache Hudi Issue Type: Bug Affects Versions

[jira] [Updated] (HUDI-4091) Timestamp micro handling

2022-05-12 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Darvas updated HUDI-4091: Description: Hi Guys!   I am not able to use timestamp micro columns save with HUDI.  I would like t

[jira] [Updated] (HUDI-4091) TIMESTAMP_MICROS handling

2022-05-13 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Darvas updated HUDI-4091: Summary: TIMESTAMP_MICROS handling (was: Timestamp micro handling) > TIMESTAMP_MICROS handling > --

[jira] [Updated] (HUDI-4091) TIMESTAMP_MICROS handling

2022-05-13 Thread Istvan Darvas (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Darvas updated HUDI-4091: Description: Hi Guys!   I am not able to use timestamp micro columns save with HUDI.  I would like t