Bo Cui created HUDI-3336:
Summary: Configurations transferred through Flink SQL cannot take
effect.
Key: HUDI-3336
URL: https://issues.apache.org/jira/browse/HUDI-3336
Project: Apache Hudi
Issue Typ
[
https://issues.apache.org/jira/browse/HUDI-3336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-3336:
-
Summary: Configurations transferred through Flink SQL cannot take effect
(was: Configurations transferred through
[
https://issues.apache.org/jira/browse/HUDI-3336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-3336:
-
Status: In Progress (was: Open)
> Configurations transferred through Flink SQL cannot take effect
> -
Bo Cui created HUDI-3446:
Summary: support batch Reader in BootstrapOperator#loadRecords
Key: HUDI-3446
URL: https://issues.apache.org/jira/browse/HUDI-3446
Project: Apache Hudi
Issue Type: Improveme
[
https://issues.apache.org/jira/browse/HUDI-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-3446:
-
Status: In Progress (was: Open)
> support batch Reader in BootstrapOperator#loadRecords
> ---
[
https://issues.apache.org/jira/browse/HUDI-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-3446:
-
Summary: Support batch Reader in BootstrapOperator#loadRecords (was:
support batch Reader in BootstrapOperator#lo
[
https://issues.apache.org/jira/browse/HUDI-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-3446:
-
Summary: Support Batch Reader in BootstrapOperator#loadRecords (was:
Support batch Reader in BootstrapOperator#lo
[
https://issues.apache.org/jira/browse/HUDI-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-3446:
-
Description:
[https://github.com/apache/hudi/blob/433c2573ef5d1f25cba42f169679a4afe5ff2e24/hudi-flink/src/main/jav
[
https://issues.apache.org/jira/browse/HUDI-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-3446:
-
Description:
[https://github.com/apache/hudi/blob/433c2573ef5d1f25cba42f169679a4afe5ff2e24/hudi-flink/src/main/jav
Bo Cui created HUDI-3460:
Summary: Flink TM Memory Optimization
Key: HUDI-3460
URL: https://issues.apache.org/jira/browse/HUDI-3460
Project: Apache Hudi
Issue Type: Improvement
Components:
[
https://issues.apache.org/jira/browse/HUDI-3460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17495346#comment-17495346
]
Bo Cui commented on HUDI-3460:
--
hi [~danny0405] WDYT?
> Flink TM Memory Optimization
>
[
https://issues.apache.org/jira/browse/HUDI-3460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-3460:
-
Description:
HoodieTableSource uses the MapReduce Memory Config,
[https://github.com/apache/hudi/blob/359fbfde798
Bo Cui created HUDI-3516:
Summary: Optimize the memory of HoodieDataBlock for Flink
Key: HUDI-3516
URL: https://issues.apache.org/jira/browse/HUDI-3516
Project: Apache Hudi
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/HUDI-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-3516:
-
Description:
[https://github.com/apache/hudi/blob/45d1216e91babcfb92470a7b5c314fefa27fce0d/hudi-common/src/main/ja
[
https://issues.apache.org/jira/browse/HUDI-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-3516:
-
Attachment: image-2022-02-25-16-22-49-689.png
> Optimize the memory of HoodieDataBlock for Flink
> ---
[
https://issues.apache.org/jira/browse/HUDI-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-3516:
-
Description:
[https://github.com/apache/hudi/blob/45d1216e91babcfb92470a7b5c314fefa27fce0d/hudi-common/src/main/ja
[
https://issues.apache.org/jira/browse/HUDI-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17497981#comment-17497981
]
Bo Cui commented on HUDI-3516:
--
in my cluster, after the pr, the TM memory is reduced from 8
Bo Cui created HUDI-3564:
Summary: chk throws No inflight instant when flushing data in
sink#snapshotState
Key: HUDI-3564
URL: https://issues.apache.org/jira/browse/HUDI-3564
Project: Apache Hudi
Is
[
https://issues.apache.org/jira/browse/HUDI-3564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-3564:
-
Description:
The chk fails after the job has been running for several hours.
!image-2022-03-05-15-42-49-600.png!
[
https://issues.apache.org/jira/browse/HUDI-3564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-3564:
-
Description:
The chk fails after the job has been running for several hours. and chk didn't
time out.
!image-202
Bo Cui created HUDI-4078:
Summary: BootstrapOperator cannot load all index data
Key: HUDI-4078
URL: https://issues.apache.org/jira/browse/HUDI-4078
Project: Apache Hudi
Issue Type: Bug
Re
[
https://issues.apache.org/jira/browse/HUDI-4078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-4078:
-
Affects Version/s: 0.9.0
0.11.0
> BootstrapOperator cannot load all index data
> --
[
https://issues.apache.org/jira/browse/HUDI-4078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui reassigned HUDI-4078:
Assignee: Bo Cui
> BootstrapOperator cannot load all index data
> -
Bo Cui created HUDI-4082:
Summary: The readability of hudi operator names on FlinkWeb is
enhanced
Key: HUDI-4082
URL: https://issues.apache.org/jira/browse/HUDI-4082
Project: Apache Hudi
Issue Type:
[
https://issues.apache.org/jira/browse/HUDI-4082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-4082:
-
Component/s: flink-sql
> The readability of hudi operator names on FlinkWeb is enhanced
>
[
https://issues.apache.org/jira/browse/HUDI-4082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-4082:
-
Summary: Enhance the readability of the hudi operator name on FlinkUI
(was: The readability of hudi operator name
Bo Cui created HUDI-4151:
Summary: flink split_reader supports rocksdb
Key: HUDI-4151
URL: https://issues.apache.org/jira/browse/HUDI-4151
Project: Apache Hudi
Issue Type: New Feature
Compo
[
https://issues.apache.org/jira/browse/HUDI-4151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui reassigned HUDI-4151:
Assignee: Bo Cui
> flink split_reader supports rocksdb
> ---
>
>
[
https://issues.apache.org/jira/browse/HUDI-4153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui reassigned HUDI-4153:
Assignee: Bo Cui
> StreamReadOperator supports asynchronous opening of format
> ---
Bo Cui created HUDI-4153:
Summary: StreamReadOperator supports asynchronous opening of format
Key: HUDI-4153
URL: https://issues.apache.org/jira/browse/HUDI-4153
Project: Apache Hudi
Issue Type: New
[
https://issues.apache.org/jira/browse/HUDI-4153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-4153:
-
Component/s: flink
> StreamReadOperator supports asynchronous opening of format
>
Bo Cui created HUDI-6559:
Summary: Add Sharing Group for Compaction
Key: HUDI-6559
URL: https://issues.apache.org/jira/browse/HUDI-6559
Project: Apache Hudi
Issue Type: Improvement
Componen
Bo Cui created HUDI-7132:
Summary: Data may be lost in flink#chk
Key: HUDI-7132
URL: https://issues.apache.org/jira/browse/HUDI-7132
Project: Apache Hudi
Issue Type: Bug
Components: flink
[
https://issues.apache.org/jira/browse/HUDI-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-7132:
-
Description:
https://github.com/apache/hudi/blob/a1afcdd989ce2d634290d1bd9e099a17057e6b4d/hudi-flink-datasource/hu
[
https://issues.apache.org/jira/browse/HUDI-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-7132:
-
Description:
https://github.com/apache/hudi/blob/a1afcdd989ce2d634290d1bd9e099a17057e6b4d/hudi-flink-datasource/hu
[
https://issues.apache.org/jira/browse/HUDI-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-7132:
-
Description:
https://github.com/apache/hudi/blob/a1afcdd989ce2d634290d1bd9e099a17057e6b4d/hudi-flink-datasource/hu
[
https://issues.apache.org/jira/browse/HUDI-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-7132:
-
Description:
https://github.com/apache/hudi/blob/a1afcdd989ce2d634290d1bd9e099a17057e6b4d/hudi-flink-datasource/hu
[
https://issues.apache.org/jira/browse/HUDI-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-7132:
-
Description:
https://github.com/apache/hudi/blob/a1afcdd989ce2d634290d1bd9e099a17057e6b4d/hudi-flink-datasource/hu
[
https://issues.apache.org/jira/browse/HUDI-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17791871#comment-17791871
]
Bo Cui commented on HUDI-7132:
--
hi [~danny0405]
If it's a scene like this:
t1: chk is complet
[
https://issues.apache.org/jira/browse/HUDI-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17791873#comment-17791873
]
Bo Cui commented on HUDI-7132:
--
and another scenario:：
t1: chk is complete and all Coordinato
[
https://issues.apache.org/jira/browse/HUDI-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17795645#comment-17795645
]
Bo Cui edited comment on HUDI-7132 at 12/12/23 8:50 AM:
>From the
[
https://issues.apache.org/jira/browse/HUDI-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-7132:
-
Attachment: screenshot-1.png
> Data may be lost in Flink checkpoint
>
>
>
[
https://issues.apache.org/jira/browse/HUDI-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17795645#comment-17795645
]
Bo Cui commented on HUDI-7132:
--
>From the code, this pr (https://github.com/apache/hudi/pull/
[
https://issues.apache.org/jira/browse/HUDI-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-7132:
-
Attachment: (was: screenshot-1.png)
> Data may be lost in Flink checkpoint
> -
[ https://issues.apache.org/jira/browse/HUDI-7132 ]
Bo Cui deleted comment on HUDI-7132:
--
was (Author: bo cui):
>From the code, this pr ([https://github.com/apache/hudi/pull/9867/files])
>fixes the logic during initialization,
but it doesn't fix the
[
https://issues.apache.org/jira/browse/HUDI-7170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui reassigned HUDI-7170:
Assignee: Bo Cui (was: Ethan Guo)
> Implement HFile reader independent of HBase
>
Bo Cui created HUDI-7012:
Summary: The BootstrapOperator reduces the memory usage.
Key: HUDI-7012
URL: https://issues.apache.org/jira/browse/HUDI-7012
Project: Apache Hudi
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/HUDI-7012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-7012:
-
Description:
the stream job and hoodieTable never release memory.
!image-2023-10-31-14-00-41-402.png!
was:
the
[
https://issues.apache.org/jira/browse/HUDI-7012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-7012:
-
Description:
the stream job and hoodieTable never release memory.
!image-2023-10-31-14-05-18-391.png|width=884,he
[
https://issues.apache.org/jira/browse/HUDI-7012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-7012:
-
Description:
the stream job and hoodieTable never release memory.
was:
the stream job and hoodieTable never
[
https://issues.apache.org/jira/browse/HUDI-7012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-7012:
-
Summary: The BootstrapOperator reduces the memory. (was: The
BootstrapOperator reduces the memory usage.)
> The
[
https://issues.apache.org/jira/browse/HUDI-7012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui reassigned HUDI-7012:
Assignee: Bo Cui
> The BootstrapOperator reduces the memory.
> -
>
[
https://issues.apache.org/jira/browse/HUDI-7012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-7012:
-
Description:
the stream job and hoodieTable never release memory.
!image-2023-10-31-14-29-55-715.png!
was:
the
[
https://issues.apache.org/jira/browse/HUDI-7012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-7012:
-
Description:
the stream job and hoodieTable never release memory.
was:
the stream job and hoodieTable never
[
https://issues.apache.org/jira/browse/HUDI-7012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-7012:
-
Description:
the stream job and hoodieTable never release memory.
!image-2023-10-31-14-37-10-118.png!
was:
the
[
https://issues.apache.org/jira/browse/HUDI-7012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-7012:
-
Attachment: image-2023-10-31-14-37-10-118.png
> The BootstrapOperator reduces the memory.
> --
[
https://issues.apache.org/jira/browse/HUDI-7012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-7012:
-
Attachment: (was: image-2023-10-31-14-37-10-118.png)
> The BootstrapOperator reduces the memory.
> ---
[
https://issues.apache.org/jira/browse/HUDI-7012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-7012:
-
Description:
the stream job and hoodieTable never release memory.
was:
the stream job and hoodieTable never
[
https://issues.apache.org/jira/browse/HUDI-7012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-7012:
-
Description:
the stream job and hoodieTable never release memory.
!image-2023-10-31-14-42-57-424.png!
was:
the
[
https://issues.apache.org/jira/browse/HUDI-7012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-7012:
-
Attachment: image-2023-11-01-12-32-19-627.png
> The BootstrapOperator reduces the memory.
> --
[
https://issues.apache.org/jira/browse/HUDI-7012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-7012:
-
Description:
the stream job and hoodieTable never release memory.
!image-2023-11-01-12-32-19-627.png|width=987,he
Bo Cui created HUDI-4196:
Summary: Bootstrap supports index alignment
Key: HUDI-4196
URL: https://issues.apache.org/jira/browse/HUDI-4196
Project: Apache Hudi
Issue Type: New Feature
Compon
[
https://issues.apache.org/jira/browse/HUDI-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-4196:
-
Attachment: image-2022-06-06-17-04-01-515.png
> Bootstrap supports index alignment
> -
[
https://issues.apache.org/jira/browse/HUDI-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-4196:
-
Description:
Indexes and data may be out of order.
After the operator loads indexes, the operator starts to proce
Bo Cui created HUDI-4270:
Summary: Bootstrap operation data loading missing
Key: HUDI-4270
URL: https://issues.apache.org/jira/browse/HUDI-4270
Project: Apache Hudi
Issue Type: Bug
Report
[
https://issues.apache.org/jira/browse/HUDI-4270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-4270:
-
Description:
[https://github.com/apache/hudi/issues/4558]
Procedure:
1. The fs of hudi supports append (for examp
[
https://issues.apache.org/jira/browse/HUDI-4270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-4270:
-
Description:
[https://github.com/apache/hudi/issues/4558]
Procedure:
1. The fs of hudi supports append (for examp
[
https://issues.apache.org/jira/browse/HUDI-4270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-4270:
-
Description:
[https://github.com/apache/hudi/issues/4558]
Procedure:
1. The fs of hudi supports append (for examp
68 matches
Mail list logo
