[jira] [Commented] (FLINK-31089) pin L0 index in memory can lead to slow memory grow finally lead to memory beyond limit

2023-02-20 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17691114#comment-17691114 ] xiaogang zhou commented on FLINK-31089: --- I found in rocksdb log,   2023/02/20-17

[jira] [Comment Edited] (FLINK-31089) pin L0 index in memory can lead to slow memory grow finally lead to memory beyond limit

2023-02-20 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17691114#comment-17691114 ] xiaogang zhou edited comment on FLINK-31089 at 2/20/23 10:10 AM: -

[jira] [Commented] (FLINK-31089) pin L0 index in memory can lead to slow memory grow finally lead to memory beyond limit

2023-02-20 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17691153#comment-17691153 ] xiaogang zhou commented on FLINK-31089: --- I create another task with ttl open, And

[jira] [Commented] (FLINK-31089) pin L0 index in memory can lead to slow memory grow finally lead to memory beyond limit

2023-02-20 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17691338#comment-17691338 ] xiaogang zhou commented on FLINK-31089: --- [~yunta] Master, After turn on compaction

[jira] [Comment Edited] (FLINK-31089) pin L0 index in memory can lead to slow memory grow finally lead to memory beyond limit

2023-02-20 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17690346#comment-17690346 ] xiaogang zhou edited comment on FLINK-31089 at 2/21/23 2:38 AM: --

[jira] [Commented] (FLINK-31089) pin L0 index in memory can lead to slow memory grow finally lead to memory beyond limit

2023-02-22 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17692546#comment-17692546 ] xiaogang zhou commented on FLINK-31089: --- [~yunta] if I turn off the PinTopLevelInd

[jira] [Commented] (FLINK-31089) pin L0 index in memory can lead to slow memory grow finally lead to memory beyond limit

2023-02-23 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17692566#comment-17692566 ] xiaogang zhou commented on FLINK-31089: --- some more info: 1, the task with ttl on

[jira] [Commented] (FLINK-31089) pin L0 index in memory can lead to slow memory grow finally lead to memory beyond limit

2023-02-25 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17693581#comment-17693581 ] xiaogang zhou commented on FLINK-31089: --- [~Yanfei Lei] yes, your summary is pretty

[jira] [Created] (FLINK-31225) rocksdb max open file can lead to oom

2023-02-25 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-31225: - Summary: rocksdb max open file can lead to oom Key: FLINK-31225 URL: https://issues.apache.org/jira/browse/FLINK-31225 Project: Flink Issue Type: Improvem

[jira] [Comment Edited] (FLINK-31089) pin L0 index in memory can lead to slow memory grow finally lead to memory beyond limit

2023-02-25 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17693581#comment-17693581 ] xiaogang zhou edited comment on FLINK-31089 at 2/26/23 4:05 AM: --

[jira] [Updated] (FLINK-31225) rocksdb max open file can lead to oom

2023-02-25 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-31225: -- Attachment: image-2023-02-26-12-08-49-717.png > rocksdb max open file can lead to oom > -

[jira] [Updated] (FLINK-31225) rocksdb max open file can lead to oom

2023-02-25 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-31225: -- Description: the default value for  state.backend.rocksdb.files.open is -1   [https://gith

[jira] [Updated] (FLINK-31225) rocksdb max open file can lead to oom

2023-02-25 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-31225: -- Attachment: leak_test(2).png > rocksdb max open file can lead to oom > --

[jira] [Updated] (FLINK-31225) rocksdb max open file can lead to oom

2023-02-25 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-31225: -- Description: the default value for  state.backend.rocksdb.files.open is -1   [https://gith

[jira] [Updated] (FLINK-31225) rocksdb max open file can lead to oom

2023-02-26 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-31225: -- Description: the default value for  state.backend.rocksdb.files.open is -1   [https://gith

[jira] [Commented] (FLINK-31225) rocksdb max open file can lead to oom

2023-02-27 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17693953#comment-17693953 ] xiaogang zhou commented on FLINK-31225: --- [~yunta] Master I logged onto the contai

[jira] [Comment Edited] (FLINK-31225) rocksdb max open file can lead to oom

2023-02-27 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17693953#comment-17693953 ] xiaogang zhou edited comment on FLINK-31225 at 2/27/23 10:54 AM: -

[jira] [Created] (FLINK-32732) auto offset reset should be exposed to user

2023-08-02 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-32732: - Summary: auto offset reset should be exposed to user Key: FLINK-32732 URL: https://issues.apache.org/jira/browse/FLINK-32732 Project: Flink Issue Type: Imp

[jira] [Updated] (FLINK-32732) auto offset reset should be exposed to user

2023-08-02 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-32732: -- Description: {code:java} // code placeholder maybeOverride( ConsumerConfig.AUTO_OFFSET

[jira] [Updated] (FLINK-32732) auto offset reset should be exposed to user

2023-08-02 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-32732: -- Description: {code:java} // code placeholder maybeOverride( ConsumerConfig.AUTO_OFFSET

[jira] [Commented] (FLINK-32732) auto offset reset should be exposed to user

2023-08-02 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17750183#comment-17750183 ] xiaogang zhou commented on FLINK-32732: --- [~libenchao] [~renqs]  let me know your t

[jira] [Commented] (FLINK-32607) Kafka table source and json format support projection pushdown

2023-08-02 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17750184#comment-17750184 ] xiaogang zhou commented on FLINK-32607: --- [~libenchao] Not sure if someone has take

[jira] [Created] (FLINK-32115) json_value support cache

2023-05-16 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-32115: - Summary: json_value support cache Key: FLINK-32115 URL: https://issues.apache.org/jira/browse/FLINK-32115 Project: Flink Issue Type: Improvement

[jira] [Updated] (FLINK-32115) json_value support cache

2023-05-16 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-32115: -- Description: [https://github.com/apache/hive/blob/storage-branch-2.3/ql/src/java/org/apache/ha

[jira] [Updated] (FLINK-32115) json_value support cache

2023-05-17 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-32115: -- Description: [https://github.com/apache/hive/blob/storage-branch-2.3/ql/src/java/org/apache/ha

[jira] [Created] (FLINK-32132) Cast function CODEGEN does not work as expected when nullOnFailure enabled

2023-05-19 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-32132: - Summary: Cast function CODEGEN does not work as expected when nullOnFailure enabled Key: FLINK-32132 URL: https://issues.apache.org/jira/browse/FLINK-32132 Project:

[jira] [Updated] (FLINK-32132) Cast function CODEGEN does not work as expected when nullOnFailure enabled

2023-05-19 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-32132: -- Description: I am trying to generate code cast string to bigint, and got generated code like:

[jira] [Commented] (FLINK-32132) Cast function CODEGEN does not work as expected when nullOnFailure enabled

2023-05-21 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17724780#comment-17724780 ] xiaogang zhou commented on FLINK-32132: --- [~luoyuxia] yes, please assign to me > C

[jira] [Updated] (FLINK-32115) json_value support cache

2023-05-21 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-32115: -- Description: [https://github.com/apache/hive/blob/storage-branch-2.3/ql/src/java/org/apache/ha

[jira] [Updated] (FLINK-32115) json_value support cache

2023-05-22 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-32115: -- Description: [https://github.com/apache/hive/blob/storage-branch-2.3/ql/src/java/org/apache/ha

[jira] [Commented] (FLINK-32115) json_value support cache

2023-05-22 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17724801#comment-17724801 ] xiaogang zhou commented on FLINK-32115: --- [~luoyuxia] Hi yuxia, can you please help

[jira] (FLINK-32115) json_value support cache

2023-05-23 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32115 ] xiaogang zhou deleted comment on FLINK-32115: --- was (Author: zhoujira86): [~luoyuxia] Hi yuxia, can you please help review this? > json_value support cache > > >

[jira] [Commented] (FLINK-32132) Cast function CODEGEN does not work as expected when nullOnFailure enabled

2023-05-25 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17726445#comment-17726445 ] xiaogang zhou commented on FLINK-32132: --- [~luoyuxia] Can you please help review >

[jira] [Commented] (FLINK-16009) Native support for the Variable-length and Zig-zag Variable-length integers

2023-05-05 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17719745#comment-17719745 ] xiaogang zhou commented on FLINK-16009: --- [~nkruber] [~gaoyunhaii]  Hi masters, I

[jira] [Created] (FLINK-32738) PROTOBUF format supports projection push down

2023-08-02 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-32738: - Summary: PROTOBUF format supports projection push down Key: FLINK-32738 URL: https://issues.apache.org/jira/browse/FLINK-32738 Project: Flink Issue Type: S

[jira] [Commented] (FLINK-32738) PROTOBUF format supports projection push down

2023-08-02 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17750527#comment-17750527 ] xiaogang zhou commented on FLINK-32738: --- [~libenchao] created, please help assign

[jira] [Comment Edited] (FLINK-32732) auto offset reset should be exposed to user

2023-08-02 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17750183#comment-17750183 ] xiaogang zhou edited comment on FLINK-32732 at 8/3/23 2:30 AM: ---

[jira] [Commented] (FLINK-32732) auto offset reset should be exposed to user

2023-08-02 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17750532#comment-17750532 ] xiaogang zhou commented on FLINK-32732: --- [~renqs] The main defect of the current i

[jira] [Created] (FLINK-32765) create view should reuse calcite tree

2023-08-06 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-32765: - Summary: create view should reuse calcite tree Key: FLINK-32765 URL: https://issues.apache.org/jira/browse/FLINK-32765 Project: Flink Issue Type: Improveme

[jira] [Updated] (FLINK-32765) create view should reuse calcite tree

2023-08-06 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-32765: -- Component/s: Table SQL / API (was: Table SQL / Planner) > create view sho

[jira] [Updated] (FLINK-32765) create view should reuse calcite tree

2023-08-07 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-32765: -- Description: {code:java} // code placeholder CREATE TABLE source (     k2 bigint,     o1 bigi

[jira] [Updated] (FLINK-32765) create view should reuse calcite tree

2023-08-07 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-32765: -- Description: {code:java} // code placeholder CREATE TABLE source (     k2 bigint,     o1 bigi

[jira] [Updated] (FLINK-32765) create view should reuse calcite tree

2023-08-07 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-32765: -- Description: {code:java} // code placeholder CREATE TABLE source (     k2 bigint,     o1 bigi

[jira] [Commented] (FLINK-21688) we use setIncreaseParallelism function, can cause slow flush in restore

2021-03-23 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17307520#comment-17307520 ] xiaogang zhou commented on FLINK-21688: --- [~yunta] Hello, Can you please help under

[jira] [Created] (FLINK-22008) writing metadata is not an atomic operation, we should add a commit logic

2021-03-29 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-22008: - Summary: writing metadata is not an atomic operation, we should add a commit logic Key: FLINK-22008 URL: https://issues.apache.org/jira/browse/FLINK-22008 Project:

[jira] [Commented] (FLINK-22008) writing metadata is not an atomic operation, we should add a commit logic

2021-03-29 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310578#comment-17310578 ] xiaogang zhou commented on FLINK-22008: --- if a metadata is invalid, someone search

[jira] [Comment Edited] (FLINK-22008) writing metadata is not an atomic operation, we should add a commit logic

2021-03-29 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310578#comment-17310578 ] xiaogang zhou edited comment on FLINK-22008 at 3/29/21, 11:21 AM:

[jira] [Commented] (FLINK-22008) writing metadata is not an atomic operation, we should add a commit logic

2021-03-29 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17311148#comment-17311148 ] xiaogang zhou commented on FLINK-22008: --- [~yunta] thx for reply, would you please

[jira] [Commented] (FLINK-21688) we use setIncreaseParallelism function, can cause slow flush in restore

2021-03-30 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17311244#comment-17311244 ] xiaogang zhou commented on FLINK-21688: --- [~yunta] Thx for explanation, will try to

[jira] [Commented] (FLINK-17808) Rename checkpoint meta file to "_metadata" until it has completed writing

2021-03-30 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17311245#comment-17311245 ] xiaogang zhou commented on FLINK-17808: --- Should we create a pointer point to the l

[jira] [Commented] (FLINK-17808) Rename checkpoint meta file to "_metadata" until it has completed writing

2021-03-30 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312029#comment-17312029 ] xiaogang zhou commented on FLINK-17808: --- [~yunta] As Steven mentioned above, betwe

[jira] [Comment Edited] (FLINK-17808) Rename checkpoint meta file to "_metadata" until it has completed writing

2021-03-30 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312029#comment-17312029 ] xiaogang zhou edited comment on FLINK-17808 at 3/31/21, 3:39 AM: -

[jira] [Created] (FLINK-22059) add a new option is rocksdb statebackend to enable job threads setting

2021-03-30 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-22059: - Summary: add a new option is rocksdb statebackend to enable job threads setting Key: FLINK-22059 URL: https://issues.apache.org/jira/browse/FLINK-22059 Project: Fli

[jira] [Comment Edited] (FLINK-17808) Rename checkpoint meta file to "_metadata" until it has completed writing

2021-03-30 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312029#comment-17312029 ] xiaogang zhou edited comment on FLINK-17808 at 3/31/21, 6:10 AM: -

[jira] [Commented] (FLINK-22059) add a new option is rocksdb statebackend to enable job threads setting

2021-03-31 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312157#comment-17312157 ] xiaogang zhou commented on FLINK-22059: --- [~yunta] yes, I'd like to take the ticket

[jira] [Commented] (FLINK-22059) add a new option is rocksdb statebackend to enable job threads setting

2021-06-28 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17370989#comment-17370989 ] xiaogang zhou commented on FLINK-22059: --- Sorry I forgot it, will submit a PR soon

[jira] [Comment Edited] (FLINK-22059) add a new option is rocksdb statebackend to enable job threads setting

2021-06-28 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17370989#comment-17370989 ] xiaogang zhou edited comment on FLINK-22059 at 6/29/21, 2:28 AM: -

[jira] [Updated] (FLINK-21543) when using FIFO compaction, I found sst being deleted on the first checkpoint

2021-03-02 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-21543: -- Description: 2021/03/01-18:51:01.202049 7f59042fc700 (Original Log Time 2021/03/01-18:51:01.2

[jira] [Updated] (FLINK-21543) when using FIFO compaction, I found sst being deleted on the first checkpoint

2021-03-02 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-21543: -- Attachment: LOG (2) > when using FIFO compaction, I found sst being deleted on the first check

[jira] [Commented] (FLINK-21543) when using FIFO compaction, I found sst being deleted on the first checkpoint

2021-03-02 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294247#comment-17294247 ] xiaogang zhou commented on FLINK-21543: --- [~yunta] As level compaction can cause to

[jira] [Commented] (FLINK-21543) when using FIFO compaction, I found sst being deleted on the first checkpoint

2021-03-02 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294250#comment-17294250 ] xiaogang zhou commented on FLINK-21543: --- !image-2021-03-03-11-35-11-458.png! evid

[jira] [Updated] (FLINK-21543) when using FIFO compaction, I found sst being deleted on the first checkpoint

2021-03-02 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-21543: -- Attachment: image-2021-03-03-11-35-11-458.png > when using FIFO compaction, I found sst being

[jira] [Updated] (FLINK-21543) when using FIFO compaction, I found sst being deleted on the first checkpoint

2021-03-02 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-21543: -- Attachment: image-2021-03-03-13-09-01-695.png > when using FIFO compaction, I found sst being

[jira] [Commented] (FLINK-21543) when using FIFO compaction, I found sst being deleted on the first checkpoint

2021-03-02 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294281#comment-17294281 ] xiaogang zhou commented on FLINK-21543: --- !image-2021-03-03-13-09-01-695.png! 主要还是

[jira] [Commented] (FLINK-21543) when using FIFO compaction, I found sst being deleted on the first checkpoint

2021-03-02 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294288#comment-17294288 ] xiaogang zhou commented on FLINK-21543: --- And Can we support a fifo auto compaction

[jira] [Created] (FLINK-21688) we use setIncreaseParallelism function, can cause slow flush in restore

2021-03-09 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-21688: - Summary: we use setIncreaseParallelism function, can cause slow flush in restore Key: FLINK-21688 URL: https://issues.apache.org/jira/browse/FLINK-21688 Project: Fl

[jira] [Created] (FLINK-19757) TimeStampData can cause time inconsistent problem

2020-10-21 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-19757: - Summary: TimeStampData can cause time inconsistent problem Key: FLINK-19757 URL: https://issues.apache.org/jira/browse/FLINK-19757 Project: Flink Issue Typ

[jira] [Updated] (FLINK-19757) TimeStampData can cause time inconsistent problem

2020-10-21 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-19757: -- Description: when we check jdk LocalDateTime code,we find that public static LocalDateTime of

[jira] [Updated] (FLINK-19757) TimeStampData can cause time inconsistent problem

2020-10-21 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-19757: -- Description: when we check jdk LocalDateTime code,we find that   {code:java} // code placehol

[jira] [Commented] (FLINK-19757) TimeStampData can cause time inconsistent problem

2020-10-21 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218759#comment-17218759 ] xiaogang zhou commented on FLINK-19757: --- [~jark] thx for commenting, if i run the

[jira] [Commented] (FLINK-19757) TimeStampData can cause time inconsistent problem

2020-10-21 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218784#comment-17218784 ] xiaogang zhou commented on FLINK-19757: --- [~jark] the ideal that TimestampData and

[jira] [Commented] (FLINK-19757) TimeStampData can cause time inconsistent problem

2020-10-22 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218821#comment-17218821 ] xiaogang zhou commented on FLINK-19757: --- Hi [~jark] , My point is using LocalDateT

[jira] [Comment Edited] (FLINK-19757) TimeStampData can cause time inconsistent problem

2020-10-22 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218821#comment-17218821 ] xiaogang zhou edited comment on FLINK-19757 at 10/22/20, 7:30 AM:

[jira] [Commented] (FLINK-19757) TimeStampData can cause time inconsistent problem

2020-10-22 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218914#comment-17218914 ] xiaogang zhou commented on FLINK-19757: --- [~jark] Thx,  we both agree there is no t

[jira] [Commented] (FLINK-19757) TimeStampData can cause time inconsistent problem

2020-10-22 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218970#comment-17218970 ] xiaogang zhou commented on FLINK-19757: --- the problem is if there is a proctime() i

[jira] [Comment Edited] (FLINK-19757) TimeStampData can cause time inconsistent problem

2020-10-22 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218970#comment-17218970 ] xiaogang zhou edited comment on FLINK-19757 at 10/22/20, 12:06 PM: ---

[jira] [Commented] (FLINK-19757) TimeStampData can cause time inconsistent problem

2020-10-22 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218979#comment-17218979 ] xiaogang zhou commented on FLINK-19757: --- clear > TimeStampData can cause time inc

[jira] [Created] (FLINK-19847) Can we create a fast support on the Nested table join?

2020-10-28 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-19847: - Summary: Can we create a fast support on the Nested table join? Key: FLINK-19847 URL: https://issues.apache.org/jira/browse/FLINK-19847 Project: Flink Issu

[jira] [Commented] (FLINK-19847) Can we create a fast support on the Nested table join?

2020-10-28 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17222026#comment-17222026 ] xiaogang zhou commented on FLINK-19847: --- [~jark] Please help review, thx > Can we

[jira] [Comment Edited] (FLINK-19847) Can we create a fast support on the Nested table join?

2020-10-28 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17222033#comment-17222033 ] xiaogang zhou edited comment on FLINK-19847 at 10/28/20, 8:20 AM:

[jira] [Commented] (FLINK-19847) Can we create a fast support on the Nested table join?

2020-10-28 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17222033#comment-17222033 ] xiaogang zhou commented on FLINK-19847: --- In our situation, we use a Asynclookup fo

[jira] [Commented] (FLINK-19847) Can we create a fast support on the Nested table join?

2020-10-28 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17222042#comment-17222042 ] xiaogang zhou commented on FLINK-19847: --- looks like splitJoinCondition already has

[jira] [Commented] (FLINK-17808) Rename checkpoint meta file to "_metadata" until it has completed writing

2021-04-06 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17315992#comment-17315992 ] xiaogang zhou commented on FLINK-17808: --- [~yunta] Let me know your thinking :) >

[jira] [Created] (FLINK-15264) Job Manager TASK_SLOTS_TOTAL metrics does not shows the Job ID

2019-12-15 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-15264: - Summary: Job Manager TASK_SLOTS_TOTAL metrics does not shows the Job ID Key: FLINK-15264 URL: https://issues.apache.org/jira/browse/FLINK-15264 Project: Flink

[jira] [Created] (FLINK-16721) getProcessCpuLoad seems to report a wrong cpu load

2020-03-23 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-16721: - Summary: getProcessCpuLoad seems to report a wrong cpu load Key: FLINK-16721 URL: https://issues.apache.org/jira/browse/FLINK-16721 Project: Flink Issue T

[jira] [Updated] (FLINK-16721) getProcessCpuLoad seems to report a wrong cpu load

2020-03-23 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-16721: -- Attachment: c (1).txt > getProcessCpuLoad seems to report a wrong cpu load >

[jira] [Updated] (FLINK-16721) getProcessCpuLoad seems to report a wrong cpu load

2020-03-23 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-16721: -- Attachment: (was: c (1).txt) > getProcessCpuLoad seems to report a wrong cpu load > -

[jira] [Updated] (FLINK-16721) getProcessCpuLoad seems to report a wrong cpu load

2020-03-23 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-16721: -- Attachment: busythreads.txt > getProcessCpuLoad seems to report a wrong cpu load > --

[jira] [Updated] (FLINK-16721) getProcessCpuLoad seems to report a wrong cpu load

2020-03-23 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-16721: -- Attachment: cpu trend.png > getProcessCpuLoad seems to report a wrong cpu load >

[jira] [Updated] (FLINK-16721) getProcessCpuLoad seems to report a wrong cpu load

2020-03-23 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-16721: -- Description: I am monitoring the flink_taskmanager_Status_JVM_CPU_Load in the prometheus. As

[jira] [Created] (FLINK-30256) LogalWindowAgg can set the chaining Strategy to always

2022-11-30 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-30256: - Summary: LogalWindowAgg can set the chaining Strategy to always Key: FLINK-30256 URL: https://issues.apache.org/jira/browse/FLINK-30256 Project: Flink Issu

[jira] [Closed] (FLINK-30256) LogalWindowAgg can set the chaining Strategy to always

2022-11-30 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou closed FLINK-30256. - Resolution: Duplicate > LogalWindowAgg can set the chaining Strategy to always > ---

[jira] [Commented] (FLINK-27944) IO metrics collision happens if a task has union inputs

2022-06-20 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17556668#comment-17556668 ] xiaogang zhou commented on FLINK-27944: --- this issue is introduced by register the

[jira] [Commented] (FLINK-27944) IO metrics collision happens if a task has union inputs

2022-06-21 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17556687#comment-17556687 ] xiaogang zhou commented on FLINK-27944: --- [~chesnay] hi Chesnay, would you please h

[jira] [Commented] (FLINK-29545) kafka consuming stop when trigger first checkpoint

2022-10-24 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17623212#comment-17623212 ] xiaogang zhou commented on FLINK-29545: --- [~pnowojski] Hi Master, I could clearly f

[jira] [Created] (FLINK-29545) kafka consuming stop when trigger first checkpoint

2022-10-08 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-29545: - Summary: kafka consuming stop when trigger first checkpoint Key: FLINK-29545 URL: https://issues.apache.org/jira/browse/FLINK-29545 Project: Flink Issue Ty

[jira] [Updated] (FLINK-29545) kafka consuming stop when trigger first checkpoint

2022-10-08 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-29545: -- Attachment: task dag.png > kafka consuming stop when trigger first checkpoint > --

[jira] [Updated] (FLINK-29545) kafka consuming stop when trigger first checkpoint

2022-10-08 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-29545: -- Description: the task dag is like attached file. when the task is started to consume from ear

[jira] [Updated] (FLINK-29545) kafka consuming stop when trigger first checkpoint

2022-10-08 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-29545: -- Attachment: backpressure 100 busy 0.png > kafka consuming stop when trigger first checkpoint >

[jira] [Updated] (FLINK-29545) kafka consuming stop when trigger first checkpoint

2022-10-08 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-29545: -- Attachment: task acknowledge na.png > kafka consuming stop when trigger first checkpoint > ---

<    1   2   3   >