[jira] [Commented] (FLINK-32086) Cleanup non-reported managed directory on exit of TM

2024-04-22 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17839917#comment-17839917 ] xiaogang zhou commented on FLINK-32086: --- [~Zakelly] yes no problem > Cleanup non-

[jira] [Commented] (FLINK-32070) FLIP-306 Unified File Merging Mechanism for Checkpoints

2024-04-07 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17834636#comment-17834636 ] xiaogang zhou commented on FLINK-32070: --- [~Zakelly] yes, sounds good, Let me take

[jira] [Comment Edited] (FLINK-32070) FLIP-306 Unified File Merging Mechanism for Checkpoints

2024-04-06 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17834609#comment-17834609 ] xiaogang zhou edited comment on FLINK-32070 at 4/7/24 6:36 AM: ---

[jira] [Commented] (FLINK-32070) FLIP-306 Unified File Merging Mechanism for Checkpoints

2024-04-06 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17834609#comment-17834609 ] xiaogang zhou commented on FLINK-32070: --- Is there any Branch I can view do a POC?

[jira] [Commented] (FLINK-32070) FLIP-306 Unified File Merging Mechanism for Checkpoints

2024-04-06 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17834580#comment-17834580 ] xiaogang zhou commented on FLINK-32070: --- [~Zakelly] Hi, we met a problem that FLIN

[jira] [Commented] (FLINK-34976) LD_PRELOAD environment may not be effective after su to flink user

2024-04-01 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17832762#comment-17832762 ] xiaogang zhou commented on FLINK-34976: --- [~yunta] Ok, Thanks for clarification >

[jira] [Closed] (FLINK-34976) LD_PRELOAD environment may not be effective after su to flink user

2024-04-01 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou closed FLINK-34976. - Resolution: Invalid > LD_PRELOAD environment may not be effective after su to flink user > -

[jira] [Updated] (FLINK-34976) LD_PRELOAD environment may not be effective after su to flink user

2024-03-31 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-34976: -- Description: I am not sure if LD_PRELOAD  still takes effect after drop_privs_cmd. Do we need

[jira] [Updated] (FLINK-34976) LD_PRELOAD environment may not be effective after su to flink user

2024-03-31 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-34976: -- Description: I am not sure if LD_PRELOAD  still takes effect after drop_privs_cmd. Should we 

[jira] [Updated] (FLINK-34976) LD_PRELOAD environment may not be effective after su to flink user

2024-03-31 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-34976: -- Description: I am not sure if LD_PRELOAD  still takes effect after drop_privs_cmd. Do we need

[jira] [Created] (FLINK-34976) LD_PRELOAD environment may not be effective after su to flink user

2024-03-31 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-34976: - Summary: LD_PRELOAD environment may not be effective after su to flink user Key: FLINK-34976 URL: https://issues.apache.org/jira/browse/FLINK-34976 Project: Flink

[jira] [Commented] (FLINK-17593) Support arbitrary recovery mechanism for PartFileWriter

2024-02-04 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17814195#comment-17814195 ] xiaogang zhou commented on FLINK-17593: --- [~maguowei] Hi , for filesystem which doe

[jira] [Updated] (FLINK-33728) Do not rewatch when KubernetesResourceManagerDriver watch fail

2024-01-22 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-33728: -- Summary: Do not rewatch when KubernetesResourceManagerDriver watch fail (was: do not rewatch

[jira] [Commented] (FLINK-33728) do not rewatch when KubernetesResourceManagerDriver watch fail

2024-01-14 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17806640#comment-17806640 ] xiaogang zhou commented on FLINK-33728: --- [~xtsong] [~wangyang0918] Ok, glad to hea

[jira] [Updated] (FLINK-33741) Expose Rocksdb Histogram statistics in Flink metrics

2024-01-09 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-33741: -- Summary: Expose Rocksdb Histogram statistics in Flink metrics (was: Exposed Rocksdb Histogra

[jira] [Updated] (FLINK-33741) Exposed Rocksdb Histogram statistics in Flink metrics

2024-01-09 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-33741: -- Description: I'd like to expose ROCKSDB Histogram metrics like db_get db_write to enable troub

[jira] [Updated] (FLINK-33741) Exposed Rocksdb Histogram statistics in Flink metrics

2024-01-09 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-33741: -- Summary: Exposed Rocksdb Histogram statistics in Flink metrics (was: Exposed Rocksdb statist

[jira] [Comment Edited] (FLINK-33728) do not rewatch when KubernetesResourceManagerDriver watch fail

2024-01-09 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17804638#comment-17804638 ] xiaogang zhou edited comment on FLINK-33728 at 1/9/24 8:53 AM: ---

[jira] [Comment Edited] (FLINK-33728) do not rewatch when KubernetesResourceManagerDriver watch fail

2024-01-09 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17804638#comment-17804638 ] xiaogang zhou edited comment on FLINK-33728 at 1/9/24 8:52 AM: ---

[jira] [Commented] (FLINK-33728) do not rewatch when KubernetesResourceManagerDriver watch fail

2024-01-09 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17804638#comment-17804638 ] xiaogang zhou commented on FLINK-33728: --- [~xtsong] In a default FLINK setting, whe

[jira] [Commented] (FLINK-33728) do not rewatch when KubernetesResourceManagerDriver watch fail

2024-01-08 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17804553#comment-17804553 ] xiaogang zhou commented on FLINK-33728: --- [~mapohl] I think your concern is really

[jira] [Commented] (FLINK-33728) do not rewatch when KubernetesResourceManagerDriver watch fail

2024-01-08 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17804214#comment-17804214 ] xiaogang zhou commented on FLINK-33728: --- Hi Matthias, wish you had recovered and e

[jira] [Commented] (FLINK-33728) do not rewatch when KubernetesResourceManagerDriver watch fail

2023-12-19 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17798797#comment-17798797 ] xiaogang zhou commented on FLINK-33728: --- [~mapohl] Hi Matthias , would you please

[jira] [Commented] (FLINK-33728) do not rewatch when KubernetesResourceManagerDriver watch fail

2023-12-11 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17795571#comment-17795571 ] xiaogang zhou commented on FLINK-33728: --- Hi [~mapohl] , thanks for the comment abo

[jira] [Updated] (FLINK-33741) Exposed Rocksdb statistics in Flink metrics and introduce 2 Rocksdb statistic related configuration

2023-12-10 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-33741: -- Summary: Exposed Rocksdb statistics in Flink metrics and introduce 2 Rocksdb statistic related

[jira] [Updated] (FLINK-33741) Exposed Rocksdb statistics in Flink metrics and introduce 2 Rocksdb statistic related configuration

2023-12-10 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-33741: -- Description: I think we can also parse the multi-line string of the rocksdb statistics. {code:

[jira] [Updated] (FLINK-33741) Introduce stat dump period and statsLevel configuration

2023-12-10 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-33741: -- Summary: Introduce stat dump period and statsLevel configuration (was: introduce stat dump pe

[jira] [Commented] (FLINK-33741) introduce stat dump period and statsLevel configuration

2023-12-09 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17794941#comment-17794941 ] xiaogang zhou commented on FLINK-33741: --- And I think we can also parse the multi-l

[jira] [Comment Edited] (FLINK-33728) do not rewatch when KubernetesResourceManagerDriver watch fail

2023-12-09 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17794900#comment-17794900 ] xiaogang zhou edited comment on FLINK-33728 at 12/9/23 9:52 AM: --

[jira] [Commented] (FLINK-33728) do not rewatch when KubernetesResourceManagerDriver watch fail

2023-12-08 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17794900#comment-17794900 ] xiaogang zhou commented on FLINK-33728: --- [~gyfora] my proposal is keep the jobmana

[jira] [Created] (FLINK-33741) introduce stat dump period and statsLevel configuration

2023-12-04 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-33741: - Summary: introduce stat dump period and statsLevel configuration Key: FLINK-33741 URL: https://issues.apache.org/jira/browse/FLINK-33741 Project: Flink Iss

[jira] [Commented] (FLINK-33728) do not rewatch when KubernetesResourceManagerDriver watch fail

2023-12-04 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17793092#comment-17793092 ] xiaogang zhou commented on FLINK-33728: --- [~wangyang0918] [~mapohl] [~gyfora] Would

[jira] [Updated] (FLINK-33728) do not rewatch when KubernetesResourceManagerDriver watch fail

2023-12-04 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-33728: -- Description: I met massive production problem when kubernetes ETCD slow responding happen. Af

[jira] [Updated] (FLINK-33728) do not rewatch when KubernetesResourceManagerDriver watch fail

2023-12-03 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-33728: -- Description: is it necessary to getResourceEventHandler().onError(throwable) in  PodCallback

[jira] [Created] (FLINK-33728) do not rewatch when KubernetesResourceManagerDriver watch fail

2023-12-03 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-33728: - Summary: do not rewatch when KubernetesResourceManagerDriver watch fail Key: FLINK-33728 URL: https://issues.apache.org/jira/browse/FLINK-33728 Project: Flink

[jira] [Commented] (FLINK-33249) comment should be parsed by StringLiteral() instead of SqlCharStringLiteral to avoid parsing failure

2023-10-18 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1035#comment-1035 ] xiaogang zhou commented on FLINK-33249: --- Hi [~martijnvisser] https://issues.apach

[jira] [Commented] (FLINK-33249) comment should be parsed by StringLiteral() instead of SqlCharStringLiteral to avoid parsing failure

2023-10-12 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17774468#comment-17774468 ] xiaogang zhou commented on FLINK-33249: --- [~martijnvisser] Sure thing, Let me provi

[jira] [Commented] (FLINK-33249) comment should be parsed by StringLiteral() instead of SqlCharStringLiteral to avoid parsing failure

2023-10-12 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17774426#comment-17774426 ] xiaogang zhou commented on FLINK-33249: --- [~martijnvisser]  Hi Martin, I am not sur

[jira] [Commented] (FLINK-33249) comment should be parsed by StringLiteral() instead of SqlCharStringLiteral to avoid parsing failure

2023-10-11 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17774339#comment-17774339 ] xiaogang zhou commented on FLINK-33249: --- I'd like to take this ticket > comment s

[jira] [Updated] (FLINK-33249) comment should be parsed by StringLiteral() instead of SqlCharStringLiteral to avoid parsing failure

2023-10-11 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-33249: -- Description: this problem is also recorded in calcite   https://issues.apache.org/jira/brows

[jira] [Updated] (FLINK-33249) comment should be parsed by StringLiteral() instead of SqlCharStringLiteral to avoid parsing failure

2023-10-11 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-33249: -- Description: this problem is also recorded in calcite   https://issues.apache.org/jira/brows

[jira] [Created] (FLINK-33249) comment should be parsed by StringLiteral() instead of SqlCharStringLiteral to avoid parsing failure

2023-10-11 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-33249: - Summary: comment should be parsed by StringLiteral() instead of SqlCharStringLiteral to avoid parsing failure Key: FLINK-33249 URL: https://issues.apache.org/jira/browse/FLINK-3

[jira] [Commented] (FLINK-33174) enabling tablesample bernoulli in flink

2023-10-09 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17773306#comment-17773306 ] xiaogang zhou commented on FLINK-33174: --- [~libenchao] [~lsy] [~martijnvisser]  Tha

[jira] [Commented] (FLINK-33174) enabling tablesample bernoulli in flink

2023-10-07 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17772820#comment-17772820 ] xiaogang zhou commented on FLINK-33174: --- [~libenchao] Hi Benchao, Would you please

[jira] [Commented] (FLINK-33174) enabling tablesample bernoulli in flink

2023-10-01 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17770822#comment-17770822 ] xiaogang zhou commented on FLINK-33174: --- [~lsy] [~libenchao] Hi Bros, would you pl

[jira] [Created] (FLINK-33174) enabling tablesample bernoulli in flink

2023-10-01 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-33174: - Summary: enabling tablesample bernoulli in flink Key: FLINK-33174 URL: https://issues.apache.org/jira/browse/FLINK-33174 Project: Flink Issue Type: Improve

[jira] [Updated] (FLINK-33162) seperate the executor in DefaultDispatcherResourceManagerComponentFactory for MetricFetcher and webMonitorEndpoint

2023-09-26 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-33162: -- Description: when starting a job with large number of taskmanagers, the jobmanager of the job

[jira] [Updated] (FLINK-33162) seperate the executor in DefaultDispatcherResourceManagerComponentFactory for MetricFetcher and webMonitorEndpoint

2023-09-26 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-33162: -- Affects Version/s: 1.13.1 (was: 1.16.0) > seperate the executor in

[jira] [Updated] (FLINK-33162) seperate the executor in DefaultDispatcherResourceManagerComponentFactory for MetricFetcher and webMonitorEndpoint

2023-09-26 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-33162: -- Description: when starting a job with large number of taskmanagers, the jobmanager of the job

[jira] [Created] (FLINK-33162) seperate the executor in DefaultDispatcherResourceManagerComponentFactory for MetricFetcher and webMonitorEndpoint

2023-09-26 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-33162: - Summary: seperate the executor in DefaultDispatcherResourceManagerComponentFactory for MetricFetcher and webMonitorEndpoint Key: FLINK-33162 URL: https://issues.apache.org/jira

[jira] [Comment Edited] (FLINK-33038) remove getMinRetentionTime in StreamExecDeduplicate

2023-09-05 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17762248#comment-17762248 ] xiaogang zhou edited comment on FLINK-33038 at 9/6/23 2:26 AM: ---

[jira] [Commented] (FLINK-33038) remove getMinRetentionTime in StreamExecDeduplicate

2023-09-05 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17762248#comment-17762248 ] xiaogang zhou commented on FLINK-33038: --- [~Sergey Nuyanzin] [https://github.com/ap

[jira] [Commented] (FLINK-33038) remove getMinRetentionTime in StreamExecDeduplicate

2023-09-05 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17762032#comment-17762032 ] xiaogang zhou commented on FLINK-33038: --- [~snuyanzin] would you please help assign

[jira] [Updated] (FLINK-33038) remove getMinRetentionTime in StreamExecDeduplicate

2023-09-05 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-33038: -- Description: I suggest to remove the getMinRetentionTime method in StreamExecDeduplicate as i

[jira] [Created] (FLINK-33038) remove getMinRetentionTime in StreamExecDeduplicate

2023-09-05 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-33038: - Summary: remove getMinRetentionTime in StreamExecDeduplicate Key: FLINK-33038 URL: https://issues.apache.org/jira/browse/FLINK-33038 Project: Flink Issue T

[jira] [Commented] (FLINK-22059) add a new option is rocksdb statebackend to enable job threads setting

2023-09-03 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17761587#comment-17761587 ] xiaogang zhou commented on FLINK-22059: --- [~Zakelly] yes > add a new option is roc

[jira] [Updated] (FLINK-32765) create view should reuse calcite tree

2023-08-07 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-32765: -- Description: {code:java} // code placeholder CREATE TABLE source (     k2 bigint,     o1 bigi

[jira] [Updated] (FLINK-32765) create view should reuse calcite tree

2023-08-07 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-32765: -- Description: {code:java} // code placeholder CREATE TABLE source (     k2 bigint,     o1 bigi

[jira] [Updated] (FLINK-32765) create view should reuse calcite tree

2023-08-07 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-32765: -- Description: {code:java} // code placeholder CREATE TABLE source (     k2 bigint,     o1 bigi

[jira] [Updated] (FLINK-32765) create view should reuse calcite tree

2023-08-06 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-32765: -- Component/s: Table SQL / API (was: Table SQL / Planner) > create view sho

[jira] [Created] (FLINK-32765) create view should reuse calcite tree

2023-08-06 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-32765: - Summary: create view should reuse calcite tree Key: FLINK-32765 URL: https://issues.apache.org/jira/browse/FLINK-32765 Project: Flink Issue Type: Improveme

[jira] [Commented] (FLINK-32732) auto offset reset should be exposed to user

2023-08-02 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17750532#comment-17750532 ] xiaogang zhou commented on FLINK-32732: --- [~renqs] The main defect of the current i

[jira] [Comment Edited] (FLINK-32732) auto offset reset should be exposed to user

2023-08-02 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17750183#comment-17750183 ] xiaogang zhou edited comment on FLINK-32732 at 8/3/23 2:30 AM: ---

[jira] [Commented] (FLINK-32738) PROTOBUF format supports projection push down

2023-08-02 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17750527#comment-17750527 ] xiaogang zhou commented on FLINK-32738: --- [~libenchao] created, please help assign

[jira] [Created] (FLINK-32738) PROTOBUF format supports projection push down

2023-08-02 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-32738: - Summary: PROTOBUF format supports projection push down Key: FLINK-32738 URL: https://issues.apache.org/jira/browse/FLINK-32738 Project: Flink Issue Type: S

[jira] [Commented] (FLINK-32607) Kafka table source and json format support projection pushdown

2023-08-02 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17750184#comment-17750184 ] xiaogang zhou commented on FLINK-32607: --- [~libenchao] Not sure if someone has take

[jira] [Commented] (FLINK-32732) auto offset reset should be exposed to user

2023-08-02 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17750183#comment-17750183 ] xiaogang zhou commented on FLINK-32732: --- [~libenchao] [~renqs]  let me know your t

[jira] [Updated] (FLINK-32732) auto offset reset should be exposed to user

2023-08-02 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-32732: -- Description: {code:java} // code placeholder maybeOverride( ConsumerConfig.AUTO_OFFSET

[jira] [Updated] (FLINK-32732) auto offset reset should be exposed to user

2023-08-02 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-32732: -- Description: {code:java} // code placeholder maybeOverride( ConsumerConfig.AUTO_OFFSET

[jira] [Created] (FLINK-32732) auto offset reset should be exposed to user

2023-08-02 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-32732: - Summary: auto offset reset should be exposed to user Key: FLINK-32732 URL: https://issues.apache.org/jira/browse/FLINK-32732 Project: Flink Issue Type: Imp

[jira] [Commented] (FLINK-32132) Cast function CODEGEN does not work as expected when nullOnFailure enabled

2023-05-25 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17726445#comment-17726445 ] xiaogang zhou commented on FLINK-32132: --- [~luoyuxia] Can you please help review >

[jira] (FLINK-32115) json_value support cache

2023-05-23 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32115 ] xiaogang zhou deleted comment on FLINK-32115: --- was (Author: zhoujira86): [~luoyuxia] Hi yuxia, can you please help review this? > json_value support cache > > >

[jira] [Commented] (FLINK-32115) json_value support cache

2023-05-22 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17724801#comment-17724801 ] xiaogang zhou commented on FLINK-32115: --- [~luoyuxia] Hi yuxia, can you please help

[jira] [Updated] (FLINK-32115) json_value support cache

2023-05-22 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-32115: -- Description: [https://github.com/apache/hive/blob/storage-branch-2.3/ql/src/java/org/apache/ha

[jira] [Updated] (FLINK-32115) json_value support cache

2023-05-21 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-32115: -- Description: [https://github.com/apache/hive/blob/storage-branch-2.3/ql/src/java/org/apache/ha

[jira] [Commented] (FLINK-32132) Cast function CODEGEN does not work as expected when nullOnFailure enabled

2023-05-21 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17724780#comment-17724780 ] xiaogang zhou commented on FLINK-32132: --- [~luoyuxia] yes, please assign to me > C

[jira] [Updated] (FLINK-32132) Cast function CODEGEN does not work as expected when nullOnFailure enabled

2023-05-19 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-32132: -- Description: I am trying to generate code cast string to bigint, and got generated code like:

[jira] [Created] (FLINK-32132) Cast function CODEGEN does not work as expected when nullOnFailure enabled

2023-05-19 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-32132: - Summary: Cast function CODEGEN does not work as expected when nullOnFailure enabled Key: FLINK-32132 URL: https://issues.apache.org/jira/browse/FLINK-32132 Project:

[jira] [Updated] (FLINK-32115) json_value support cache

2023-05-17 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-32115: -- Description: [https://github.com/apache/hive/blob/storage-branch-2.3/ql/src/java/org/apache/ha

[jira] [Updated] (FLINK-32115) json_value support cache

2023-05-16 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-32115: -- Description: [https://github.com/apache/hive/blob/storage-branch-2.3/ql/src/java/org/apache/ha

[jira] [Created] (FLINK-32115) json_value support cache

2023-05-16 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-32115: - Summary: json_value support cache Key: FLINK-32115 URL: https://issues.apache.org/jira/browse/FLINK-32115 Project: Flink Issue Type: Improvement

[jira] [Commented] (FLINK-16009) Native support for the Variable-length and Zig-zag Variable-length integers

2023-05-05 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17719745#comment-17719745 ] xiaogang zhou commented on FLINK-16009: --- [~nkruber] [~gaoyunhaii]  Hi masters, I

[jira] [Comment Edited] (FLINK-31225) rocksdb max open file can lead to oom

2023-02-27 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17693953#comment-17693953 ] xiaogang zhou edited comment on FLINK-31225 at 2/27/23 10:54 AM: -

[jira] [Commented] (FLINK-31225) rocksdb max open file can lead to oom

2023-02-27 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17693953#comment-17693953 ] xiaogang zhou commented on FLINK-31225: --- [~yunta] Master I logged onto the contai

[jira] [Updated] (FLINK-31225) rocksdb max open file can lead to oom

2023-02-26 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-31225: -- Description: the default value for  state.backend.rocksdb.files.open is -1   [https://gith

[jira] [Updated] (FLINK-31225) rocksdb max open file can lead to oom

2023-02-25 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-31225: -- Description: the default value for  state.backend.rocksdb.files.open is -1   [https://gith

[jira] [Updated] (FLINK-31225) rocksdb max open file can lead to oom

2023-02-25 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-31225: -- Attachment: leak_test(2).png > rocksdb max open file can lead to oom > --

[jira] [Updated] (FLINK-31225) rocksdb max open file can lead to oom

2023-02-25 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-31225: -- Description: the default value for  state.backend.rocksdb.files.open is -1   [https://gith

[jira] [Updated] (FLINK-31225) rocksdb max open file can lead to oom

2023-02-25 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-31225: -- Attachment: image-2023-02-26-12-08-49-717.png > rocksdb max open file can lead to oom > -

[jira] [Comment Edited] (FLINK-31089) pin L0 index in memory can lead to slow memory grow finally lead to memory beyond limit

2023-02-25 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17693581#comment-17693581 ] xiaogang zhou edited comment on FLINK-31089 at 2/26/23 4:05 AM: --

[jira] [Created] (FLINK-31225) rocksdb max open file can lead to oom

2023-02-25 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-31225: - Summary: rocksdb max open file can lead to oom Key: FLINK-31225 URL: https://issues.apache.org/jira/browse/FLINK-31225 Project: Flink Issue Type: Improvem

[jira] [Commented] (FLINK-31089) pin L0 index in memory can lead to slow memory grow finally lead to memory beyond limit

2023-02-25 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17693581#comment-17693581 ] xiaogang zhou commented on FLINK-31089: --- [~Yanfei Lei] yes, your summary is pretty

[jira] [Commented] (FLINK-31089) pin L0 index in memory can lead to slow memory grow finally lead to memory beyond limit

2023-02-23 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17692566#comment-17692566 ] xiaogang zhou commented on FLINK-31089: --- some more info: 1, the task with ttl on

[jira] [Commented] (FLINK-31089) pin L0 index in memory can lead to slow memory grow finally lead to memory beyond limit

2023-02-22 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17692546#comment-17692546 ] xiaogang zhou commented on FLINK-31089: --- [~yunta] if I turn off the PinTopLevelInd

[jira] [Comment Edited] (FLINK-31089) pin L0 index in memory can lead to slow memory grow finally lead to memory beyond limit

2023-02-20 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17690346#comment-17690346 ] xiaogang zhou edited comment on FLINK-31089 at 2/21/23 2:38 AM: --

[jira] [Commented] (FLINK-31089) pin L0 index in memory can lead to slow memory grow finally lead to memory beyond limit

2023-02-20 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17691338#comment-17691338 ] xiaogang zhou commented on FLINK-31089: --- [~yunta] Master, After turn on compaction

[jira] [Commented] (FLINK-31089) pin L0 index in memory can lead to slow memory grow finally lead to memory beyond limit

2023-02-20 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17691153#comment-17691153 ] xiaogang zhou commented on FLINK-31089: --- I create another task with ttl open, And

[jira] [Comment Edited] (FLINK-31089) pin L0 index in memory can lead to slow memory grow finally lead to memory beyond limit

2023-02-20 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17691114#comment-17691114 ] xiaogang zhou edited comment on FLINK-31089 at 2/20/23 10:10 AM: -

[jira] [Commented] (FLINK-31089) pin L0 index in memory can lead to slow memory grow finally lead to memory beyond limit

2023-02-20 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17691114#comment-17691114 ] xiaogang zhou commented on FLINK-31089: --- I found in rocksdb log,   2023/02/20-17

[jira] [Comment Edited] (FLINK-31089) pin L0 index in memory can lead to slow memory grow finally lead to memory beyond limit

2023-02-19 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17690999#comment-17690999 ] xiaogang zhou edited comment on FLINK-31089 at 2/20/23 4:56 AM: --

  1   2   3   >