[jira] [Commented] (FLINK-8533) Support MasterTriggerRestoreHook state reinitialization

[ https://issues.apache.org/jira/browse/FLINK-8533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16360404#comment-16360404 ] Tzu-Li (Gordon) Tai commented on FLINK-8533: [~eronwright]thanks for the heads

[jira] [Commented] (FLINK-8364) Add iterator() to ListState which returns empty iterator when it has no value

[ https://issues.apache.org/jira/browse/FLINK-8364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16360389#comment-16360389 ] ASF GitHub Bot commented on FLINK-8364: --- Github user bowenli86 commented on the issu

[GitHub] flink issue #5356: [FLINK-8364][state backend] Add iterator() to ListState w...

Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5356 @StefanRRichter I think how `null` is handled is one major benefit, not all. Another benefit is that `iterator()` is more intuitive in traversing all values. For example, this change makes ListStat

[jira] [Closed] (FLINK-8638) Job restart when Checkpoint On Barrier failed

[ https://issues.apache.org/jira/browse/FLINK-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ran Tao closed FLINK-8638. -- Resolution: Duplicate > Job restart when Checkpoint On Barrier failed >

[jira] [Commented] (FLINK-8638) Job restart when Checkpoint On Barrier failed

[ https://issues.apache.org/jira/browse/FLINK-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16360378#comment-16360378 ] Ran Tao commented on FLINK-8638: [~yanghua] OK, thanks. > Job restart when Checkpoint On

[jira] [Commented] (FLINK-8516) FlinkKinesisConsumer does not balance shards over subtasks

[ https://issues.apache.org/jira/browse/FLINK-8516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16360377#comment-16360377 ] ASF GitHub Bot commented on FLINK-8516: --- Github user tzulitai commented on the issue

[GitHub] flink issue #5393: [FLINK-8516] Allow for custom hash function for shard to ...

Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/5393 @tweise changes look good, will merge this to `master`. Thanks a lot for the work! ---

[jira] [Assigned] (FLINK-8459) Implement cancelWithSavepoint in RestClusterClient

[ https://issues.apache.org/jira/browse/FLINK-8459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned FLINK-8459: --- Assignee: vinoyang > Implement cancelWithSavepoint in RestClusterClient > ---

[jira] [Commented] (FLINK-8459) Implement cancelWithSavepoint in RestClusterClient

[ https://issues.apache.org/jira/browse/FLINK-8459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16360352#comment-16360352 ] vinoyang commented on FLINK-8459: - Hi [~gjy] , are you handling this issue? If not , can I

[jira] [Commented] (FLINK-7711) Port JarListHandler to new REST endpoint

[ https://issues.apache.org/jira/browse/FLINK-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16360348#comment-16360348 ] ASF GitHub Bot commented on FLINK-7711: --- Github user GJL commented on a diff in the

[GitHub] flink pull request #5455: [FLINK-7711][flip6] Port JarListHandler

Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/5455#discussion_r167474541 --- Diff: flink-runtime-web/src/main/java/org/apache/flink/runtime/webmonitor/handlers/ng/JarListHandler.java --- @@ -0,0 +1,156 @@ +/* + * Licensed to

[jira] [Assigned] (FLINK-8638) Job restart when Checkpoint On Barrier failed

[ https://issues.apache.org/jira/browse/FLINK-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned FLINK-8638: --- Assignee: (was: vinoyang) > Job restart when Checkpoint On Barrier failed > -

[jira] [Commented] (FLINK-8638) Job restart when Checkpoint On Barrier failed

[ https://issues.apache.org/jira/browse/FLINK-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16360342#comment-16360342 ] vinoyang commented on FLINK-8638: - [~insomnia] , I also fixed this bug in our inner versio

[jira] [Commented] (FLINK-8638) Job restart when Checkpoint On Barrier failed

[ https://issues.apache.org/jira/browse/FLINK-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16360292#comment-16360292 ] Ran Tao commented on FLINK-8638: Hi， [~yanghua] It is indeed the case. I fixed this bug i

[jira] [Commented] (FLINK-8638) Job restart when Checkpoint On Barrier failed

[ https://issues.apache.org/jira/browse/FLINK-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16360273#comment-16360273 ] vinoyang commented on FLINK-8638: - Hi [~insomnia] , we also see this problem in our produc

[jira] [Assigned] (FLINK-8638) Job restart when Checkpoint On Barrier failed

[ https://issues.apache.org/jira/browse/FLINK-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned FLINK-8638: --- Assignee: vinoyang > Job restart when Checkpoint On Barrier failed >

[jira] [Updated] (FLINK-8638) Job restart when Checkpoint On Barrier failed

[ https://issues.apache.org/jira/browse/FLINK-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ran Tao updated FLINK-8638: --- Description: The following example comes from the one snapshotState process by using hdfs, snapshotState fail

[jira] [Created] (FLINK-8638) Job restart when Checkpoint On Barrier failed

Ran Tao created FLINK-8638: -- Summary: Job restart when Checkpoint On Barrier failed Key: FLINK-8638 URL: https://issues.apache.org/jira/browse/FLINK-8638 Project: Flink Issue Type: Bug Com

[jira] [Updated] (FLINK-8636) Pass TaskManagerServices to TaskExecutor

[ https://issues.apache.org/jira/browse/FLINK-8636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-8636: - Issue Type: Improvement (was: Bug) > Pass TaskManagerServices to TaskExecutor > -

[jira] [Commented] (FLINK-8637) Pass JobManagerSharedServices to JobMaster

[ https://issues.apache.org/jira/browse/FLINK-8637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16360180#comment-16360180 ] ASF GitHub Bot commented on FLINK-8637: --- GitHub user tillrohrmann opened a pull requ

[GitHub] flink pull request #5457: [FLINK-8637] [flip6] Use JobManagerSharedServices ...

GitHub user tillrohrmann opened a pull request: https://github.com/apache/flink/pull/5457 [FLINK-8637] [flip6] Use JobManagerSharedServices to pass in services to JobMaster ## What is the purpose of the change Pass a JobManagerSharedServices instance to the JobMaster instea

[jira] [Created] (FLINK-8637) Pass JobManagerSharedServices to JobMaster

Till Rohrmann created FLINK-8637: Summary: Pass JobManagerSharedServices to JobMaster Key: FLINK-8637 URL: https://issues.apache.org/jira/browse/FLINK-8637 Project: Flink Issue Type: Improvem

[jira] [Commented] (FLINK-8636) Pass TaskManagerServices to TaskExecutor

[ https://issues.apache.org/jira/browse/FLINK-8636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16360177#comment-16360177 ] ASF GitHub Bot commented on FLINK-8636: --- GitHub user tillrohrmann opened a pull requ

[GitHub] flink pull request #5456: [FLINK-8636] [flip6] Use TaskManagerServices to pa...

GitHub user tillrohrmann opened a pull request: https://github.com/apache/flink/pull/5456 [FLINK-8636] [flip6] Use TaskManagerServices to pass in services to TaskExecutor ## What is the purpose of the change Pass in the TaskExecutor services via the TaskManagerServices inst

[jira] [Created] (FLINK-8636) Pass TaskManagerServices to TaskExecutor

Till Rohrmann created FLINK-8636: Summary: Pass TaskManagerServices to TaskExecutor Key: FLINK-8636 URL: https://issues.apache.org/jira/browse/FLINK-8636 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-8560) Access to the current key in ProcessFunction after keyBy()

[ https://issues.apache.org/jira/browse/FLINK-8560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16360156#comment-16360156 ] Bowen Li commented on FLINK-8560: - [~aljoscha] [~pnowojski] I have taken a look at this,

[jira] [Commented] (FLINK-8297) RocksDBListState stores whole list in single byte[]

[ https://issues.apache.org/jira/browse/FLINK-8297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16360123#comment-16360123 ] ASF GitHub Bot commented on FLINK-8297: --- Github user je-ik commented on the issue:

[GitHub] flink issue #5185: [FLINK-8297] [flink-rocksdb] optionally use RocksDBMapSta...

Github user je-ik commented on the issue: https://github.com/apache/flink/pull/5185 @aljoscha I (partly) reworked this PR as you suggest. There are still some unresolved questions though: 1) I'm not 100% sure how to cleanly support the migration between list state savepoints, wou

[jira] [Commented] (FLINK-6469) Configure Memory Sizes with units

[ https://issues.apache.org/jira/browse/FLINK-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359954#comment-16359954 ] ASF GitHub Bot commented on FLINK-6469: --- Github user yanghua commented on the issue:

[GitHub] flink issue #5448: [FLINK-6469] Configure Memory Sizes with units

Github user yanghua commented on the issue: https://github.com/apache/flink/pull/5448 Hi @StephanEwen , with the help of your `MemorySize` (sub task of FLINK-6469)，I finished the remained work, replaced the old memory config (in code、config file and shell script) with the memory s

[jira] [Commented] (FLINK-7711) Port JarListHandler to new REST endpoint

[ https://issues.apache.org/jira/browse/FLINK-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359904#comment-16359904 ] ASF GitHub Bot commented on FLINK-7711: --- GitHub user GJL opened a pull request:

[GitHub] flink pull request #5455: [FLINK-7711][flip6] Port JarListHandler

GitHub user GJL opened a pull request: https://github.com/apache/flink/pull/5455 [FLINK-7711][flip6] Port JarListHandler ## What is the purpose of the change *Port JarListHandler.* cc: @tillrohrmann PR is based on #5442 ## Brief change log

[jira] [Commented] (FLINK-7713) Port JarUploadHandler to new REST endpoint

[ https://issues.apache.org/jira/browse/FLINK-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359894#comment-16359894 ] ASF GitHub Bot commented on FLINK-7713: --- Github user GJL commented on a diff in the

[GitHub] flink pull request #5442: [FLINK-7713][flip6] Implement JarUploadHandler

Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/5442#discussion_r167430276 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/webmonitor/WebMonitorUtils.java --- @@ -207,6 +215,53 @@ public static WebMonitor startWebRuntime

[jira] [Commented] (FLINK-7713) Port JarUploadHandler to new REST endpoint

[ https://issues.apache.org/jira/browse/FLINK-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359888#comment-16359888 ] ASF GitHub Bot commented on FLINK-7713: --- Github user GJL commented on a diff in the

[GitHub] flink pull request #5442: [FLINK-7713][flip6] Implement JarUploadHandler

Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/5442#discussion_r167429820 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/webmonitor/WebMonitorUtils.java --- @@ -207,6 +215,53 @@ public static WebMonitor startWebRuntime

[GitHub] flink pull request #5442: [FLINK-7713][flip6] Implement JarUploadHandler

Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/5442#discussion_r167429671 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/webmonitor/WebMonitorUtils.java --- @@ -207,6 +215,53 @@ public static WebMonitor startWebRuntime

[jira] [Commented] (FLINK-7713) Port JarUploadHandler to new REST endpoint

[ https://issues.apache.org/jira/browse/FLINK-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359886#comment-16359886 ] ASF GitHub Bot commented on FLINK-7713: --- Github user GJL commented on a diff in the

[jira] [Commented] (FLINK-7713) Port JarUploadHandler to new REST endpoint

[ https://issues.apache.org/jira/browse/FLINK-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359885#comment-16359885 ] ASF GitHub Bot commented on FLINK-7713: --- Github user GJL commented on a diff in the

[GitHub] flink pull request #5442: [FLINK-7713][flip6] Implement JarUploadHandler

Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/5442#discussion_r167429608 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/DispatcherRestEndpoint.java --- @@ -100,6 +107,16 @@ public DispatcherRestEndpoint(

[jira] [Assigned] (FLINK-7711) Port JarListHandler to new REST endpoint

[ https://issues.apache.org/jira/browse/FLINK-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Yao reassigned FLINK-7711: --- Assignee: Gary Yao (was: Fang Yong) > Port JarListHandler to new REST endpoint > ---

[jira] [Commented] (FLINK-8212) Pull EnvironmentInformation out of TaskManagerServices

[ https://issues.apache.org/jira/browse/FLINK-8212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359861#comment-16359861 ] mingleizhang commented on FLINK-8212: - I can directly move those methods to {{TaskMana

[jira] [Commented] (FLINK-8543) Output Stream closed at org.apache.hadoop.fs.s3a.S3AOutputStream.checkOpen

[ https://issues.apache.org/jira/browse/FLINK-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359852#comment-16359852 ] chris snow commented on FLINK-8543: --- I'm hoping that I can get access to an internal clu

[jira] [Commented] (FLINK-8477) Add api to support for user to skip the first incomplete window data

[ https://issues.apache.org/jira/browse/FLINK-8477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359841#comment-16359841 ] ASF GitHub Bot commented on FLINK-8477: --- Github user Aitozi commented on the issue:

[GitHub] flink issue #5405: [FLINK-8477][Window]Add api to support user to skip serva...

Github user Aitozi commented on the issue: https://github.com/apache/flink/pull/5405 Hi @aljoscha , you have mentioned two points : 1. The events arrived may out of order in event-time processing 2. We can use windowFunction or ProcessWindowFunction to filter serverl window b