[jira] [Closed] (FLINK-6633) Register with shared state registry before adding to CompletedCheckpointStore

2017-05-19 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6633. - Resolution: Fixed fixed in 0162543ac1 > Register with shared state registry before adding to Comp

[jira] [Created] (FLINK-6640) Ensure registration of shared state happens before externalizing a checkpoint

2017-05-19 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6640: - Summary: Ensure registration of shared state happens before externalizing a checkpoint Key: FLINK-6640 URL: https://issues.apache.org/jira/browse/FLINK-6640 Project

[jira] [Closed] (FLINK-6640) Ensure registration of shared state happens before externalizing a checkpoint

2017-05-21 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6640. - Resolution: Fixed fixed in 040356391f > Ensure registration of shared state happens before extern

[jira] [Assigned] (FLINK-6651) Clearing registeredStates map should be protected in SharedStateRegistry#clear

2017-05-22 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-6651: - Assignee: Stefan Richter > Clearing registeredStates map should be protected in SharedSta

[jira] [Closed] (FLINK-6651) Clearing registeredStates map should be protected in SharedStateRegistry#clear

2017-05-22 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6651. - Resolution: Fixed Fix Version/s: 1.3.0 fixed in 392bc71301 > Clearing registeredStates map

[jira] [Commented] (FLINK-6620) Add KeyGroupCheckpointedOperator interface that works for checkpointing key-groups

2017-05-22 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16019298#comment-16019298 ] Stefan Richter commented on FLINK-6620: --- Yes, and I think there problem with designi

[jira] [Commented] (FLINK-6633) Register with shared state registry before adding to CompletedCheckpointStore

2017-05-22 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16019373#comment-16019373 ] Stefan Richter commented on FLINK-6633: --- This is fixed through the issue you mention

[jira] [Commented] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

2017-05-22 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16019717#comment-16019717 ] Stefan Richter commented on FLINK-6537: --- Which exception is that exactly? And how do

[jira] [Comment Edited] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

2017-05-22 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16019717#comment-16019717 ] Stefan Richter edited comment on FLINK-6537 at 5/22/17 3:42 PM:

[jira] [Comment Edited] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

2017-05-22 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16019717#comment-16019717 ] Stefan Richter edited comment on FLINK-6537 at 5/22/17 4:19 PM:

[jira] [Commented] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

2017-05-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16020789#comment-16020789 ] Stefan Richter commented on FLINK-6537: --- I had a look at those logs, but they seem s

[jira] [Comment Edited] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

2017-05-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16020789#comment-16020789 ] Stefan Richter edited comment on FLINK-6537 at 5/23/17 8:20 AM:

[jira] [Comment Edited] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

2017-05-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16020789#comment-16020789 ] Stefan Richter edited comment on FLINK-6537 at 5/23/17 8:23 AM:

[jira] [Comment Edited] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

2017-05-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16020789#comment-16020789 ] Stefan Richter edited comment on FLINK-6537 at 5/23/17 8:23 AM:

[jira] [Comment Edited] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

2017-05-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16020789#comment-16020789 ] Stefan Richter edited comment on FLINK-6537 at 5/23/17 8:33 AM:

[jira] [Commented] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

2017-05-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16020941#comment-16020941 ] Stefan Richter commented on FLINK-6537: --- Ok, I think I have an idea about a possible

[jira] [Created] (FLINK-6684) Remove AsyncCheckpointRunnable from StreamTask

2017-05-23 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6684: - Summary: Remove AsyncCheckpointRunnable from StreamTask Key: FLINK-6684 URL: https://issues.apache.org/jira/browse/FLINK-6684 Project: Flink Issue Type: Im

[jira] [Created] (FLINK-6685) SafetyNetCloseableRegistry is closed prematurely in Task::triggerCheckpointBarrier

2017-05-23 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6685: - Summary: SafetyNetCloseableRegistry is closed prematurely in Task::triggerCheckpointBarrier Key: FLINK-6685 URL: https://issues.apache.org/jira/browse/FLINK-6685 Pr

[jira] [Commented] (FLINK-6685) SafetyNetCloseableRegistry is closed prematurely in Task::triggerCheckpointBarrier

2017-05-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021192#comment-16021192 ] Stefan Richter commented on FLINK-6685: --- For the release, we can fix this by reusing

[jira] [Commented] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

2017-05-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021248#comment-16021248 ] Stefan Richter commented on FLINK-6537: --- So this is not strictly related to incremen

[jira] [Commented] (FLINK-6690) Rescaling broken

2017-05-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021694#comment-16021694 ] Stefan Richter commented on FLINK-6690: --- I have found the cause in a bug that was in

[jira] [Commented] (FLINK-6690) Rescaling broken

2017-05-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022602#comment-16022602 ] Stefan Richter commented on FLINK-6690: --- I guess the rescaling IT case will already

[jira] [Closed] (FLINK-6685) SafetyNetCloseableRegistry is closed prematurely in Task::triggerCheckpointBarrier

2017-05-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6685. - Resolution: Fixed fixed in 7639d49e03 > SafetyNetCloseableRegistry is closed prematurely in > Ta

[jira] [Closed] (FLINK-6690) Rescaling broken

2017-05-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6690. - Resolution: Fixed fixed in 36830adace > Rescaling broken > > > K

[jira] [Closed] (FLINK-5756) When there are many values under the same key in ListState, RocksDBStateBackend performances poor

2017-05-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5756. - Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 fixed in e651df99f4 > When

[jira] [Commented] (FLINK-6333) Utilize Bloomfilters in RocksDb

2017-05-29 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16028212#comment-16028212 ] Stefan Richter commented on FLINK-6333: --- This issue still exists after some testing

[jira] [Created] (FLINK-6761) Limitation for maximum state size per key in RocksDB backend

2017-05-29 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6761: - Summary: Limitation for maximum state size per key in RocksDB backend Key: FLINK-6761 URL: https://issues.apache.org/jira/browse/FLINK-6761 Project: Flink

[jira] [Updated] (FLINK-6761) Limitation for maximum state size per key in RocksDB backend

2017-05-29 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6761: -- Description: RocksDB`s JNI bridge allows for putting and getting {{byte[]}} as keys and values.

[jira] [Commented] (FLINK-6761) Limitation for maximum state size per key in RocksDB backend

2017-05-29 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16028363#comment-16028363 ] Stefan Richter commented on FLINK-6761: --- Opened a corresponding issue in the RocksDB

[jira] [Commented] (FLINK-6762) Cannot rescale externalized incremental checkpoints

2017-05-29 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16028449#comment-16028449 ] Stefan Richter commented on FLINK-6762: --- Officially, we currently do not want to sup

[jira] [Comment Edited] (FLINK-6762) Cannot rescale externalized incremental checkpoints

2017-05-29 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16028449#comment-16028449 ] Stefan Richter edited comment on FLINK-6762 at 5/29/17 3:19 PM:

[jira] [Created] (FLINK-6766) Update documentation with async backends and incremental checkpoints

2017-05-29 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6766: - Summary: Update documentation with async backends and incremental checkpoints Key: FLINK-6766 URL: https://issues.apache.org/jira/browse/FLINK-6766 Project: Flink

[jira] [Commented] (FLINK-6762) Cannot rescale externalized incremental checkpoints

2017-05-29 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16028487#comment-16028487 ] Stefan Richter commented on FLINK-6762: --- FYI, I think we can can ALMOST support this

[jira] [Comment Edited] (FLINK-6762) Cannot rescale externalized incremental checkpoints

2017-05-29 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16028487#comment-16028487 ] Stefan Richter edited comment on FLINK-6762 at 5/29/17 4:02 PM:

[jira] [Created] (FLINK-6773) Use compression (e.g. snappy) for full check/savepoints

2017-05-30 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6773: - Summary: Use compression (e.g. snappy) for full check/savepoints Key: FLINK-6773 URL: https://issues.apache.org/jira/browse/FLINK-6773 Project: Flink Issue

[jira] [Updated] (FLINK-6773) Use compression (e.g. snappy) for full check/savepoints

2017-05-30 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6773: -- Description: We could use compression (e.g. snappy stream compression) to decrease the size of

[jira] [Created] (FLINK-6776) Use skip instead of seek for small forward repositioning in DFS streams

2017-05-30 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6776: - Summary: Use skip instead of seek for small forward repositioning in DFS streams Key: FLINK-6776 URL: https://issues.apache.org/jira/browse/FLINK-6776 Project: Flin

[jira] [Updated] (FLINK-6776) Use skip instead of seek for small forward repositioning in DFS streams

2017-05-30 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6776: -- Priority: Minor (was: Major) > Use skip instead of seek for small forward repositioning in DFS

[jira] [Commented] (FLINK-6849) Refactor operator state backend and internal operator state hierarchy

2017-06-07 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040460#comment-16040460 ] Stefan Richter commented on FLINK-6849: --- I agree in general, because this was clear

[jira] [Comment Edited] (FLINK-6849) Refactor operator state backend and internal operator state hierarchy

2017-06-07 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040460#comment-16040460 ] Stefan Richter edited comment on FLINK-6849 at 6/7/17 8:09 AM: -

[jira] [Closed] (FLINK-5053) Incremental / lightweight snapshots for checkpoints

2017-06-07 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5053. - Resolution: Implemented > Incremental / lightweight snapshots for checkpoints > --

[jira] [Closed] (FLINK-6364) Implement incremental checkpointing in RocksDBStateBackend

2017-06-07 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6364. - Resolution: Fixed > Implement incremental checkpointing in RocksDBStateBackend > -

[jira] [Reopened] (FLINK-6685) SafetyNetCloseableRegistry is closed prematurely in Task::triggerCheckpointBarrier

2017-06-12 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reopened FLINK-6685: --- Fix was incomplete. > SafetyNetCloseableRegistry is closed prematurely in > Task::triggerCheckpo

[jira] [Assigned] (FLINK-6773) Use compression (e.g. snappy) for full check/savepoints

2017-06-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-6773: - Assignee: Stefan Richter > Use compression (e.g. snappy) for full check/savepoints >

[jira] [Closed] (FLINK-6776) Use skip instead of seek for small forward repositioning in DFS streams

2017-06-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6776. - Resolution: Implemented Fix Version/s: 1.4.0 Implemented in 9141379f6d > Use skip instead

[jira] [Created] (FLINK-6931) Support custom compression formats for checkpoints (+Upgrade/Compatibility)

2017-06-15 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6931: - Summary: Support custom compression formats for checkpoints (+Upgrade/Compatibility) Key: FLINK-6931 URL: https://issues.apache.org/jira/browse/FLINK-6931 Project:

[jira] [Commented] (FLINK-6679) Document HeapStatebackend

2017-06-19 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16053694#comment-16053694 ] Stefan Richter commented on FLINK-6679: --- The issue is not very specific, so I think

[jira] [Commented] (FLINK-6679) Document HeapStatebackend

2017-06-19 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16053904#comment-16053904 ] Stefan Richter commented on FLINK-6679: --- MemoryStateBackend and FsStateBackend are t

[jira] [Commented] (FLINK-6679) Document HeapStatebackend

2017-06-19 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16053919#comment-16053919 ] Stefan Richter commented on FLINK-6679: --- I can understand that :) The naming is conf

[jira] [Commented] (FLINK-6633) Register with shared state registry before adding to CompletedCheckpointStore

2017-06-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056390#comment-16056390 ] Stefan Richter commented on FLINK-6633: --- Thanks for reporting this. First, let me cl

[jira] [Commented] (FLINK-6633) Register with shared state registry before adding to CompletedCheckpointStore

2017-06-21 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057176#comment-16057176 ] Stefan Richter commented on FLINK-6633: --- [~cre...@gmail.com], I think this log was a

[jira] [Commented] (FLINK-6633) Register with shared state registry before adding to CompletedCheckpointStore

2017-06-21 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057249#comment-16057249 ] Stefan Richter commented on FLINK-6633: --- I created https://issues.apache.org/jira/br

[jira] [Created] (FLINK-6964) Fix recovery for incremental checkpoints in StandaloneCompletedCheckpointStore

2017-06-21 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6964: - Summary: Fix recovery for incremental checkpoints in StandaloneCompletedCheckpointStore Key: FLINK-6964 URL: https://issues.apache.org/jira/browse/FLINK-6964 Projec

[jira] [Updated] (FLINK-6964) Fix recovery for incremental checkpoints in StandaloneCompletedCheckpointStore

2017-06-21 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6964: -- Description: {{StandaloneCompletedCheckpointStore}} does not register shared states ion resume.

[jira] [Commented] (FLINK-6633) Register with shared state registry before adding to CompletedCheckpointStore

2017-06-21 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057939#comment-16057939 ] Stefan Richter commented on FLINK-6633: --- [~cre...@gmail.com] I think I have a fix fo

[jira] [Commented] (FLINK-9486) Introduce TimerState in keyed state backend

2018-09-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16610497#comment-16610497 ] Stefan Richter commented on FLINK-9486: --- Hi, you can migrate an old savepoint from

[jira] [Commented] (FLINK-9486) Introduce TimerState in keyed state backend

2018-09-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16610602#comment-16610602 ] Stefan Richter commented on FLINK-9486: --- Exactly, that's how it is right now. In th

[jira] [Closed] (FLINK-10267) [State] Fix arbitrary iterator access on RocksDBMapIterator

2018-09-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10267. -- Resolution: Fixed Merged in: master: 16dc5978c7 release-1.6: a19e1ee3ba release-1.5: d8e7741bf

[jira] [Commented] (FLINK-10346) MemoryStateBackend does not clean up checkpoint directory

2018-09-17 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16617533#comment-16617533 ] Stefan Richter commented on FLINK-10346: I think the checkpoint directory is the

[jira] [Created] (FLINK-10377) Remove precondition in TwoPhaseCommitSinkFunction.notifyCheckpointComplete

2018-09-20 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10377: -- Summary: Remove precondition in TwoPhaseCommitSinkFunction.notifyCheckpointComplete Key: FLINK-10377 URL: https://issues.apache.org/jira/browse/FLINK-10377 Projec

[jira] [Updated] (FLINK-10377) Remove precondition in TwoPhaseCommitSinkFunction.notifyCheckpointComplete

2018-09-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-10377: --- Description: The precondition {{checkState(pendingTransactionIterator.hasNext(), "checkpoint

[jira] [Commented] (FLINK-10374) [Map State] Let user value serializer handle null values

2018-09-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622213#comment-16622213 ] Stefan Richter commented on FLINK-10374: Thanks for creating a Jira to track thi

[jira] [Commented] (FLINK-10382) Writer has already been opened while using AvroKeyValueSinkWriter and BucketingSink

2018-09-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622246#comment-16622246 ] Stefan Richter commented on FLINK-10382: Thanks for reporting this. [~aljoscha]

[jira] [Closed] (FLINK-10157) Allow `null` user values in map state with TTL

2018-09-21 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10157. -- Resolution: Fixed Fix Version/s: 1.6.2 1.7.0 Merged in: master: f343

[jira] [Created] (FLINK-10429) Redesign Flink Scheduling, introducing dedicated Scheduler component

2018-09-26 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10429: -- Summary: Redesign Flink Scheduling, introducing dedicated Scheduler component Key: FLINK-10429 URL: https://issues.apache.org/jira/browse/FLINK-10429 Project: Fli

[jira] [Created] (FLINK-10430) Extract scheduling-related code from Executions

2018-09-26 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10430: -- Summary: Extract scheduling-related code from Executions Key: FLINK-10430 URL: https://issues.apache.org/jira/browse/FLINK-10430 Project: Flink Issue Typ

[jira] [Created] (FLINK-10431) Extract scheduling-related code from SlotPool

2018-09-26 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10431: -- Summary: Extract scheduling-related code from SlotPool Key: FLINK-10431 URL: https://issues.apache.org/jira/browse/FLINK-10431 Project: Flink Issue Type:

[jira] [Created] (FLINK-10432) Introduce bulk/group-aware scheduling

2018-09-26 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10432: -- Summary: Introduce bulk/group-aware scheduling Key: FLINK-10432 URL: https://issues.apache.org/jira/browse/FLINK-10432 Project: Flink Issue Type: Sub-tas

[jira] [Created] (FLINK-10433) Stepwise creation of the ExecutionGraph sub-structures

2018-09-26 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10433: -- Summary: Stepwise creation of the ExecutionGraph sub-structures Key: FLINK-10433 URL: https://issues.apache.org/jira/browse/FLINK-10433 Project: Flink Is

[jira] [Created] (FLINK-10490) OperatorSnapshotUtil should probably use SavepointV2Serializer

2018-10-04 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10490: -- Summary: OperatorSnapshotUtil should probably use SavepointV2Serializer Key: FLINK-10490 URL: https://issues.apache.org/jira/browse/FLINK-10490 Project: Flink

[jira] [Commented] (FLINK-7289) Memory allocation of RocksDB can be problematic in container environments

2017-07-31 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16107037#comment-16107037 ] Stefan Richter commented on FLINK-7289: --- Thanks for the input. I have one question a

[jira] [Comment Edited] (FLINK-7289) Memory allocation of RocksDB can be problematic in container environments

2017-07-31 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16107244#comment-16107244 ] Stefan Richter edited comment on FLINK-7289 at 7/31/17 12:33 PM: ---

[jira] [Commented] (FLINK-7289) Memory allocation of RocksDB can be problematic in container environments

2017-07-31 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16107244#comment-16107244 ] Stefan Richter commented on FLINK-7289: --- Cache memory is usually not reclaimed by ap

[jira] [Commented] (FLINK-7289) Memory allocation of RocksDB can be problematic in container environments

2017-08-01 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16109411#comment-16109411 ] Stefan Richter commented on FLINK-7289: --- Hi, I understand that cache memory is not

[jira] [Comment Edited] (FLINK-7289) Memory allocation of RocksDB can be problematic in container environments

2017-08-01 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16109411#comment-16109411 ] Stefan Richter edited comment on FLINK-7289 at 8/1/17 5:54 PM: -

[jira] [Comment Edited] (FLINK-7289) Memory allocation of RocksDB can be problematic in container environments

2017-08-01 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16109411#comment-16109411 ] Stefan Richter edited comment on FLINK-7289 at 8/1/17 6:01 PM: -

[jira] [Commented] (FLINK-7266) Don't attempt to delete parent directory on S3

2017-08-02 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16110453#comment-16110453 ] Stefan Richter commented on FLINK-7266: --- One comment about the "not necessary on S3"

[jira] [Commented] (FLINK-7266) Don't attempt to delete parent directory on S3

2017-08-02 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16110547#comment-16110547 ] Stefan Richter commented on FLINK-7266: --- I agree that we should not block the releas

[jira] [Created] (FLINK-7449) Improve and enhance documentation for incremental checkpoints

2017-08-15 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-7449: - Summary: Improve and enhance documentation for incremental checkpoints Key: FLINK-7449 URL: https://issues.apache.org/jira/browse/FLINK-7449 Project: Flink

[jira] [Closed] (FLINK-7213) Introduce state management by OperatorID in TaskManager

2017-08-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-7213. - Resolution: Fixed Fix Version/s: 1.4.0 Merged in b71154a734 . > Introduce state management

[jira] [Closed] (FLINK-7268) Zookeeper Checkpoint Store interacting with Incremental State Handles can lead to loss of handles

2017-08-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-7268. - Resolution: Fixed Merged in 91a4b27617 (1.4) and 09caa9ffdc (1.3) > Zookeeper Checkpoint Store in

[jira] [Closed] (FLINK-7362) CheckpointProperties are not correctly set when restoring savepoint with HA enabled

2017-08-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-7362. - Resolution: Fixed Assignee: Stefan Richter Merged in 843f0cbc10 . > CheckpointProperties ar

[jira] [Created] (FLINK-7460) Close all ColumnFamilyHandles when restoring rescaled incremental checkpoints

2017-08-16 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-7460: - Summary: Close all ColumnFamilyHandles when restoring rescaled incremental checkpoints Key: FLINK-7460 URL: https://issues.apache.org/jira/browse/FLINK-7460 Project

[jira] [Created] (FLINK-7461) Remove Backwards compatibility for Flink 1.1 from Flink 1.4

2017-08-16 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-7461: - Summary: Remove Backwards compatibility for Flink 1.1 from Flink 1.4 Key: FLINK-7461 URL: https://issues.apache.org/jira/browse/FLINK-7461 Project: Flink

[jira] [Updated] (FLINK-7460) Close all ColumnFamilyHandles when restoring rescaled incremental checkpoints

2017-08-16 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-7460: -- Affects Version/s: 1.4.0 1.3.2 > Close all ColumnFamilyHandles when resto

[jira] [Commented] (FLINK-3089) State API Should Support Data Expiration (State TTL)

2017-08-17 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16130083#comment-16130083 ] Stefan Richter commented on FLINK-3089: --- [~sihuazhou] one thing that we would also n

[jira] [Comment Edited] (FLINK-3089) State API Should Support Data Expiration (State TTL)

2017-08-17 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16130083#comment-16130083 ] Stefan Richter edited comment on FLINK-3089 at 8/17/17 8:20 AM:

[jira] [Comment Edited] (FLINK-3089) State API Should Support Data Expiration (State TTL)

2017-08-17 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16130083#comment-16130083 ] Stefan Richter edited comment on FLINK-3089 at 8/17/17 8:20 AM:

[jira] [Created] (FLINK-7505) Use lambdas in suppressed exception idiom

2017-08-24 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-7505: - Summary: Use lambdas in suppressed exception idiom Key: FLINK-7505 URL: https://issues.apache.org/jira/browse/FLINK-7505 Project: Flink Issue Type: Improve

[jira] [Closed] (FLINK-7461) Remove Backwards compatibility for Flink 1.1 from Flink 1.4

2017-08-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-7461. - Resolution: Fixed merged in 6642768ad8. > Remove Backwards compatibility for Flink 1.1 from Flink

[jira] [Closed] (FLINK-7505) Use lambdas in suppressed exception idiom

2017-08-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-7505. - Resolution: Fixed merged in 5456cf9f8f. > Use lambdas in suppressed exception idiom > ---

[jira] [Closed] (FLINK-7460) Close all ColumnFamilyHandles when restoring rescaled incremental checkpoints

2017-08-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-7460. - Resolution: Fixed merged in ca87bec4f7. > Close all ColumnFamilyHandles when restoring rescaled i

[jira] [Assigned] (FLINK-12483) Support (legacy) SourceFunctions with mailbox

2019-05-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-12483: -- Assignee: Stefan Richter (was: vinoyang) > Support (legacy) SourceFunctions with mai

[jira] [Commented] (FLINK-10855) CheckpointCoordinator does not delete checkpoint directory of late/failed checkpoints

2019-05-16 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16841428#comment-16841428 ] Stefan Richter commented on FLINK-10855: @vinoyang i guess i cannot. I was just

[jira] [Comment Edited] (FLINK-6755) Allow triggering Checkpoints through command line client

2019-05-17 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842210#comment-16842210 ] Stefan Richter edited comment on FLINK-6755 at 5/17/19 2:25 PM: ---

[jira] [Commented] (FLINK-6755) Allow triggering Checkpoints through command line client

2019-05-17 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842210#comment-16842210 ] Stefan Richter commented on FLINK-6755: --- IMO, this somehow leads to the more genera

[jira] [Comment Edited] (FLINK-6755) Allow triggering Checkpoints through command line client

2019-05-17 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842210#comment-16842210 ] Stefan Richter edited comment on FLINK-6755 at 5/17/19 2:24 PM: ---

[jira] [Comment Edited] (FLINK-6755) Allow triggering Checkpoints through command line client

2019-05-17 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842210#comment-16842210 ] Stefan Richter edited comment on FLINK-6755 at 5/17/19 2:30 PM: ---

[jira] [Commented] (FLINK-10855) CheckpointCoordinator does not delete checkpoint directory of late/failed checkpoints

2019-05-21 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16844829#comment-16844829 ] Stefan Richter commented on FLINK-10855: [~yanghua] Just a heads-up that you pin

[jira] [Created] (FLINK-12591) StatsDReporterTest is unstable

2019-05-22 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-12591: -- Summary: StatsDReporterTest is unstable Key: FLINK-12591 URL: https://issues.apache.org/jira/browse/FLINK-12591 Project: Flink Issue Type: Bug

<    1   2   3   4   5   6   7   8   9   10   >