[jira] [Commented] (FLINK-4374) GroupReduce Broken for null Date

2016-08-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15417162#comment-15417162 ] Stefan Richter commented on FLINK-4374: --- Yes, it is the data field of the Tuple2 in

[jira] [Comment Edited] (FLINK-4374) GroupReduce Broken for null Date

2016-08-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15417162#comment-15417162 ] Stefan Richter edited comment on FLINK-4374 at 8/11/16 12:52 PM: ---

[jira] [Commented] (FLINK-6321) RocksDB state backend Checkpointing is not working with KeydCEP.

2017-04-18 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15973369#comment-15973369 ] Stefan Richter commented on FLINK-6321: --- The reported exception is probably not show

[jira] [Commented] (FLINK-6333) Utilize Bloomfilters in RocksDb

2017-04-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976306#comment-15976306 ] Stefan Richter commented on FLINK-6333: --- Right now, the biggest problem in updating

[jira] [Commented] (FLINK-6321) RocksDB state backend Checkpointing is not working with KeydCEP.

2017-04-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976363#comment-15976363 ] Stefan Richter commented on FLINK-6321: --- This is an indicator of some problem in the

[jira] [Commented] (FLINK-6321) RocksDB state backend Checkpointing is not working with KeydCEP.

2017-04-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976383#comment-15976383 ] Stefan Richter commented on FLINK-6321: --- I understood that part about the backends.

[jira] [Commented] (FLINK-6321) RocksDB state backend Checkpointing is not working with KeydCEP.

2017-04-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976404#comment-15976404 ] Stefan Richter commented on FLINK-6321: --- Ok, then this problem can be related. The e

[jira] [Commented] (FLINK-6353) Restoring using CheckpointedRestoring does not work from 1.2 to 1.2

2017-04-21 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15979042#comment-15979042 ] Stefan Richter commented on FLINK-6353: --- Just a small idea: do you think that from a

[jira] [Comment Edited] (FLINK-6353) Restoring using CheckpointedRestoring does not work from 1.2 to 1.2

2017-04-21 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15979042#comment-15979042 ] Stefan Richter edited comment on FLINK-6353 at 4/21/17 4:40 PM:

[jira] [Comment Edited] (FLINK-6353) Restoring using CheckpointedRestoring does not work from 1.2 to 1.2

2017-04-21 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15979042#comment-15979042 ] Stefan Richter edited comment on FLINK-6353 at 4/21/17 4:42 PM:

[jira] [Commented] (FLINK-6353) Restoring using CheckpointedRestoring does not work from 1.2 to 1.2

2017-04-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15980978#comment-15980978 ] Stefan Richter commented on FLINK-6353: --- Yes, that is the idea. After implementing `

[jira] [Comment Edited] (FLINK-6353) Restoring using CheckpointedRestoring does not work from 1.2 to 1.2

2017-04-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15980978#comment-15980978 ] Stefan Richter edited comment on FLINK-6353 at 4/24/17 10:29 AM: ---

[jira] [Comment Edited] (FLINK-6353) Restoring using CheckpointedRestoring does not work from 1.2 to 1.2

2017-04-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15980978#comment-15980978 ] Stefan Richter edited comment on FLINK-6353 at 4/24/17 10:29 AM: ---

[jira] [Comment Edited] (FLINK-6353) Restoring using CheckpointedRestoring does not work from 1.2 to 1.2

2017-04-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15980978#comment-15980978 ] Stefan Richter edited comment on FLINK-6353 at 4/24/17 10:30 AM: ---

[jira] [Comment Edited] (FLINK-6353) Restoring using CheckpointedRestoring does not work from 1.2 to 1.2

2017-04-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15980978#comment-15980978 ] Stefan Richter edited comment on FLINK-6353 at 4/24/17 10:30 AM: ---

[jira] [Comment Edited] (FLINK-6353) Restoring using CheckpointedRestoring does not work from 1.2 to 1.2

2017-04-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15980978#comment-15980978 ] Stefan Richter edited comment on FLINK-6353 at 4/24/17 10:32 AM: ---

[jira] [Commented] (FLINK-6402) Consider locking REAPER_THREAD_LOCK in SafetyNetCloseableRegistry#doRegister()

2017-04-27 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15986909#comment-15986909 ] Stefan Richter commented on FLINK-6402: --- I think this lock is not required, because

[jira] [Commented] (FLINK-6402) Consider removing REAPER_THREAD_LOCK in SafetyNetCloseableRegistry#doRegister()

2017-04-27 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15986940#comment-15986940 ] Stefan Richter commented on FLINK-6402: --- I think that removing wouldn't be helpful,

[jira] [Commented] (FLINK-6412) Stream has already been closed during job cancel

2017-04-28 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15989125#comment-15989125 ] Stefan Richter commented on FLINK-6412: --- I think the root cause of this is a) the st

[jira] [Commented] (FLINK-6412) Stream has already been closed during job cancel

2017-04-28 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15989189#comment-15989189 ] Stefan Richter commented on FLINK-6412: --- I can probably fix this easily, suggest I w

[jira] [Commented] (FLINK-6333) Utilize Bloomfilters in RocksDb

2017-05-02 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992627#comment-15992627 ] Stefan Richter commented on FLINK-6333: --- It is mentioned in this issue: https://gith

[jira] [Closed] (FLINK-6048) Asynchronous snapshots for heap-based operator state backends

2017-05-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6048. - Resolution: Implemented > Asynchronous snapshots for heap-based operator state backends >

[jira] [Closed] (FLINK-5041) Implement savepoint backwards compatibility 1.1 -> 1.2

2017-05-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5041. - Resolution: Implemented Fix Version/s: 1.2.0 > Implement savepoint backwards compatibility

[jira] [Closed] (FLINK-5051) Backwards compatibility for serializers in backend state

2017-05-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5051. - Resolution: Implemented > Backwards compatibility for serializers in backend state > -

[jira] [Assigned] (FLINK-6412) Stream has already been closed during job cancel

2017-05-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-6412: - Assignee: Stefan Richter > Stream has already been closed during job cancel > ---

[jira] [Commented] (FLINK-5925) Clean up extracted RocksDB JNI library

2017-05-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15998354#comment-15998354 ] Stefan Richter commented on FLINK-5925: --- [~till.rohrmann] is this issue still valid?

[jira] [Commented] (FLINK-5924) Support asynchronous checkpointing of operator state

2017-05-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15998356#comment-15998356 ] Stefan Richter commented on FLINK-5924: --- Was this issue about the raw (stream-writte

[jira] [Commented] (FLINK-5440) Misleading error message when migrating and scaling down from savepoint

2017-05-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15998362#comment-15998362 ] Stefan Richter commented on FLINK-5440: --- [~uce] I think we can close this issue? Cor

[jira] [Commented] (FLINK-5439) Adjust max parallelism when migrating

2017-05-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15998363#comment-15998363 ] Stefan Richter commented on FLINK-5439: --- [~uce] I think we can close this issue? Cor

[jira] [Commented] (FLINK-5462) Flink job fails due to java.util.concurrent.CancellationException while snapshotting

2017-05-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15998367#comment-15998367 ] Stefan Richter commented on FLINK-5462: --- I think this is just a followup exception o

[jira] [Commented] (FLINK-5463) RocksDB.disposeInternal does not react to interrupts, blocks task cancellation

2017-05-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15998368#comment-15998368 ] Stefan Richter commented on FLINK-5463: --- [~rmetzger] How should we proceed with this

[jira] [Commented] (FLINK-5599) State interface docs often refer to keyed state only

2017-05-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15998370#comment-15998370 ] Stefan Richter commented on FLINK-5599: --- This looks like we can close it by now. The

[jira] [Closed] (FLINK-5599) State interface docs often refer to keyed state only

2017-05-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5599. - Resolution: Fixed > State interface docs often refer to keyed state only > ---

[jira] [Commented] (FLINK-6471) RocksDBStateBackendTest#testCancelRunningSnapshot sometimes fails

2017-05-07 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15999837#comment-15999837 ] Stefan Richter commented on FLINK-6471: --- Thanks for reporting this problem. This is

[jira] [Created] (FLINK-6475) Incremental snapshots in RocksDB hold lock during async file upload

2017-05-07 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6475: - Summary: Incremental snapshots in RocksDB hold lock during async file upload Key: FLINK-6475 URL: https://issues.apache.org/jira/browse/FLINK-6475 Project: Flink

[jira] [Closed] (FLINK-6471) RocksDBStateBackendTest#testCancelRunningSnapshot sometimes fails

2017-05-07 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6471. - Resolution: Fixed Assignee: Stefan Richter Fix Version/s: 1.3.0 Fixed in b8ffacb1b

[jira] [Closed] (FLINK-6475) Incremental snapshots in RocksDB hold lock during async file upload

2017-05-07 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6475. - Resolution: Fixed Fixed in 38003c2829. > Incremental snapshots in RocksDB hold lock during async

[jira] [Created] (FLINK-6480) Add executor service parameter Snapshotable::snapshot(...)

2017-05-08 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6480: - Summary: Add executor service parameter Snapshotable::snapshot(...) Key: FLINK-6480 URL: https://issues.apache.org/jira/browse/FLINK-6480 Project: Flink Is

[jira] [Created] (FLINK-6481) Encapsulate different snapshot algorithms (full, incremental) slightly clearer into strategy pattern

2017-05-08 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6481: - Summary: Encapsulate different snapshot algorithms (full, incremental) slightly clearer into strategy pattern Key: FLINK-6481 URL: https://issues.apache.org/jira/browse/FLINK-64

[jira] [Created] (FLINK-6484) Send only the registry keys for already registered files in incremental checkpointing

2017-05-08 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6484: - Summary: Send only the registry keys for already registered files in incremental checkpointing Key: FLINK-6484 URL: https://issues.apache.org/jira/browse/FLINK-6484

[jira] [Created] (FLINK-6485) Use buffering to avoid frequent memtable flushes for short intervals in RockdDB incremental checkpoints

2017-05-08 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6485: - Summary: Use buffering to avoid frequent memtable flushes for short intervals in RockdDB incremental checkpoints Key: FLINK-6485 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Updated] (FLINK-6484) Send only the registry keys for already registered files in incremental checkpointing

2017-05-08 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6484: -- Description: State handles for files that are (potentially) shared across multiple incremental

[jira] [Created] (FLINK-6504) Lack of synchronization on materializedSstFiles in RocksDBKEyedStateBackend

2017-05-09 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6504: - Summary: Lack of synchronization on materializedSstFiles in RocksDBKEyedStateBackend Key: FLINK-6504 URL: https://issues.apache.org/jira/browse/FLINK-6504 Project:

[jira] [Created] (FLINK-6505) Proactively cleanup local FS for RocksDBKeyedStateBackend on startup

2017-05-09 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6505: - Summary: Proactively cleanup local FS for RocksDBKeyedStateBackend on startup Key: FLINK-6505 URL: https://issues.apache.org/jira/browse/FLINK-6505 Project: Flink

[jira] [Updated] (FLINK-6504) Lack of synchronization on materializedSstFiles in RocksDBKEyedStateBackend

2017-05-09 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6504: -- Affects Version/s: 1.3.0 Component/s: State Backends, Checkpointing > Lack of synchron

[jira] [Updated] (FLINK-6505) Proactively cleanup local FS for RocksDBKeyedStateBackend on startup

2017-05-09 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6505: -- Description: In {{RocksDBKeyedStateBackend}}, the {{instanceBasePath}} is cleared on {{dispose(

[jira] [Created] (FLINK-6506) Some tests in flink-tests exceed memory the resources in containerized Travis builds

2017-05-09 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6506: - Summary: Some tests in flink-tests exceed memory the resources in containerized Travis builds Key: FLINK-6506 URL: https://issues.apache.org/jira/browse/FLINK-6506

[jira] [Updated] (FLINK-6506) Some tests in flink-tests exceed the memory resources in containerized Travis builds

2017-05-09 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6506: -- Summary: Some tests in flink-tests exceed the memory resources in containerized Travis builds (

[jira] [Closed] (FLINK-6506) Some tests in flink-tests exceed the memory resources in containerized Travis builds

2017-05-09 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6506. - Resolution: Fixed Fixed in 6b451d949a. > Some tests in flink-tests exceed the memory resources in

[jira] [Created] (FLINK-6507) Potential bug in ContinuousFileProcessing

2017-05-09 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6507: - Summary: Potential bug in ContinuousFileProcessing Key: FLINK-6507 URL: https://issues.apache.org/jira/browse/FLINK-6507 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-6527) OperatorSubtaskState has empty implementations of (un)/registerSharedStates

2017-05-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6527: - Summary: OperatorSubtaskState has empty implementations of (un)/registerSharedStates Key: FLINK-6527 URL: https://issues.apache.org/jira/browse/FLINK-6527 Project:

[jira] [Created] (FLINK-6533) Duplicated registration of new shared state when checkpoint confirmations are still pending

2017-05-11 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6533: - Summary: Duplicated registration of new shared state when checkpoint confirmations are still pending Key: FLINK-6533 URL: https://issues.apache.org/jira/browse/FLINK-6533

[jira] [Created] (FLINK-6534) SharedStateRegistry is disposing state handles from main thread

2017-05-11 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6534: - Summary: SharedStateRegistry is disposing state handles from main thread Key: FLINK-6534 URL: https://issues.apache.org/jira/browse/FLINK-6534 Project: Flink

[jira] [Created] (FLINK-6535) JobID should not be part of the registration key to the SharedStateRegistry

2017-05-11 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6535: - Summary: JobID should not be part of the registration key to the SharedStateRegistry Key: FLINK-6535 URL: https://issues.apache.org/jira/browse/FLINK-6535 Project:

[jira] [Created] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

2017-05-11 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6537: - Summary: Umbrella issue for fixes to incremental snapshots Key: FLINK-6537 URL: https://issues.apache.org/jira/browse/FLINK-6537 Project: Flink Issue Type:

[jira] [Updated] (FLINK-6535) JobID should not be part of the registration key to the SharedStateRegistry

2017-05-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6535: -- Issue Type: Sub-task (was: Improvement) Parent: FLINK-6537 > JobID should not be part o

[jira] [Updated] (FLINK-6534) SharedStateRegistry is disposing state handles from main thread

2017-05-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6534: -- Issue Type: Sub-task (was: Improvement) Parent: FLINK-6537 > SharedStateRegistry is dis

[jira] [Updated] (FLINK-6533) Duplicated registration of new shared state when checkpoint confirmations are still pending

2017-05-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6533: -- Issue Type: Sub-task (was: Bug) Parent: FLINK-6537 > Duplicated registration of new sha

[jira] [Updated] (FLINK-6527) OperatorSubtaskState has empty implementations of (un)/registerSharedStates

2017-05-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6527: -- Issue Type: Sub-task (was: Bug) Parent: FLINK-6537 > OperatorSubtaskState has empty imp

[jira] [Updated] (FLINK-6505) Proactively cleanup local FS for RocksDBKeyedStateBackend on startup

2017-05-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6505: -- Issue Type: Sub-task (was: Bug) Parent: FLINK-6537 > Proactively cleanup local FS for R

[jira] [Updated] (FLINK-6504) Lack of synchronization on materializedSstFiles in RocksDBKEyedStateBackend

2017-05-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6504: -- Issue Type: Sub-task (was: Bug) Parent: FLINK-6537 > Lack of synchronization on materia

[jira] [Updated] (FLINK-6475) Incremental snapshots in RocksDB hold lock during async file upload

2017-05-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6475: -- Issue Type: Sub-task (was: Bug) Parent: FLINK-6537 > Incremental snapshots in RocksDB h

[jira] [Created] (FLINK-6540) Create tests that cover all the issues

2017-05-11 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6540: - Summary: Create tests that cover all the issues Key: FLINK-6540 URL: https://issues.apache.org/jira/browse/FLINK-6540 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-6545) Make incremental checkpoints externalizable

2017-05-11 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6545: - Summary: Make incremental checkpoints externalizable Key: FLINK-6545 URL: https://issues.apache.org/jira/browse/FLINK-6545 Project: Flink Issue Type: Sub-t

[jira] [Created] (FLINK-6556) Include and expose Flink version in the savepoint data

2017-05-11 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6556: - Summary: Include and expose Flink version in the savepoint data Key: FLINK-6556 URL: https://issues.apache.org/jira/browse/FLINK-6556 Project: Flink Issue

[jira] [Commented] (FLINK-5053) Incremental / lightweight snapshots for checkpoints

2017-05-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16006995#comment-16006995 ] Stefan Richter commented on FLINK-5053: --- I have opened this jira to track everything

[jira] [Created] (FLINK-4730) Introduce CheckpointMetaData

2016-10-04 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4730: - Summary: Introduce CheckpointMetaData Key: FLINK-4730 URL: https://issues.apache.org/jira/browse/FLINK-4730 Project: Flink Issue Type: Bug Repo

[jira] [Created] (FLINK-4731) HeapKeyedStateBackend restorig broken for scale-in

2016-10-04 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4731: - Summary: HeapKeyedStateBackend restorig broken for scale-in Key: FLINK-4731 URL: https://issues.apache.org/jira/browse/FLINK-4731 Project: Flink Issue Type

[jira] [Updated] (FLINK-4730) Introduce CheckpointMetaData

2016-10-04 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-4730: -- Component/s: State Backends, Checkpointing > Introduce CheckpointMetaData >

[jira] [Assigned] (FLINK-4730) Introduce CheckpointMetaData

2016-10-04 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-4730: - Assignee: Stefan Richter > Introduce CheckpointMetaData > >

[jira] [Updated] (FLINK-4731) HeapKeyedStateBackend restoring broken for scale-in

2016-10-04 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-4731: -- Summary: HeapKeyedStateBackend restoring broken for scale-in (was: HeapKeyedStateBackend restor

[jira] [Created] (FLINK-4744) Introduce usercode class loader to deserialize partitionable operator state

2016-10-05 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4744: - Summary: Introduce usercode class loader to deserialize partitionable operator state Key: FLINK-4744 URL: https://issues.apache.org/jira/browse/FLINK-4744 Project:

[jira] [Commented] (FLINK-4492) Cleanup files from canceled snapshots

2016-10-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15575225#comment-15575225 ] Stefan Richter commented on FLINK-4492: --- I did not add any cleanup on cancel in the

[jira] [Created] (FLINK-4842) Introduce test to enforce order of operator / udf lifecycles

2016-10-17 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4842: - Summary: Introduce test to enforce order of operator / udf lifecycles Key: FLINK-4842 URL: https://issues.apache.org/jira/browse/FLINK-4842 Project: Flink

[jira] [Created] (FLINK-4843) Introduce Test for FsCheckpointStateOutputStream::getPos

2016-10-17 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4843: - Summary: Introduce Test for FsCheckpointStateOutputStream::getPos Key: FLINK-4843 URL: https://issues.apache.org/jira/browse/FLINK-4843 Project: Flink Issu

[jira] [Created] (FLINK-4844) Partitionable Raw Keyed/Operator State

2016-10-17 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4844: - Summary: Partitionable Raw Keyed/Operator State Key: FLINK-4844 URL: https://issues.apache.org/jira/browse/FLINK-4844 Project: Flink Issue Type: New Featur

[jira] [Updated] (FLINK-4858) Remove Legacy Checkpointing Interfaces

2016-10-19 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-4858: -- Description: This issue tracks the removal of the deprecated/legacy interfaces that are still i

[jira] [Closed] (FLINK-4842) Introduce test to enforce order of operator / udf lifecycles

2016-10-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-4842. - Resolution: Implemented Fix Version/s: 1.2.0 > Introduce test to enforce order of operator

[jira] [Closed] (FLINK-4844) Partitionable Raw Keyed/Operator State

2016-10-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-4844. - Resolution: Implemented Fix Version/s: 1.2.0 > Partitionable Raw Keyed/Operator State > ---

[jira] [Comment Edited] (FLINK-4867) Investigate code generation for improving sort performance

2016-10-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15592292#comment-15592292 ] Stefan Richter edited comment on FLINK-4867 at 10/20/16 4:32 PM: ---

[jira] [Commented] (FLINK-4867) Investigate code generation for improving sort performance

2016-10-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15592292#comment-15592292 ] Stefan Richter commented on FLINK-4867: --- If you sort performance is crucial to you,

[jira] [Commented] (FLINK-4867) Investigate code generation for improving sort performance

2016-10-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15592866#comment-15592866 ] Stefan Richter commented on FLINK-4867: --- I have already pushed my code into https://

[jira] [Created] (FLINK-4883) Prevent UDFs implementations through Scala singleton objects

2016-10-21 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4883: - Summary: Prevent UDFs implementations through Scala singleton objects Key: FLINK-4883 URL: https://issues.apache.org/jira/browse/FLINK-4883 Project: Flink

[jira] [Commented] (FLINK-4883) Prevent UDFs implementations through Scala singleton objects

2016-10-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15601278#comment-15601278 ] Stefan Richter commented on FLINK-4883: --- Ok, thanks! I will assign you to this. > P

[jira] [Updated] (FLINK-4883) Prevent UDFs implementations through Scala singleton objects

2016-10-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-4883: -- Assignee: Renkai Ge > Prevent UDFs implementations through Scala singleton objects > ---

[jira] [Commented] (FLINK-4883) Prevent UDFs implementations through Scala singleton objects

2016-10-25 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15604566#comment-15604566 ] Stefan Richter commented on FLINK-4883: --- Sure, here is the example from the mailing

[jira] [Assigned] (FLINK-4910) Introduce safety net for closing file system streams

2016-10-25 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-4910: - Assignee: Stefan Richter > Introduce safety net for closing file system streams > ---

[jira] [Created] (FLINK-4910) Introduce safety net for closing file system streams

2016-10-25 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4910: - Summary: Introduce safety net for closing file system streams Key: FLINK-4910 URL: https://issues.apache.org/jira/browse/FLINK-4910 Project: Flink Issue Ty

[jira] [Created] (FLINK-4942) Improve processing performance of HeapInternalTimerService with key groups

2016-10-27 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4942: - Summary: Improve processing performance of HeapInternalTimerService with key groups Key: FLINK-4942 URL: https://issues.apache.org/jira/browse/FLINK-4942 Project: F

[jira] [Assigned] (FLINK-4942) Improve processing performance of HeapInternalTimerService with key groups

2016-10-27 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-4942: - Assignee: Stefan Richter > Improve processing performance of HeapInternalTimerService wit

[jira] [Created] (FLINK-4945) KafkaConsumer logs wrong warning about confirmation for unknown checkpoint

2016-10-27 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4945: - Summary: KafkaConsumer logs wrong warning about confirmation for unknown checkpoint Key: FLINK-4945 URL: https://issues.apache.org/jira/browse/FLINK-4945 Project: F

[jira] [Assigned] (FLINK-4945) KafkaConsumer logs wrong warning about confirmation for unknown checkpoint

2016-10-27 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-4945: - Assignee: Stefan Richter > KafkaConsumer logs wrong warning about confirmation for unknow

[jira] [Created] (FLINK-4956) Introduce convenient methods for testing checkpoint/restore in StreamTaskTestHarness

2016-10-28 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4956: - Summary: Introduce convenient methods for testing checkpoint/restore in StreamTaskTestHarness Key: FLINK-4956 URL: https://issues.apache.org/jira/browse/FLINK-4956

[jira] [Closed] (FLINK-4974) RescalingITCase.testSavepointRescalingInPartitionedOperatorState unstable

2016-10-31 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-4974. - Resolution: Fixed Fixed trough 094b747 > RescalingITCase.testSavepointRescalingInPartitionedOpera

[jira] [Commented] (FLINK-4193) Task manager JVM crashes while deploying cancelling jobs

2016-10-31 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15622902#comment-15622902 ] Stefan Richter commented on FLINK-4193: --- I fixed some concurrency issues in the Rock

[jira] [Created] (FLINK-5019) Proper isRestored result for tasks that did not write state

2016-11-04 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5019: - Summary: Proper isRestored result for tasks that did not write state Key: FLINK-5019 URL: https://issues.apache.org/jira/browse/FLINK-5019 Project: Flink

[jira] [Commented] (FLINK-5036) Perform the grouping of keys in restoring instead of checkpointing

2016-11-09 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15650460#comment-15650460 ] Stefan Richter commented on FLINK-5036: --- >From the description it is not entirely cl

[jira] [Commented] (FLINK-5036) Perform the grouping of keys in restoring instead of checkpointing

2016-11-09 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15650479#comment-15650479 ] Stefan Richter commented on FLINK-5036: --- Ok, now I see that you are talking about so

[jira] [Closed] (FLINK-5019) Proper isRestored result for tasks that did not write state

2016-11-09 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5019. - Resolution: Fixed Fix Version/s: 1.2.0 > Proper isRestored result for tasks that did not wr

[jira] [Closed] (FLINK-3841) RocksDB statebackend creates empty dbs for stateless operators

2017-02-17 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-3841. - Resolution: Not A Problem Fix Version/s: 1.2.0 Not a problem any more. Will close this beca

<    1   2   3   4   5   6   7   8   9   10   >