[jira] [Commented] (FLINK-2491) Operators are not participating in state checkpointing in some cases

2017-02-17 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15871538#comment-15871538 ] Stefan Richter commented on FLINK-2491: --- This seems still valid, but I assume it is

[jira] [Commented] (FLINK-1725) New Partitioner for better load balancing for skewed data

2017-02-17 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15871572#comment-15871572 ] Stefan Richter commented on FLINK-1725: --- I agree with you [~aljoscha]. While this wo

[jira] [Commented] (FLINK-5932) Order of legacy vs new state initialization in the AbstractStreamOperator.

2017-03-02 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891930#comment-15891930 ] Stefan Richter commented on FLINK-5932: --- I think it makes a lot of sense if it is ea

[jira] [Commented] (FLINK-5917) Remove MapState.size()

2017-03-02 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891945#comment-15891945 ] Stefan Richter commented on FLINK-5917: --- I agree with [~aljoscha]. Unlike Java's Has

[jira] [Commented] (FLINK-5107) Job Manager goes out of memory from long history of prior execution attempts

2017-03-03 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15893955#comment-15893955 ] Stefan Richter commented on FLINK-5107: --- This is not intentional. > Job Manager goe

[jira] [Created] (FLINK-5958) Asyncronous snapshots for heap-based keyed state backends

2017-03-03 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5958: - Summary: Asyncronous snapshots for heap-based keyed state backends Key: FLINK-5958 URL: https://issues.apache.org/jira/browse/FLINK-5958 Project: Flink Iss

[jira] [Updated] (FLINK-5958) Asynchronous snapshots for heap-based keyed state backends

2017-03-03 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-5958: -- Summary: Asynchronous snapshots for heap-based keyed state backends (was: Asyncronous snapshots

[jira] [Closed] (FLINK-5917) Remove MapState.size()

2017-03-03 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5917. - Resolution: Fixed Fixed in f37507d (master) > Remove MapState.size() > -- > >

[jira] [Commented] (FLINK-4275) Generic Folding, Reducing and List states behave differently from other state backends

2017-03-03 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15894595#comment-15894595 ] Stefan Richter commented on FLINK-4275: --- One more ping on this. Can I close this iss

[jira] [Commented] (FLINK-4760) Kafka 09 Consumer failed to initialize state because of corrupted operator state and not able to recover

2017-03-03 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15894605#comment-15894605 ] Stefan Richter commented on FLINK-4760: --- [~zhenzhongxu] is this still a problem or c

[jira] [Commented] (FLINK-3089) OperatorState timeout

2017-03-03 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15894606#comment-15894606 ] Stefan Richter commented on FLINK-3089: --- Does this solve the problem and we can clos

[jira] [Commented] (FLINK-3387) Replace all ByteArrayOutputStream and DataOutputStream use in State Backends by DataOutputSerializer

2017-03-03 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15894614#comment-15894614 ] Stefan Richter commented on FLINK-3387: --- [~sbcd90] are you still working on this? [~

[jira] [Created] (FLINK-5961) Queryable State is broken for HeapKeyedStateBackend

2017-03-03 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5961: - Summary: Queryable State is broken for HeapKeyedStateBackend Key: FLINK-5961 URL: https://issues.apache.org/jira/browse/FLINK-5961 Project: Flink Issue Typ

[jira] [Created] (FLINK-5979) Backwards compatibility for HeapKeyedStateBackend serialization format (1.2 -> 1.3)

2017-03-07 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5979: - Summary: Backwards compatibility for HeapKeyedStateBackend serialization format (1.2 -> 1.3) Key: FLINK-5979 URL: https://issues.apache.org/jira/browse/FLINK-5979 P

[jira] [Commented] (FLINK-5995) Get a Exception when creating the ListStateDescriptor with a TypeInformation

2017-03-09 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15902750#comment-15902750 ] Stefan Richter commented on FLINK-5995: --- Hi, I think your idea should work, you jus

[jira] [Commented] (FLINK-5991) Expose Broadcast Operator State through public APIs

2017-03-09 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15903085#comment-15903085 ] Stefan Richter commented on FLINK-5991: --- I agree with [~aljoscha] 's suggestion. >

[jira] [Assigned] (FLINK-5397) Fail to deserialize savepoints in v1.1 when there exist missing fields in class serialization descriptors

2016-12-28 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5397: - Assignee: Stefan Richter > Fail to deserialize savepoints in v1.1 when there exist missin

[jira] [Commented] (FLINK-5397) Fail to deserialize savepoints in v1.1 when there exist missing fields in class serialization descriptors

2016-12-28 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15782747#comment-15782747 ] Stefan Richter commented on FLINK-5397: --- Thanks for pointing out this problem. I ope

[jira] [Assigned] (FLINK-5416) Function wrappers should support CheckpointedFunction

2017-01-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5416: - Assignee: Stefan Richter > Function wrappers should support CheckpointedFunction > -

[jira] [Assigned] (FLINK-5407) Savepoint for iterative Task fails.

2017-01-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5407: - Assignee: Stefan Richter > Savepoint for iterative Task fails. >

[jira] [Created] (FLINK-5421) Explicit restore method in Snapshotable

2017-01-06 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5421: - Summary: Explicit restore method in Snapshotable Key: FLINK-5421 URL: https://issues.apache.org/jira/browse/FLINK-5421 Project: Flink Issue Type: Improveme

[jira] [Updated] (FLINK-5250) Make AbstractUdfStreamOperator aware of WrappingFunction

2017-01-09 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-5250: -- Assignee: Stefan Richter > Make AbstractUdfStreamOperator aware of WrappingFunction > --

[jira] [Created] (FLINK-5442) Add test to fix ordinals of serialized enum StateDescriptor.Type

2017-01-11 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5442: - Summary: Add test to fix ordinals of serialized enum StateDescriptor.Type Key: FLINK-5442 URL: https://issues.apache.org/jira/browse/FLINK-5442 Project: Flink

[jira] [Commented] (FLINK-5465) RocksDB fails with segfault while calling AbstractRocksDBState.clear()

2017-01-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15819458#comment-15819458 ] Stefan Richter commented on FLINK-5465: --- Looks like cleanup function which calls to

[jira] [Assigned] (FLINK-5467) Stateless chained tasks set legacy operator state

2017-01-12 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5467: - Assignee: Stefan Richter > Stateless chained tasks set legacy operator state > --

[jira] [Commented] (FLINK-5473) setMaxParallelism() higher than 1 is possible on non-parallel operators

2017-01-12 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15821254#comment-15821254 ] Stefan Richter commented on FLINK-5473: --- We could try to automatically set the old p

[jira] [Created] (FLINK-5480) User-provided hashes for operators

2017-01-13 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5480: - Summary: User-provided hashes for operators Key: FLINK-5480 URL: https://issues.apache.org/jira/browse/FLINK-5480 Project: Flink Issue Type: Improvement

[jira] [Closed] (FLINK-4956) Introduce convenient methods for testing checkpoint/restore in StreamTaskTestHarness

2017-01-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-4956. - Resolution: Implemented > Introduce convenient methods for testing checkpoint/restore in > Stream

[jira] [Closed] (FLINK-5283) InputStream should be closed in RocksDBKeyedStateBackend#restoreOldSavepointKeyedState

2017-01-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5283. - Resolution: Fixed > InputStream should be closed in > RocksDBKeyedStateBackend#restoreOldSavepoin

[jira] [Commented] (FLINK-5468) Restoring from a semi async rocksdb statebackend (1.1) to 1.2 fails with ClassNotFoundException

2017-01-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15821807#comment-15821807 ] Stefan Richter commented on FLINK-5468: --- Migrating from semi async snapshotting will

[jira] [Commented] (FLINK-5465) RocksDB fails with segfault while calling AbstractRocksDBState.clear()

2017-01-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15821808#comment-15821808 ] Stefan Richter commented on FLINK-5465: --- After talking to [~StephanEwen], we came to

[jira] [Assigned] (FLINK-5468) Restoring from a semi async rocksdb statebackend (1.1) to 1.2 fails with ClassNotFoundException

2017-01-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5468: - Assignee: Stefan Richter > Restoring from a semi async rocksdb statebackend (1.1) to 1.2

[jira] [Commented] (FLINK-5436) UDF state without CheckpointedRestoring can result in restarting loop

2017-01-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15834292#comment-15834292 ] Stefan Richter commented on FLINK-5436: --- I think that would be good to have in. > U

[jira] [Commented] (FLINK-5663) Checkpoint fails because of closed registry

2017-01-26 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840068#comment-15840068 ] Stefan Richter commented on FLINK-5663: --- I don't think this is a race condition. Thi

[jira] [Commented] (FLINK-5663) Checkpoint fails because of closed registry

2017-01-26 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840070#comment-15840070 ] Stefan Richter commented on FLINK-5663: --- Then again, question is if this task alread

[jira] [Commented] (FLINK-5663) Checkpoint fails because of closed registry

2017-01-26 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840101#comment-15840101 ] Stefan Richter commented on FLINK-5663: --- The only place this registry ever gets clos

[jira] [Assigned] (FLINK-5663) Checkpoint fails because of closed registry

2017-01-26 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5663: - Assignee: Stefan Richter > Checkpoint fails because of closed registry >

[jira] [Created] (FLINK-5681) Make ReaperThread for SafetyNetCloseableRegistry a singleton

2017-01-27 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5681: - Summary: Make ReaperThread for SafetyNetCloseableRegistry a singleton Key: FLINK-5681 URL: https://issues.apache.org/jira/browse/FLINK-5681 Project: Flink

[jira] (FLINK-5044) Converting operator and function state from Flink 1.1 for all changed operators in 1.2

2017-01-30 Thread Stefan Richter (JIRA)
Title: Message Title Stefan Richter commented on FLINK-5044

[jira] (FLINK-5480) User-provided hashes for operators

2017-01-30 Thread Stefan Richter (JIRA)
Title: Message Title Stefan Richter commented on FLINK-5480

[jira] [Created] (FLINK-5707) Find better keys for backend configuration parameters

2017-02-03 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5707: - Summary: Find better keys for backend configuration parameters Key: FLINK-5707 URL: https://issues.apache.org/jira/browse/FLINK-5707 Project: Flink Issue T

[jira] [Created] (FLINK-5715) Asynchronous snapshotting for HeapKeyedStateBackend

2017-02-06 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5715: - Summary: Asynchronous snapshotting for HeapKeyedStateBackend Key: FLINK-5715 URL: https://issues.apache.org/jira/browse/FLINK-5715 Project: Flink Issue Typ

[jira] [Created] (FLINK-5730) User can concurrently modify state metadata of RocksDB asynchronous snapshots

2017-02-07 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5730: - Summary: User can concurrently modify state metadata of RocksDB asynchronous snapshots Key: FLINK-5730 URL: https://issues.apache.org/jira/browse/FLINK-5730 Project

[jira] [Updated] (FLINK-5730) Users can concurrently modify state metadata of RocksDB asynchronous snapshots

2017-02-07 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-5730: -- Summary: Users can concurrently modify state metadata of RocksDB asynchronous snapshots (was: U

[jira] [Commented] (FLINK-5740) Make WrappingFunction an interface and move to flink-core

2017-02-09 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15859254#comment-15859254 ] Stefan Richter commented on FLINK-5740: --- +1 very good idea. > Make WrappingFunction

[jira] [Created] (FLINK-7619) Improve abstraction in AbstractAsyncIOCallable to better fit

2017-09-14 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-7619: - Summary: Improve abstraction in AbstractAsyncIOCallable to better fit Key: FLINK-7619 URL: https://issues.apache.org/jira/browse/FLINK-7619 Project: Flink

[jira] [Closed] (FLINK-7524) Task "xxx" did not react to cancelling signal, but is stuck in method

2017-09-25 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-7524. - Assignee: Stefan Richter I still found some small potential for improvement that is merged in 0073

[jira] [Closed] (FLINK-7619) Improve abstraction in AbstractAsyncIOCallable to better fit

2017-09-25 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-7619. - Resolution: Fixed Fix Version/s: 1.4.0 Merged in 5af463a9c0. > Improve abstraction in Abst

[jira] [Created] (FLINK-7719) Send checkpoint id to task as part of deployment descriptor when resuming

2017-09-27 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-7719: - Summary: Send checkpoint id to task as part of deployment descriptor when resuming Key: FLINK-7719 URL: https://issues.apache.org/jira/browse/FLINK-7719 Project: Fl

[jira] [Created] (FLINK-7720) Centralize creation of backends and state related resources

2017-09-27 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-7720: - Summary: Centralize creation of backends and state related resources Key: FLINK-7720 URL: https://issues.apache.org/jira/browse/FLINK-7720 Project: Flink

[jira] [Created] (FLINK-7757) RocksDB lock is too strict and can block snapshots in synchronous phase

2017-10-03 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-7757: - Summary: RocksDB lock is too strict and can block snapshots in synchronous phase Key: FLINK-7757 URL: https://issues.apache.org/jira/browse/FLINK-7757 Project: Flin

[jira] [Commented] (FLINK-6684) Remove AsyncCheckpointRunnable from StreamTask

2017-10-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16203174#comment-16203174 ] Stefan Richter commented on FLINK-6684: --- Not sure if this issue is actually valid, b

[jira] [Commented] (FLINK-7796) RocksDBKeyedStateBackend#RocksDBFullSnapshotOperation should close snapshotCloseableRegistry

2017-10-18 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16208979#comment-16208979 ] Stefan Richter commented on FLINK-7796: --- It is closed by the creator/owner in {{clos

[jira] [Closed] (FLINK-7796) RocksDBKeyedStateBackend#RocksDBFullSnapshotOperation should close snapshotCloseableRegistry

2017-10-18 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-7796. - Resolution: Invalid > RocksDBKeyedStateBackend#RocksDBFullSnapshotOperation should close > snapsh

[jira] [Closed] (FLINK-7757) RocksDB lock is too strict and can block snapshots in synchronous phase

2017-10-18 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-7757. - Resolution: Fixed Fixed in 7d026aa728. > RocksDB lock is too strict and can block snapshots in sy

[jira] [Assigned] (FLINK-5372) Fix RocksDBAsyncSnapshotTest.testCancelFullyAsyncCheckpoints()

2017-10-18 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5372: - Assignee: Stefan Richter > Fix RocksDBAsyncSnapshotTest.testCancelFullyAsyncCheckpoints()

[jira] [Commented] (FLINK-5372) Fix RocksDBAsyncSnapshotTest.testCancelFullyAsyncCheckpoints()

2017-10-18 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16210596#comment-16210596 ] Stefan Richter commented on FLINK-5372: --- Those are two separate problems and I don't

[jira] [Comment Edited] (FLINK-5372) Fix RocksDBAsyncSnapshotTest.testCancelFullyAsyncCheckpoints()

2017-10-18 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16210596#comment-16210596 ] Stefan Richter edited comment on FLINK-5372 at 10/19/17 5:23 AM: ---

[jira] [Comment Edited] (FLINK-5372) Fix RocksDBAsyncSnapshotTest.testCancelFullyAsyncCheckpoints()

2017-10-18 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16210596#comment-16210596 ] Stefan Richter edited comment on FLINK-5372 at 10/19/17 5:41 AM: ---

[jira] [Closed] (FLINK-5372) Fix RocksDBAsyncSnapshotTest.testCancelFullyAsyncCheckpoints()

2017-10-19 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5372. - Resolution: Fixed Merged in dbf4c86 > Fix RocksDBAsyncSnapshotTest.testCancelFullyAsyncCheckpoint

[jira] [Assigned] (FLINK-4809) Operators should tolerate checkpoint failures

2017-10-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-4809: - Assignee: Stefan Richter > Operators should tolerate checkpoint failures > --

[jira] [Closed] (FLINK-10289) Classify Exceptions to different category for apply different failover strategy

2018-10-09 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10289. -- Resolution: Implemented Merged in: master: 20b9326397 > Classify Exceptions to different cate

[jira] [Closed] (FLINK-10565) Refactor SchedulerTestBase

2018-10-16 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10565. -- Resolution: Fixed Merged in: master: 05a4789042 > Refactor SchedulerTestBase > --

[jira] [Closed] (FLINK-4052) Unstable test ConnectionUtilsTest

2018-10-16 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-4052. - Resolution: Fixed Merged in: master: f195a6ed5c > Unstable test ConnectionUtilsTest > --

[jira] [Closed] (FLINK-10567) Lost serialize fields when ttl state store with the mutable serializer

2018-10-18 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10567. -- Resolution: Fixed Fix Version/s: 1.6.3 Merged in: master: 4be1afa3a6 release-1.6: c2180

[jira] [Assigned] (FLINK-10630) Update migration tests for Flink 1.6

2018-10-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-10630: -- Assignee: Stefan Richter (was: vinoyang) > Update migration tests for Flink 1.6 > --

[jira] [Created] (FLINK-10645) Update StatefulJobSavepointMigrationITCase for 1.6

2018-10-23 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10645: -- Summary: Update StatefulJobSavepointMigrationITCase for 1.6 Key: FLINK-10645 URL: https://issues.apache.org/jira/browse/FLINK-10645 Project: Flink Issue

[jira] [Created] (FLINK-10647) Update WindowOperatorMigrationTest for 1.6

2018-10-23 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10647: -- Summary: Update WindowOperatorMigrationTest for 1.6 Key: FLINK-10647 URL: https://issues.apache.org/jira/browse/FLINK-10647 Project: Flink Issue Type: Su

[jira] [Created] (FLINK-10646) Update AbstractOperatorRestoreTestBase for 1.6

2018-10-23 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10646: -- Summary: Update AbstractOperatorRestoreTestBase for 1.6 Key: FLINK-10646 URL: https://issues.apache.org/jira/browse/FLINK-10646 Project: Flink Issue Type

[jira] [Created] (FLINK-10648) Update ContinuousFileProcessingMigrationTest for 1.6

2018-10-23 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10648: -- Summary: Update ContinuousFileProcessingMigrationTest for 1.6 Key: FLINK-10648 URL: https://issues.apache.org/jira/browse/FLINK-10648 Project: Flink Issu

[jira] [Created] (FLINK-10649) Update FlinkKafkaConsumerBaseMigrationTest for 1.6

2018-10-23 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10649: -- Summary: Update FlinkKafkaConsumerBaseMigrationTest for 1.6 Key: FLINK-10649 URL: https://issues.apache.org/jira/browse/FLINK-10649 Project: Flink Issue

[jira] [Created] (FLINK-10650) Update BucketingSinkMigrationTest for 1.6

2018-10-23 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10650: -- Summary: Update BucketingSinkMigrationTest for 1.6 Key: FLINK-10650 URL: https://issues.apache.org/jira/browse/FLINK-10650 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-10651) Update CEPMigrationTest for 1.6

2018-10-23 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10651: -- Summary: Update CEPMigrationTest for 1.6 Key: FLINK-10651 URL: https://issues.apache.org/jira/browse/FLINK-10651 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-10652) Update StatefulJobWBroadcastStateMigrationITCase for 1.6

2018-10-23 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10652: -- Summary: Update StatefulJobWBroadcastStateMigrationITCase for 1.6 Key: FLINK-10652 URL: https://issues.apache.org/jira/browse/FLINK-10652 Project: Flink

[jira] [Closed] (FLINK-10630) Update migration tests for Flink 1.6

2018-10-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10630. -- Resolution: Duplicate > Update migration tests for Flink 1.6 > ---

[jira] [Assigned] (FLINK-8995) Add a test operator with keyed state that uses custom, stateful serializer

2018-10-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-8995: - Assignee: Stefan Richter > Add a test operator with keyed state that uses custom, statef

[jira] [Commented] (FLINK-10909) Possible RocksDBStateBackend performance regression with rocksdbjni-5.7.5

2018-11-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16692995#comment-16692995 ] Stefan Richter commented on FLINK-10909: [~Aminouvic] I will close this issue fo

[jira] [Resolved] (FLINK-10909) Possible RocksDBStateBackend performance regression with rocksdbjni-5.7.5

2018-11-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-10909. Resolution: Cannot Reproduce > Possible RocksDBStateBackend performance regression with ro

[jira] [Resolved] (FLINK-10946) Resuming Externalized Checkpoint (rocks, incremental, scale up) end-to-end test failed on Travis

2018-11-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-10946. Resolution: Fixed Fix Version/s: (was: 1.7.1) (was: 1.8.0

[jira] [Commented] (FLINK-10954) Hardlink from files of previous local stored state might cross devices

2018-11-26 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16698635#comment-16698635 ] Stefan Richter commented on FLINK-10954: I agree with [~StephanEwen] that we sho

[jira] [Commented] (FLINK-10949) When use flink-1.6.2's intervalJoin funtion, the thread is stucked in rockdb's seek for too long time

2018-11-26 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16698862#comment-16698862 ] Stefan Richter commented on FLINK-10949: Hi, as commented on the mailing list I

[jira] [Commented] (FLINK-10912) Configurable RocksDBStateBackend options factory

2018-11-26 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16698961#comment-16698961 ] Stefan Richter commented on FLINK-10912: [~thw] Is this something that you would

[jira] [Created] (FLINK-11012) Introduce abstract superclass for filesystem IT cases

2018-11-27 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-11012: -- Summary: Introduce abstract superclass for filesystem IT cases Key: FLINK-11012 URL: https://issues.apache.org/jira/browse/FLINK-11012 Project: Flink Iss

[jira] [Commented] (FLINK-10844) ArrayIndexOutOfBoundsException during checkpoint (Flink 1.5.2)

2018-12-10 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16714523#comment-16714523 ] Stefan Richter commented on FLINK-10844: Hi, sorry for the late reply. I cannot

[jira] [Closed] (FLINK-10865) Implement Flink's own Aliyun OSS filesystem

2018-12-10 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10865. -- Resolution: Implemented Fix Version/s: 1.8.0 Merged in: master: 1a0d49e044 > Implement

[jira] [Commented] (FLINK-10949) When use flink-1.6.2's intervalJoin funtion, the thread is stucked in rockdb's seek for too long time

2018-12-10 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16714613#comment-16714613 ] Stefan Richter commented on FLINK-10949: Is there any new insight or update on t

[jira] [Created] (FLINK-11121) Check and update licensing notes for Aliyun FS [FLINK-10865]

2018-12-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-11121: -- Summary: Check and update licensing notes for Aliyun FS [FLINK-10865] Key: FLINK-11121 URL: https://issues.apache.org/jira/browse/FLINK-11121 Project: Flink

[jira] [Closed] (FLINK-6504) Lack of synchronization on materializedSstFiles in RocksDBKEyedStateBackend

2017-05-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6504. - Resolution: Fixed fixed in 958773b71c > Lack of synchronization on materializedSstFiles in RocksD

[jira] [Closed] (FLINK-6527) OperatorSubtaskState has empty implementations of (un)/registerSharedStates

2017-05-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6527. - Resolution: Fixed fixed in efbb41bc63 > OperatorSubtaskState has empty implementations of (un)/re

[jira] [Closed] (FLINK-6533) Duplicated registration of new shared state when checkpoint confirmations are still pending

2017-05-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6533. - Resolution: Fixed fixed in 4745d0c082 > Duplicated registration of new shared state when checkpoi

[jira] [Closed] (FLINK-6534) SharedStateRegistry is disposing state handles from main thread

2017-05-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6534. - Resolution: Fixed fixed in 44fb035e02. > SharedStateRegistry is disposing state handles from main

[jira] [Closed] (FLINK-6535) JobID should not be part of the registration key to the SharedStateRegistry

2017-05-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6535. - Resolution: Fixed fixed in 4745d0c082 > JobID should not be part of the registration key to the S

[jira] [Closed] (FLINK-6545) Make incremental checkpoints externalizable

2017-05-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6545. - Resolution: Fixed fixed in 098e46f2d2 > Make incremental checkpoints externalizable > ---

[jira] [Updated] (FLINK-6505) Proactively cleanup local FS for RocksDBKeyedStateBackend on startup

2017-05-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6505: -- Priority: Major (was: Blocker) > Proactively cleanup local FS for RocksDBKeyedStateBackend on s

[jira] [Updated] (FLINK-6540) Add more thorough tests for RocksDB and incremental checkpointing

2017-05-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6540: -- Priority: Major (was: Blocker) > Add more thorough tests for RocksDB and incremental checkpoint

[jira] [Updated] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

2017-05-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6537: -- Priority: Major (was: Blocker) > Umbrella issue for fixes to incremental snapshots > --

[jira] [Commented] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

2017-05-16 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16011952#comment-16011952 ] Stefan Richter commented on FLINK-6537: --- Hi, thanks a lot for the testing effort an

[jira] [Created] (FLINK-6599) Communicate last committed checkpoint through trigger checkpoint message

2017-05-16 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6599: - Summary: Communicate last committed checkpoint through trigger checkpoint message Key: FLINK-6599 URL: https://issues.apache.org/jira/browse/FLINK-6599 Project: Fli

[jira] [Created] (FLINK-6633) Register with shared state registry before aadding to CompletedCheckpointStore

2017-05-19 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6633: - Summary: Register with shared state registry before aadding to CompletedCheckpointStore Key: FLINK-6633 URL: https://issues.apache.org/jira/browse/FLINK-6633 Projec

[jira] [Updated] (FLINK-6633) Register with shared state registry before adding to CompletedCheckpointStore

2017-05-19 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6633: -- Summary: Register with shared state registry before adding to CompletedCheckpointStore (was: Re

<    1   2   3   4   5   6   7   8   9   10   >