[jira] [Created] (FLINK-4492) Cleanup files from canceled snapshots

2016-08-25 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4492: - Summary: Cleanup files from canceled snapshots Key: FLINK-4492 URL: https://issues.apache.org/jira/browse/FLINK-4492 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-4493) Unify the snapshot output format for keyed-state backends

2016-08-25 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4493: - Summary: Unify the snapshot output format for keyed-state backends Key: FLINK-4493 URL: https://issues.apache.org/jira/browse/FLINK-4493 Project: Flink Iss

[jira] [Created] (FLINK-4508) Consolidate DummyEnvironment and MockEnvironment for Tests

2016-08-26 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4508: - Summary: Consolidate DummyEnvironment and MockEnvironment for Tests Key: FLINK-4508 URL: https://issues.apache.org/jira/browse/FLINK-4508 Project: Flink Is

[jira] [Assigned] (FLINK-4556) Make Queryable State Key-Group Aware

2016-09-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-4556: - Assignee: Stefan Richter > Make Queryable State Key-Group Aware > ---

[jira] [Commented] (FLINK-4603) KeyedStateBackend cannot restore user code classes

2016-09-22 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15512553#comment-15512553 ] Stefan Richter commented on FLINK-4603: --- Currently, we should still keep the UserCod

[jira] [Commented] (FLINK-5985) Flink treats every task as stateful (making topology changes impossible)

2017-03-10 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15904895#comment-15904895 ] Stefan Richter commented on FLINK-5985: --- I think the proper solution is based on pre

[jira] [Assigned] (FLINK-6044) TypeSerializerSerializationProxy.read() doesn't verify the read buffer length

2017-03-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-6044: - Assignee: Stefan Richter > TypeSerializerSerializationProxy.read() doesn't verify the rea

[jira] [Commented] (FLINK-6044) TypeSerializerSerializationProxy.read() doesn't verify the read buffer length

2017-03-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15924201#comment-15924201 ] Stefan Richter commented on FLINK-6044: --- Thanks for reporting this. The {{read(...)}

[jira] [Created] (FLINK-6048) Asynchronous snapshots for heap-based operator state backends

2017-03-14 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6048: - Summary: Asynchronous snapshots for heap-based operator state backends Key: FLINK-6048 URL: https://issues.apache.org/jira/browse/FLINK-6048 Project: Flink

[jira] [Created] (FLINK-6049) Parallelize execution of (async) snapshots in AsyncCheckpointRunnable

2017-03-14 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6049: - Summary: Parallelize execution of (async) snapshots in AsyncCheckpointRunnable Key: FLINK-6049 URL: https://issues.apache.org/jira/browse/FLINK-6049 Project: Flink

[jira] [Commented] (FLINK-6061) NPE on TypeSerializer.serialize with a RocksDBStateBackend calling entries() on a keyed state in the open() function

2017-03-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15925929#comment-15925929 ] Stefan Richter commented on FLINK-6061: --- Thanks for reporting this. I agree that the

[jira] [Assigned] (FLINK-6061) NPE on TypeSerializer.serialize with a RocksDBStateBackend calling entries() on a keyed state in the open() function

2017-03-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-6061: - Assignee: Stefan Richter > NPE on TypeSerializer.serialize with a RocksDBStateBackend cal

[jira] [Comment Edited] (FLINK-6061) NPE on TypeSerializer.serialize with a RocksDBStateBackend calling entries() on a keyed state in the open() function

2017-03-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15925929#comment-15925929 ] Stefan Richter edited comment on FLINK-6061 at 3/15/17 11:19 AM: ---

[jira] [Commented] (FLINK-6061) NPE on TypeSerializer.serialize with a RocksDBStateBackend calling entries() on a keyed state in the open() function

2017-03-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15926192#comment-15926192 ] Stefan Richter commented on FLINK-6061: --- [~vpernin] afaik, there is not yet a native

[jira] [Closed] (FLINK-6061) NPE on TypeSerializer.serialize with a RocksDBStateBackend calling entries() on a keyed state in the open() function

2017-03-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6061. - Resolution: Fixed Fix Version/s: 1.3.0 Fixed in 0bdc8bf (master) > NPE on TypeSerializer.s

[jira] [Closed] (FLINK-6044) TypeSerializerSerializationProxy.read() doesn't verify the read buffer length

2017-03-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6044. - Resolution: Fixed Fix Version/s: 1.3.0 Fixed in cbaf4e5 (master) > TypeSerializerSerializa

[jira] [Closed] (FLINK-5979) Backwards compatibility for HeapKeyedStateBackend serialization format (1.2 -> 1.3)

2017-03-16 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5979. - Resolution: Fixed fixed in ab014ef > Backwards compatibility for HeapKeyedStateBackend serializat

[jira] [Closed] (FLINK-5715) Asynchronous snapshotting for HeapKeyedStateBackend

2017-03-16 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5715. - Resolution: Fixed Fix Version/s: 1.3.0 fixed in ab014ef > Asynchronous snapshotting for He

[jira] [Closed] (FLINK-5985) Flink treats every task as stateful (making topology changes impossible)

2017-03-17 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5985. - Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 fixed in 20fff32. > Flink

[jira] [Assigned] (FLINK-5985) Flink treats every task as stateful (making topology changes impossible)

2017-03-17 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5985: - Assignee: Stefan Richter > Flink treats every task as stateful (making topology changes i

[jira] [Closed] (FLINK-4760) Kafka 09 Consumer failed to initialize state because of corrupted operator state and not able to recover

2017-03-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-4760. - Resolution: Not A Problem > Kafka 09 Consumer failed to initialize state because of corrupted oper

[jira] [Commented] (FLINK-5217) Deprecated interface Checkpointed make clear suggestion

2017-03-27 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15942790#comment-15942790 ] Stefan Richter commented on FLINK-5217: --- [~shijinkui] the JavaDocs for {{Checkpointe

[jira] [Created] (FLINK-6207) Duplicate type serializers for async snapshots of CopyOnWriteStateTable

2017-03-28 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6207: - Summary: Duplicate type serializers for async snapshots of CopyOnWriteStateTable Key: FLINK-6207 URL: https://issues.apache.org/jira/browse/FLINK-6207 Project: Flin

[jira] [Closed] (FLINK-6207) Duplicate type serializers for async snapshots of CopyOnWriteStateTable

2017-03-28 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6207. - Resolution: Fixed Fix Version/s: 1.2.1 fixed in 89866a5 backported to 1.2 in bb3e26f > Du

[jira] [Closed] (FLINK-6034) Add KeyedStateHandle for the snapshots in keyed streams

2017-03-28 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6034. - Resolution: Fixed Fix Version/s: 1.3.0 Implemented in cd5527417a1cae57073a8855c6c3b88c88c78

[jira] [Created] (FLINK-6220) Fine-grained copy-on-write for Heap(Map/List)States in CopyOnWriteStateTable

2017-03-30 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6220: - Summary: Fine-grained copy-on-write for Heap(Map/List)States in CopyOnWriteStateTable Key: FLINK-6220 URL: https://issues.apache.org/jira/browse/FLINK-6220 Project:

[jira] [Closed] (FLINK-5037) Instability in AbstractUdfStreamOperatorLifecycleTest

2016-11-09 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5037. - Resolution: Fixed Fix Version/s: 1.2.0 > Instability in AbstractUdfStreamOperatorLifecycleT

[jira] [Created] (FLINK-5041) Implement savepoint backwards compatibility 1.1 -> 1.2

2016-11-09 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5041: - Summary: Implement savepoint backwards compatibility 1.1 -> 1.2 Key: FLINK-5041 URL: https://issues.apache.org/jira/browse/FLINK-5041 Project: Flink Issue

[jira] [Created] (FLINK-5042) Convert old savepoints to new savepoints

2016-11-09 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5042: - Summary: Convert old savepoints to new savepoints Key: FLINK-5042 URL: https://issues.apache.org/jira/browse/FLINK-5042 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-5043) Converting keyed state from Flink 1.1 backend implementations to their new counterparts in 1.2

2016-11-09 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5043: - Summary: Converting keyed state from Flink 1.1 backend implementations to their new counterparts in 1.2 Key: FLINK-5043 URL: https://issues.apache.org/jira/browse/FLINK-5043

[jira] [Created] (FLINK-5044) Converting operator and function state from Flink 1.1 for all changed operators in 1.2

2016-11-09 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5044: - Summary: Converting operator and function state from Flink 1.1 for all changed operators in 1.2 Key: FLINK-5044 URL: https://issues.apache.org/jira/browse/FLINK-5044

[jira] [Created] (FLINK-5051) Backwards compatibility for serializers in backend state

2016-11-11 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5051: - Summary: Backwards compatibility for serializers in backend state Key: FLINK-5051 URL: https://issues.apache.org/jira/browse/FLINK-5051 Project: Flink Issu

[jira] [Created] (FLINK-5052) Changing the maximum parallelism (number of key groups) of a job

2016-11-11 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5052: - Summary: Changing the maximum parallelism (number of key groups) of a job Key: FLINK-5052 URL: https://issues.apache.org/jira/browse/FLINK-5052 Project: Flink

[jira] [Created] (FLINK-5053) Incremental / lightweight snapshots for checkpoints

2016-11-11 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5053: - Summary: Incremental / lightweight snapshots for checkpoints Key: FLINK-5053 URL: https://issues.apache.org/jira/browse/FLINK-5053 Project: Flink Issue Typ

[jira] [Commented] (FLINK-5053) Incremental / lightweight snapshots for checkpoints

2016-11-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15663198#comment-15663198 ] Stefan Richter commented on FLINK-5053: --- That might very well be, I am still plannin

[jira] [Updated] (FLINK-5051) Backwards compatibility for serializers in backend state

2016-11-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-5051: -- Description: When a new state is register, e.g. in a keyed backend via `getPartitionedState`, t

[jira] [Updated] (FLINK-5051) Backwards compatibility for serializers in backend state

2016-11-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-5051: -- Description: When a new state is register, e.g. in a keyed backend via `getPartitionedState`, t

[jira] [Created] (FLINK-5099) Test testCancelPartitionRequest is instable

2016-11-18 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5099: - Summary: Test testCancelPartitionRequest is instable Key: FLINK-5099 URL: https://issues.apache.org/jira/browse/FLINK-5099 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-5100) Test testZooKeeperReelection is instable

2016-11-18 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5100: - Summary: Test testZooKeeperReelection is instable Key: FLINK-5100 URL: https://issues.apache.org/jira/browse/FLINK-5100 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-5101) Test CassandraConnectorITCase instable

2016-11-18 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5101: - Summary: Test CassandraConnectorITCase instable Key: FLINK-5101 URL: https://issues.apache.org/jira/browse/FLINK-5101 Project: Flink Issue Type: Bug

[jira] [Updated] (FLINK-5053) Incremental / lightweight snapshots for checkpoints

2016-11-18 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-5053: -- Description: There is currently basically no difference between savepoints and checkpoints in F

[jira] [Created] (FLINK-5107) Job Manager goes out of memory from long history of prior execution attempts

2016-11-21 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5107: - Summary: Job Manager goes out of memory from long history of prior execution attempts Key: FLINK-5107 URL: https://issues.apache.org/jira/browse/FLINK-5107 Project:

[jira] [Commented] (FLINK-5107) Job Manager goes out of memory from long history of prior execution attempts

2016-11-21 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15683096#comment-15683096 ] Stefan Richter commented on FLINK-5107: --- agreed, it could be a next step to provide

[jira] [Commented] (FLINK-5111) Change the assignToKeyGroup() method to not use Object.hashCode()

2016-11-21 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15683737#comment-15683737 ] Stefan Richter commented on FLINK-5111: --- I think this is not an issue, because the d

[jira] [Created] (FLINK-5146) Improved resource cleanup in RocksDB keyed state backend

2016-11-23 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5146: - Summary: Improved resource cleanup in RocksDB keyed state backend Key: FLINK-5146 URL: https://issues.apache.org/jira/browse/FLINK-5146 Project: Flink Issu

[jira] [Updated] (FLINK-5146) Improved resource cleanup in RocksDB keyed state backend

2016-11-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-5146: -- Priority: Blocker (was: Major) > Improved resource cleanup in RocksDB keyed state backend > ---

[jira] [Commented] (FLINK-5024) Add SimpleStateDescriptor to clarify the concepts

2016-11-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15692874#comment-15692874 ] Stefan Richter commented on FLINK-5024: --- Independently of this, I also talked with A

[jira] [Closed] (FLINK-4100) RocksDBStateBackend#close() can throw NPE

2016-11-28 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-4100. - Resolution: Fixed Fix Version/s: 1.1.3 1.2.0 > RocksDBStateBackend#close

[jira] [Commented] (FLINK-4100) RocksDBStateBackend#close() can throw NPE

2016-11-28 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15701566#comment-15701566 ] Stefan Richter commented on FLINK-4100: --- Yes, this looks very outdated. > RocksDBSt

[jira] [Commented] (FLINK-4492) Cleanup files from canceled snapshots

2016-12-02 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15715225#comment-15715225 ] Stefan Richter commented on FLINK-4492: --- Should be ok to close this. > Cleanup file

[jira] [Created] (FLINK-5265) Introduce state handle replication mode for CheckpointCoordinator

2016-12-05 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5265: - Summary: Introduce state handle replication mode for CheckpointCoordinator Key: FLINK-5265 URL: https://issues.apache.org/jira/browse/FLINK-5265 Project: Flink

[jira] [Assigned] (FLINK-5265) Introduce state handle replication mode for CheckpointCoordinator

2016-12-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5265: - Assignee: Stefan Richter > Introduce state handle replication mode for CheckpointCoordina

[jira] [Assigned] (FLINK-5052) Changing the maximum parallelism (number of key groups) of a job

2016-12-06 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5052: - Assignee: Stefan Richter > Changing the maximum parallelism (number of key groups) of a j

[jira] [Updated] (FLINK-5052) Changing the maximum parallelism (number of key groups) of a job

2016-12-06 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-5052: -- Assignee: (was: Stefan Richter) > Changing the maximum parallelism (number of key groups) of

[jira] [Assigned] (FLINK-5051) Backwards compatibility for serializers in backend state

2016-12-06 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5051: - Assignee: Stefan Richter > Backwards compatibility for serializers in backend state > ---

[jira] [Commented] (FLINK-5035) Don't Write TypeSerializer to Heap State Snapshot

2016-12-07 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15728267#comment-15728267 ] Stefan Richter commented on FLINK-5035: --- That is correct. I think we actually need t

[jira] [Assigned] (FLINK-5283) InputStream should be closed in RocksDBKeyedStateBackend#restoreOldSavepointKeyedState

2016-12-07 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5283: - Assignee: Stefan Richter > InputStream should be closed in > RocksDBKeyedStateBackend#re

[jira] [Commented] (FLINK-5286) Build instability: WordCountSubclassPOJOITCase fails with IOException: Stream Closed

2016-12-08 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731933#comment-15731933 ] Stefan Richter commented on FLINK-5286: --- I think that FLINK-4910 uncovers subtle pro

[jira] [Updated] (FLINK-5041) Implement savepoint backwards compatibility 1.1 -> 1.2

2016-12-08 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-5041: -- Description: This issue tracks the implementation of backwards compatibility between Flink 1.1

[jira] [Created] (FLINK-5290) Ensure backwards compatibility of the hashes used to generate JobVertexIds

2016-12-08 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5290: - Summary: Ensure backwards compatibility of the hashes used to generate JobVertexIds Key: FLINK-5290 URL: https://issues.apache.org/jira/browse/FLINK-5290 Project: F

[jira] [Created] (FLINK-5291) Ensure backwards compatibility of the hashes used to generate JobVertexIds

2016-12-08 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5291: - Summary: Ensure backwards compatibility of the hashes used to generate JobVertexIds Key: FLINK-5291 URL: https://issues.apache.org/jira/browse/FLINK-5291 Project: F

[jira] [Closed] (FLINK-5291) Ensure backwards compatibility of the hashes used to generate JobVertexIds

2016-12-08 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5291. - Resolution: Duplicate > Ensure backwards compatibility of the hashes used to generate JobVertexIds

[jira] [Assigned] (FLINK-5289) NPE when using value state on non-keyed stream

2016-12-08 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5289: - Assignee: Stefan Richter > NPE when using value state on non-keyed stream > -

[jira] [Commented] (FLINK-4858) Remove Legacy Checkpointing Interfaces

2016-12-12 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15742624#comment-15742624 ] Stefan Richter commented on FLINK-4858: --- Agreed. We can not remove it in 1.2, becaus

[jira] [Created] (FLINK-5325) Introduce interface for CloseableRegistry to separate user from system-facing functionality

2016-12-13 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5325: - Summary: Introduce interface for CloseableRegistry to separate user from system-facing functionality Key: FLINK-5325 URL: https://issues.apache.org/jira/browse/FLINK-5325

[jira] [Created] (FLINK-5327) Remove IOException from StateObject::getStateSize

2016-12-13 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5327: - Summary: Remove IOException from StateObject::getStateSize Key: FLINK-5327 URL: https://issues.apache.org/jira/browse/FLINK-5327 Project: Flink Issue Type:

[jira] [Updated] (FLINK-5327) Remove IOException from StateObject::getStateSize

2016-12-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-5327: -- Description: The signature of {{StateObject::getStateSize}} declares throwing of an {{IOExceptio

[jira] [Commented] (FLINK-5034) Don't Write StateDescriptor to RocksDB Snapshot

2016-12-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15744733#comment-15744733 ] Stefan Richter commented on FLINK-5034: --- Yes > Don't Write StateDescriptor to Rocks

[jira] [Created] (FLINK-5335) Allow ListCheckpointed user functions to return null

2016-12-14 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5335: - Summary: Allow ListCheckpointed user functions to return null Key: FLINK-5335 URL: https://issues.apache.org/jira/browse/FLINK-5335 Project: Flink Issue Ty

[jira] [Closed] (FLINK-5290) Ensure backwards compatibility of the hashes used to generate JobVertexIds

2016-12-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5290. - Resolution: Fixed Fix Version/s: 1.2.0 > Ensure backwards compatibility of the hashes used

[jira] [Created] (FLINK-5337) Introduce backwards compatible state to task assignment

2016-12-14 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5337: - Summary: Introduce backwards compatible state to task assignment Key: FLINK-5337 URL: https://issues.apache.org/jira/browse/FLINK-5337 Project: Flink Issue

[jira] [Closed] (FLINK-5335) Allow ListCheckpointed user functions to return null

2016-12-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5335. - Resolution: Implemented Fix Version/s: 1.2.0 > Allow ListCheckpointed user functions to ret

[jira] [Issue Comment Deleted] (FLINK-5347) Unclosed stream in OperatorBackendSerializationProxy#write()

2016-12-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-5347: -- Comment: was deleted (was: The stream is not opened in the method and therefore should also not

[jira] [Commented] (FLINK-5347) Unclosed stream in OperatorBackendSerializationProxy#write()

2016-12-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15752754#comment-15752754 ] Stefan Richter commented on FLINK-5347: --- The stream is not opened in the method and

[jira] [Commented] (FLINK-5347) Unclosed stream in OperatorBackendSerializationProxy#write()

2016-12-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15752765#comment-15752765 ] Stefan Richter commented on FLINK-5347: --- {{dos}} is just a wrapper around {{out}}. {

[jira] [Created] (FLINK-4134) EventTimeSessionWindows trigger for empty windows when dropping late events

2016-06-30 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4134: - Summary: EventTimeSessionWindows trigger for empty windows when dropping late events Key: FLINK-4134 URL: https://issues.apache.org/jira/browse/FLINK-4134 Project:

[jira] [Assigned] (FLINK-4134) EventTimeSessionWindows trigger for empty windows when dropping late events

2016-06-30 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-4134: - Assignee: Stefan Richter > EventTimeSessionWindows trigger for empty windows when droppin

[jira] [Created] (FLINK-4140) CheckpointCoordinator fails to discard completed checkpoint

2016-07-01 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4140: - Summary: CheckpointCoordinator fails to discard completed checkpoint Key: FLINK-4140 URL: https://issues.apache.org/jira/browse/FLINK-4140 Project: Flink

[jira] [Assigned] (FLINK-4140) CheckpointCoordinator fails to discard completed checkpoint

2016-07-01 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-4140: - Assignee: Stefan Richter > CheckpointCoordinator fails to discard completed checkpoint >

[jira] [Updated] (FLINK-4140) CheckpointCoordinator fails to discard completed checkpoint

2016-07-01 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-4140: -- Assignee: Ufuk Celebi (was: Stefan Richter) > CheckpointCoordinator fails to discard completed

[jira] [Created] (FLINK-4141) TaskManager failures not always recover when killed during an ApplicationMaster failure in HA mode on Yarn

2016-07-01 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4141: - Summary: TaskManager failures not always recover when killed during an ApplicationMaster failure in HA mode on Yarn Key: FLINK-4141 URL: https://issues.apache.org/jira/browse/FL

[jira] [Created] (FLINK-4142) Recovery problem in HA on Hadoop Yarn 2.5.0

2016-07-01 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4142: - Summary: Recovery problem in HA on Hadoop Yarn 2.5.0 Key: FLINK-4142 URL: https://issues.apache.org/jira/browse/FLINK-4142 Project: Flink Issue Type: Bug

[jira] [Updated] (FLINK-4142) Recovery problem in HA on Hadoop Yarn 2.4.1

2016-07-01 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-4142: -- Summary: Recovery problem in HA on Hadoop Yarn 2.4.1 (was: Recovery problem in HA on Hadoop Yar

[jira] [Updated] (FLINK-4142) Recovery problem in HA on Hadoop Yarn 2.5.0

2016-07-01 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-4142: -- Description: On Hadoop Yarn 2.4.1, recovery in HA fails in the following scenario: 1) Kill appl

[jira] [Commented] (FLINK-4142) Recovery problem in HA on Hadoop Yarn 2.4.1

2016-07-01 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15359073#comment-15359073 ] Stefan Richter commented on FLINK-4142: --- I have a log for the problem here: https:/

[jira] [Created] (FLINK-4150) Problem with Blobstore in Yarn HA setting on recovery after cluster shutdown

2016-07-04 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4150: - Summary: Problem with Blobstore in Yarn HA setting on recovery after cluster shutdown Key: FLINK-4150 URL: https://issues.apache.org/jira/browse/FLINK-4150 Project:

[jira] [Created] (FLINK-4156) Job with -m yarn-cluster registers TaskManagers to another running Yarn session

2016-07-06 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4156: - Summary: Job with -m yarn-cluster registers TaskManagers to another running Yarn session Key: FLINK-4156 URL: https://issues.apache.org/jira/browse/FLINK-4156 Proje

[jira] [Created] (FLINK-4166) Generate automatic different namespaces in Zookeeper for Flink applications

2016-07-07 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4166: - Summary: Generate automatic different namespaces in Zookeeper for Flink applications Key: FLINK-4166 URL: https://issues.apache.org/jira/browse/FLINK-4166 Project:

[jira] [Created] (FLINK-4182) HA recovery not working properly under ApplicationMaster failures.

2016-07-08 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4182: - Summary: HA recovery not working properly under ApplicationMaster failures. Key: FLINK-4182 URL: https://issues.apache.org/jira/browse/FLINK-4182 Project: Flink

[jira] [Updated] (FLINK-4182) HA recovery not working properly under ApplicationMaster failures.

2016-07-08 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-4182: -- Description: When randomly killing TaskManager and ApplicationMaster, a job sometimes does not

[jira] [Created] (FLINK-4200) Kafka consumers should log the offset from which they restore

2016-07-12 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4200: - Summary: Kafka consumers should log the offset from which they restore Key: FLINK-4200 URL: https://issues.apache.org/jira/browse/FLINK-4200 Project: Flink

[jira] [Updated] (FLINK-4150) Problem with Blobstore in Yarn HA setting on recovery after cluster shutdown

2016-07-12 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-4150: -- Description: Submitting a job in Yarn with HA can lead to the following exception: {code} org.a

[jira] [Created] (FLINK-4201) Checkpoints for jobs in non-terminal state (e.g. suspended) get deleted

2016-07-12 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4201: - Summary: Checkpoints for jobs in non-terminal state (e.g. suspended) get deleted Key: FLINK-4201 URL: https://issues.apache.org/jira/browse/FLINK-4201 Project: Flin

[jira] [Created] (FLINK-4211) Dynamic Properties not working for jobs submitted to Yarn session

2016-07-13 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4211: - Summary: Dynamic Properties not working for jobs submitted to Yarn session Key: FLINK-4211 URL: https://issues.apache.org/jira/browse/FLINK-4211 Project: Flink

[jira] [Commented] (FLINK-4211) Dynamic Properties not working for jobs submitted to Yarn session

2016-07-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15378999#comment-15378999 ] Stefan Richter commented on FLINK-4211: --- I see. I think unfortunately this is not re

[jira] [Created] (FLINK-4230) Session Windowing IT Case

2016-07-18 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4230: - Summary: Session Windowing IT Case Key: FLINK-4230 URL: https://issues.apache.org/jira/browse/FLINK-4230 Project: Flink Issue Type: Test Componen

[jira] [Commented] (FLINK-3623) Adjust MurmurHash algorithm

2016-08-09 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15414110#comment-15414110 ] Stefan Richter commented on FLINK-3623: --- In my opinion, our implementation of Murmur

[jira] [Created] (FLINK-4374) GroupReduce Broken for null Date

2016-08-11 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4374: - Summary: GroupReduce Broken for null Date Key: FLINK-4374 URL: https://issues.apache.org/jira/browse/FLINK-4374 Project: Flink Issue Type: Bug Co

[jira] [Assigned] (FLINK-4374) GroupReduce Broken for null Date

2016-08-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-4374: - Assignee: Timo Walther > GroupReduce Broken for null Date > -

[jira] [Updated] (FLINK-4374) GroupReduce Broken for null Date

2016-08-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-4374: -- Description: The GroupReduceITCase has an error that allows a problem with {{null}} Dates to go

  1   2   3   4   5   6   7   8   9   10   >