[jira] [Closed] (FLINK-10095) Change the serialisation order in TTL value wrapper

2018-08-07 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10095. -- Resolution: Implemented Fix Version/s: 1.6.0 Merged in: master: b535fab release-1.6: f4

[jira] [Created] (FLINK-10121) Introduce methods to remove registered operator states

2018-08-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10121: -- Summary: Introduce methods to remove registered operator states Key: FLINK-10121 URL: https://issues.apache.org/jira/browse/FLINK-10121 Project: Flink Is

[jira] [Created] (FLINK-10122) KafkaConsumer should use partitionable state over union state if partition discovery is not active

2018-08-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10122: -- Summary: KafkaConsumer should use partitionable state over union state if partition discovery is not active Key: FLINK-10122 URL: https://issues.apache.org/jira/browse/FLINK-1

[jira] [Created] (FLINK-10124) Use ByteArrayDataInput/OutputView instead of stream + wrapper

2018-08-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10124: -- Summary: Use ByteArrayDataInput/OutputView instead of stream + wrapper Key: FLINK-10124 URL: https://issues.apache.org/jira/browse/FLINK-10124 Project: Flink

[jira] [Closed] (FLINK-10124) Use ByteArrayDataInput/OutputView instead of stream + wrapper

2018-08-10 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10124. -- Resolution: Implemented Fix Version/s: 1.7.0 Merged in: master: 18ff4ab > Use ByteArra

[jira] [Closed] (FLINK-10041) Extract all different iterators (inner or static inner classes) into full classes

2018-08-10 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10041. -- Resolution: Implemented Fix Version/s: 1.7.0 Merged in: master: 9d67afbb84 > Extract a

[jira] [Commented] (FLINK-10129) Flink job IDs are not getting deleted automatically from zookeeper metadata after canceling flink job in flink HA cluster

2018-08-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577929#comment-16577929 ] Stefan Richter commented on FLINK-10129: Could you please specify for which Flin

[jira] [Closed] (FLINK-10066) Keep only archived version of previous executions

2018-08-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10066. -- Resolution: Fixed Merged in: master: 160dc56fdf release-1.6: 74323d50b0 release-1.5: 2217c09c8

[jira] [Closed] (FLINK-10160) Index out of bound when serializing operator state

2018-08-16 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10160. -- Resolution: Duplicate > Index out of bound when serializing operator state > -

[jira] [Commented] (FLINK-10160) Index out of bound when serializing operator state

2018-08-16 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16582693#comment-16582693 ] Stefan Richter commented on FLINK-10160: This problem was fixed in 1.4.3. > Ind

[jira] [Closed] (FLINK-10154) Make sure we always read at least one record in KinesisConnector

2018-08-16 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10154. -- Resolution: Fixed Fix Version/s: 1.7.0 1.6.1 Merged in: master: b34e

[jira] [Created] (FLINK-10175) Fix concurrent access to shared buffer in map state / querable state

2018-08-20 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10175: -- Summary: Fix concurrent access to shared buffer in map state / querable state Key: FLINK-10175 URL: https://issues.apache.org/jira/browse/FLINK-10175 Project: Fli

[jira] [Created] (FLINK-10176) Replace ByteArrayData[Input|Output]View with Data[Output|InputDe]Serializer

2018-08-20 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10176: -- Summary: Replace ByteArrayData[Input|Output]View with Data[Output|InputDe]Serializer Key: FLINK-10176 URL: https://issues.apache.org/jira/browse/FLINK-10176 Proje

[jira] [Commented] (FLINK-10176) Replace ByteArrayData[Input|Output]View with Data[Output|InputDe]Serializer

2018-08-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585700#comment-16585700 ] Stefan Richter commented on FLINK-10176: Yes, they almost did what I was looking

[jira] [Closed] (FLINK-10068) Add documentation for async/RocksDB-based timers

2018-08-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10068. -- Resolution: Implemented Fix Version/s: 1.7.0 1.6.1 Merged in: master

[jira] [Closed] (FLINK-10042) Extract snapshot algorithms from inner classes into full classes

2018-08-21 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10042. -- Resolution: Implemented Fix Version/s: 1.7.0 Merged in: master: f803280bb9 > Extract s

[jira] [Closed] (FLINK-10151) [State TTL] Fix false recursion call in TransformingStateTableKeyGroupPartitioner.tryAddToSource

2018-08-21 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10151. -- Resolution: Fixed Merged in: master: c73747b release-1.6: 00a2e81 > [State TTL] Fix false rec

[jira] [Closed] (FLINK-10175) Fix concurrent access to shared buffer in map state / querable state

2018-08-22 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10175. -- Resolution: Fixed Merged in: master: 2b6beed > Fix concurrent access to shared buffer in map

[jira] [Closed] (FLINK-10176) Replace ByteArrayData[Input|Output]View with Data[Output|InputDe]Serializer

2018-08-22 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10176. -- Resolution: Implemented Merged in: master: 3fd6587 > Replace ByteArrayData[Input|Output]View

[jira] [Created] (FLINK-10198) Set Env object in DBOptions for RocksDB

2018-08-22 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10198: -- Summary: Set Env object in DBOptions for RocksDB Key: FLINK-10198 URL: https://issues.apache.org/jira/browse/FLINK-10198 Project: Flink Issue Type: Impro

[jira] [Created] (FLINK-10200) Consolidate FileBasedStateOutputStream and FsCheckpointStateOutputStream

2018-08-22 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10200: -- Summary: Consolidate FileBasedStateOutputStream and FsCheckpointStateOutputStream Key: FLINK-10200 URL: https://issues.apache.org/jira/browse/FLINK-10200 Project:

[jira] [Commented] (FLINK-8098) LeaseExpiredException when using FsStateBackend for checkpointing due to multiple mappers tries to access the same file.

2018-09-06 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16605446#comment-16605446 ] Stefan Richter commented on FLINK-8098: --- Maybe you could first give us some more de

[jira] [Created] (FLINK-10297) PostVersionedIOReadableWritable ignores result of InputStream.read(...)

2018-09-07 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10297: -- Summary: PostVersionedIOReadableWritable ignores result of InputStream.read(...) Key: FLINK-10297 URL: https://issues.apache.org/jira/browse/FLINK-10297 Project:

[jira] [Commented] (FLINK-10297) PostVersionedIOReadableWritable ignores result of InputStream.read(...)

2018-09-07 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16606844#comment-16606844 ] Stefan Richter commented on FLINK-10297: Yes, that is a very common trap that ca

[jira] [Comment Edited] (FLINK-10297) PostVersionedIOReadableWritable ignores result of InputStream.read(...)

2018-09-07 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16606844#comment-16606844 ] Stefan Richter edited comment on FLINK-10297 at 9/7/18 8:35 AM: --

[jira] [Closed] (FLINK-9735) Potential resource leak in RocksDBStateBackend#getDbOptions

2018-09-10 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-9735. - Resolution: Fixed Merged in: master: 1a94c2094b > Potential resource leak in RocksDBStateBackend

[jira] [Commented] (FLINK-8281) org.apache.flink.runtime.fs.hdfs.HadoopDataOutputStream cannot be cast to org.apache.flink.core.fs.WrappingProxyCloseable

2017-12-18 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295806#comment-16295806 ] Stefan Richter commented on FLINK-8281: --- Hi, I had a look at your stacktraces and s

[jira] [Comment Edited] (FLINK-8281) org.apache.flink.runtime.fs.hdfs.HadoopDataOutputStream cannot be cast to org.apache.flink.core.fs.WrappingProxyCloseable

2017-12-18 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295806#comment-16295806 ] Stefan Richter edited comment on FLINK-8281 at 12/18/17 10:58 PM: --

[jira] [Commented] (FLINK-8309) JVM sigsegv crash when enabling async checkpoints

2017-12-22 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16301756#comment-16301756 ] Stefan Richter commented on FLINK-8309: --- Looks like this is very likely related to t

[jira] [Created] (FLINK-8360) Implement task-local state recovery

2018-01-04 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-8360: - Summary: Implement task-local state recovery Key: FLINK-8360 URL: https://issues.apache.org/jira/browse/FLINK-8360 Project: Flink Issue Type: New Feature

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-01-04 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16311322#comment-16311322 ] Stefan Richter commented on FLINK-8360: --- More general implementation that also works

[jira] [Issue Comment Deleted] (FLINK-8360) Implement task-local state recovery

2018-01-04 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-8360: -- Comment: was deleted (was: More general implementation that also works for non-filebased state.)

[jira] [Created] (FLINK-8385) Fix exceptions in AbstractEventTimeWindowCheckpointingITCase

2018-01-08 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-8385: - Summary: Fix exceptions in AbstractEventTimeWindowCheckpointingITCase Key: FLINK-8385 URL: https://issues.apache.org/jira/browse/FLINK-8385 Project: Flink

[jira] [Closed] (FLINK-7475) support update() in ListState

2018-01-10 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-7475. - Resolution: Fixed Merged in 438e4e3742. > support update() in ListState > ---

[jira] [Commented] (FLINK-8411) inconsistent behavior between HeapListState#add() and RocksDBListState#add()

2018-01-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16321968#comment-16321968 ] Stefan Richter commented on FLINK-8411: --- Yes, I agree. Would you like to make a PR o

[jira] [Comment Edited] (FLINK-8411) inconsistent behavior between HeapListState#add() and RocksDBListState#add()

2018-01-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16321968#comment-16321968 ] Stefan Richter edited comment on FLINK-8411 at 1/11/18 9:46 AM:

[jira] [Commented] (FLINK-8413) Snapshot state of aggregated data is not maintained in flink's checkpointing

2018-01-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16322191#comment-16322191 ] Stefan Richter commented on FLINK-8413: --- Can you share a (minimal) code example that

[jira] [Comment Edited] (FLINK-8413) Snapshot state of aggregated data is not maintained in flink's checkpointing

2018-01-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16322191#comment-16322191 ] Stefan Richter edited comment on FLINK-8413 at 1/11/18 1:25 PM:

[jira] [Closed] (FLINK-7938) support addAll() in ListState

2018-01-19 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-7938. - Resolution: Implemented Merged in 14840809b1. > support addAll() in ListState > -

[jira] [Commented] (FLINK-8487) State loss after multiple restart attempts

2018-01-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16335551#comment-16335551 ] Stefan Richter commented on FLINK-8487: --- Afaik [~aljoscha] already fixed this in FLI

[jira] [Closed] (FLINK-8469) relocate and unify RocksDB option params in RocksDBPerformanceTest

2018-01-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-8469. - Resolution: Fixed Merged in 1c9c1e36c1dd7b3f2a160216e405302d7854c148 . > relocate and unify Rocks

[jira] [Closed] (FLINK-8411) HeapListState#add(null) will wipe out entire list state

2018-01-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-8411. - Resolution: Fixed Merged in e157cfa77f83608a0cd6d7d41a96edb0ca1f97f6 . > HeapListState#add(null)

[jira] [Closed] (FLINK-8365) Relax List type in HeapListState and HeapKeyedStateBackend

2018-01-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-8365. - Resolution: Fixed Merged in e075da5d5eb0f5ae8c394ea0c549f9dbce28fcf3 . > Relax List type in HeapL

[jira] [Closed] (FLINK-8441) serialize values and value separator directly to stream in RocksDBListState

2018-01-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-8441. - Resolution: Fixed Merged in ce25688bac1c1ecfa53a03ab1857bb82963b0696 . > serialize values and val

[jira] [Closed] (FLINK-7720) Centralize creation of backends and state related resources

2018-01-25 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-7720. - Resolution: Fixed Fix Version/s: 1.5.0 Merged in 517b3f87214168a445b5751cda210ecf3a292fd6.

[jira] [Closed] (FLINK-7719) Send checkpoint id to task as part of deployment descriptor when resuming

2018-01-25 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-7719. - Resolution: Fixed Fix Version/s: 1.5.0 Merged in 402a2e30c750e1bcb753643ed66c6df0dd861112.

[jira] [Commented] (FLINK-11955) Modify build to move filesystems from lib to plugins folder

2019-04-16 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16818833#comment-16818833 ] Stefan Richter commented on FLINK-11955: Great, thanks! I would suggest to use o

[jira] [Closed] (FLINK-10712) RestartPipelinedRegionStrategy does not restore state

2019-04-17 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10712. -- Resolution: Fixed Fix Version/s: 1.9.0 Merged in: master: c3a9293 > RestartPipelinedRe

[jira] [Closed] (FLINK-12212) Clarify documentation about async checkpointing

2019-04-17 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-12212. -- Resolution: Fixed Fix Version/s: 1.9.0 Merged in: master: 046d752c6e > Clarify documen

[jira] [Commented] (FLINK-12296) Data loss silently in RocksDBStateBackend when more than one operator(has states) chained in a single task

2019-04-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16824945#comment-16824945 ] Stefan Richter commented on FLINK-12296: I guess this is one remaining relic fro

[jira] [Commented] (FLINK-12296) Data loss silently in RocksDBStateBackend when more than one operator(has states) chained in a single task

2019-04-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16825138#comment-16825138 ] Stefan Richter commented on FLINK-12296: [~klion26] In general I think it is a g

[jira] [Commented] (FLINK-12296) Data loss silently in RocksDBStateBackend when more than one operator(has states) chained in a single task

2019-04-26 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16826787#comment-16826787 ] Stefan Richter commented on FLINK-12296: [~klion26] I was just taking a look int

[jira] [Comment Edited] (FLINK-12296) Data loss silently in RocksDBStateBackend when more than one operator(has states) chained in a single task

2019-04-26 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16826787#comment-16826787 ] Stefan Richter edited comment on FLINK-12296 at 4/26/19 9:00 AM: -

[jira] [Closed] (FLINK-10724) Refactor failure handling in check point coordinator

2019-04-29 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10724. -- Resolution: Done Fix Version/s: 1.9.0 Merged in: master: c4b0e8f > Refactor failure ha

[jira] [Closed] (FLINK-11167) Optimize RocksDBList#put for no empty input

2019-04-29 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-11167. -- Resolution: Implemented Fix Version/s: 1.9.0 Merged in: master: 03faeb9 > Optimize Roc

[jira] [Reopened] (FLINK-12350) RocksDBStateBackendTest doesn't cover the incremental checkpoint code path

2019-04-29 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reopened FLINK-12350: > RocksDBStateBackendTest doesn't cover the incremental checkpoint code path > ---

[jira] [Closed] (FLINK-12350) RocksDBStateBackendTest doesn't cover the incremental checkpoint code path

2019-04-29 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-12350. -- Resolution: Fixed Fix Version/s: 1.9.0 Merged in: master: 9aeb4e5 > RocksDBStateBacken

[jira] [Closed] (FLINK-12350) RocksDBStateBackendTest doesn't cover the incremental checkpoint code path

2019-04-29 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-12350. -- Resolution: Fixed Fix Version/s: 1.8.1 Merged in: master: 9aeb4e5 release-1.8: 80207878

[jira] [Created] (FLINK-12477) Change threading-model in StreamTask to a mailbox-based approach

2019-05-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-12477: -- Summary: Change threading-model in StreamTask to a mailbox-based approach Key: FLINK-12477 URL: https://issues.apache.org/jira/browse/FLINK-12477 Project: Flink

[jira] [Created] (FLINK-12479) Make InputProcessors and StreamIterationHead non-blocking

2019-05-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-12479: -- Summary: Make InputProcessors and StreamIterationHead non-blocking Key: FLINK-12479 URL: https://issues.apache.org/jira/browse/FLINK-12479 Project: Flink

[jira] [Created] (FLINK-12478) Decompose monolithic run-loops in StreamTask implementations into step-wise calls

2019-05-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-12478: -- Summary: Decompose monolithic run-loops in StreamTask implementations into step-wise calls Key: FLINK-12478 URL: https://issues.apache.org/jira/browse/FLINK-12478

[jira] [Created] (FLINK-12480) Introduce mailbox to StreamTask main-loop

2019-05-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-12480: -- Summary: Introduce mailbox to StreamTask main-loop Key: FLINK-12480 URL: https://issues.apache.org/jira/browse/FLINK-12480 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-12481) Make processing time timer trigger run via the mailbox

2019-05-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-12481: -- Summary: Make processing time timer trigger run via the mailbox Key: FLINK-12481 URL: https://issues.apache.org/jira/browse/FLINK-12481 Project: Flink Is

[jira] [Created] (FLINK-12482) Make checkpoint trigger/notifyComplete run via the mailbox queue

2019-05-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-12482: -- Summary: Make checkpoint trigger/notifyComplete run via the mailbox queue Key: FLINK-12482 URL: https://issues.apache.org/jira/browse/FLINK-12482 Project: Flink

[jira] [Updated] (FLINK-12477) Change threading-model in StreamTask to a mailbox-based approach

2019-05-10 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-12477: --- Description: This is the umbrella issue to change the threading-model in StreamTask to a ma

[jira] [Created] (FLINK-12483) Support (legacy) SourceFunctions with mailbox

2019-05-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-12483: -- Summary: Support (legacy) SourceFunctions with mailbox Key: FLINK-12483 URL: https://issues.apache.org/jira/browse/FLINK-12483 Project: Flink Issue Type:

[jira] [Created] (FLINK-12484) Drop unnecessary locking for code-paths that now use the mailbox

2019-05-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-12484: -- Summary: Drop unnecessary locking for code-paths that now use the mailbox Key: FLINK-12484 URL: https://issues.apache.org/jira/browse/FLINK-12484 Project: Flink

[jira] [Assigned] (FLINK-12480) Introduce mailbox to StreamTask main-loop

2019-05-10 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-12480: -- Assignee: Stefan Richter > Introduce mailbox to StreamTask main-loop > --

[jira] [Commented] (FLINK-12481) Make processing time timer trigger run via the mailbox

2019-05-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16838391#comment-16838391 ] Stefan Richter commented on FLINK-12481: Hi [~aitozi] and thanks for offering so

[jira] [Resolved] (FLINK-11731) Make DefaultOperatorStateBackend follow the builder pattern

2019-03-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-11731. Resolution: Implemented Fix Version/s: 1.8.0 Merged in: master: 94f84a5c release-1.

[jira] [Resolved] (FLINK-11729) Make all state backends follow builder pattern

2019-03-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-11729. Resolution: Implemented Fix Version/s: 1.8.0 Merged in: master: 94f84a5c release-1.

[jira] [Issue Comment Deleted] (FLINK-11729) Make all state backends follow builder pattern

2019-03-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-11729: --- Comment: was deleted (was: Merged in: master: 94f84a5c release-1.8: 2f62b890) > Make all st

[jira] [Resolved] (FLINK-11796) Remove Snapshotable interface

2019-03-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-11796. Resolution: Implemented Fix Version/s: 1.8.0 Merged in: master: e8daa49a release-1.

[jira] [Resolved] (FLINK-11833) Cleanup unnecessary createKeyedStateBackend methods in StateBackend

2019-03-06 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-11833. Resolution: Implemented Fix Version/s: 1.8.0 Merged in: master: f10a7d8b release-1.

[jira] [Updated] (FLINK-11829) [checkpoint] FsCheckpointStateOutputStream might store state in files even state size below fileStateThreshold

2019-03-06 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-11829: --- Fix Version/s: 1.9.0 > [checkpoint] FsCheckpointStateOutputStream might store state in files

[jira] [Resolved] (FLINK-11829) [checkpoint] FsCheckpointStateOutputStream might store state in files even state size below fileStateThreshold

2019-03-06 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-11829. Resolution: Fixed Merged in: master: 753bc10 > [checkpoint] FsCheckpointStateOutputStream

[jira] [Resolved] (FLINK-11874) Split CheckpointStorage interface to distinguish JM and TM side

2019-03-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-11874. Resolution: Implemented Merged in: master: b6b4baf > Split CheckpointStorage interface to

[jira] [Resolved] (FLINK-11904) Improve MemoryStateBackendTest by using JUnit's Parameterized

2019-03-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-11904. Resolution: Implemented Merged in: master: 6c7ddf3 > Improve MemoryStateBackendTest by us

[jira] [Resolved] (FLINK-11903) Improve FileStateBackendTest by using JUnit's Parameterized

2019-03-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-11903. Resolution: Implemented Merged in: master: 76b9f8b > Improve FileStateBackendTest by usin

[jira] [Created] (FLINK-11952) Introduce Plugin Architecture for loading FileSystems

2019-03-18 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-11952: -- Summary: Introduce Plugin Architecture for loading FileSystems Key: FLINK-11952 URL: https://issues.apache.org/jira/browse/FLINK-11952 Project: Flink Iss

[jira] [Created] (FLINK-11953) Introduce Plugin/Loading system and integrate it with FileSystem

2019-03-18 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-11953: -- Summary: Introduce Plugin/Loading system and integrate it with FileSystem Key: FLINK-11953 URL: https://issues.apache.org/jira/browse/FLINK-11953 Project: Flink

[jira] [Created] (FLINK-11954) Provide unit test(s) for new plugin infrastructure

2019-03-18 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-11954: -- Summary: Provide unit test(s) for new plugin infrastructure Key: FLINK-11954 URL: https://issues.apache.org/jira/browse/FLINK-11954 Project: Flink Issue

[jira] [Created] (FLINK-11955) Modify build to move filesystems from lib to plugins folder

2019-03-18 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-11955: -- Summary: Modify build to move filesystems from lib to plugins folder Key: FLINK-11955 URL: https://issues.apache.org/jira/browse/FLINK-11955 Project: Flink

[jira] [Created] (FLINK-11956) Remove shading from filesystems build

2019-03-18 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-11956: -- Summary: Remove shading from filesystems build Key: FLINK-11956 URL: https://issues.apache.org/jira/browse/FLINK-11956 Project: Flink Issue Type: Sub-tas

[jira] [Assigned] (FLINK-11953) Introduce Plugin/Loading system and integrate it with FileSystem

2019-03-18 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-11953: -- Assignee: Stefan Richter > Introduce Plugin/Loading system and integrate it with File

[jira] [Assigned] (FLINK-11954) Provide unit test(s) for new plugin infrastructure

2019-03-18 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-11954: -- Assignee: Stefan Richter > Provide unit test(s) for new plugin infrastructure > -

[jira] [Created] (FLINK-11980) Improve efficiency of iterating KeySelectionListener on notification

2019-03-20 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-11980: -- Summary: Improve efficiency of iterating KeySelectionListener on notification Key: FLINK-11980 URL: https://issues.apache.org/jira/browse/FLINK-11980 Project: Fli

[jira] [Resolved] (FLINK-11980) Improve efficiency of iterating KeySelectionListener on notification

2019-03-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-11980. Resolution: Fixed Fix Version/s: 1.9.0 1.8.0 Merged in: master:

[jira] [Created] (FLINK-12143) Mechanism to ship plugin jars in the cluster

2019-04-09 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-12143: -- Summary: Mechanism to ship plugin jars in the cluster Key: FLINK-12143 URL: https://issues.apache.org/jira/browse/FLINK-12143 Project: Flink Issue Type:

[jira] [Commented] (FLINK-11775) Introduce MemorySegmentWritable to let DataOutputView direct copy to internal bytes

2019-04-09 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16813295#comment-16813295 ] Stefan Richter commented on FLINK-11775: [~lzljs3620320] I think in general the

[jira] [Closed] (FLINK-10205) Batch Job: InputSplit Fault tolerant for DataSourceTask

2019-04-10 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10205. -- Resolution: Implemented Fix Version/s: 1.9.0 Merged in: master: 4f689b1 > Batch Job: I

[jira] [Commented] (FLINK-11775) Introduce MemorySegmentWritable to let DataOutputView direct copy to internal bytes

2019-04-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16815161#comment-16815161 ] Stefan Richter commented on FLINK-11775: [~StephanEwen] I found that the impleme

[jira] [Comment Edited] (FLINK-11775) Introduce MemorySegmentWritable to let DataOutputView direct copy to internal bytes

2019-04-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16815161#comment-16815161 ] Stefan Richter edited comment on FLINK-11775 at 4/11/19 7:58 AM: -

[jira] [Comment Edited] (FLINK-11775) Introduce MemorySegmentWritable to let DataOutputView direct copy to internal bytes

2019-04-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16815161#comment-16815161 ] Stefan Richter edited comment on FLINK-11775 at 4/11/19 7:59 AM: -

[jira] [Commented] (FLINK-11955) Modify build to move filesystems from lib to plugins folder

2019-04-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16817887#comment-16817887 ] Stefan Richter commented on FLINK-11955: [~yanghua] are you commited to working

[jira] [Comment Edited] (FLINK-11955) Modify build to move filesystems from lib to plugins folder

2019-04-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16817887#comment-16817887 ] Stefan Richter edited comment on FLINK-11955 at 4/15/19 11:43 AM:

[jira] [Closed] (FLINK-11953) Introduce Plugin/Loading system and integrate it with FileSystem

2019-04-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-11953. -- Resolution: Implemented Fix Version/s: 1.9.0 Merged in: master: c6307b5990 > Introduce

[jira] [Resolved] (FLINK-11954) Provide unit test(s) for new plugin infrastructure

2019-04-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-11954. Resolution: Done Work is already done as part of FLINK-11953 > Provide unit test(s) for n

[jira] [Closed] (FLINK-13256) Periodical checkpointing is stopped after failovers

2019-07-18 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-13256. -- Resolution: Fixed Merged in: master: 1ec34249a0 release-1.9: b7bfafca14 > Periodical checkpoi

[jira] [Closed] (FLINK-13249) Distributed Jepsen test fails with blocked TaskExecutor

2019-07-18 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-13249. -- Resolution: Fixed Merged in: master: 23bd23b325 release-1.9: 3eff6387b5 > Distributed Jepsen

<    3   4   5   6   7   8   9   10   >