[
https://issues.apache.org/jira/browse/FLINK-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644176#comment-14644176
]
ASF GitHub Bot commented on FLINK-2324:
---------------------------------------
Github user StephanEwen commented on the pull request:
https://github.com/apache/flink/pull/937#issuecomment-125539636
I think it is fine to have a set of heavy tests, this is a core and crucial
feature. It may very well be that these variants are eventually implemented
differently under the hood (especially partitioned state). So far, this feature
is far from overtested.
The fact that the checks after the re-partitioning are disabled is, in
fact, a problem.
Let me re-add a pure `Checkpointed` variant of this test, with enabled
checks after the repartitioning.
> Rework partitioned state storage
> --------------------------------
>
> Key: FLINK-2324
> URL: https://issues.apache.org/jira/browse/FLINK-2324
> Project: Flink
> Issue Type: Improvement
> Reporter: Gyula Fora
> Assignee: Gyula Fora
>
> Partitioned states are currently stored per-key in statehandles. This is
> alright for in-memory storage but is very inefficient for HDFS.
> The logic behind the current mechanism is that this approach provides a way
> to repartition a state without fetching the data from the external storage
> and only manipulating handles.
> We should come up with a solution that can achieve both.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
