Kostas created FLINK-2319:
-----------------------------

             Summary: Collect size limitation due to akka.
                 Key: FLINK-2319
                 URL: https://issues.apache.org/jira/browse/FLINK-2319
             Project: Flink
          Issue Type: New Feature
          Components: JobManager, TaskManager
    Affects Versions: 0.10
            Reporter: Kostas


Each TaksManager keeps the results of a local task in a set of Accumulators. 
Upon termination of the task, the Accumulators are sent back to the JobManager, 
who merges them, before sending them back to the Client. 

To exchange the Accumulators and their content, akka is used. This limits the 
size of the output of a task to no more than akka.framesize bytes. In other 
case, akka would drop the message.

This ticket is to propose the removal of this limitation so that results can be 
of arbitrary size.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to