Sebastian Kruse created FLINK-1754:
--------------------------------------

             Summary: Deadlock in job execution
                 Key: FLINK-1754
                 URL: https://issues.apache.org/jira/browse/FLINK-1754
             Project: Flink
          Issue Type: Bug
            Reporter: Sebastian Kruse


I have encountered a reproducible deadlock in the execution of one of my jobs. 
The part of the plan, where this happens, is the following:
{code:java}
    /** Performs the reduction via creating transitive INDs and removing them 
from the original IND set. */
    private DataSet<Tuple2<Integer, int[]>> 
calculateTransitiveReduction1(DataSet<Tuple2<Integer, int[]>> 
inclusionDependencies) {
        // Concatenate INDs (only one hop).
        DataSet<Tuple2<Integer, int[]>> transitiveInds = inclusionDependencies
                .flatMap(new SplitInds())
                .joinWithTiny(inclusionDependencies)
                .where(1).equalTo(0)
                .with(new ConcatenateInds());

        // Remove the concatenated INDs to come up with a transitive reduction 
of the INDs.
        return inclusionDependencies
                .coGroup(transitiveInds)
                .where(0).equalTo(0)
                .with(new RemoveTransitiveInds());
    }
{code}
Seemingly, the flatmap operator waits infinitely for a free buffer to write on.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to