Ufuk Celebi created FLINK-2089:
----------------------------------

             Summary: "Buffer recycled" IllegalStateException during cancelling
                 Key: FLINK-2089
                 URL: https://issues.apache.org/jira/browse/FLINK-2089
             Project: Flink
          Issue Type: Bug
          Components: Distributed Runtime
    Affects Versions: master
            Reporter: Ufuk Celebi


[~rmetzger] reported the following stack trace during cancelling of high 
parallelism jobs:

{code}
Error: java.lang.IllegalStateException: Buffer has already been recycled.
at 
org.apache.flink.shaded.com.google.common.base.Preconditions.checkState(Preconditions.java:173)
at 
org.apache.flink.runtime.io.network.buffer.Buffer.ensureNotRecycled(Buffer.java:142)
at 
org.apache.flink.runtime.io.network.buffer.Buffer.getMemorySegment(Buffer.java:78)
at 
org.apache.flink.runtime.io.network.api.serialization.SpillingAdaptiveSpanningRecordDeserializer.setNextBuffer(SpillingAdaptiveSpanningRecordDeserializer.java:72)
at 
org.apache.flink.runtime.io.network.api.reader.AbstractRecordReader.getNextRecord(AbstractRecordReader.java:80)
at 
org.apache.flink.runtime.io.network.api.reader.MutableRecordReader.next(MutableRecordReader.java:34)
at 
org.apache.flink.runtime.operators.util.ReaderIterator.next(ReaderIterator.java:73)
at org.apache.flink.runtime.operators.MapDriver.run(MapDriver.java:96)
at 
org.apache.flink.runtime.operators.RegularPactTask.run(RegularPactTask.java:496)
at 
org.apache.flink.runtime.operators.RegularPactTask.invoke(RegularPactTask.java:362)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:559)
at java.lang.Thread.run(Thread.java:745)
{code}

This looks like a concurrent buffer pool release/buffer usage error. I'm 
investing this today.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to