Hi,Felipe Quirce Could you reproduce this in stand alone mode? or could you share your code?
Best Congxian Felipe Quirce <pipe....@gmail.com> 于2018年11月30日周五 下午9:34写道: > Hi Chesnay, > > I tried with the version 1.7.0 and I had the same error. > > 2018-11-30 13:13:00,718 INFO org.apache.flink.runtime.taskmanager.Task > - keyedstats-processor-165 -> map2alert-165 -> Process -> Sink: > sink-level165 (1/4) (a972c963d4ee576a88c9116e946eec62) switched from RUNNING > to FAILED. > java.io.IOException: Exception while applying AggregateFunction in > aggregating state > at > org.apache.flink.runtime.state.heap.HeapAggregatingState.add(HeapAggregatingState.java:107) > at > org.apache.flink.streaming.runtime.operators.windowing.WindowOperator.processElement(WindowOperator.java:391) > at > org.apache.flink.streaming.runtime.io.StreamInputProcessor.processInput(StreamInputProcessor.java:202) > at > org.apache.flink.streaming.runtime.tasks.OneInputStreamTask.run(OneInputStreamTask.java:105) > at > org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:300) > at org.apache.flink.runtime.taskmanager.Task.run(Task.java:704) > at java.lang.Thread.run(Thread.java:748) > Caused by: java.lang.ArrayIndexOutOfBoundsException: -1 > at com.esotericsoftware.kryo.util.IntArray.pop(IntArray.java:157) > at com.esotericsoftware.kryo.Kryo.reference(Kryo.java:822) > at > com.esotericsoftware.kryo.serializers.CollectionSerializer.copy(CollectionSerializer.java:129) > at > com.esotericsoftware.kryo.serializers.CollectionSerializer.copy(CollectionSerializer.java:22) > at com.esotericsoftware.kryo.Kryo.copy(Kryo.java:862) > at > org.apache.flink.api.java.typeutils.runtime.kryo.KryoSerializer.copy(KryoSerializer.java:217) > at > org.apache.flink.api.java.typeutils.runtime.PojoSerializer.copy(PojoSerializer.java:243) > at > org.apache.flink.api.scala.typeutils.TraversableSerializer$$anonfun$copy$1.apply(TraversableSerializer.scala:69) > at > org.apache.flink.api.scala.typeutils.TraversableSerializer$$anonfun$copy$1.apply(TraversableSerializer.scala:69) > at scala.collection.immutable.List.foreach(List.scala:392) > at > org.apache.flink.api.scala.typeutils.TraversableSerializer.copy(TraversableSerializer.scala:69) > at > org.apache.flink.api.scala.typeutils.TraversableSerializer.copy(TraversableSerializer.scala:33) > at > org.apache.flink.api.scala.typeutils.CaseClassSerializer.copy(CaseClassSerializer.scala:101) > at > org.apache.flink.api.scala.typeutils.CaseClassSerializer.copy(CaseClassSerializer.scala:32) > at > org.apache.flink.api.scala.typeutils.TraversableSerializer$$anonfun$copy$1.apply(TraversableSerializer.scala:69) > at > org.apache.flink.api.scala.typeutils.TraversableSerializer$$anonfun$copy$1.apply(TraversableSerializer.scala:69) > at scala.collection.Iterator$class.foreach(Iterator.scala:891) > at scala.collection.AbstractIterator.foreach(Iterator.scala:1334) > at scala.collection.IterableLike$class.foreach(IterableLike.scala:72) > at scala.collection.AbstractIterable.foreach(Iterable.scala:54) > at > org.apache.flink.api.scala.typeutils.TraversableSerializer.copy(TraversableSerializer.scala:69) > at > org.apache.flink.api.scala.typeutils.TraversableSerializer.copy(TraversableSerializer.scala:33) > at > org.apache.flink.runtime.state.heap.CopyOnWriteStateTable.transform(CopyOnWriteStateTable.java:465) > at > org.apache.flink.runtime.state.heap.CopyOnWriteStateTable.transform(CopyOnWriteStateTable.java:341) > at > org.apache.flink.runtime.state.heap.HeapAggregatingState.add(HeapAggregatingState.java:105) > ... 6 more > 2018-11-30 13:13:00,719 INFO org.apache.flink.runtime.taskmanager.Task > - Freeing task resources for keyedstats-processor-165 -> > map2alert-165 -> Process -> Sink: sink-level165 (1/4) > (a972c963d4ee576a88c9116e946eec62). > 2018-11-30 13:13:00,748 INFO org.apache.flink.runtime.taskmanager.Task > > Thanks > > > On Thu, 29 Nov 2018 at 12:50, Chesnay Schepler <ches...@apache.org> wrote: > >> Would it be possible for you to try this with 1.6-SNAPSHOT? This issue >> may have been fixed with >> https://issues.apache.org/jira/browse/FLINK-10839. >> >> On 29.11.2018 12:11, Felipe Quirce wrote: >> >> Hi >> >> I'm using the flink 1.6.2, and full stack trace is >> >> java.io.IOException: Exception while applying AggregateFunction in >> aggregating state >> 4308 at >> org.apache.flink.runtime.state.heap.HeapAggregatingState.add(HeapAggregatingState.java:107) >> 4309 at >> org.apache.flink.streaming.runtime.operators.windowing.WindowOperator.processElement(WindowOperator.java:391) >> 4310 at >> org.apache.flink.streaming.runtime.io.StreamInputProcessor.processInput(StreamInputProcessor.java:202) >> 4311 at >> org.apache.flink.streaming.runtime.tasks.OneInputStreamTask.run(OneInputStreamTask.java:105) >> 4312 at >> org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:300) >> 4313 at >> org.apache.flink.runtime.taskmanager.Task.run(Task.java:711) >> 4314 at >> java.lang.Thread.run(Thread.java:748) >> 4315 Caused by: java.lang.ArrayIndexOutOfBoundsException: >> -1 >> 4316 at >> com.esotericsoftware.kryo.util.IntArray.pop(IntArray.java:157) >> 4317 at >> com.esotericsoftware.kryo.Kryo.reference(Kryo.java:822) >> 4318 at >> com.esotericsoftware.kryo.serializers.CollectionSerializer.copy(CollectionSerializer.java:129) >> 4319 at >> com.esotericsoftware.kryo.serializers.CollectionSerializer.copy(CollectionSerializer.java:22) >> 4320 at >> com.esotericsoftware.kryo.Kryo.copy(Kryo.java:862) >> 4321 at >> org.apache.flink.api.java.typeutils.runtime.kryo.KryoSerializer.copy(KryoSerializer.java:217) >> 4322 at >> org.apache.flink.api.java.typeutils.runtime.PojoSerializer.copy(PojoSerializer.java:239) >> 4323 at >> org.apache.flink.api.scala.typeutils.TraversableSerializer$$anonfun$copy$1.apply(TraversableSerializer.scala:69) >> 4324 at >> org.apache.flink.api.scala.typeutils.TraversableSerializer$$anonfun$copy$1.apply(TraversableSerializer.scala:69) >> 4325 at >> scala.collection.immutable.List.foreach(List.scala:392) >> 4326 at >> org.apache.flink.api.scala.typeutils.TraversableSerializer.copy(TraversableSerializer.scala:69) >> 4327 at >> org.apache.flink.api.scala.typeutils.TraversableSerializer.copy(TraversableSerializer.scala:33) >> 4328 at >> org.apache.flink.api.scala.typeutils.CaseClassSerializer.copy(CaseClassSerializer.scala:101) >> 4329 at >> org.apache.flink.api.scala.typeutils.CaseClassSerializer.copy(CaseClassSerializer.scala:32) >> 4330 at >> org.apache.flink.api.scala.typeutils.TraversableSerializer$$anonfun$copy$1.apply(TraversableSerializer.scala:69) >> 4331 at >> org.apache.flink.api.scala.typeutils.TraversableSerializer$$anonfun$copy$1.apply(TraversableSerializer.scala:69) >> 4332 at >> scala.collection.Iterator$class.foreach(Iterator.scala:891) >> 4333 at >> scala.collection.AbstractIterator.foreach(Iterator.scala:1334) >> 4334 at >> scala.collection.IterableLike$class.foreach(IterableLike.scala:72) >> 4335 at >> scala.collection.AbstractIterable.foreach(Iterable.scala:54) >> 4336 at >> org.apache.flink.api.scala.typeutils.TraversableSerializer.copy(TraversableSerializer.scala:69) >> 4337 at >> org.apache.flink.api.scala.typeutils.TraversableSerializer.copy(TraversableSerializer.scala:33) >> 4338 at >> org.apache.flink.runtime.state.heap.CopyOnWriteStateTable.transform(CopyOnWriteStateTable.java:465) >> 4339 at >> org.apache.flink.runtime.state.heap.CopyOnWriteStateTable.transform(CopyOnWriteStateTable.java:341) >> 4340 at >> org.apache.flink.runtime.state.heap.HeapAggregatingState.add(HeapAggregatingState.java:105) >> 4341 ... 6 more >> >> Thanks >> >> On Thu, 29 Nov 2018 at 11:55, Felipe Quirce <pipe....@gmail.com> wrote: >> >>> Hi, >>> >>> I have found a problem during the checkpoint. >>> Could anyone help me or help me to debug it? >>> Exception: >>> >>>> 1804 2018-11-29 11:31:00,448 INFO >>>> org.apache.flink.runtime.executiongraph.ExecutionGraph >>>> - keyedstats-processor-165 -> map2alert-165 -> Process -> Sink: >>>> sink-level165 (1/2) (d860069560a4e3e6a62a450c9e3fa699) switched from >>>> RUNNING to FAILED. >>>> 51805 java.io.IOException: Exception while applying AggregateFunction >>>> in aggregating state >>>> 51806 at >>>> org.apache.flink.runtime.state.heap.HeapAggregatingState.add(HeapAggregatingState.java:107) >>>> 51807 at >>>> org.apache.flink.streaming.runtime.operators.windowing.WindowOperator.processElement(WindowOperator.java:391) >>>> 51808 at >>>> org.apache.flink.streaming.runtime.io.StreamInputProcessor.processInput(StreamInputProcessor.java:202) >>>> 51809 at >>>> org.apache.flink.streaming.runtime.tasks.OneInputStreamTask.run(OneInputStreamTask.java:105) >>>> 51810 at >>>> org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:300) >>>> 51811 at >>>> org.apache.flink.runtime.taskmanager.Task.run(Task.java:711) >>>> 51812 at >>>> java.lang.Thread.run(Thread.java:748) >>>> 51813 Caused by: java.lang.ArrayIndexOutOfBoundsException >>>> >>> >>> Thanks in Advance, >>> >> >> -- Blog:http://www.klion26.com GTalk:qcx978132955 一切随心