Re: Deep Copy in FLINK, Kryo Copy is used in the different operator

2018-02-21 Thread chen
@Gábor Gévay, Thanks Gábor I just use flink in produce environment, but the performance is not good, especially in aggregation. At the beginning I used Java serialization, but it does not work well. Maybe I do not understood flink very well then. I will try change the serialization meth

Re: Deep Copy in FLINK, Kryo Copy is used in the different operator

2018-02-21 Thread chen
@Aljoscha Krettek, Thanks Aljoscha, I will try this way to test the performance. Last 7 days is chinese spring fastival, sorry for response you so late. -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Deep Copy in FLINK, Kryo Copy is used in the different operator

2018-02-14 Thread Gábor Gévay
Hello, You might also be able to make Flink use a better serializer than Kryo. Flink falls back to Kryo when it can't use its own serializers, see here: https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/types_serialization.html For example, it might help to make your type a POJO. Be

Re: Deep Copy in FLINK, Kryo Copy is used in the different operator

2018-02-14 Thread Aljoscha Krettek
Hi, You can disable those copies via ExecutionConfig.enableObjectReuse(), which you can get from the StreamExecutionEnvironment via getConfig(). Best, Aljoscha > On 12. Feb 2018, at 04:00, chen wrote: > > Actually our team have our own Stream Engine, we tested our engine and flink, > find out