Re: Scala Case Class Serialization

2021-12-07 Thread Roman Grebennikov
Hi, I guess the problematic line where the kryo fallback is happening is here: lazy val myState: MapState[String, TestCaseClass] = getRuntimeContext.getMapState( new MapStateDescriptor[String, TestCaseClass]("test-state", classOf[String], ttestclass.getTypeClass) MapStateDescriptor has

Re: Scala Case Class Serialization

2021-12-07 Thread Lars Skjærven
Thanks for quick response. Please find attached a minimal example illustrating the issue. I've added implicit TypeInformation, and checked that I'm importing the scala variant only. Matthias: Just my superficial impression from [1]. Will look into TypeInfoFactory. Thanks again! package com.mystu

Re: Scala Case Class Serialization

2021-12-07 Thread Roman Grebennikov
Hi Lars, can you please show a small reproducer of the way you construct the DataStream, and which imports do you use? We also often experience similar performance issues with scala, but usually they are related to accidental usage of Flink Java API. A couple of hints from my experience: 1. Ma

Re: Scala Case Class Serialization

2021-12-07 Thread Matthias Pohl
Hi Lars, not sure about the out-of-the-box support for case classes with primitive member types (could you refer to the section which made you conclude this?). I haven't used Scala with Flink, yet. So maybe, others can give more context. But have you looked into using the TypeInfoFactory to define