Re: Odd Serialization exception

2021-08-12 Thread Daniel Vol
e super.open(…) function which would leave the > producer only half initialized > > > > Thias > > > > > > > > > > *From:* Daniel Vol > *Sent:* Donnerstag, 12. August 2021 08:01 > *To:* Guowei Ma > *Cc:* user > *Subject:* Re: Odd Serialization exceptio

RE: Odd Serialization exception

2021-08-12 Thread Schwalbe Matthias
(…) function which would leave the producer only half initialized Thias From: Daniel Vol Sent: Donnerstag, 12. August 2021 08:01 To: Guowei Ma Cc: user Subject: Re: Odd Serialization exception Hi Guowei, I am running on EMR 5.32.0 with Flink 1.11.2 In meanwhile I did some tests and

Re: Odd Serialization exception

2021-08-11 Thread Guowei Ma
Hi, I think you might be right. So you could try to call the super.open(...) in your LogSessionProducer. Best, Guowei On Thu, Aug 12, 2021 at 2:01 PM Daniel Vol wrote: > Hi Guowei, > > I am running on EMR 5.32.0 with Flink 1.11.2 > > In meanwhile I did some tests and commented out part of the n

Re: Odd Serialization exception

2021-08-11 Thread Daniel Vol
Hi Guowei, I am running on EMR 5.32.0 with Flink 1.11.2 In meanwhile I did some tests and commented out part of the new code - override def invoke(value: OUT, context: SinkFunction.Context[_]): Unit = { try { // val session = value.asInstanceOf[Session] // sessionDuration = 17L //s

Re: Odd Serialization exception

2021-08-11 Thread Guowei Ma
Hi, Daniel Could you tell me the version of Flink you use? I want to look at the corresponding code. Best, Guowei On Wed, Aug 11, 2021 at 11:23 PM Daniel Vol wrote: > Hi Matthias, > > First, thanks for a fast reply. > I am new to Flink, so probably I miss a lot in terms of flow and objects > pa

Re: Odd Serialization exception

2021-08-11 Thread Daniel Vol
Hi Matthias, First, thanks for a fast reply. I am new to Flink, so probably I miss a lot in terms of flow and objects passed. The motivation is to get internal data from the transferred OUT Object to send metrics. So I do downscale it but as per my perspective it is not forwarded (super called wi

RE: Odd Serialization exception

2021-08-11 Thread Schwalbe Matthias
Hi Daniel, On the first look there is one thing that catches my eye: In line ‘val session = value.asInstanceOf[Session]' it looks like you are downcasting the event from OUT to Session. In Flink this is a dangerous thing to do … DataStream[OUT] uses a specific serializer[OUT] to transport events