Re: PubSub source throwing grpc errors

2020-01-19 Thread Itamar Syn-Hershko
Definitely (though will be hijacking my own thread). The root issue is that it seems impossible to load custom Jackson Modules, specifically in our case JodaModule and KotlinModule . Since Jack

Re: PubSub source throwing grpc errors

2020-01-15 Thread Richard Deurwaarder
Hi Itamar and Till, Yes this actually looks a lot worse than it is, fortunately. >From what I understand this means: something has not released or properly shutdown an grpc client and the library likes to inform you about this. I would definartly expect to see this if the job crashes at the 'wron

Re: PubSub source throwing grpc errors

2020-01-15 Thread Till Rohrmann
Hi Itamar, could you share a bit more details about the serialization problem. Which class is not serializable and where does it originate from? Cheers, Till On Tue, Jan 14, 2020 at 9:47 PM Itamar Syn-Hershko < ita...@bigdataboutique.com> wrote: > Thanks! > > I was able to track this down. Esse

Re: PubSub source throwing grpc errors

2020-01-14 Thread Itamar Syn-Hershko
Thanks! I was able to track this down. Essentially it was a deserialization error which propagated and might have prevented the channel from closing down properly. This could be considered as a problem, but I'm not further down the rabbit hole chasing down a solution for the original deserializati

Re: PubSub source throwing grpc errors

2020-01-14 Thread Till Rohrmann
Hi Itamar, for further debugging it would be helpful to get the full logs of Flink and more information about your environment. Since I'm not too familiar with Flink's PubSub connector, I have pulled in Richard (original author), Becket and Robert (both helped with reviewing and merging this conne

PubSub source throwing grpc errors

2020-01-13 Thread Itamar Syn-Hershko
Hi all, We are trying to use the PubSub source with a very minimal and basic Flink application as a POC, and getting the following error consistently every couple of seconds. What am I missing? ``` io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue SEVERE: *~*~*~ Chan