Re: exception when parallelizing application

2022-03-21 Thread Prashant Deva
ah i think i got it. this line: hash = (19 * hash) + getDescriptor().hashCode(); the object returned by getDescriptor() doesnt define hashCode() and thus object.hashcode() is used. resulting in unstable hash across jvms. On Mon, Mar 21, 2022 at 10:10 AM Prashant Deva wrote: > Here is

Re: exception when parallelizing application

2022-03-21 Thread Prashant Deva
; return hash; } On Sun, Mar 20, 2022 at 11:22 PM Guowei Ma wrote: > It seems that the key's hashcode is not stable. > So would you like to show the details of the `TraceKeyOuterClass.TraceKey`. > > Best, > Guowei > > > On Sun, Mar 20, 2022 at 3:21 PM Prashan

Re: exception when parallelizing application

2022-03-20 Thread Prashant Deva
zer(SpanOuterClass.Span::class.java, ProtobufSerializer::class.java) On Sun, Mar 20, 2022 at 12:15 AM caoyu wrote: > Would you like copy the key code here to help debugging. > > Replied Message > From Prashant Deva > Date 03/20/2022 12:24 > To user > Subject exce

exception when parallelizing application

2022-03-19 Thread Prashant Deva
using flink 1.13.2. When i increase the parallelization of my application from 1 to 2, i see the following exceptions. what do they mean? how can i possibly fix this? java.lang.IllegalArgumentException: key group from 128 to 256 does not contain 89 at org.apache.flink.util.Preconditions.c

Session Windows should have a max size

2021-07-28 Thread Prashant Deva
It seems there is no way to set a maximum size of events for a session window. This results in a security vulnerability. Example: I am recording all the user interaction events of a browser session. A malicious user can then generate hundreds of thousands or even millions of events, and cause out o

kafka consumers partition count and parallelism

2021-04-25 Thread Prashant Deva
Can a Kafka Consumer Source have more tasks run in parallel than the number of partitions for the topic it is the source of? Or is the max parallelism of the source constrained by max partitions of the topic?

Re: NoSuchMethorError when using chill-protobuf

2021-04-24 Thread Prashant Deva
ah it seems that one needs to use chill 0.7.6 in order to get it to work with flink. On Sat, Apr 24, 2021 at 1:18 PM Prashant Deva wrote: > I am trying to use chill-protobuf to serialize protobuf messages. > However, I am getting this exception: > > > Caused by: java.lang.No

NoSuchMethorError when using chill-protobuf

2021-04-24 Thread Prashant Deva
I am trying to use chill-protobuf to serialize protobuf messages. However, I am getting this exception: Caused by: java.lang.NoSuchMethodError: 'boolean com.twitter.chill.java.Java8ClosureRegistrar.areOnJava8 ( http://com.twitter.chill.java.java8closureregistrar.areonjava8/ ) ()' at com.twitte

Re: pojo warning when using auto generated protobuf class

2021-04-24 Thread Prashant Deva
ts/flink/flink-docs-stable/dev/custom_serializers.html > ) > > > >> --Original Mail -- >> *Sender:* Prashant Deva < prashant@ astradot. com ( prash...@astradot.com ) >> > >> *Send Date:* Sat Apr 24 11:00:17 2021 >> *Recipients:* Us

pojo warning when using auto generated protobuf class

2021-04-23 Thread Prashant Deva
I am seeing this warning msg when trying to use a custom protobuf de/serializer with kafka source with auto generated java protobuf class: 18:41:31.164 [main] INFO org.apache.flink.api.java.typeutils.TypeExtractor - Class class com.xx.APITrace cannot be used as a POJO type because not all fields a