Re: Serialization schema

2017-02-26 Thread Mohit Anchlia
There was a private member variable that was not serializable and was not marked transient. Thanks for the pointer. On Thu, Feb 23, 2017 at 11:44 PM, Tzu-Li (Gordon) Tai wrote: > Thanks for clarifying. > > From the looks of your exception: > > Caused by: java.io.NotSerializableException: > c

Re: Serialization schema

2017-02-23 Thread Tzu-Li (Gordon) Tai
Thanks for clarifying.  From the looks of your exception: Caused by: java.io.NotSerializableException: com.sy.flink.test.Tuple2Serializerr$1     at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1184)     at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStre

Re: Serialization schema

2017-02-23 Thread Mohit Anchlia
But it is not an inner class. On Thu, Feb 23, 2017 at 11:09 PM, Tzu-Li (Gordon) Tai wrote: > Since I don’t have your complete code, I’m guessing this is the problem: > Is your `Tuple2Serializer` an inner class? If yes, you should be able to > solve the problem by declaring `Tuple2Serializer` to

Re: Serialization schema

2017-02-23 Thread Tzu-Li (Gordon) Tai
Since I don’t have your complete code, I’m guessing this is the problem: Is your `Tuple2Serializer` an inner class? If yes, you should be able to solve the problem by declaring `Tuple2Serializer` to be `static`. This is more of a Java problem - It isn’t serializable if it isn’t static, because it

Re: Serialization schema

2017-02-23 Thread Mohit Anchlia
This is at high level what I am doing: Serialize: String s = tuple.getPos(0) + "," + tuple.getPos(1); return s.getBytes() Deserialize: String s = new String(message); String [] sarr = s.split(","); Tuple2 tuple = new Tuple2<>(Integer.valueOf(sarr[0]), Integer.valueOf(sarr[1])); return tuple;

Re: Serialization schema

2017-02-23 Thread Tzu-Li (Gordon) Tai
Hi Mohit, As 刘彪 pointed out in his reply, the problem is that your `Tuple2Serializer` contains fields that are not serializable, so `Tuple2Serializer` itself is not serializable. Could you perhaps share your `Tuple2Serializer` implementation with us so we can pinpoint the problem? A snippet of

Re: Serialization schema

2017-02-23 Thread Mohit Anchlia
I am using String inside to convert into bytes. On Thu, Feb 23, 2017 at 6:50 PM, 刘彪 wrote: > Hi Mohit > As you did not give the whole codes of Tuple2Serializerr. I guess the > reason is some fields of Tuple2Serializerr do not implement Serializable. > > 2017-02-24 9:07 GMT+08:00 Mohit Anchlia :

Re: Serialization schema

2017-02-23 Thread 刘彪
Hi Mohit As you did not give the whole codes of Tuple2Serializerr. I guess the reason is some fields of Tuple2Serializerr do not implement Serializable. 2017-02-24 9:07 GMT+08:00 Mohit Anchlia : > I wrote a key serialization class to write to kafka however I am getting > this error. Not sure why