RE: Serializing NULLs

2017-01-04 Thread Newport, Billy
Map> in your avro schema is what you want here if the map values are nullable. From: Anirudh Mallem [mailto:anirudh.mal...@247-inc.com] Sent: Tuesday, December 20, 2016 2:26 PM To: user@flink.apache.org Subject: Re: Serializing NULLs If you are using Avro generated classes then you cannot h

Re: Serializing NULLs

2016-12-22 Thread Matt
pache.org/confluence/display/AVRO/FAQ#FAQ-Whyisn' > teveryvalueinAvronullable? > > From: Stephan Ewen > Reply-To: "user@flink.apache.org" > Date: Tuesday, December 20, 2016 at 8:17 AM > To: "user@flink.apache.org" > Subject: Re: Serializing NULLs > > Thanks

Re: Serializing NULLs

2016-12-20 Thread Anirudh Mallem
r 20, 2016 at 8:17 AM To: "user@flink.apache.org<mailto:user@flink.apache.org>" Subject: Re: Serializing NULLs Thanks for sharing the stack trace. This seems not really Flink related, it is part of the specific Avro encoding logic. The Avro Generic Record Type apparently does not

Re: Serializing NULLs

2016-12-20 Thread Stephan Ewen
Thanks for sharing the stack trace. This seems not really Flink related, it is part of the specific Avro encoding logic. The Avro Generic Record Type apparently does not allow the map value to be null. On Tue, Dec 20, 2016 at 4:55 PM, Matt wrote: > Here is the back trace: https://gist.github.

Re: Serializing NULLs

2016-12-20 Thread Deepak Sharma
Hi Matt Can you please share the code like how you are mapping null to long? Thanks Deepak On Tue, Dec 20, 2016 at 9:25 PM, Matt wrote: > Here is the back trace: https://gist.github.com/ > 56af4818bcf5dee6b97c248fd9233c67 > > In the meanwhile I've solved the issue by creating a POJO class where

Re: Serializing NULLs

2016-12-20 Thread Matt
Here is the back trace: https://gist.github.com/56af4818bcf5dee6b97c248fd9233c67 In the meanwhile I've solved the issue by creating a POJO class where null is just Long.MIN_VALUE, that with a custom equals() made the trick. I guess it's not as fast as de/serializing Double though. If you need any

Re: Serializing NULLs

2016-12-20 Thread Stephan Ewen
The "null" support in some types is not fully developed. However in that case I am wondering why it does not work. Can you share the stack trace, so we can take a look at the serializer? On Mon, Dec 19, 2016 at 9:56 PM, Matt wrote: > Hello list, > > I'm getting this error: > > > *java.lang.Run