Re: Projection exception with "Thrifted" Parquet data

2015-05-21 Thread Stephan Ewen
Hi Flavio! The latest master should have a fix for the problem. The issue is tracked here: https://issues.apache.org/jira/browse/FLINK-2071 Greetings, Stephan On Thu, May 21, 2015 at 2:24 PM, Flavio Pompermaier wrote: > Great! Thanks for the great support Stephan > > On Thu, May 21, 2015 at

Re: Projection exception with "Thrifted" Parquet data

2015-05-21 Thread Flavio Pompermaier
Great! Thanks for the great support Stephan On Thu, May 21, 2015 at 2:22 PM, Stephan Ewen wrote: > Hi! > > It seems that the "project()" operator wants to write an empty instance > of type "Person" as part of the object, which is not possible for thrift. > > We can remove that instance, since i

Re: Projection exception with "Thrifted" Parquet data

2015-05-21 Thread Stephan Ewen
Hi! It seems that the "project()" operator wants to write an empty instance of type "Person" as part of the object, which is not possible for thrift. We can remove that instance, since it is not really needed. It was intended to be a reusable object instance, but it has become obsolete. Stephan

Projection exception with "Thrifted" Parquet data

2015-05-21 Thread Flavio Pompermaier
Hi to all, I'm using a code that basically is originated from the Flink-Parquet example at https://github.com/FelixNeutatz/parquet-flinktacular/blob/master/java/thrift/flink/src/main/java/flink/parquet/ParquetThriftExample.java . If I do the following everything works fine: DataSet> input = read