Re: Parquet Article / Tutorial

2015-05-11 Thread Felix Neutatz
Hi Flavio, changing the block size may help. But I haven't played around with it yet. Best regards, Felix Am 11.05.2015 12:23 nachm. schrieb "Flavio Pompermaier" < pomperma...@okkam.it>: > Hi Felix, > I was looking at your code and I don't see any parquet.block.size settings. > Do you think it i

Re: Parquet Article / Tutorial

2015-05-11 Thread Flavio Pompermaier
Hi Felix, I was looking at your code and I don't see any parquet.block.size settings. Do you think it is safe to keep defaults? On Fri, Apr 24, 2015 at 11:19 PM, Flavio Pompermaier wrote: > Thanks Felix, > Thanks fir the response! > I'm looking forward to use it! > On Apr 24, 2015 9:01 PM, "Feli

Re: Parquet Article / Tutorial

2015-04-24 Thread Flavio Pompermaier
Thanks Felix, Thanks fir the response! I'm looking forward to use it! On Apr 24, 2015 9:01 PM, "Felix Neutatz" wrote: > Hi Flavio, > > in Thrift you can try: > > struct FlavioTuple { > 1: optional string f1; > 2: optional string f2; > 3: optional list f3; > } > > See: http://diwakergu

Re: Parquet Article / Tutorial

2015-04-24 Thread Felix Neutatz
Hi Flavio, in Thrift you can try: struct FlavioTuple { 1: optional string f1; 2: optional string f2; 3: optional list f3; } See: http://diwakergupta.github.io/thrift-missing-guide/ I like Thrift the most, because the API for Thrift in Parquet is the easiest. Have fun with Parquet :

Re: Parquet Article / Tutorial

2015-04-24 Thread Flavio Pompermaier
I was looking at this great example and I'd like to ask you which serialization framework is the best if I have to serialize Tuple3 with Parquet. The syntax I like the most is the Thrift one but I can't see all the pros and cons of using it and I'd like to hear your opinion here. Thanks in advance

Re: Parquet Article / Tutorial

2015-04-07 Thread Henry Saputra
+1 to the idea. Awesome work, Felix On Tuesday, April 7, 2015, Maximilian Michels wrote: > Hi Felix, > > Very nice informative read. > > +1 for a short blog post and a full version in the wiki. > +1 for putting this into flink-contrib > > > On Tue, Apr 7, 2015 at 1:46 PM, Fabian Hueske > wrote

Re: Parquet Article / Tutorial

2015-04-07 Thread Maximilian Michels
Hi Felix, Very nice informative read. +1 for a short blog post and a full version in the wiki. +1 for putting this into flink-contrib On Tue, Apr 7, 2015 at 1:46 PM, Fabian Hueske wrote: > Very nice article! > How about adding the full article to the wiki and having a shorter version > as a b

Re: Parquet Article / Tutorial

2015-04-07 Thread Fabian Hueske
Very nice article! How about adding the full article to the wiki and having a shorter version as a blog post (with a link to the wiki)? Adding the code to contrib would be great! 2015-04-07 12:45 GMT+02:00 Kostas Tzoumas : > Looks very nice! Would love to see a blog post on that! > > On Mon, Apr

Re: Parquet Article / Tutorial

2015-04-07 Thread Kostas Tzoumas
Looks very nice! Would love to see a blog post on that! On Mon, Apr 6, 2015 at 7:19 PM, Felix Neutatz wrote: > The intention was to post it on the blog, but if you think it would better > fit into the wiki, that would be also fine :) > > About the code: I have not thought about putting it to con

Re: Parquet Article / Tutorial

2015-04-06 Thread Felix Neutatz
The intention was to post it on the blog, but if you think it would better fit into the wiki, that would be also fine :) About the code: I have not thought about putting it to contrib-package, but I can. What do you think is suitable for flink-contrib? Best regards, Felix 2015-04-06 14:57 GMT+0

Re: Parquet Article / Tutorial

2015-04-06 Thread Stephan Ewen
Wow, very nice work! It looks impressive at first sight, no comments :-) Just one question: Do you want this to be a standalone tutorial, or are you thinking of putting this into the Flink wiki, or some code even into "flink-contrib" ? Stephan On Sun, Apr 5, 2015 at 3:30 PM, Felix Neutatz wro

Parquet Article / Tutorial

2015-04-05 Thread Felix Neutatz
Hi everybody, I am working currently on a tutorial/article about how/when/why to use Parquet on Flink. You can find the pdf version here: https://github.com/FelixNeutatz/parquet-flinktacular/blob/master/tutorial/parquet_flinktacular.pdf The git repository with all the code examples can be found