Re: Tuple performance and the curious JIT compiler

2016-03-08 Thread Gábor Horváth
Hi! I am planning to do GSoC and I would like to work on the serializers. More specifically I would like to implement code generation. I am planning to send the first draft of the proposal to the mailing list early next week. If everything is going well, that will include some preliminary benchmar

GSoC Project Proposal Draft: Code Generation in Serializers

2016-03-09 Thread Gábor Horváth
Hi,I did not want to send this proposal out before the I have some initial benchmarks, but this issue was mentioned on the mailing list ( http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Tuple-performance-and-the-curious-JIT-compiler-td10666.html), and I wanted to make this informatio

Re: Tuple performance and the curious JIT compiler

2016-03-09 Thread Gábor Horváth
in JIRA (should > > be > > > labeled with gsoc2016). > > > I am also not sure if any of the Flink committers signed up as a GSoC > > > mentor. > > > Maybe it is still time to do that but as it looks right now there are > no > > > GSoC projects offered by

Re: GSoC Project Proposal Draft: Code Generation in Serializers

2016-03-09 Thread Gábor Horváth
Hi! As far as I can see the formatting was not correct in my previous mail. A better formatted version is available here: https://docs.google.com/document/d/1VC8lCeErx9kI5lCMPiUn625PO0rxR-iKlVqtt3hkVnk Sorry for that. Regards, Gábor On 9 March 2016 at 15:51, Gábor Horváth wrote: > Hi,I

Re: GSoC Project Proposal Draft: Code Generation in Serializers

2016-03-14 Thread Gábor Horváth
Hi, I have updated this draft to include preliminary benchmarks, mentioned the interaction of annotations with savepoints, extended it with a timeline, and some notes about scala case classes. Regards, Gábor On 9 March 2016 at 16:12, Gábor Horváth wrote: > Hi! > > As far as I ca

Re: GSoC Project Proposal Draft: Code Generation in Serializers

2016-03-19 Thread Gábor Horváth
, 2016 at 11:16 AM, Gábor Horváth > wrote: > > > Hi, > > > > I have updated this draft to include preliminary benchmarks, mentioned > the > > interaction of annotations with savepoints, extended it with a timeline, > > and some notes about scala case classes. &g

Table API / SQL Queries and Code Generation

2016-04-05 Thread Gábor Horváth
looking for. Thanks in advance, Gábor Horváth [1] https://docs.google.com/document/d/1VC8lCeErx9kI5lCMPiUn625PO0rxR-iKlVqtt3hkVnk [2] https://docs.google.com/document/d/1sITIShmJMGegzAjGqFuwiN_iw1urwykKsLiacokxSw0

Re: Table API / SQL Queries and Code Generation

2016-04-07 Thread Gábor Horváth
hank you I will definitely look into the code. > > > > Regards, > > Timo > > > > [1] http://unkrig.de/w/Janino > > [2] > > > https://github.com/apache/flink/blob/master/flink-libraries/flink-table/src/main/scala/org/apache/flink/api/table/codegen/CodeGe

Re: GSoC Project Proposal Draft: Code Generation in Serializers

2016-04-16 Thread Gábor Horváth
] http://unkrig.de/w/Janino [2] https://github.com/apache/flink/blob/master/flink-libraries/flink-table/src/main/scala/org/apache/flink/api/table/codegen/CodeGenerator.scala On 18 March 2016 at 19:37, Gábor Horváth wrote: > Thank you! I finalized the project. > > > On 18 March 2016 at 1

Re: GSoC Project Proposal Draft: Code Generation in Serializers

2016-04-18 Thread Gábor Horváth
e I am skeptical. We have seen IDE compilation issues with > > projects > > >>> using this setup and have decided that the community-wide potential > IDE > > >>> setup pain outweighs the individual implementation convenience with > > >> Scala. >

Re: GSoC Project Proposal Draft: Code Generation in Serializers

2016-04-20 Thread Gábor Horváth
; TypeInformations for types with overridden serializers / comparators. > This would require some design document and discussion in the community. > > Cheers, Fabian > > > > > > 2016-04-18 21:19 GMT+02:00 Gábor Horváth : > > > Unfortunately making code generation a separ

Re: GSoC Project Proposal Draft: Code Generation in Serializers

2016-04-20 Thread Gábor Horváth
the TypeInformation in Scala? > I think we need a way to replace Serializer implementations anyway unless > the generated serializers are compatible to the current ones. > > 2016-04-20 15:53 GMT+02:00 Gábor Horváth : > > > Hi Fabian, > > > > I agree that it would be aw

Re: GSoC Project Proposal Draft: Code Generation in Serializers

2016-04-23 Thread Gábor Horváth
Hi, The GSoC project proposal was accepted! Thank you for all your support. I will do my best to live up to the challenges and deliver everything that way planned for this summer. Best Regards, Gábor On 20 April 2016 at 16:18, Gábor Horváth wrote: > On the second thought I think you are ri

Janino related question

2016-05-08 Thread Gábor Horváth
Hi! I have created a proof of concept implementation of my GSoC project [1]: introducing code generation to the serializers. The code is available here [2]. Unfortunately I have run into a problem that I am unable to debug. I generated some code that I compiled using the Janino compiler [4]. I did

Re: Janino related question

2016-05-09 Thread Gábor Horváth
apache.flink.api.java.typeutils.PojoTypeInfo.createSerializer(PojoTypeInfo.java:306) > > at org.apache.flink.api.java.DataSet.collect(DataSet.java:407) > > at org.apache.flink.api.java.DataSet.print(DataSet.java:1605) > > at > > > > > org.apache.flink.examples.java.wordco

Re: Janino related question

2016-05-23 Thread Gábor Horváth
of you see similar phenomenon? What would be the best way to debug this? I have attached the generated Java code. Thanks in advance, Gábor On 9 May 2016 at 20:41, Gábor Horváth wrote: > Hi, > > Thank you for your support, I was able to solve this issue :) > > Gábor > > O

Re: GSoC Project Proposal Draft: Code Generation in Serializers

2016-05-29 Thread Gábor Horváth
github.com/Xazax-hun/flink/commits/serializer_codegen On 23 April 2016 at 10:33, Gábor Horváth wrote: > Hi, > > The GSoC project proposal was accepted! Thank you for all your support. I > will do my best to live up to the challenges and deliver everything that > way planned for this

PojoComparator question

2016-05-30 Thread Gábor Horváth
Hi! While I was working on code generation support for PojoComparators, I stumbled upon the compareSerialized method [1]. It first creates two new instances and then it is using the reusing overloads of the serializer. Calling the non-reusing overload would create the instance anyways. Is there a