[jira] [Created] (FLINK-1829) Conflicting Jackson version in the Flink POMs

2015-04-04 Thread Alexander Alexandrov (JIRA)
Alexander Alexandrov created FLINK-1829: --- Summary: Conflicting Jackson version in the Flink POMs Key: FLINK-1829 URL: https://issues.apache.org/jira/browse/FLINK-1829 Project: Flink Iss

Re: NullPointerException in DeltaIteration when no ForwardedFileds annotation

2015-04-04 Thread Vasiliki Kalavri
Hi Fabian, thanks for looking into this. Let me know if there's anything I can do to help! Cheers, V. On 3 April 2015 at 22:31, Fabian Hueske wrote: > Thanks for the nice setup! > I could easily reproduce the exception you are facing. > But that's the only good news so far :-( > > I checked th

Re: HBase TableOutputFormat fix (Flink 0.8.1)

2015-04-04 Thread Flavio Pompermaier
I created a JIRA ticket for this problem ( https://issues.apache.org/jira/browse/FLINK-1828) and I just made a PR that fix that (thanks Fabian and Robert for the great support!) Last question: is the "mapred.output.dir" parameter really necessary? At the end of my job that writes to hbase I found o

[jira] [Created] (FLINK-1828) Impossible to output data to an HBase table

2015-04-04 Thread Flavio Pompermaier (JIRA)
Flavio Pompermaier created FLINK-1828: - Summary: Impossible to output data to an HBase table Key: FLINK-1828 URL: https://issues.apache.org/jira/browse/FLINK-1828 Project: Flink Issue Typ

Re: Test sources in wrong folder

2015-04-04 Thread Fabian Hueske
Thanks! 2015-04-04 12:54 GMT+02:00 Flavio Pompermaier : > I opened a JIRA for this porblem > https://issues.apache.org/jira/browse/FLINK-1827. > Obviously it's an improvement with minor priority but I think this will be > a nice fix for user that want to compile java sources quickly. > > On Fri,

Re: Test sources in wrong folder

2015-04-04 Thread Flavio Pompermaier
I opened a JIRA for this porblem https://issues.apache.org/jira/browse/FLINK-1827. Obviously it's an improvement with minor priority but I think this will be a nice fix for user that want to compile java sources quickly. On Fri, Apr 3, 2015 at 2:38 PM, Flavio Pompermaier wrote: > This is my prob

[jira] [Created] (FLINK-1827) Move test classes in test folders and fix scope of test dependencies

2015-04-04 Thread Flavio Pompermaier (JIRA)
Flavio Pompermaier created FLINK-1827: - Summary: Move test classes in test folders and fix scope of test dependencies Key: FLINK-1827 URL: https://issues.apache.org/jira/browse/FLINK-1827 Project:

Re: HBase TableOutputFormat fix (Flink 0.8.1)

2015-04-04 Thread fhueske
Yes, reusing output objects is a good practice but optional. It can help to bring down GC overhead. You could make your function a RichFunction and initialize the output object in open(). Switching function serialization to Kryo is on our TODO list (FLINK-1256). Would be good to fix that so

Re: HBase TableOutputFormat fix (Flink 0.8.1)

2015-04-04 Thread Flavio Pompermaier
Ok graeat!this was not prtfectly clear to me! I'll try that now. About reuse variable instead..I use it because I saw that this is a common practice ib the examples but I'd like to know whether there's a real benefit in reusing it for return tuple with respect to returning a brand new one each tim

Re: HBase TableOutputFormat fix (Flink 0.8.1)

2015-04-04 Thread Fabian Hueske
User functions are still serialized using Java serialization, not Kryo. Kryo is only used for data exchange at runtime between tasks. If a function such as your MapFunction has a non-serializable member variable, you need to declare it as transient and initialize it before it is executed, e.g., vi

Re: HBase TableOutputFormat fix (Flink 0.8.1)

2015-04-04 Thread Flavio Pompermaier
There's no way to register put with kryo for example? On Apr 4, 2015 10:06 AM, "Robert Metzger" wrote: > Hey Flavio, > > I checked out your "master" branch and started the HBaseWriteExample. > It started without errors (there were some errors connecting to Zookeeper, > but thats probably because

Re: HBase TableOutputFormat fix (Flink 0.8.1)

2015-04-04 Thread Robert Metzger
Hey Flavio, I checked out your "master" branch and started the HBaseWriteExample. It started without errors (there were some errors connecting to Zookeeper, but thats probably because I don't have HBase running). Am I using the right code ( https://github.com/fpompermaier/flink/commit/c1934da379db