Hi Chiwan,
I'm using Flink 0.9. 1
Cheers,
Giacomo
I created a JIRA issue [1]. After FLINK-2637 [2][3] is resolved, I’ll
submit a patch to solve this.
Currently, there is no way to use derived class with CSV input.
Thank you for reporting.
[1] https://issues.apache.org/jira/browse/FLINK-2690
[2]
I created a JIRA issue [1]. After FLINK-2637 [2][3] is resolved, I’ll submit a
patch to solve this.
Currently, there is no way to use derived class with CSV input.
Thank you for reporting.
[1] https://issues.apache.org/jira/browse/FLINK-2690
[2] https://issues.apache.org/jira/browse/FLINK-2637
[
It seems like a bug of CsvInputFormat. I succeed in reproducing in my local
machine.
I will create a JIRA issue for this and submit a patch to fix it.
Which version of Flink are used?
Regards,
Chiwan Park
> On Sep 17, 2015, at 12:20 AM, Giacomo Licari wrote:
>
> Yes I did.
>
> if anyone has
Yes I did.
if anyone has a bypass solution, let us know.
Regards,
Giacomo Licari
On Wed, Sep 16, 2015 at 5:15 PM, Chiwan Park wrote:
> Hi Giacomo,
>
> Did you create constructors without arguments in both base class and
> derived class?
> If you do, it seems like a bug.
>
> Regards,
> Chiwan P
Hi Giacomo,
Did you create constructors without arguments in both base class and derived
class?
If you do, it seems like a bug.
Regards,
Chiwan Park
> On Sep 17, 2015, at 12:04 AM, Giacomo Licari wrote:
>
> Hi Chiwan,
> I followed instructions in documentation.
> I have a simple base class wi
Hi Chiwan,
I followed instructions in documentation.
I have a simple base class with some properties (all public).
Then I extend that class with a new public property (tweet in my case), I
provide also getter and setter for that property.
Now when I execute:
DataSet ds_twitter = env.readCsvFile("f
Hi Giacomo,
You should set your field as public. If you are set your field as private or
protected, the class must provide getter and setter to be treated as POJO.
Maybe the documentation in homepage [1] would be helpful.
Regards,
Chiwan Park
[1]
https://ci.apache.org/projects/flink/flink-doc
I run it only implementing java.io.Serializable without disabling the
closure cleaner.
Another question I have is about POJO classes.
I would also create a base POJO class with some common proprerties, and
then extend it in new classes. These classes are used to convert a CSV into
a dataset of POJ
Could you also try the other variant (disabeling the closure cleaner)? I
would be curious if this behavior is expected Java Serialization behavior,
or whether our pre-processing code is causing it.
Greetings,
Stephan
On Wed, Sep 16, 2015 at 3:38 PM, Giacomo Licari
wrote:
> Thank you Martin and
Thank you Martin and Stephan for your help.
I tried directly to implement java.io.Serializable in Base class and it
worked perfectly!
Now I can develop more flexible and maintainable code. Thank you a lot guys.
Greetings,
Giacomo
On Wed, Sep 16, 2015 at 1:46 PM, Stephan Ewen wrote:
> Hi!
>
> I
Hi!
Interesting case. We use plain Java Serialization to distribute UDFs, and
perform additional "cleaning" of scopes, which may be causing the issue.
Can you try the following to see if any of those resolves the problem?
1) On the environment, disable the closure cleaner (in the execution
confi
Hi Giacomo,
I ran into the same issue. Seems to be coupled to the serialization
mechanism of UDFs. I solved it by letting the base class implement the
UDF interface (e.g. FlatMapFunction) and in addition make it generic
(which should be necessary in your example).
public [abstract] class Cul
12 matches
Mail list logo
