Hi Flavio,
1) the parameters you set to the configuration object in the main method
should be available in the JM and TMs. The OutputFormat object is
serialized at the client-side, sent to JM and the TMs, and deserialized.
Therefore, all information that was set in the main() should be there in
th
No I haven't. There are some points that are not clear to me:
1) why the parameters I set in the job configuration get lost when arriving
to the job and task managers?
2)do you think I should put the setConf in the configure method?what is the
lifecycle of the Outputformat?
3)is it really necessar
the problem or should I open
> a ticket in JIRA?
>
> On Sun, Mar 22, 2015 at 12:09 PM, Flavio Pompermaier > wrote:
>
>> Hi Stephan,
>> the problem is when you try to write into HBase with the
>> HadoopOutputFormat.
>> Unfortunately the recordWriter of the H
>>> if(this.mapreduceOutputFormat instanceof Configurable){
>>>>> ((Configurable)this.mapreduceOutputFormat).setConf(this.configuration);
>>>>> }
>>>>> otherwise the "mapred.output.dir" property was always null :(
>>>>>
Hi Stephan,
the problem is when you try to write into HBase with the HadoopOutputFormat.
Unfortunately the recordWriter of the HBase TableOutputFormat requires a
Table object to be instantiated through the setConf() method (otherwise you
get a nullPointer), and it sets also other parameters in the
null :(
>>>
>>> On Fri, Mar 20, 2015 at 10:27 AM, Flavio Pompermaier <
>>> pomperma...@okkam.it> wrote:
>>>
>>>> Hi guys,
>>>>
>>>> I was trying to insert into an HBase table with Flink 0.8.1 and it
>
rwise the "mapred.output.dir" property was always null :(
>>
>> On Fri, Mar 20, 2015 at 10:27 AM, Flavio Pompermaier <
>> pomperma...@okkam.it> wrote:
>>
>>> Hi guys,
>>>
>>> I was trying to insert into an HBase table with Flink
wrote:
>
>> Hi guys,
>>
>> I was trying to insert into an HBase table with Flink 0.8.1 and it seems
>> to be not possible without creating a custom version of the HBase
>> TableOutputFormat that specialize Mutation with Put.
>> This is my code using the standard Fl
the "mapred.output.dir" property was always null :(
On Fri, Mar 20, 2015 at 10:27 AM, Flavio Pompermaier
wrote:
> Hi guys,
>
> I was trying to insert into an HBase table with Flink 0.8.1 and it seems
> to be not possible without creating a custom version of the HBase
&g
Hi guys,
I was trying to insert into an HBase table with Flink 0.8.1 and it seems to
be not possible without creating a custom version of the HBase
TableOutputFormat that specialize Mutation with Put.
This is my code using the standard Flink APIs:
myds.output(new HadoopOutputFormat(new
10 matches
Mail list logo
