I think hadoop-hdfs might be sufficient.

> On 8. Dec 2017, at 14:48, shashank agarwal <shashank...@gmail.com> wrote:
> 
> Can you specifically guide which dependencies should I add to extend this :
> 
> https://github.com/apache/flink/blob/release-1.4.0-rc3/flink-connectors/flink-connector-filesystem/src/main/java/org/apache/flink/streaming/connectors/fs/Bucketer.java
>  
> <https://github.com/apache/flink/blob/release-1.4.0-rc3/flink-connectors/flink-connector-filesystem/src/main/java/org/apache/flink/streaming/connectors/fs/Bucketer.java>
> 
> is the Hadoop-core is sufficient. 
> 
> 
> ‌
> 
> On Fri, Dec 8, 2017 at 6:58 PM, shashank agarwal <shashank...@gmail.com 
> <mailto:shashank...@gmail.com>> wrote:
> It's a compilation error. I think I have to include the Hadoop dependencies.
> 
> 
> 
> ‌
> 
> On Fri, Dec 8, 2017 at 6:54 PM, Aljoscha Krettek <aljos...@apache.org 
> <mailto:aljos...@apache.org>> wrote:
> Hi,
> 
> Is this a compilation error or at runtime. But in general, yes you have to 
> include the Hadoop dependencies if they're not there.
> 
> Best,
> Aljoscha
> 
> 
>> On 8. Dec 2017, at 14:10, shashank agarwal <shashank...@gmail.com 
>> <mailto:shashank...@gmail.com>> wrote:
>> 
>> Hello,
>> 
>> I am trying to test 1.4.0-RC3, Hadoop libraries removed in this version. 
>> Actually, i have created custom Bucketer for the bucketing sink.  I am 
>> extending 
>> 
>> 
>> org.apache.flink.streaming.connectors.fs.bucketing.Bucketer
>> 
>> in the class, i have to use org.apache.hadoop.fs.Path  but as hadoop 
>> libraries removed it's giving error 
>> 
>> "object hadoop is not a member of package org.apache"
>> 
>> Should i have to include Hadoop client libs in build.sbt dependencies.
>> 
>> 
>> Thanks
>> Shashank
>> ‌
> 
> 
> 
> 
> -- 
> Thanks Regards
> 
> SHASHANK AGARWAL
>  ---  Trying to mobilize the things....
> 
> 
> 
> 
> -- 
> Thanks Regards
> 
> SHASHANK AGARWAL
>  ---  Trying to mobilize the things....

Reply via email to