Re: Help with flink hdfs sink

2020-03-25 Thread Nick Bendtner
Thank you so much guys, I used "hdfs://nameservice/path/of/your/file", works fine for me now. Best, Nick On Fri, Mar 20, 2020 at 3:48 AM Yang Wang wrote: > I think Jingsong is right. You miss a slash in your HDFS path. > > Usually a HDFS path is like this "hdfs://nameservice/path/of/your/file".

Re: Help with flink hdfs sink

2020-03-20 Thread Yang Wang
I think Jingsong is right. You miss a slash in your HDFS path. Usually a HDFS path is like this "hdfs://nameservice/path/of/your/file". And the nameservice could be omitted if you want to use the defaultFS configured in the core-site.xml. Best, Yang Jingsong Li 于2020年3月20日周五 上午10:09写道: > Hi N

Re: Help with flink hdfs sink

2020-03-19 Thread Jingsong Li
Hi Nick, You can try "new Path("hdfs:///tmp/auditlog/")". There is one additional / after hdfs://, which is a protocol name. Best, Jingsong Lee On Fri, Mar 20, 2020 at 3:13 AM Nick Bendtner wrote: > Hi guys, > I am using flink version 1.7.2. > I am trying to write to hdfs sink from my flink jo

Help with flink hdfs sink

2020-03-19 Thread Nick Bendtner
Hi guys, I am using flink version 1.7.2. I am trying to write to hdfs sink from my flink job. I setup HADOOP_HOME. Here is the debug log for this : 2020-03-19 18:59:34,316 DEBUG org.apache.flink.runtime.util.HadoopUtils - Cannot find hdfs-default configuration-file path in Flin