Thanks Jörn! I expected Flink will schedule the input file to all workers.
Am 05.08.2017 um 16:25 schrieb Jörn Franke <jornfra...@gmail.com<mailto:jornfra...@gmail.com>>: Probably you need to refer to the file on HDFS or manually make it available on each node as a local file. HDFS is recommended. If it is already on HDFS then you need to provide an HDFS URL to the file. On 5. Aug 2017, at 14:27, Kaepke, Marc <marc.kae...@haw-hamburg.de<mailto:marc.kae...@haw-hamburg.de>> wrote: Hi there, my really small test job reads an external file and print the input to console. Execute it as standalone with a local cluster, everything is fine. If I execute the same job as standalone with 1 job manager und 1 task manager, I get an FileNotFound Exception. As a real distributed cluster. The cluster seems to be fine, because I can execute another job, which don’t consume a file. at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) Caused by: java.io.IOException: Error opening the Input Split file:/home/bigdata/Documents/marc/wiki-vote.txt [0,1095061]: /home/bigdata/Documents/marc/wiki-vote.txt (No such file or directory) at org.apache.flink.api.common.io.FileInputFormat.open(FileInputFormat.java:706) at org.apache.flink.api.common.io.DelimitedInputFormat.open(DelimitedInputFormat.java:477) at org.apache.flink.api.common.io.GenericCsvInputFormat.open(GenericCsvInputFormat.java:301) at org.apache.flink.api.java.io.CsvInputFormat.open(CsvInputFormat.java:48) at org.apache.flink.api.java.io.CsvInputFormat.open(CsvInputFormat.java:31) at org.apache.flink.runtime.operators.DataSourceTask.invoke(DataSourceTask.java:145) at org.apache.flink.runtime.taskmanager.Task.run(Task.java:702) at java.lang.Thread.run(Thread.java:745) Caused by: java.io.FileNotFoundException: /home/bigdata/Documents/marc/wiki-vote.txt (No such file or directory) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.<init>(FileInputStream.java:138) at org.apache.flink.core.fs.local.LocalDataInputStream.<init>(LocalDataInputStream.java:49) at org.apache.flink.core.fs.local.LocalFileSystem.open(LocalFileSystem.java:141) at org.apache.flink.api.common.io.FileInputFormat$InputSplitOpenThread.run(FileInputFormat.java:866) Does someone has an idea to solve it? Thanks! Marc
