Re: Fwd: Continuous File monitoring not reading nested files

Hi Lukas, have you tried to set the parameter " recursive.file.enumeration" to true? |// create a configuration object Configuration parameters = new Configuration(); // set the recursive enumeration parameter parameters.setBoolean("recursive.file.enumeration", true); | If this also does not

Fwd: Continuous File monitoring not reading nested files

Hi all, this is probably related to the problem that I reported in December. In case it helps you can find a self contained example below. I haven't looked deeply into the problem but it seems like the correct file splits are determined but somehow not processed. If I read from HDFS nested file