Hi,
I am trying to use "Recursive Traversal of the Input Path Directory" in
Flink 1.3 using scala. Snippet of my code below. If I give exact file name
it is working fine. Ref
https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/batch/index.html
import org.apache.flink.api.java.utils.ParameterTool
import org.apache.flink.api.java.{DataSet, ExecutionEnvironment}
import org.apache.flink.configuration.Configuration
val config = new Configuration
config.setBoolean("recursive.file.enumeration",true)
val featuresSource: String =
"file:///Users/adarsh/Documents/testData/featurecsv/31c710ac40/2017/06/22"
val testInput = env.readTextFile(featuresSource).withParameters(config)
testInput.print()
Please guide how to fix this.
Regards,
Adarsh