Hi, I am trying to use textFileStream("some_hdfs_location") to pick new files from a HDFS location.I am seeing a pretty strange behavior though. textFileStream() is not detecting new files when I "move" them from a location with in hdfs to location at which textFileStream() is checking for new files. But when I copy files from a location in linux filesystem to hdfs then the textFileStream is detecting the new files.
Is this a know issue? Thanks, Baahu