Here is some info http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.4/bk_storm-user-guide/content/writing-data-with-storm-hdfs-connector.html On Feb 8, 2016 7:53 AM, "K Zharas" <[email protected]> wrote:
> Hi. > > 1) How can I set "HdfsSpout" so that it will emit a tuple every X seconds? > Is it done by "hdfsspout.commit.sec = 30"? > 2) I have only one file which has 300+ lines. After processing all the > line it does not move it to "done" directory, and it still has ".lock" & > ".inprogress". Also, it gives an error like "couldn't find the next file". > What I want to do is to move the file into "done" directory, > once "HdfsSpout" emits all the lines and to kill topology (stop program). > > Thank you. >
