Hi Kostas
Thanks for the reply, Yep i am planning to implement the same.
On Mon, Mar 26, 2018 at 7:53 PM, Kostas Kloudas wrote:
> Hi Puneet,
>
> If you mean that after processing a file, you want to move it to another
> directory outside the one containing
> the data to be processed, then I
Hi Puneet,
If you mean that after processing a file, you want to move it to another
directory outside the one containing
the data to be processed, then I am afraid that this is currently not possible.
This is because the whole logic
of how to treat files is included in your FileInputFormat.
Hi Timo
FileInputFormat fileInputFormat = new TextInputFormat(new
Path(fileSystem+this.path));
fileInputFormat.setNestedFileEnumeration(true);
fileInputFormat.setFilesFilter(new UnicaFileFilter(".csv"));
DataStreamvalue =this.execEnv.readFile(fileInputFormat,
fileSystem+this.path,
F
Hi Puneet,
can you share a little code example with us? I could not reproduce your
problem.
You have to keep in mind that a setParallelism() only affects the last
operation. If you want to change the default parallelism of the entire
pipeline, you have to change it in StreamExecutionEnvironm
if i set parallelsim equals to 1 still it create multiple splits while
processing.
--
*Cheers *
*Puneet Kinra*
*Mobile:+918800167808 | Skype : puneet.ki...@customercentria.com
*
*e-mail :puneet.ki...@customercentria.com
*
