Re: Dataset output callback

2015-05-27 Thread Flavio Pompermaier
I'll look into that! Thanks for the moment On Wed, May 27, 2015 at 9:24 AM, Stephan Ewen wrote: > If you just want to do something after the job finishes, just put the > finalization code after the call to "execute()": > > env.execute(); > myCustomOutputFinalization(); > > If you want each paral

Re: Dataset output callback

2015-05-27 Thread Stephan Ewen
If you just want to do something after the job finishes, just put the finalization code after the call to "execute()": env.execute(); myCustomOutputFinalization(); If you want each parallel output to do something after it finished, then override the "close()" method of the OutputFormat. To have

Re: Dataset output callback

2015-05-26 Thread Flavio Pompermaier
Any insight about this? On Tue, May 26, 2015 at 5:58 PM, Flavio Pompermaier wrote: > Hi to all, > > In my program I'd like to infer from a mysql table the list of directory I > have to output on hdfs (status=0). > Once my job finish to clean each directory and update the status value of > my sql

Dataset output callback

2015-05-26 Thread Flavio Pompermaier
Hi to all, In my program I'd like to infer from a mysql table the list of directory I have to output on hdfs (status=0). Once my job finish to clean each directory and update the status value of my sql table. How can I do that in Flink? Is there any callback on the dataset.output() finish? Best,