I have also, similar scenario. Any suggestion would be appreciated. On Thu, Feb 4, 2016 at 10:29 AM Jeyhun Karimov <je.kari...@gmail.com> wrote:
> Hi Matthias, > > This need not to be necessarily in api functions. I just want to get a > roadmap to add this functionality. Should I save each window's data into > disk and create a new dataset environment in parallel? Or change trigger > functionality maybe? > > I have large windows. As I asked in previous question, in flink the > problem with large windows (that data inside windows may not fit in memory) > will be solved. So, after getting the data of window, I want to do more > than the functions in stream api. Therefore I need to convert it to > dataset. Any roadmap would be appreciated. > > On Thu, Feb 4, 2016 at 10:23 AM Matthias J. Sax <mj...@apache.org> wrote: > >> Hi Sane, >> >> Currently, DataSet and DataStream API a strictly separated. Thus, this >> is not possible at the moment. >> >> What kind of operation do you want to perform on the data of a window? >> Why do you want to convert the data into a data set? >> >> -Matthias >> >> On 02/04/2016 10:11 AM, Sane Lee wrote: >> > Dear all, >> > >> > I want to convert the data from each window of stream to dataset. What >> > is the best way to do that? So, while streaming, at the end of each >> > window I want to convert those data to dataset and possible apply >> > dataset transformations to it. >> > Any suggestions? >> > >> > -best >> > -sane >> >>
