I added two comments to the pull request that this is based on... On Fri, Oct 2, 2015 at 2:47 PM, Robert Metzger <rmetz...@apache.org> wrote:
> I suspect: "- Deletion of "DataSet.forward() and .global()"" is a typo, you > meant DataStream ? > > On Fri, Oct 2, 2015 at 2:44 PM, Kostas Tzoumas <ktzou...@apache.org> > wrote: > > > Oh, and of course, support for event time. I might be forgetting more, > feel > > free to add to the list > > > > > > On Fri, Oct 2, 2015 at 2:40 PM, Kostas Tzoumas <ktzou...@apache.org> > > wrote: > > > > > Hi folks, > > > > > > Currently, Aljoscha, Stephan, and I are reworking the DataStream API as > > > discussed before. Things are a bit in-flight right now with several > > commits > > > and pull requests, and the current master containing code from both the > > old > > > and the new API. > > > > > > I want to give you an idea of how the new API will look like. This is a > > > very rough draft of the new documentation page (also a WiP): > > > > > > > > > https://www.dropbox.com/sh/t5nvlx7meadppnp/AAD5sEIH5S3QNYTiMsyE9KBva?dl=0 > > > > > > Compared to the current API, the major changes include: > > > > > > - Different syntax (and implementation) for windows. Old constructs > will > > > be replaced by the new ones. The new syntax resembles Google's Dataflow > > > model, but contains "shortcuts" as syntactic sugar for common cases > > > > > > - Different syntax (and implementation) of "grouping". New terminology > > > will be KeyedDataStream (and "keyBy") which will replace > > GroupedDataStream. > > > > > > - Reduced functionality in ConnectedDataStream - only map and flatMap > > > > > > - New syntax (and implementation) for window joins, removal of cross > > > > > > - No changes in iterations besides deleting the "long milliseconds" > > > argument > > > > > > - No changes in state > > > > > > - Deletion of "DataSet.forward() and .global()" > > > > > > - Windows can only come after keyBy, otherwise they are DOP-1 operators > > > and are defined as "windowAll" > > > > > > Best, > > > Kostas > > > > > >
