Good job! =) Congrats to all who was involved to move this forward! Btw, for all who is interested in a progress of work on this runner, I wanted to remind that we have #beam-spark channel on Slack where we discuss all ongoing questions. Feel free to join!
Alexey > On 21 Mar 2019, at 15:51, Jean-Baptiste Onofré <j...@nanthrax.net> wrote: > > Congrats and huge thanks ! > > (I'm glad to be one of the little "launcher" to this effort ;) ) > > Regards > JB > > On 21/03/2019 15:47, Ismaël Mejía wrote: >> This is excellent news. Congrats Etienne, Alexey and the others >> involved for the great work! >> On Thu, Mar 21, 2019 at 3:10 PM Etienne Chauchot <echauc...@apache.org> >> wrote: >>> >>> Hi guys, >>> >>> We are glad to announce that the spark runner POC that was re-written from >>> scratch using the structured-streaming framework and the dataset API can >>> now run WordCount ! >>> >>> It is still embryonic. For now it only runs in batch mode and there is no >>> fancy stuff like state, timer, SDF, metrics, ... but it is still a major >>> step forward ! >>> >>> Streaming support work has just started. >>> >>> You can find the branch here: >>> https://github.com/apache/beam/tree/spark-runner_structured-streaming >>> >>> Enjoy, >>> >>> Etienne >>> >>>
