Re: [spark structured streaming runner] available on master

2019-11-20 Thread Kai Jiang
Cool, cool! Love to see Nexmark on Spark structured streaming runner perfkit dashboard On Wed, Nov 20, 2019 at 2:12 PM Pablo Estrada wrote: > Very cool! : ) Thanks to everyone involved moving this forward. > Best > -P. > > On Wed, Nov 20, 2019 at 8:50 AM Etienne Chauchot > wrote: > >> Forgot to

Re: [spark structured streaming runner] available on master

2019-11-20 Thread Pablo Estrada
Very cool! : ) Thanks to everyone involved moving this forward. Best -P. On Wed, Nov 20, 2019 at 8:50 AM Etienne Chauchot wrote: > Forgot to say thanks everyone for their contribution to this especially > Alexey, Ryan and Ismael. > > Etienne > On 20/11/2019 17:12, Etienne Chauchot wrote: > > Hi

Re: [spark structured streaming runner] available on master

2019-11-20 Thread Etienne Chauchot
Forgot to say thanks everyone for their contribution to this especially Alexey, Ryan and Ismael. Etienne On 20/11/2019 17:12, Etienne Chauchot wrote: Hi all, I'm glad to announce that the new Spark runner based on Spark structured streaming framework has been merged into master ! It is not

[spark structured streaming runner] available on master

2019-11-20 Thread Etienne Chauchot
Hi all, I'm glad to announce that the new Spark runner based on Spark structured streaming framework has been merged into master ! It is not based on RDD/DStream API. See https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html It is still experimental, its coverage