Re: Structured Streaming Spark Summit Demo - Databricks people

2017-02-16 Thread Sam Elamin
Thanks Micheal it really was a great demo I figured I needed to add a trigger to display the results. But Buraz from Databricks mentioned here that the display on this functionality wont be availab

Re: Structured Streaming Spark Summit Demo - Databricks people

2017-02-16 Thread Michael Armbrust
Thanks for your interest in Apache Spark Structured Streaming! There is nothing secret in that demo, though I did make some configuration changes in order to get the timing right (gotta have some dramatic effect :) ). Also I think the visualizations based on metrics output by the StreamingQueryLi

Re: Structured Streaming Spark Summit Demo - Databricks people

2017-02-15 Thread Sam Elamin
Fair enough your absolutely right Thanks for pointing me in the right direction On Wed, 15 Feb 2017 at 20:13, Nicholas Chammas wrote: > I don't think this is the right place for questions about Databricks. I'm > pretty sure they have their own website with a forum for questions about > their pro

Re: Structured Streaming Spark Summit Demo - Databricks people

2017-02-15 Thread Chris Fregly
Just be warned:  the last time I asked a question about a non-working Databricks Keynote Demo from Spark Summit on the forum mentioned here, they deleted my question!  And i’m a major contributor to those forums!! Often times, those on-stage demos don’t actually work until many months after the

Re: Structured Streaming Spark Summit Demo - Databricks people

2017-02-15 Thread Nicholas Chammas
I don't think this is the right place for questions about Databricks. I'm pretty sure they have their own website with a forum for questions about their product. Maybe this? https://forums.databricks.com/ On Wed, Feb 15, 2017 at 2:34 PM Sam Elamin wrote: > Hey folks > > This one is mainly aimed

Structured Streaming Spark Summit Demo - Databricks people

2017-02-15 Thread Sam Elamin
Hey folks This one is mainly aimed at the databricks folks, I have been trying to replicate the cloudtrail demo Micheal did at Spark Summit. The code for it can be found here