Just be warned: the last time I asked a question about a non-working Databricks Keynote Demo from Spark Summit on the forum mentioned here, they deleted my question! And i’m a major contributor to those forums!!
Often times, those on-stage demos don’t actually work until many months after they’re presented on stage - especially the proprietary demos involving dbutils() and display(). Chris Fregly Research Scientist @ PipelineIO Founder @ Advanced Spark and TensorFlow Meetup San Francisco - Chicago - Washington DC - London On Feb 15, 2017, 12:14 PM -0800, Nicholas Chammas <nicholas.cham...@gmail.com>, wrote: > I don't think this is the right place for questions about Databricks. I'm > pretty sure they have their own website with a forum for questions about > their product. > > Maybe this? https://forums.databricks.com/ > > > On Wed, Feb 15, 2017 at 2:34 PM Sam Elamin <hussam.ela...@gmail.com> wrote: > > > Hey folks > > > > > > This one is mainly aimed at the databricks folks, I have been trying to > > > replicate the cloudtrail demo Micheal did at Spark Summit. The code for > > > it can be found here > > > > > > My question is how did you get the results to be displayed and updated > > > continusly in real time > > > > > > I am also using databricks to duplicate it but I noticed the code link > > > mentions > > > > > > "If you count the number of rows in the table, you should find the value > > > increasing over time. Run the following every few minutes." > > > This leads me to believe that the version of Databricks that Micheal was > > > using for the demo is still not released, or at-least the functionality > > > to display those changes in real time aren't > > > > > > Is this the case? or am I completely wrong? > > > > > > Can I display the results of a structured streaming query in realtime > > > using the databricks "display" function? > > > > > > > > > Regards > > > Sam