Hey folks This one is mainly aimed at the databricks folks, I have been trying to replicate the cloudtrail demo <https://www.youtube.com/watch?v=IJmFTXvUZgY> Micheal did at Spark Summit. The code for it can be found here <https://databricks-prod-cloudfront.cloud.databricks.com/public/4027ec902e239c93eaaa8714f173bcfc/8599738367597028/2070341989008532/3601578643761083/latest.html>
My question is how did you get the results to be displayed and updated continusly in real time I am also using databricks to duplicate it but I noticed the code link mentions "If you count the number of rows in the table, you should find the value increasing over time. Run the following every few minutes." This leads me to believe that the version of Databricks that Micheal was using for the demo is still not released, or at-least the functionality to display those changes in real time aren't Is this the case? or am I completely wrong? Can I display the results of a structured streaming query in realtime using the databricks "display" function? Regards Sam