Hey Guys, I've noticed that the time elapsed section at the end of a cell, the Took x seconds doesn't always reconcile with the time elapsed in the application master of Spark - particularly when two cells are executed in sequence.
I'm using Zeppelin 0.55 with Spark 1.5.2 and these errors are appearing on the Spark interpreter. It appears that the latest cell is bringing the sum of the previous cell into the execution time. An example is below where Cell 1 reconciles with Spark but the following cells add the previous time elapsed to their time taken. Cell 1 Zeppelin Time (%sql query 1) [cid:image001.png@01D15438.4757C050] YARN Time [cid:image002.png@01D15438.4757C050] Cell 2 (%sql query 1 again, should be 28 seconds) Zeppelin Time [cid:image003.png@01D15438.4757C050] YARN Time [cid:image004.png@01D15438.4757C050] Cell 3 (blank cell) Zeppelin Time [cid:image005.png@01D15438.BF1EE5F0] YARN Time Obviously 0 as there wasn't a query being run Is this a known issue or should I raise a bug? Cheers, Joel Joel Van Veluwen QUANTIUM Level 25, 8 Chifley 8-12 Chifley Square Sydney NSW 2000 T: +61 2 8224 8981 M: +61 403 153 265 F: +61 2 9292 6444 W: quantium.com.au<http://www.quantium.com.au> ________________________________ linkedin.com/company/quantium<http://www.linkedin.com/company/quantium> facebook.com/QuantiumAustralia<http://www.facebook.com/QuantiumAustralia> twitter.com/QuantiumAU<http://www.twitter.com/QuantiumAU> The contents of this email, including attachments, may be confidential information. If you are not the intended recipient, any use, disclosure or copying of the information is unauthorised. If you have received this email in error, we would be grateful if you would notify us immediately by email reply, phone (+ 61 2 9292 6400) or fax (+ 61 2 9292 6444) and delete the message from your system.
