Hi Joel, This happens because Zeppelin misdefine job start time as job submission time. And Zeppelin's elapsed time can be few seconds longer than Yarn's elapsed time because Zeppelin needs few more seconds to communicate with spark and to render the result on web brower.
Please feel free to make an issue in JIRA. On Wed, Jan 20, 2016 at 3:44 PM, Joel Van Veluwen < joel.vanvelu...@quantium.com.au> wrote: > Hey Guys, > > > > I’ve noticed that the time elapsed section at the end of a cell, the *Took > x seconds* doesn’t always reconcile with the time elapsed in the > application master of Spark – particularly when two cells are executed in > sequence. > > > > I’m using Zeppelin 0.55 with Spark 1.5.2 and these errors are appearing on > the Spark interpreter. > > > > It appears that the latest cell is bringing the sum of the previous cell > into the execution time. An example is below where Cell 1 reconciles with > Spark but the following cells add the previous time elapsed to their time > taken. > > > > *Cell 1 * > > > > *Zeppelin Time (%sql query 1)* > > *YARN Time* > > > > *Cell 2 (%sql query 1 again, should be 28 seconds)* > > > > > > *Zeppelin Time* > > *YARN Time* > > > > *Cell 3 (blank cell)* > > > > *Zeppelin Time* > > *YARN Time* > > Obviously 0 as there wasn’t a query being run > > > > Is this a known issue or should I raise a bug? > > > > Cheers, > > > > Joel > > > > Joel Van Veluwen > *QUANTIUM* > Level 25, 8 Chifley > 8-12 Chifley Square > Sydney NSW 2000 > > T: +61 2 8224 8981 > M: +61 403 153 265 > F: +61 2 9292 6444 > > W: quantium.com.au <http://www.quantium.com.au> > ------------------------------ > > linkedin.com/company/quantium <http://www.linkedin.com/company/quantium> > facebook.com/QuantiumAustralia <http://www.facebook.com/QuantiumAustralia> > twitter.com/QuantiumAU <http://www.twitter.com/QuantiumAU> > > The contents of this email, including attachments, may be confidential > information. If you are not the intended recipient, any use, disclosure or > copying of the information is unauthorised. If you have received this email > in error, we would be grateful if you would notify us immediately by email > reply, phone (+ 61 2 9292 6400) or fax (+ 61 2 9292 6444) and delete the > message from your system. > > >
