Just keep in mind that rest-api needs to be called from driver ui endpoint and not from Spark/Master UI.
On Wed, Dec 7, 2016 at 12:03 PM, Richard Startin <[email protected] > wrote: > Ok it looks like I could reconstruct the logic in the Spark UI from the > /jobs resource. Thanks. > > > https://richardstartin.com/ > > > ------------------------------ > *From:* map reduced <[email protected]> > *Sent:* 07 December 2016 19:49 > *To:* Richard Startin > *Cc:* [email protected] > *Subject:* Re: Spark streaming completed batches statistics > > Have you checked http://spark.apache.org/docs/latest/monitoring. > html#rest-api ? > > KP > > On Wed, Dec 7, 2016 at 11:43 AM, Richard Startin < > [email protected]> wrote: > >> Is there any way to get this information as CSV/JSON? >> >> >> https://docs.databricks.com/_images/CompletedBatches.png >> >> >> https://richardstartin.com/ >> >> >> ------------------------------ >> *From:* Richard Startin <[email protected]> >> *Sent:* 05 December 2016 15:55 >> *To:* [email protected] >> *Subject:* Spark streaming completed batches statistics >> >> Is there any way to get a more computer friendly version of the completes >> batches section of the streaming page of the application master? I am very >> interested in the statistics and am currently screen-scraping... >> >> https://richardstartin.com >> --------------------------------------------------------------------- >> To unsubscribe e-mail: [email protected] >> >> >
