Re: New Spark json endpoints

2015-09-17 Thread Kevin Chen
e.org" , Matt Cheah , Mingyu Kim Subject: Re: New Spark json endpoints While we're at it, adding endpoints that get results by jobGroup (cf. SparkContext#setJobGroup) instead of just for a single Job would also be very useful to some of us. On Thu, Sep 17, 2015 at 7:30 AM, Imran Rashid wr

Re: New Spark json endpoints

2015-09-17 Thread Mark Hamstra
case there were any thoughts. >> Having all the information from the web UI accessible through a supported >> json API is very important to us; are there any objections to us adding a >> v2 API to Spark? >> >> Thanks! >> >> From: Kevin Chen >> D

Re: New Spark json endpoints

2015-09-17 Thread Imran Rashid
rg" > Cc: Matt Cheah , Mingyu Kim > Subject: New Spark json endpoints > > Hello Spark Devs, > > I noticed that [SPARK-3454], which introduces new json endpoints at > /api/v1/[path] for information previously only shown on the web UI, does > not expose several useful pro

Re: New Spark json endpoints

2015-09-16 Thread Reynold Xin
on API is very important to us; are there any objections to us adding a > v2 API to Spark? > > Thanks! > > From: Kevin Chen > Date: Friday, September 11, 2015 at 11:30 AM > To: "dev@spark.apache.org" > Cc: Matt Cheah , Mingyu Kim > Subject: New Spark json endpo

Re: New Spark json endpoints

2015-09-16 Thread Kevin Chen
, 2015 at 11:30 AM To: "dev@spark.apache.org" Cc: Matt Cheah , Mingyu Kim Subject: New Spark json endpoints Hello Spark Devs, I noticed that [SPARK-3454], which introduces new json endpoints at /api/v1/[path] for information previously only shown on the web UI, does not expose seve

New Spark json endpoints

2015-09-11 Thread Kevin Chen
Hello Spark Devs, I noticed that [SPARK-3454], which introduces new json endpoints at /api/v1/[path] for information previously only shown on the web UI, does not expose several useful properties about Spark jobs that are exposed on the web UI and on the unofficial /json endpoint. Specific exam