Hi, Can you please see the query plan (in case you are using a query)?
There is a very high chance that the query was broken into multiple steps and only a subsequent step failed. Regards, Gourav Sengupta On Fri, Jun 17, 2016 at 2:49 PM, Sumona Routh <sumos...@gmail.com> wrote: > Hi there, > Our Spark job had an error (specifically the Cassandra table definition > did not match what was in Cassandra), which threw an exception that logged > out to our spark-submit log. > However ,the UI never showed any failed stage or job. It appeared as if > the job finished without error, which is not correct. > > We are trying to define our monitoring for our scheduled jobs, and we > intended to use the Spark UI to catch issues. Can we explain why the UI > would not report an exception like this? Is there a better approach we > should use for tracking failures in a Spark job? > > We are currently on 1.2 standalone, however we do intend to upgrade to 1.6 > shortly. > > Thanks! > Sumona >
