Hi, How do you access Cassandra? Could that connector not have sent a SparkListenerEvent to inform about failure?
Jacek On 17 Jun 2016 3:50 p.m., "Sumona Routh" <sumos...@gmail.com> wrote: > Hi there, > Our Spark job had an error (specifically the Cassandra table definition > did not match what was in Cassandra), which threw an exception that logged > out to our spark-submit log. > However ,the UI never showed any failed stage or job. It appeared as if > the job finished without error, which is not correct. > > We are trying to define our monitoring for our scheduled jobs, and we > intended to use the Spark UI to catch issues. Can we explain why the UI > would not report an exception like this? Is there a better approach we > should use for tracking failures in a Spark job? > > We are currently on 1.2 standalone, however we do intend to upgrade to 1.6 > shortly. > > Thanks! > Sumona >
