[ https://issues.apache.org/jira/browse/HIVE-9428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288619#comment-14288619 ]
Rui Li commented on HIVE-9428: ------------------------------ And some examples when we need to check the future instead of SparkJobInfo: [~chengxiang li] mentioned that if a spark job's resource data is empty, the job may not be submitted at all so we won't get a SparkJobInfo. I also noticed if something goes wrong during submission, we won't get a SparkJobInfo. > LocalSparkJobStatus may return failed job as successful [Spark Branch] > ---------------------------------------------------------------------- > > Key: HIVE-9428 > URL: https://issues.apache.org/jira/browse/HIVE-9428 > Project: Hive > Issue Type: Sub-task > Components: Spark > Reporter: Rui Li > Assignee: Rui Li > Priority: Minor > Attachments: HIVE-9428.1-spark.patch, HIVE-9428.2-spark.patch > > > Future is done doesn't necessarily mean the job is successful. We should rely > on SparkJobInfo to get job status whenever it's available. -- This message was sent by Atlassian JIRA (v6.3.4#6332)