Re: Spark driver main thread hanging after SQL insert

2015-01-02 Thread Alessandro Baretta
Patrick, Sure. I was interested in knowing if anyone experienced a similar issue and whether there was any known workaround. Anyway will report on JIRA. Alex On Jan 2, 2015 9:13 AM, "Patrick Wendell" wrote: > Hi Alessandro, > > Can you create a JIRA for this rather than reporting it on the dev

Re: Spark driver main thread hanging after SQL insert

2015-01-02 Thread Patrick Wendell
Hi Alessandro, Can you create a JIRA for this rather than reporting it on the dev list? That's where we track issues like this. Thanks!. - Patrick On Wed, Dec 31, 2014 at 8:48 PM, Alessandro Baretta wrote: > Here's what the console shows: > > 15/01/01 01:12:29 INFO scheduler.TaskSchedulerImpl:

Spark driver main thread hanging after SQL insert

2014-12-31 Thread Alessandro Baretta
Here's what the console shows: 15/01/01 01:12:29 INFO scheduler.TaskSchedulerImpl: Removed TaskSet 58.0, whose tasks have all completed, from pool 15/01/01 01:12:29 INFO scheduler.DAGScheduler: Stage 58 (runJob at ParquetTableOperations.scala:326) finished in 5493.549 s 15/01/01 01:12:29 INFO sche