Re: weird error message

2017-04-26 Thread Jacek Laskowski
in-hadoop2.7/bin/pysark > > > > From: "Afshin, Bardia" > Date: Wednesday, April 26, 2017 at 9:47 AM > To: Jacek Laskowski > Cc: "user@spark.apache.org" > > > Subject: Re: weird error message > > > > Thanks for the hint, I don’t thin

Re: weird error message

2017-04-26 Thread Afshin, Bardia
To: Jacek Laskowski Cc: "user@spark.apache.org" Subject: Re: weird error message Thanks for the hint, I don’t think. I thought it’s a permission issue that it cannot read or write to ~/metastore_db but the directory is definitely there drwxrwx--- 5 ubuntu ubuntu 4.0K Apr 25 23:27 metast

Re: weird error message

2017-04-26 Thread Afshin, Bardia
pache.spark.sql.hive.HiveSessionState':" >>> ubuntu@:~/spark-2.1.0-bin-hadoop2.7$ ps aux | grep spark ubuntu 2796 0.0 0.0 10460 932 pts/0S+ 16:44 0:00 grep --color=auto spark From: Jacek Laskowski Date: Wednesday, April 26, 2017 at 12:51 AM To: "Afshin, Bardia

Re: weird error message

2017-04-26 Thread Jacek Laskowski
Hi, You've got two spark sessions up and running (and given Spark SQL uses Derby-managed Hive MetaStock hence the issue) Please don't start spark-submit from inside bin. Rather bin/spark-submit... Jacek On 26 Apr 2017 1:57 a.m., "Afshin, Bardia" wrote: I’m having issues when I fire up pyspar