Re: sessionState could not be accessed in spark-shell command line

2017-09-06 Thread ChenJun Zou
I am examined the code and found lazy val is added recently in 2.2.0 2017-09-07 14:34 GMT+08:00 ChenJun Zou : > thanks, > my mistake > > 2017-09-07 14:21 GMT+08:00 sujith chacko : > >> If your intention is to just view the logical plan in spark shell then I >> thi

Re: sessionState could not be accessed in spark-shell command line

2017-09-06 Thread ChenJun Zou
gt; > Thanks. > > > On Thu, 7 Sep 2017 at 11:39 AM, ChenJun Zou wrote: > >> spark-2.1.1 I use >> >> >> >> 2017-09-07 14:00 GMT+08:00 sujith chacko : >> >>> Hi, >>> may I know which version of spark you are using, in 2.2 I tried

Re: sessionState could not be accessed in spark-shell command line

2017-09-06 Thread ChenJun Zou
from table1") > > The above query you can use for seeing logical plan. > > Thanks, > Sujith > > On Thu, 7 Sep 2017 at 11:03 AM, ChenJun Zou wrote: > >> Hi, >> >> when I use spark-shell to get the logical plan of sql, an error occurs >> >>

sessionState could not be accessed in spark-shell command line

2017-09-06 Thread ChenJun Zou
Hi, when I use spark-shell to get the logical plan of sql, an error occurs scala> spark.sessionState :30: error: lazy value sessionState in class SparkSession cannot be accessed in org.apache.spark.sql.SparkSession spark.sessionState ^ But if I use spark-submit to access the