Zepplin 0.7.3 DEBUG console output, how do I switch it off!!! Spark 2.2.0-bin-hadoop2.7

2017-10-12 Thread amersh...@gmail.com
Hello there I have installed Spark 2.20 and from the spark-shell, my scala code works perfectly and performs well. The same scala executed from Zeppelin causes lots of DEBUG statements to be printed in the console (almost non-stop) and the performance is very slow. I have just installed binari

Re: Zepplin 0.7.3 DEBUG console output, how do I switch it off!!! Spark 2.2.0-bin-hadoop2.7

2017-10-12 Thread amersh...@gmail.com
On 2017-10-12 10:41, "amersh...@gmail.com" wrote: > Hello there > > I have installed Spark 2.20 and from the spark-shell, my scala code works > perfectly and performs well. > > The same scala executed from Zeppelin causes lots of DEBUG statements to be > pri

Re: Zepplin 0.7.3 DEBUG console output, how do I switch it off!!! Spark 2.2.0-bin-hadoop2.7

2017-10-16 Thread amersh...@gmail.com
2017 at 12:15 AM > >> To: "users@zeppelin.apache.org" > >> Subject: Re: Zepplin 0.7.3 DEBUG console output, how do I switch it > >> off!!! Spark 2.2.0-bin-hadoop2.7 > >> > >> Hi there > >> > >> Please see the console output > >

PLEASE HELP: Spark query through Zeppelin 0.7.3 runs so much slower than the same query through spark-shell

2017-10-16 Thread amersh...@gmail.com
Hello there This questions relates to a previous query. Im filtering a single row from a 5 million row dataframe. Through Zeppelin the query takes 7minutes. Through spark-shell, it takes 1.5minutes. I need help with this to see why the Zeppelin query is taking a much slower path. Please help