Re: Unable to run simple programs with local spark + Zeppelin on widnows 10

2018-08-20 Thread Xi Shen
The error says it cannot find "C:\installedsoftwares\spark-2.2.0-bin-hadoop2.7\bin\spark-submit2.cmd". Please check the PATH environment variable on your Windows system. Xi Shen about.me/davidshen On Sun, Aug 12, 2018 at 3:21 PM Divya Gehlot wrote: > > Hi , > I am getting bel

Re: How to make Zeppelin log everything to console

2016-10-21 Thread Xi Shen
DEBUG,console,file > log4j.appender.console=org.apache.log4j.ConsoleAppender > log4j.appender.file=org.apache.log4j.RollingFileAppender > > > On Friday, 21 October 2016, Xi Shen wrote: > > Hi, > > Currently, the default log4j logs almost everything to the log files. But > I do not want t

How to make Zeppelin log everything to console

2016-10-21 Thread Xi Shen
Hi, Currently, the default log4j logs almost everything to the log files. But I do not want to run Zeppelin as a service, and I want to print all the logs, including the interpreter logs to the console. Can I do that with log4j configuration? Which class should I use? -- Thanks, David S.

Re: Zeppelin 0.6.1 not connecting to Spark 2.0 on Windows

2016-10-14 Thread Xi Shen
Hi, By "local Spark 2.0 instance", did you mean a standalone cluster on your local? So you updated the "master", and "deploy-mode" interpreter configuration? I had this problem as well. But I found if you set the "spark.executor.memory" to "512m", and make sure your machine has sufficient physica

Re: ClassNotFoundException when using %jdbc(hive)

2016-10-14 Thread Xi Shen
Yes, I think JRE is not able do pull dependencies. That's why I found the dependency configuration did not take effect. On Fri, Oct 14, 2016 at 2:50 PM Jongyoul Lee wrote: > Hi, > > Did you solve it by installing JDK? > > On Thu, Oct 13, 2016 at 8:44 PM, Xi Shen wrote: >

ConcurrentModificationException when trying to create JDBC interpreter

2016-10-13 Thread Xi Shen
Hi, I caught this error when trying to using JDBC to query my Hive. With the same environment setting, I was able to connect to my Hive and query tables, create tables, etc..So I think the problem is not related to my environment. I created ticket https://issues.apache.org/jira/browse/ZEPPELIN-15

Re: ClassNotFoundException when using %jdbc(hive)

2016-10-13 Thread Xi Shen
Turns out I need JDK, but I only install JRE... On Wed, Oct 12, 2016 at 3:25 PM Xi Shen wrote: > Here's the log http://pastie.org/private/nem2pur2tl3adgbrv4hl2g > > I did a test. I copied the jar file to ./interpreter/jdbc, the execute the > same command. This I got another

Re: Spark got java.net.ConnectException: Connection refused

2016-10-12 Thread Xi Shen
Turns out a port was blocked...nvm On Wed, Oct 12, 2016 at 3:43 PM Xi Shen wrote: > Hi, > > I configured my Spark in Zeppelin to use a remote YARN cluster. I set the > "master=yarn" and "deploy-mode=client". Then I started playing some spark > command. Every

Re: zeppelin with spark 2.0.1

2016-10-12 Thread Xi Shen
java.net.ConnectException: Connection refused is a clear sign of network issue. What is your network topology like? Maybe you want to check the firewall settings. On Thu, Oct 13, 2016 at 6:43 AM Mich Talebzadeh wrote: > what have you defined your export MASTER= > > and > > export SPARK_HOME= >

Spark got java.net.ConnectException: Connection refused

2016-10-12 Thread Xi Shen
Hi, I configured my Spark in Zeppelin to use a remote YARN cluster. I set the "master=yarn" and "deploy-mode=client". Then I started playing some spark command. Everything looks good. I can see the new Spark application in the YARN RM page, and I can see the Spark UI page. But after some time, wh

Re: ClassNotFoundException when using %jdbc(hive)

2016-10-12 Thread Xi Shen
But there's no error either. Please help~ On Wed, Oct 12, 2016 at 1:02 PM Xi Shen wrote: Hi, I followed https://zeppelin.apache.org/docs/0.6.1/interpreter/jdbc.html, and added two artifacts: - org.apache.hive:hive-jdbc:2.1.0 - org.apache.hadoop:hadoop-common:2.7.3 Then I tried thi

ClassNotFoundException when using %jdbc(hive)

2016-10-11 Thread Xi Shen
Hi, I followed https://zeppelin.apache.org/docs/0.6.1/interpreter/jdbc.html, and added two artifacts: - org.apache.hive:hive-jdbc:2.1.0 - org.apache.hadoop:hadoop-common:2.7.3 Then I tried this: %jdbc(hive) show tables But I got this error: org.apache.hive.jdbc.HiveDriver class java.lan

Re: How to connect to a remote YARN cluster?

2016-10-09 Thread Xi Shen
hich process you are using, can > you kill these processes and rerun again ? > > And are you sure you put hadoop conf files under /opt/hadoop/conf/ ? > > On Sun, Oct 9, 2016 at 3:14 PM, Xi Shen wrote: > > > ps aux | grep RemoteInterpreterServer > > root71 0.

Re: How to connect to a remote YARN cluster?

2016-10-09 Thread Xi Shen
Run the following command: > > ps aux | grep RemoteInterpreterServer > > On Sun, Oct 9, 2016 at 2:36 PM, Xi Shen wrote: > > Hi, > > I followed http://zeppelin.apache.org/docs/latest/interpreter/spark.html, > and set up SPARK_HOME, HADOOP_CONF_DIR. > > My SPARK b

How to connect to a remote YARN cluster?

2016-10-08 Thread Xi Shen
Hi, I followed http://zeppelin.apache.org/docs/latest/interpreter/spark.html, and set up SPARK_HOME, HADOOP_CONF_DIR. My SPARK build is 2.0. My Zeppelin build is the 0.6.1 binary from the web. After I start Zeppelin, I went to the interpreter setting page and changed Spark interpreter settings a

Re: Matplotlib uses tkinter instead of Agg

2016-09-21 Thread Xi Shen
interested, you may take a look at https://hub.docker.com/r/davidshen84/zeppelin/ On Sat, Sep 17, 2016 at 6:01 PM Xi Shen wrote: > I think it has nothing to do with docker. It relates to the matploblib > settings. I don't know why, but in some other cases, I found matplotlib > will u

Re: Matplotlib uses tkinter instead of Agg

2016-09-17 Thread Xi Shen
gt;> File "/usr/lib/pymodules/python2.7/matplotlib/pyplot.py", line 450, in gcf >> return figure() >> File "/usr/lib/pymodules/python2.7/matplotlib/pyplot.py", line 423, in >> figure >> **kwargs) >> File "/usr/lib/pymodules/python2.7/matplotlib/backe

Re: Matplotlib uses tkinter instead of Agg

2016-09-16 Thread Xi Shen
given_figure(num, figure) > File "/usr/lib/pymodules/python2.7/matplotlib/backends/backend_tkagg.py", > line 87, in new_figure_manager_given_figure > window = Tk.Tk() > File "/usr/lib/python2.7/lib-tk/Tkinter.py", line 1767, in __init__ > self.tk = _tkinter.create(scre

Re: Matplotlib uses tkinter instead of Agg

2016-09-14 Thread Xi Shen
, x = np.linspace(-2,2,1000) with both python2 and > python3 in %python interpreter. I don't have any problem. > > > On Wed, Sep 14, 2016 at 3:12 AM Xi Shen wrote: > >> OK, for this problem, it is discussed at >> https://stackoverflow.com/questions/15538099/conversion-of

Re: Matplotlib uses tkinter instead of Agg

2016-09-14 Thread Xi Shen
['axes.unicode_minus'] = True. Can you guys please check if this only happens to a Python3 environment? I don't think I am the first one hit this problem. On Wed, Sep 14, 2016 at 5:49 PM Xi Shen wrote: > Hi, > > I worked it out...So I have start a new instance of Zeppelin...creati

Re: Matplotlib uses tkinter instead of Agg

2016-09-14 Thread Xi Shen
Tuesday, September 13, 2016 2:34 PM > Subject: Re: Matplotlib uses tkinter instead of Agg > To: > > > > Hi, > > Thanks for sharing the problem. > Could you share which version of Zeppelin are you using and how did you > try matplotlib inside of Zeppelin? Are you trying

Matplotlib uses tkinter instead of Agg

2016-09-13 Thread Xi Shen
Hi, I want to build a Zeppelin docker image for my self. The docker image is based on ubuntu:wily, and has openjdk-8-jre and python3 installed. I also installed other packages that I need. After started Zeppelin in the docker, I am able to access the webapp from my local browser. I tried to execu