RE: Is any limitation of maximum interpreter processes?

2017-10-03 Thread Belousov Maksim Eduardovich
> Which interpreter is pending ? There comes a time when any paragraph with any interpreter doesn't run and remains in 'Pending' state. We use local spark instances in spark interpretator. Logs don't contain errors. Максим Белоусов Архитектор Отдел отчетности и витрин данных Управление хранилищ

Re: How to execute spark-submit on Note

2017-10-03 Thread Jianfeng (Jeff) Zhang
I am surprised why would you use %spark-submit, there’s no document about %spark-submit. If you want to use spark-submit in zeppelin, then you could use %sh Best Regard, Jeff Zhang From: 小野圭二 mailto:onoke...@gmail.com>> Reply-To: "users@zeppelin.apache.org

Re: How to execute spark-submit on Note

2017-10-03 Thread 小野圭二
Thank you for your reply, Jeff "%sh" ? "sh" seems like request something execution code. I tried "%sh", then %sh %sh bash: : no permission I made binary file from .py to .pyc, but the answer was as same. I am sorry seems like doubting you, but Is "%sh" the resolution? -Keiji 2017-10-03

Re: How to execute spark-submit on Note

2017-10-03 Thread Jeff Zhang
%sh is shell interpreter, you can run spark-submit just as you run it in shell terminal. 小野圭二 于2017年10月3日周二 下午4:58写道: > Thank you for your reply, Jeff > > "%sh" ? > "sh" seems like request something execution code. > I tried "%sh", then > > %sh > %sh bash: : no permission > > I made binary

Re: How to execute spark-submit on Note

2017-10-03 Thread 小野圭二
Thank you for your quick reply again, Jeff. Yes i know the difference of the execution environment between "%sh" and ">spark-submit". And my question was "how to execute spark-submit as shell interpreter". That mean, i am searching how to execute a binary program from a note of zeppelin. This time

RE: How to execute spark-submit on Note

2017-10-03 Thread David Howell
Hi Keiji, In the paragraph you would write: %sh spark-submit myapp.jar ... The %sh interpreter is a shell, and runs as the zeppelin service user with whatever permissions it has. You can run any shell commands in it. Although, this is a fairly strange way to run zeppelin so I’m not really sure

Re: How to execute spark-submit on Note

2017-10-03 Thread 小野圭二
Hi Dave, Thank You for your suggestion. It worked fine order by my expectation so far. I did not know "%sh" could use like that. Anyhow, i would like to explain why i would like to execute "spark-submit" in a note, to be clear your wondering. Yes, i know the basic instruction of Zeppelin as You e

question about how to update zeppelin interpreters.

2017-10-03 Thread Jeffrey Rodriguez
Hi folks, I would like to upgrade the zeppelin interpreter properties programmatically. I found two ways. 1. Update the conf/interpreters.json 2. User the interpreter REST API. My question is, should users/developers update the interpreter directly? id values for interpreters are like "2CVTZCC