It is more likely your spark configuration issue, could you run this code
in pyspark shell ?
Mauro Schneider 于2017年9月29日周五 下午11:24写道：
>
> Hi
>
> I'm trying execute PySpark code with Zeppelin and Livy but without
> success. With Scala and Livy work well but when I execute the code below I
> gett
Current behavior is as parallel as possible.
Run notebook button currently submits all paragraphs in a notebook into
each interpreter's own scheduler (FIFO, Parallel) at once. And each
individual scheduler of interpreter runs the paragraphs.
I think we can provide "sequential" run button for easie
What is the current behavior?
On Fri, Sep 29, 2017 at 6:56 AM, Herval Freire wrote:
> At least in our case, the notebooks that we need to run sequentially are
> expected to *always* run sequentially - thus it makes more sense to be a
> note option than a per-run mode
>
> H
>
> __
Hi
I'm trying execute PySpark code with Zeppelin and Livy but without success.
With Scala and Livy work well but when I execute the code below I getting a
Exception from Zeppelin.
%livy.pyspark
txtFile = sc.textFile ("/data/staging/zeppelin_test/data.txt")
counts = txtFile.flatMap(lambda line: l
At least in our case, the notebooks that we need to run sequentially are
expected to *always* run sequentially - thus it makes more sense to be a note
option than a per-run mode
H
_
From: moon soo Lee mailto:m...@apache.org>>
Sent: Thursday, September 28, 2017 9:03 P
even
frustrating, especially when ‘20170929-143857_1744629322’ names are involved.
Sergey Sotnichenko
From: Polyakov Valeriy [mailto:v.polja...@tinkoff.ru]
Sent: Friday, September 29, 2017 3:11 PM
To: users@zeppelin.apache.org
Subject: RE: Implementing run all paragraphs sequentially
This can
These are my findings:
I think I have found why the credentials are lost, I I think I might be
able to create a patched version that will work for us.Execution flow:
1. Spark job uses method run from ZeppelinContext.
2. The method run gets all the InterpreterContextRunner for a given
notebo
y complicated to be honest to build a DAG with names like
‘20170929-143857_1744629322’. Let’s imagine we have 20 paragraphs with such
names.
Sergey Sotnichenko
From: Jeff Zhang [mailto:zjf...@gmail.com<mailto:zjf...@gmail.com>]
Sent: Friday, September 29, 2017 2:35 PM
To: users@zeppelin.apache.
lationship between paragraphs, it is almost impossible to
> schedule paragraphs correctly.
>
>
>
>
> Sotnichenko Sergey 于2017年9月29日周五 下午7:45写道：
>
>> It would be very complicated to be honest to build a DAG with names like
>> ‘20170929-143857_1744629322’. Let
It would be very complicated to be honest to build a DAG with names like
> ‘20170929-143857_1744629322’. Let’s imagine we have 20 paragraphs with such
> names.
>
>
>
>
>
>
> *Sergey Sotnichenko *
>
>
>
>
>
> *From:* Jeff Zhang [mailto:zjf...@gmail.com]
&g
‘20170929-143857_1744629322’. Let’s imagine we have 20 paragraphs with such
names.
Sergey Sotnichenko
From: Jeff Zhang [mailto:zjf...@gmail.com]
Sent: Friday, September 29, 2017 2:35 PM
To: users@zeppelin.apache.org<mailto:users@zeppelin.apache.org>
Subject: Re: Implementing run all para
It would be very complicated to be honest to build a DAG with names like
‘20170929-143857_1744629322’. Let’s imagine we have 20 paragraphs with such
names.
Sergey Sotnichenko
From: Jeff Zhang [mailto:zjf...@gmail.com]
Sent: Friday, September 29, 2017 2:35 PM
To: users@zeppelin.apache.org
'p1', 'p2' is paragraphId. Regarding the readability, we could allow user
to set paragraph name, but this is another story, could be an improvement
later.
Partridge, Lucas (GE Aviation) 于2017年9月29日周五
下午7:30写道：
> Interesting idea. But by ‘p1’, ‘p2’, etc did you literally mean that; or
> were yo
Ok… so I have Nginx set up as a proxy in front of Zeppelin.
With nginx I have to enter my username and password that I set up with
htpasswd.
Then I’m seeing my Zeppelin where I have shiro still implemented. (So I can
have multiple users rather everyone running as anonymous.)
This may be a s
Interesting idea. But by ‘p1’, ‘p2’, etc did you literally mean that; or were
you using that as shorthand for the id of the paragraph?
If the former then what happens if someone inserts, deletes or reorders
paragraphs? But if the latter then the paragraph ids wouldn’t be very easy for
someone t
I don't think 2 note setting (parallel/sequential) is sufficient for
paragraph scheduling (take the spark tutorial note as an example, we should
run the loading bank data paragraph first and then could run all the sql
paragraph parallelly). So the key is how we define the dependency
relationship b
+1
I think this is one of the most important features. don't know why this
requirement has been skipped.
/afancy
On Thu, Sep 28, 2017 at 5:28 PM, Belousov Maksim Eduardovich <
m.belou...@tinkoff.ru> wrote:
> Hello, users!
>
> At the moment our analysts often use mixes of interpreters in their n
We've been needing this feature as well. Very frustrating the way it currently
works.
Get Outlook for Android
On Fri, Sep 29, 2017 at 12:04 AM -0400, "moon soo Lee" wrote:
This is going to be really useful!
Curios why do you prefer 'note option' instead of 'run option'?
Could
Hello,
I'm trying to set a paragraph text from within custom sink provider with
the following code:
val template ="%angular" +
"" +
"alert(123)" +
""
val pid ="20170928-133811_1295405352" z.put(pid, template)
z.run(pid)
The paragraph run successfully but the content is not set. The shir
19 matches
Mail list logo
