tor | Macro Technology | 545 Washington Blvd, Floor 4 |
Jersey City, NJ 07310
From: Katz, David L (CIB Tech, USA)
Sent: Friday, March 03, 2023 11:25 AM
To: user
Subject: aws zeppelin glue table connector
Hi-
Hoping someone can give me more understanding and a sense of timing flink
leveraging
Hi-
Hoping someone can give me more understanding and a sense of timing flink
leveraging glue tables. Specifically I would like to leverage a glue table
data source via an AWS hosted Zeppelin notebook (instead of referencing a
kinesis data stream or s3 bucket directly). Additionally I will
Cool, thanks for letting us know Jeff. Hopefully, many users use Zeppelin
together with Flink.
Cheers,
Till
On Thu, Aug 26, 2021 at 4:47 AM Leonard Xu wrote:
> Thanks Jeff for the great work !
>
> Best,
> Leonard
>
> 在 2021年8月25日，22:48，Jeff Zhang 写道：
>
> Hi Flink
Thanks Jeff for the great work !
Best,
Leonard
> 在 2021年8月25日，22:48，Jeff Zhang 写道：
>
> Hi Flink users,
>
> We (Zeppelin community) are very excited to announce Zeppelin 0.10.0 is
> officially released. In this version, we made several improvements on Flink
> interpre
Hi Flink users,
We (Zeppelin community) are very excited to announce Zeppelin 0.10.0 is
officially released. In this version, we made several improvements on Flink
interpreter. Here's the main features of Flink on Zeppelin:
- Support multiple versions of Flink
- Support multiple ver
Hi flink folks,
I'd like to tell you that Zeppelin 0.9.0 is officially released, in this
new version we made a big refactoring and improvement on flink support. It
supports 3 major versions of flink (1.10, 1.11, 1.12)
You can download zeppelin 0.9.0 here.
http://zeppelin.apache.org/download
Thanks Jeff very much, that is very impressive.
Zeppelin is very convenient development platform.
Best,
Jingsong Lee
On Tue, Mar 31, 2020 at 11:58 AM Zhijiang
wrote:
>
> Thanks for the continuous efforts for engaging in Flink ecosystem Jeff!
> Glad to see the progressive achievem
Zhang
Cc:user ; dev
Subject:Re: [ANNOUNCE] Flink on Zeppelin (Zeppelin 0.9 is released)
Hi Jeff,
Thanks for the great work and sharing it with the community! Very impressive
and will try it out.
Regards,
Dian
在 2020年3月30日，下午9:16，Till Rohrmann 写道：
This is great news Jeff! Thanks a lot for
Hi Jeff,
Thanks for the great work and sharing it with the community! Very impressive
and will try it out.
Regards,
Dian
> 在 2020年3月30日，下午9:16，Till Rohrmann 写道：
>
> This is great news Jeff! Thanks a lot for sharing it with the community.
> Looking forward trying Flink on
This is great news Jeff! Thanks a lot for sharing it with the community.
Looking forward trying Flink on Zeppelin out :-)
Cheers,
Till
On Mon, Mar 30, 2020 at 2:47 PM Jeff Zhang wrote:
> Hi Folks,
>
> I am very excited to announce the integration work of flink on apache
> zeppelin
Hi Folks,
I am very excited to announce the integration work of flink on apache
zeppelin notebook is completed. You can now run flink jobs via datastream
api, table api, sql, pyflink in apache apache zeppelin notebook. Download
it here http://zeppelin.apache.org/download.html),
Here's
Hi,
Dawid, great, thanks for answering.
Jeff,
flink 1.8 with default settings, standalone cluster, one job node and three
task managers nodes.
zeppelin 0.9 config
checked "Connect to existing cluster"
host: 10.219.179.16
port: 6123
create simple notebook:
%flink
ExecutionEnvir
Thanks Dawid,
Hi Sergey,
I am working on update the flink interpreter of zeppelin to support flink
1.9 (supposed to be released this summer).
For the current flink interpreter of zeppelin 0.9, I haven't verified it
against flink 1.8. could you show the full interpreter log ? And what is
the
Hi Sergey,
I am not very familiar with Zepellin. But I know Jeff (cc'ed) is working
on integrating Flink with some notebooks. He might be able to help you.
Best,
Dawid
On 25/04/2019 08:42, Smirnov Sergey Vladimirovich (39833) wrote:
>
> Hello,
>
>
>
> Trying to link
Hello,
Trying to link Zeppelin 0.9 with Flink 1.8. It`s a small dev cluster deployed
in standalone manner.
Got the same error as described here
https://stackoverflow.com/questions/54257671/runnning-a-job-in-apache-flink-standalone-mode-on-zeppelin-i-have-this-error-to
Would appreciate for any
FYI: I finally managed to get the new Flink version running in Zeppelin.
Besides adding the parameters mentioned below you have to build Zeppelin
with profile scala-2.11 and the new Flink version 1.4.2.
Best,
Rico.
Am 09.04.2018 um 14:43 schrieb Rico Bergmann:
>
> The error mess
The error message is:
org.apache.flink.client.program.ProgramInvocationException: The program
execution failed: Communication with JobManager failed: Lost connection
to the JobManager.
Am 09.04.2018 um 14:12 schrieb kedar mhaswade:
> Hmm. What error do you see on the Zeppelin console when
Hmm. What error do you see on the Zeppelin console when you click the run
(flink code) button after making these changes for flink interpreter config
(I assume you restart the interpreter)?
Regards,
Kedar
On Mon, Apr 9, 2018 at 12:50 AM, Rico Bergmann wrote:
> Hi.
>
> Thanks for y
Hi.
Thanks for your reply. But this also didn’t work for me.
In the JM log I get an akka Error („dropping message for non-local recipient“).
My setup: I have Flink running on Kubernetes cluster, version 1.4.2. zeppelin
is version 0.8 using the flink interpreter compiled against flink 1.1.3
ards,
Kedar
On Fri, Apr 6, 2018 at 5:51 AM, Dipl.-Inf. Rico Bergmann <
i...@ricobergmann.de> wrote:
> Hi!
>
> Has someone successfully integrated Flink 1.4.2 into Zeppelin notebook
> (using Flink in cluster mode, not local mode)?
>
> Best,
>
> Rico.
>
>
Hi!
Has someone successfully integrated Flink 1.4.2 into Zeppelin notebook
(using Flink in cluster mode, not local mode)?
Best,
Rico.
Hi Alexis,
Were you able to make this work ? I am also looking for zepplin integration
with Flink and this might be helpful.
Thanks
Santosh
--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
02:00 Till Rohrmann :
> Hi Maciek and Alexis,
>
> as far as I can tell, I think it is currently not possible to use Zeppelin
> with a Flink cluster running in HA mode. In order to make it work, it would
> be necessary to specify either a Flink configuration for the Flink
> interprete
Hi Maciek and Alexis,
as far as I can tell, I think it is currently not possible to use Zeppelin
with a Flink cluster running in HA mode. In order to make it work, it would
be necessary to specify either a Flink configuration for the Flink
interpreter (this is probably the most general solution
Hi Alexis,
did you set the Zookeeper configuration for Flink in Zeppelin?
On Mon, Mar 20, 2017 at 11:37 AM, Alexis Gendronneau <
a.gendronn...@gmail.com> wrote:
> Hello users,
>
> As Maciek, I'm currently trying to make apache Zeppelin 0.7 working with
> Flink. I hav
Hello users,
As Maciek, I'm currently trying to make apache Zeppelin 0.7 working with
Flink. I have two versions of flink available (1.1.2 and 1.2.0). Each one
is running in High-availability mode.
When running jobs from Zeppelin in Flink local mode, everything works fine.
But when tryi
t; zookeeper recovery). How should I access it remotely, e.g. with Zeppelin
> notebook or scala shell?
>
> There are settings for host/port, but with HA setting they are not fixed
> - if I check which is *current leader* host and port and set that I get
> exception on job manag
Hi,
I have standalone Flink cluster configured with HA setting (i.e. with
zookeeper recovery). How should I access it remotely, e.g. with Zeppelin
notebook or scala shell?
There are settings for host/port, but with HA setting they are not fixed
- if I check which is *current leader* host
t; released yet either - ha :(. I switched to a recent version and it’s all
> good. :)
>
> Thanks !
> Neil
>
> > On Jan 17, 2017, at 11:14 AM, Neil Derraugh intellifylearning.com> wrote:
> >
> > Hi Timo & Fabian,
> >
> > Thanks for replying. I&
wrote:
>
> Hi Timo & Fabian,
>
> Thanks for replying. I'm using Zeppelin built off master. And Flink 1.2
> built off the release-1.2 branch. Is that the right branch?
>
> Neil
>
>
>
> --
> View this message in context:
> http://apache
Hi Timo & Fabian,
Thanks for replying. I'm using Zeppelin built off master. And Flink 1.2
built off the release-1.2 branch. Is that the right branch?
Neil
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Zeppelin-Flink-Kafka-
fka
> specifically?
>
>
>
> *From: *Fabian Hueske
> *Reply-To: *"user@flink.apache.org"
> *Date: *Tuesday, January 17, 2017 at 7:10 AM
> *To: *"user@flink.apache.org"
> *Subject: *Re: Zeppelin: Flink Kafka Connector
>
>
>
>
Are connectors being included in the 1.2.0 release or do you mean Kafka
specifically?
From: Fabian Hueske
Reply-To: "user@flink.apache.org"
Date: Tuesday, January 17, 2017 at 7:10 AM
To: "user@flink.apache.org"
Subject: Re: Zeppelin: Flink Kafka Connector
One thing to
t; was not present at that time. You need to upgrade to Flink 1.2.
>
> Timo
>
>
> Am 17/01/17 um 15:58 schrieb Neil Derraugh:
>
> This is really a Zeppelin question, and I’ve already posted to the user
>> list there. I’m just trying to draw in as many relevant eyeballs
You are using an old version of Flink (0.10.2). A FlinkKafkaConsumer010
was not present at that time. You need to upgrade to Flink 1.2.
Timo
Am 17/01/17 um 15:58 schrieb Neil Derraugh:
This is really a Zeppelin question, and I’ve already posted to the user list
there. I’m just trying to
This is really a Zeppelin question, and I’ve already posted to the user list
there. I’m just trying to draw in as many relevant eyeballs as possible. If
you can help please reply on the Zeppelin mailing list.
In my Zeppelin notebook I’m having a problem importing the Kafka streaming
library
That is a regression of upgrading Zeppelin to spark 2.0/Scala 2.11. as it
broke existing functionality, hopefully whoever did the upgrade will fix...
Please report to Zeppelin, thanks and good find!
On Aug 26, 2016 8:39 AM, "Frank Dekervel" wrote:
> Hello,
>
> i added this
Hello,
i added this to my Dockerfile to end up with a working setup:
RUN cp /opt/zeppelin/interpreter/ignite/scala*jar
/opt/zeppelin/interpreter/flink/
which would copy:
scala-compiler-2.11.7.jar
scala-library-2.11.7.jar
scala-parser-combinators_2.11-1.0.4.jar
scala-reflect-2.11.7.jar
scala
I'm glad you were able to work it out!
Your setup is somewhat unique, and as Zeppelin is the result of multiple
drive-by commits, interesting and unexpected things happen in the tail
cases.
Could you please report your problem and solution on the Zeppelin user
list? What you've disc
Hello,
Sorry for the spam, but i got it working after copying all scala libraries
from another interpreter to the interpreter/flink directory. so i think the
error is the scala libraries are missing from the binary release in the
zeppelin/interpreters/flink/ directory. For now i'm adding the
Hello,
For reference, below is the dockerfile i used to build the zeppelin image
(basically just openjdk 8 with the latest binary release of zeppelin)
the "docker-entrypoint.sh" script is just starting zeppelin.sh (oneliner)
FROM openjdk:alpine
RUN apk add --no-cache bash s
Hello Trevor,
Thanks for your suggestion. The log does not explain a lot: on the flink
side i don't see anything at all, on the zeppelin side i see this:
Your suggestion sounds plausible, as i always start zeppelin, and then
change the configuration from local to remote.. however, port
Frank,
can you post the zeppelin flink log please?
You can probably find it in zeppelin_dir/logs/*flink*.log
You've got a few moving pieces here. I've never run zeppelin against Flink
in a docker container. But I think the Zeppelin-Flink log is the first
place to look.
You say you
Hey Frank,
Saw your post on the Zeppelin list yesterday. I can look at it later this
morning, but my gut feeling is a ghost Zeppelin daemon is running in the
background and it's local Flink is holding the port 6123. This is fairly
common and would explain the issue.
Idk if you're o
Hi!
There are some people familiar with the Zeppelin integration. CCing
Till and Trevor. Otherwise, you could also send this to the Zeppelin
community.
Cheers,
Max
On Wed, Aug 24, 2016 at 12:58 PM, Frank Dekervel wrote:
> Hello,
>
> for reference:
>
> i already found out t
Hello,
for reference:
i already found out that "connect to existing process" was my error here:
it means connecting to an existing zeppelin interpreter, not an existing
flink cluster. After fixing my error, i'm now in the same situation as
described here:
https://stackoverflo
Hello,
I try to set up apache zeppelin with a flink cluster (one jobmanager, one
task manager).
What i did was using the dockerfiles in flink-contrib/docker-flink + the
latest binary release of apache zeppelin with all interpreters:
https://github.com/apache/flink/blob/master/flink-contrib
>> wrote:
>>
>>> For those interested, Trevor wrote a blog post describing how to setup
>>> Spark, Flink and Zeppelin, both locally and on clusters:
>>> http://trevorgrant.org/2015/11/03/apache-casserole-a-delicious-big-data-recipe-for-the-whole-family/
>>>
Indeed very nice! Thanks
On Nov 4, 2015 5:04 PM, "Till Rohrmann" wrote:
> Really cool tutorial Trevor :-)
>
> On Wed, Nov 4, 2015 at 3:26 PM, Robert Metzger
> wrote:
>
>> For those interested, Trevor wrote a blog post describing how to setup
>> Spark, Fl
Really cool tutorial Trevor :-)
On Wed, Nov 4, 2015 at 3:26 PM, Robert Metzger wrote:
> For those interested, Trevor wrote a blog post describing how to setup
> Spark, Flink and Zeppelin, both locally and on clusters:
> http://trevorgrant.org/2015/11/03/apache-casserole-a-delicious
For those interested, Trevor wrote a blog post describing how to setup
Spark, Flink and Zeppelin, both locally and on clusters:
http://trevorgrant.org/2015/11/03/apache-casserole-a-delicious-big-data-recipe-for-the-whole-family/
Thanks Trevor for the great tutorial!
On Thu, Oct 22, 2015 at 4:23
Hi Trevor,
that’s actually my bad since I only tested my branch against a remote
cluster. I fixed the problem (not properly starting the
LocalFlinkMiniCluster) so that you can now use Zeppelin also in local mode.
Just check out my branch again.
Cheers,
Till
On Wed, Oct 21, 2015 at 10:00 PM
Hey Till,
I cloned your branch of Zeplin and while it will compile, it fails tests on
timeout, which consequently was the same issue I was having when trying to
use Zeppelin.
Ideas?
---
Test set
Hi Trevor,
in order to use Zeppelin with a different Flink version in local mode,
meaning that Zeppelin starts a LocalFlinkMiniCluster when executing your
jobs, you have to build Zeppelin and change the flink.version property in
the zeppelin/flink/pom.xml file to the version you want to use.
If
I'm setting up some Flink/Spark/Zeppelin at work. Spark+Zeppelin seems to
be relatively well supported and configurable but the Flink is not so much.
I want Zeppelin to run against my 0.10 build instead of the 0.6 build that
ships with Zeppelin. My best guess at the moment on how to accom
55 matches
Mail list logo
