Hi Shuiqiang,
Thanks for letting me know. Feel free to send any beginner level contributions
for this effort my way 😊 .
Best,
kevin
From: Shuiqiang Chen
Date: Wednesday, March 24, 2021 at 10:31 PM
To: "Bohinski, Kevin"
Cc: user
Subject: [EXTERNAL] Re: PyFlink DataStream Exa
Is there a kinesis example?
From: "Bohinski, Kevin"
Date: Wednesday, March 24, 2021 at 4:40 PM
To: "Bohinski, Kevin"
Subject: Re: PyFlink DataStream Example Kafka/Kinesis?
Nevermind, found this for anyone else looking:
https://github.com/apache/flink/blob/master/flink-en
Nevermind, found this for anyone else looking:
https://github.com/apache/flink/blob/master/flink-end-to-end-tests/flink-python-test/python/datastream/data_stream_job.py
From: "Bohinski, Kevin"
Date: Wednesday, March 24, 2021 at 4:38 PM
To: user
Subject: PyFlink DataStream Exa
Hi,
Is there an example kafka/kinesis source or sink for the PyFlink DataStream API?
Best,
kevin
Hi,
Actually that seemed to use a cached 1.12.1 image.
I’m seeing the following:
```
➜ docker pull flink:1.12.2
1.12.2: Pulling from library/flink
no matching manifest for linux/amd64 in the manifest list entries
```
Best
kevin
From: "Bohinski, Kevin"
Date: Thursday, March 4, 2021
Schepler
Date: Wednesday, March 3, 2021 at 5:41 PM
To: "Bohinski, Kevin" , user
Subject: [EXTERNAL] Re: 1.12.2 docker image
they should be released in a day or two.
On 3/3/2021 11:18 PM, Bohinski, Kevin wrote:
Hi,
Are there plans to provide a docker image for 1.12.2?
Best
kevin
Hi,
Are there plans to provide a docker image for 1.12.2?
Best
kevin
Hi All,
On long lived session clusters we are seeing a k8s error `Error while watching
the ConfigMap`.
Good news is it looks like `too old resource version` issue is fixed :).
Logs are attached below. Any tips?
best
Kevin
2021-02-11 07:55:15,249 INFO
org.apache.flink.runtime.checkpoint.Chec
want all your jobs recovered when jobmanager crashed,>
> you still need to configure the Zookeeper high availability.>
>
> [1]. https://github.com/fabric8io/kubernetes-client/pull/1800>
>
>
> Best,>
> Yang>
>
> Bohinski, Kevin mailto:ke...@comcast.
Might be useful
https://stackoverflow.com/a/61437982
Best,
kevin
From: "Bohinski, Kevin"
Date: Thursday, August 13, 2020 at 6:13 PM
To: Yang Wang
Cc: "user@flink.apache.org"
Subject: Re: [EXTERNAL] Re: Native K8S Jobmanager restarts and job never
recovers
Hi
G
: Sunday, August 9, 2020 at 10:29 PM
To: "Bohinski, Kevin"
Cc: "user@flink.apache.org"
Subject: [EXTERNAL] Re: Native K8S Jobmanager restarts and job never recovers
Hi Kevin,
I think you may not set the high availability configurations in your native K8s
session. Currently, we on
Hi all,
In our 1.11.1 native k8s session after we submit a job it will run successfully
for a few hours then fail when the jobmanager pod restarts.
Relevant logs after restart are attached below. Any suggestions?
Best
kevin
2020-08-06 21:50:24,425 INFO
org.apache.flink.kubernetes.KubernetesR
Figured it out, pulled StructuredOptionsSplitter into a debugger and was able
to get it working with:
-Dkubernetes.jobmanager.annotations="\"KEY:\"\"V:A:L:U:E\"\"\""
Best
kevin
Hi,
How do we escape : in map type param?
For example, we have:
-Dkubernetes.jobmanager.annotations=KEY:V:A:L:U:E
Which should result in {“KEY”: “V:A:L:U:E”}.
Best,
kevin
Hi Yang,
Awesome, looking forward to 1.11!
In the meantime, we are using a mutating web hook in case anyone else is facing
this...
Best,
kevin
From: Yang Wang
Date: Saturday, June 27, 2020 at 11:23 PM
To: "Bohinski, Kevin"
Cc: "user@flink.apache.org"
Subject: [EXTERNAL
(via https://github.com/jtblin/kube2iam )
On 2020/06/25 19:08:41, "Bohinski, Kevin"
mailto:k...@comcast.com>> wrote:
> Hi,>
>
>
>
> How do we attach an IAM role to the native K8S sessions?>
>
>
>
> Typically for our other pods we use the f
Hi,
How do we attach an IAM role to the native K8S sessions?
Typically for our other pods we use the following in our yamls:
spec:
template:
metadata:
annotations:
iam.amazonaws.com/role: ROLE_ARN
Best
kevin
Hi Yang,
Thanks for your help, that command worked, so we connected a remote debugger
and found the root exception was initially a timeout exception from okhttp. The
increases you mentioned worked.
Thanks again for all the help!
Best,
kevin
On 2020/06/19 03:46:36, Yang Wang mailto:d...@gmail.
Hi Yang
I’m using DEBUG level; do you know what to search for to see kubernetes-client
K8s apiserver address? I don’t see anything useful so far.
Best
kevin
On 2020/06/08 16:02:07, "Bohinski, Kevin"
mailto:k...@comcast.com>> wrote:
> Hi Yang>
>
>
>
> Thanks
Hi Yang
Thanks again for your help so far.
I tried your suggestion, still with no luck.
Attached are the logs, please let me know if there are more I should send.
Best
kevin
On 2020/06/08 03:02:40, Yang Wang mailto:d...@gmail.com>> wrote:
> Hi Kevin,>
>
> It may because the characters length li
When running Flink 1.7 on EMR 5.21 using StreamingFileSink we see
java.lang.UnsupportedOperationException: Recoverable writers on Hadoop are only
supported for HDFS and for Hadoop version 2.7 or newer. EMR is showing Hadoop
version 2.8.5. Is anyone else seeing this issue?
21 matches
Mail list logo
