Hello all.
We are running Flink 1.20 on Kubernetes cluster. We deploy using Flink K8s
Operator.
I was wandering, when Kubernets decides to kill a running Flink cluster, is it
using some regular graceful method or does it just kill the pod?
Just for the reference, Docker has a way to specify a
Hi Chosen,
Whether kafka appender is supported or not has no relation to the
flink-kubernetes-operator.
It only depends on whether log4j2 supports kafka appender.
From the error message, it appears that the error is caused by the absence of
the log4j-layout-template-json[1] plugin.
For the cus
Hi,
I am recently working on syncing my Flink log to Kafka via log4j2 Kafka
appender. I have a log4j2.properties file which works fine locally, say run my
flink fat jar form terminal via following command:
PS D:\repo>>java -cp .\reconciliation-1.0-SNAPSHOT.jar
The log can be synced to Kaf
gt; 签名由 网易邮箱大师 <https://mail.163.com/dashi/dlpro.html?from=mail81> 定制
>
> On 09/30/2020 14:48，superainbower
> wrote：
>
> Hi
> How to configure statebackend when I deploy flink on k8s , I just add
> the following to flink-conf.yaml, but it doesn’t work
>
> state.backend: roc
Hi
How to configure statebackend when I deploy flink on k8s , I just add the
following to flink-conf.yaml, but it doesn’t work
state.backend: rocksdb
state.checkpoints.dir: hdfs://slave2:8020/flink/checkpoints
state.savepoints.dir: hdfs://slave2:8020/flink/savepoints
From: dty...@163.com
Sent: Friday, September 4, 2020 11:04
To: user
Subject: flink on k8s 如果jobmanager 所在pod重启后job失败如何处理
请教一个问题。在使用k8s 部署的flink 集群，如果jobmanger 重启后，1）job所在的jar包会清除，jobmanager
找不到这个job的jar 包，2）正在运行的job也会取消，重启后的jobmanager 如何找到之前运行的job
请教一个问题。在使用k8s 部署的flink 集群，如果jobmanger 重启后，1）job所在的jar包会清除，jobmanager
找不到这个job的jar 包，2）正在运行的job也会取消，重启后的jobmanager 如何找到之前运行的job
dty...@163.com
Cool; @aniket and @dagang,
As someone who hasn't dug into the code of either (will go through your
recording) -- might you share any thoughts on differences between:
https://github.com/googlecloudplatform/flink-on-k8s-operator
and
https://github.com/lyft/flinkk8soperator
??
Also, for tho
Hi folks,
Recently Aniket Mokashi and Dagang Wei hosted a webinar on how to use the
flink k8s operator they have developed. The operator also supports working
with Beam.
If you think that this may be helpful to you, you may access the recording
and slides via this link:
https://www.cncf.io/webina
/v1 instead. The apps/v1 is
> introduced
> from v1.9.0. I will create a ticket fix the documentation.
>
> Before release-1.10, you could use standalone per-job[1] or standalone
> session[2] cluster on
> K8s. There are some existing K8s operators to manage the application
> lif
.
Before release-1.10, you could use standalone per-job[1] or standalone
session[2] cluster on
K8s. There are some existing K8s operators to manage the application
lifecycle(e.g. google flink-on-k8s-operator[3],
lyft flink-k8s-operator[4]).
Running Flink native on K8s is supported from 1.10. You
I fail to deploy flink on k8s referring to
https://ci.apache.org/projects/flink/flink-docs-stable/ops/deployment/kubernetes.html
When I run the command 'kubectl create -f jobmanager-deployment.yaml',
following error is reported:
[image: image.png]
I am new to k8s. Our
Hi Lake,
Can you clearly count or identify which steps are taking a long time?
Best,
Vino
LakeShen 于2019年12月23日周一 下午2:46写道：
> Hi community , when I run the flink task on k8s , the first thing is that
> to build the flink task jar to
> Docker Image . I find that It would spend much time to buil
base image (based on
which the Flink on K8s image will be built) from DockerHub could take quite
some time from mainland China (where I assume you are since you're also
writing to user-zh).
If this is indeed the case that you met, you can try to modify the
"flink-container/docker/Dockerfil
Hi community , when I run the flink task on k8s , the first thing is that
to build the flink task jar to
Docker Image . I find that It would spend much time to build docker image.
Is there some way to makr it faster.
Thank your replay.
gtech.com> wrote:
> Hi everyone,
>
> We are beginning to run Flink on K8s and found the basic templates [1] as
> well as the example Helm chart [2] very helpful. Also the discussion about
> JobManager HA [3] and Patrick's talk [4] was very interesting. All in all
> it is delig
Maximilian Bode <
> maximilian.b...@tngtech.com> wrote:
>
>> Hi everyone,
>>
>> We are beginning to run Flink on K8s and found the basic templates [1] as
>> well as the example Helm chart [2] very helpful. Also the discussion about
>> JobManager HA [3] and Patri
The above applies to Mesos/DCOS as well. So if someone would also share
insights into automatic job deployment in that setup would very useful.
Thanks.
M
On Fri, Dec 22, 2017 at 6:56 PM, Maximilian Bode <
maximilian.b...@tngtech.com> wrote:
> Hi everyone,
>
> We are beginning to r
Hi everyone,
We are beginning to run Flink on K8s and found the basic templates [1]
as well as the example Helm chart [2] very helpful. Also the discussion
about JobManager HA [3] and Patrick's talk [4] was very interesting. All
in all it is delightful how easy everything can be set up and
19 matches
Mail list logo
