> > > > think
> > > > > > > >
> > > > > > > > it can be a follow up work as an improvement after we support
> > the
> > > > > > session
> > > > > > > > job operation.
> > > > >
>
> > > > > > >
> > > > > > > Geng Biao 于2022年3月17日周四 10:55写道：
> > > > > > >
> > > > > > >> Thanks Aitozi for the work!
> > > > > > >>
> > > > > > >&g
RunHeaders with uber job jar as
> > well.
> > > > As
> > > > > >> Yang said, the user defined dependencies may be better supported
> > in
> > > > > >> upstream flink.
> > > > > >> A follow-up thought: I think we should c
hould care the potential
> influence
> > > on
> > > > >> user experiences: as the job graph is generated in JM, when the
> > > > generation
> > > > >> fails due to some issues in the main() method, we should do some
> > work
> >
> > on
> > > >> user experiences: as the job graph is generated in JM, when the
> > > generation
> > > >> fails due to some issues in the main() method, we should do some
> work
> > on
> > > >> showing such error messages in this
ages in this proposal or the later k8s operator
> > >> implementation. Reason for this question is that if users submit many
> > jobs
> > >> to one same session cluster, it may be not easy for them to find
> > relevant
> > >> error logs
it may be not easy for them to find
> relevant
> >> error logs about main() method of a specific job. The FLINK-25715 could
> >> help us later.
> >>
> >>
> >> Best,
> >> Biao Geng
> >>
> >>
> >> 发件人: Aitozi
> >&
cific job. The FLINK-25715 could
>> help us later.
>>
>>
>> Best,
>> Biao Geng
>>
>>
>> 发件人: Aitozi
>> 日期: 星期三, 2022年3月16日 下午5:19
>> 收件人: dev@flink.apache.org
>> 主题: Re: [DISCUSS] Support the session job management in kubernetes
>> operat
that if users submit many jobs
> to one same session cluster, it may be not easy for them to find relevant
> error logs about main() method of a specific job. The FLINK-25715 could
> help us later.
>
>
> Best,
> Biao Geng
>
>
> 发件人: Aitozi
> 日期: 星期三, 2022年3月16日 下午5:19
not easy for them to find relevant error logs about main()
method of a specific job. The FLINK-25715 could help us later.
Best,
Biao Geng
发件人: Aitozi
日期: 星期三, 2022年3月16日 下午5:19
收件人: dev@flink.apache.org
主题: Re: [DISCUSS] Support the session job management in kubernetes operator
Hi Yang Wang
Hi Yang Wang
Thanks for your feedback, Provide the local and http implementation for
the first version makes sense to me.
+1 for it.
Best,
Aitozi
Yang Wang 于2022年3月16日周三 16:44写道：
> # How to download the user jars
> I agree with Gyula that it will be a burden if we bundle the flink
> filesys
# How to download the user jars
I agree with Gyula that it will be a burden if we bundle the flink
filesystem dependencies in the operator image.
Maybe we could have a *ArtifactFetcher* interface in the
flink-kubernetes-operator. By default, we provide the local and http
implementation,
which means
Hi Gyula
Thanks for your quick response. Regarding the different filesystems
dependency,
I think we can make it optional and pluggable, and let it choose by user
when building
their operator image. Users can build their image from the base operator
image and
add filesystem dependency they want
Thank you Aitozi!
I think this will be a very nice (and simple) addition to enable these
use-cases.
I have 2 comments regarding the proposal:
1. I think if we want to support different filesystems to download jars
from, we probably need some clever ways to add external operator
dependencies (jar
Hi Guys:
I would like to open a discussion for support session job management in
kubernetes operator. It’s intended to enhance the flink-kubernetes-operator
to manage the session job with k8s tooling. I have drafted the design
doc[1]. Please refer to it and give me some feedback .
[1]
https:
15 matches
Mail list logo
