Re: [DISCUSS] Intermediary releases of the flink-docker images

2020-04-29 Thread Chesnay Schepler
We will not advertise snapshot artifacts to users. This is simply not allowed by ASF rules. On 29/04/2020 04:08, Yang Wang wrote: Thanks for starting this discussion. In general, i am also in favor of making docker image release could be partly decoupled from Flink release. However, i think it

Re: [DISCUSS] Intermediary releases of the flink-docker images

2020-04-28 Thread Yang Wang
Thanks for starting this discussion. In general, i am also in favor of making docker image release could be partly decoupled from Flink release. However, i think it should only happen when we want to make some changes that are independent from Flink majar release(e.g. JDK11, change base image, ins

Re: [DISCUSS] Intermediary releases of the flink-docker images

2020-04-28 Thread Ismaël Mejía
> To me this means that the docker images should be released at the same time > the other artifacts are released. This also includes shapshot releases. So > the build of the docker images should be an integral part of the build. This is already the case since the last release, what this thread i

Re: [DISCUSS] Intermediary releases of the flink-docker images

2020-04-28 Thread Chesnay Schepler
I agree with Niels that if a Flink release is made it should be accompanied by the Dockerfiles for that version, and release them at once. This makes sense for testing purposes alone, and I view Docker as just another distribution channel like Maven central. The reverse isn't necessarily true tho

Re: [DISCUSS] Intermediary releases of the flink-docker images

2020-04-28 Thread Aljoscha Krettek
Hi Niels, I think Robert was referring to the fact that Apache considers only the source release to be "the release", everything else is called convenience release. Best, Aljoscha On 27.04.20 19:43, Niels Basjes wrote: Hi, In my opinion the docker images are essentially simply differently

Re: [DISCUSS] Intermediary releases of the flink-docker images

2020-04-27 Thread Niels Basjes
Hi, In my opinion the docker images are essentially simply differently packed binary releases. This becomes more true when in the future deploying a Flink application to kubernetes simply pulls the correct binary from a docker hub. Because of these kinds of use cases I disagree with Robert that t

Re: [DISCUSS] Intermediary releases of the flink-docker images

2020-04-27 Thread Robert Metzger
Thanks for starting the thread! I would consider the docker images of Flink convenience binary releases that can happen any time. I believe a simplified, but formal release process would be appropriate (preview / staging images for the community to validate & vote, then release to docker hub). On

Re: [DISCUSS] Intermediary releases of the flink-docker images

2020-04-22 Thread Chesnay Schepler
We can create additional releases independent of Flink, but they will have to go through a formal release process in any case. On 22/04/2020 14:55, Ismaël Mejía wrote: Hello, I wanted to discuss about a subject that was shortly mentioned during the docker unification thread (and in some other

Re: [DISCUSS] Intermediary releases of the flink-docker images

2020-04-22 Thread Tang Jinxin
maybe could try someway like foreachpartition in foreachrdd,which will not together to driver take too extra consumption. xiaoxingstack 邮箱:xiaoxingst...@gmail.com 签名由 网易邮箱大师 定制 On 04/22/2020 20:55, Ismaël Mejía wrote: Hello, I wanted to discuss about a subject that was shortly mentioned during

Re: [DISCUSS] Intermediary releases of the flink-docker images

2020-04-22 Thread Tang Jinxin
I am confused why docker upstream can influence inner process seriously,may be the jvm thread?In my opinion,docker is just a child space of os. xiaoxingstack 邮箱:xiaoxingst...@gmail.com 签名由 网易邮箱大师 定制 On 04/22/2020 20:55, Ismaël Mejía wrote: Hello, I wanted to discuss about a subject that was shor

[DISCUSS] Intermediary releases of the flink-docker images

2020-04-22 Thread Ismaël Mejía
Hello, I wanted to discuss about a subject that was shortly mentioned during the docker unification thread (and in some other PR) that is the release of docker images independent of major Flink releases. In the past when the docker images were maintained outside of the Apache repository we usuall