Hi Dian,

Thanks a lot for bringing the discussion.
It would be a headache to address these environmental problems, so +1 for
option #1 to use the virtual environment.

Best, Hequn

On Tue, Oct 29, 2019 at 9:31 PM Till Rohrmann <trohrm...@apache.org> wrote:

> Thanks for bringing this topic up Dian. I'd be in favour of option #1
> because this would also allow to create reproducible builds.
>
> Cheers,
> Till
>
> On Tue, Oct 29, 2019 at 5:28 AM jincheng sun <sunjincheng...@gmail.com>
> wrote:
>
> > Hi,
> > Thanks for bringing up the discussion Dian.
> > +1 for the #1.
> >
> > Hi Jeff, this changes is for the PyFlink release, i.e.,The release
> manager
> > should build the release package for Pyflink, and prepare the python
> > environment during the building. Since 1.10 we only support python 3.5+,
> so
> > it will throw an exception if you use python 3.4.
> >
> > Best,
> > Jincheng
> >
> >
> > Jeff Zhang <zjf...@gmail.com> 于2019年10月29日周二 上午11:55写道:
> >
> > > I am a little confused, why we need to prepare python environment in
> > > release. Shouldn't that be done when user start to use pyflink ?
> > > Or do you mean to set up python environment for pyflink's CI build ?
> > >
> > > Regarding this problem  "It needs a proper Python environment(i.e.
> Python
> > > 3.5+, setuptools, etc) to build the PyFlink package"
> > > Would the build fail if I use python 3.4 ?
> > >
> > >
> > > Dian Fu <dian0511...@gmail.com> 于2019年10月29日周二 上午11:01写道:
> > >
> > > > Hi all,
> > > >
> > > > We have reached a consensus that the PyFlink package should be
> > published
> > > > to PyPI in [1]. Thanks to Jincheng's effort, the PyPI account has
> > already
> > > > been created and available to use now [2]. It means that we could
> > publish
> > > > PyFlink to PyPI in the coming releases and it also means that
> > additional
> > > > steps will be added to the normal process of the Flink release to
> > prepare
> > > > the PyFlink release package.
> > > >
> > > > It needs a proper Python environment(i.e. Python 3.5+, setuptools,
> etc)
> > > to
> > > > build the PyFlink package. There are two options in my mind to
> prepare
> > > the
> > > > Python environment:
> > > > 1) Reuse the script lint-python.sh defined in flink-python module to
> > > > create the required virtual environment and build the PyFlink package
> > > using
> > > > the created virtual environment.
> > > > 2) It's assumed that the local Python environment is properly
> installed
> > > > and ready to use. The Python environment requirement will be
> documented
> > > at
> > > > the page "Create a Flink Release" and validation check could also be
> > > added
> > > > in create_binary_release.sh to throw an meaningful error with hints
> how
> > > to
> > > > fix it if it's not correct.
> > > >
> > > > Option 1:
> > > > Pros:
> > > > - It's transparent for release managers.
> > > > Cons:
> > > > - It needs to prepare the virtual environment during preparing the
> > > PyFlink
> > > > release package and it will take some several minutes as it need to
> > > > download a few binaries.
> > > >
> > > > Option 2:
> > > > Pros:
> > > > - There is no need to prepare the virtual environment if the local
> > > > environment is already properly configured.
> > > > Cons:
> > > > - It requires the release managers to prepare the local Python
> > > environment
> > > > and not all the people are familiar with Python and it's a burden for
> > > > release managers.
> > > >
> > > > Personally I prefer to option 1).
> > > >
> > > > Looking forward to your feedback!
> > > >
> > > > PS: I think this issue could also be discussed in the JIRA. But I
> tend
> > to
> > > > bring up the discussion to ML as it introduces an additional step to
> > the
> > > > release process and I think this should be visible to the community
> and
> > > it
> > > > should be well discussed. Besides, we could also get more feedback.
> > > >
> > > > Regards,
> > > > Dian
> > > >
> > > > [1]
> > > >
> > >
> >
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/VOTE-Publish-the-PyFlink-into-PyPI-tt31201.html
> > > > [2]
> > > >
> > >
> >
> https://issues.apache.org/jira/browse/FLINK-13011?focusedCommentId=16947307&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16947307
> > >
> > >
> > >
> > > --
> > > Best Regards
> > >
> > > Jeff Zhang
> > >
> >
>

Reply via email to