I think maybe we make the SQL or Python jobs submission more convenient in the future by introducing the *"**pyScriptURL"* or *"SQLScriptURI"* similar to *"jarURI"*.
Best, Yang Thomas Weise <t...@apache.org> 于2022年7月7日周四 01:06写道： > Since SQL or Python are essentially just examples of how to use the > operator vs. features of the operator itself, they should not affect > the release schedule and can be added anytime, as examples to the > operator or elsewhere. > > Thanks, > Thomas > > On Wed, Jul 6, 2022 at 8:33 AM Gyula Fóra <gyula.f...@gmail.com> wrote: > > > > Hi All! > > > > One thing we could do already now is to add a simple example on how to > > execute Python jobs like java jobs (with the right main class, args etc). > > > > It would be similar to > > > https://github.com/apache/flink-kubernetes-operator/tree/main/examples/flink-sql-runner-example > > but > > slightly simpler as we don't need a maven module most likely. > > > > Unfortunately I cannot do it myself as @Geng Biao <biaoge...@gmail.com> > pointed > > out that Flink Python on M1 macbook is unsupported so cannot really test > > this locally. > > > > Cheers, > > Gyula > > > > On Wed, Jul 6, 2022 at 4:56 AM Dian Fu <dian0511...@gmail.com> wrote: > > > > > Thanks for the confirmation Matyas! > > > > > > On Tue, Jul 5, 2022 at 3:00 PM Őrhidi Mátyás <matyas.orh...@gmail.com> > > > wrote: > > > > > > > Yes, this is the plan Dian. Appreciate your assistance! > > > > > > > > Best, > > > > Matyas > > > > > > > > On Tue, Jul 5, 2022 at 8:55 AM Dian Fu <dian0511...@gmail.com> > wrote: > > > > > > > >> Hi Matyas, > > > >> > > > >> According to the release schedule defined in [1], it seems that the > > > >> feature freeze of v1.2 may occur at the beginning of September, is > this > > > >> correct? If this is the case, I think it should be reasonable to > make > > > it in > > > >> v1.2 for Python support. > > > >> > > > >> Regards, > > > >> Dian > > > >> > > > >> [1] > > > >> > > > > https://cwiki.apache.org/confluence/display/FLINK/Release+Schedule+and+Planning > > > >> > > > >> On Tue, Jul 5, 2022 at 2:10 PM Őrhidi Mátyás < > matyas.orh...@gmail.com> > > > >> wrote: > > > >> > > > >>> Both sql and py support is requested frequently. I guess we should > aim > > > >>> to support both in v1.2. > > > >>> > > > >>> Matyas > > > >>> > > > >>> On Tue, Jul 5, 2022 at 6:26 AM Gyula Fóra <gyula.f...@gmail.com> > > > wrote: > > > >>> > > > >>>> Thank you for the info and help Dian :) > > > >>>> > > > >>>> Gyula > > > >>>> > > > >>>> On Tue, 5 Jul 2022 at 05:14, Yang Wang <danrtsey...@gmail.com> > wrote: > > > >>>> > > > >>>> > Thanks Dian for the confirmation and nice help. > > > >>>> > > > > >>>> > Best, > > > >>>> > Yang > > > >>>> > > > > >>>> > Dian Fu <dian0511...@gmail.com> 于2022年7月5日周二 09:27写道： > > > >>>> > > > > >>>> > > @Yang, Yes, you are right. Python jobs could be seen as > special > > > JAR > > > >>>> jobs > > > >>>> > > whose main class is always > > > >>>> `org.apache.flink.client.python.PythonDriver`. > > > >>>> > > What we could do in Flink K8s operator is to make it more > > > >>>> convenient and > > > >>>> > > handle properly for the different kinds of dependencies[1]. > > > >>>> > > > > > >>>> > > @Gyula, I can help on this. I will find some time to > investigate > > > >>>> this in > > > >>>> > > the following days and will let you know when there is any > > > progress. > > > >>>> > > > > > >>>> > > Regards, > > > >>>> > > Dian > > > >>>> > > > > > >>>> > > [1] > > > >>>> > > > > > >>>> > > > > >>>> > > > > https://nightlies.apache.org/flink/flink-docs-master/docs/dev/python/dependency_management/ > > > >>>> > > > > > >>>> > > On Mon, Jul 4, 2022 at 11:52 AM Yang Wang < > danrtsey...@gmail.com> > > > >>>> wrote: > > > >>>> > > > > > >>>> > >> AFAIK, the python job could be considered as a special case > of > > > jar > > > >>>> job. > > > >>>> > >> The user jar is flink-python-*.jar and is located in the opt > > > >>>> directory. > > > >>>> > >> The python script is just the argument of this user jar. So I > > > >>>> believe > > > >>>> > the > > > >>>> > >> users already could submit python jobs via Flink Kubernetes > > > >>>> operator. > > > >>>> > >> However, they need some manual operations, including specify > the > > > >>>> user > > > >>>> > >> jar, download python script via init container, etc. > > > >>>> > >> > > > >>>> > >> What we could do in the Flink kubernetes operator is to make > the > > > >>>> > >> submission more convenient by introducing a new field(e.g. > > > >>>> pyScript). > > > >>>> > >> > > > >>>> > >> cc @Dian Fu <dian0511...@gmail.com> @biaoge...@gmail.com > > > >>>> > >> <biaoge...@gmail.com> WDYT? > > > >>>> > >> > > > >>>> > >> Best, > > > >>>> > >> Yang > > > >>>> > >> > > > >>>> > >> Gyula Fóra <gyf...@apache.org> 于2022年7月4日周一 00:12写道： > > > >>>> > >> > > > >>>> > >>> Hi Devs! > > > >>>> > >>> > > > >>>> > >>> Would anyone with a good understanding of the Python > execution > > > >>>> layer be > > > >>>> > >>> interested in working on adding Python job support for the > Flink > > > >>>> > >>> Kubernetes > > > >>>> > >>> Operator? > > > >>>> > >>> > > > >>>> > >>> This is a feature request that comes up often ( > > > >>>> > >>> https://issues.apache.org/jira/browse/FLINK-28364) and it > would > > > >>>> be a > > > >>>> > >>> great > > > >>>> > >>> way to fill some missing feature gaps on the operator :) > > > >>>> > >>> > > > >>>> > >>> I am of course happy to help or work together with someone > on > > > >>>> this but > > > >>>> > I > > > >>>> > >>> have zero experience with the Python API at this stage and > don't > > > >>>> want > > > >>>> > to > > > >>>> > >>> miss some obvious requirements. > > > >>>> > >>> > > > >>>> > >>> Cheers, > > > >>>> > >>> Gyula > > > >>>> > >>> > > > >>>> > >> > > > >>>> > > > > >>>> > > > >>> > > > >
