[jira] [Created] (FLINK-38319) TO_TIMESTAMP_LTZ only accepts literal values in PyFlink

2025-09-03 Thread Dian Fu (Jira)
Dian Fu created FLINK-38319: --- Summary: TO_TIMESTAMP_LTZ only accepts literal values in PyFlink Key: FLINK-38319 URL: https://issues.apache.org/jira/browse/FLINK-38319 Project: Flink Issue Type

Re: [VOTE] FLIP-541 Making PyFlink more Pythonic (Phase-1)

2025-08-20 Thread Dian Fu
Hi Zander, Thanks for driving this! +1 (binding) Regards, Dian On Thu, Aug 21, 2025 at 1:13 AM Zander Matheson wrote: > > Hi Everyone, > > The discussion for FLIP-541, "Making PyFlink more Pythonic (Phase-1)" has > concluded, and I would like to call a vote to accept the proposal. > > You can

[jira] [Created] (FLINK-38214) Support Kinesis streams source in Python DataStream API

2025-08-07 Thread Dian Fu (Jira)
Dian Fu created FLINK-38214: --- Summary: Support Kinesis streams source in Python DataStream API Key: FLINK-38214 URL: https://issues.apache.org/jira/browse/FLINK-38214 Project: Flink Issue Type

[jira] [Created] (FLINK-38190) Support async function in Python DataStream API

2025-08-04 Thread Dian Fu (Jira)
Dian Fu created FLINK-38190: --- Summary: Support async function in Python DataStream API Key: FLINK-38190 URL: https://issues.apache.org/jira/browse/FLINK-38190 Project: Flink Issue Type: New

[jira] [Created] (FLINK-38189) Allow it to sink data to Kafka partitions based on KEY in PyFlink

2025-08-04 Thread Dian Fu (Jira)
Dian Fu created FLINK-38189: --- Summary: Allow it to sink data to Kafka partitions based on KEY in PyFlink Key: FLINK-38189 URL: https://issues.apache.org/jira/browse/FLINK-38189 Project: Flink

[jira] [Created] (FLINK-38115) Synchronous the Python JDBC connector with the Java implementation

2025-07-17 Thread Dian Fu (Jira)
Dian Fu created FLINK-38115: --- Summary: Synchronous the Python JDBC connector with the Java implementation Key: FLINK-38115 URL: https://issues.apache.org/jira/browse/FLINK-38115 Project: Flink

[jira] [Created] (FLINK-38105) AttributeError: 'pyflink.fn_execution.table.window_aggregate_fast.S' object has no attribute 'get_accumulators'

2025-07-14 Thread Dian Fu (Jira)
Dian Fu created FLINK-38105: --- Summary: AttributeError: 'pyflink.fn_execution.table.window_aggregate_fast.S' object has no attribute 'get_accumulators' Key: FLINK-38105 URL: https://issues.apache.o

Re: Request for PMC to get PyPI access

2025-07-06 Thread Dian Fu
Hi Ferenc, I have added you to the following two projects: "apache-flink" and "apache-flink-libraries". You should have received two invitation emails and need to accept them. Regards, Dian On Fri, Jul 4, 2025 at 11:44 PM Ferenc Csaky wrote: > > Hello devs, > > I am the release manager of the 1

Re: [DISCUSS] FLIP-XXX Improving PyFlink - The Zen of Flink

2025-07-03 Thread Dian Fu
he doc. > Dian Fu Commented: > > > I guess we could group the working items into different FLIPs according to > > the categories, the efforts, etc: > > 1) API changes which make the API more pythonic, will be referenced as > > "FLIP-1" > > 2) Make the Pyt

Re: [DISCUSS] FLIP-XXX Improving PyFlink - The Zen of Flink

2025-07-02 Thread Dian Fu
ternatives for the local execution engine. > > > > Best, > > Guowei > > > > > > On Sat, Jun 28, 2025 at 5:24 AM Alexander Matheson > > > > wrote: > > > > > Hi devs, > > > > > > I would like to start a discussion about a

Re: [DISCUSS] FLIP-XXX Improving PyFlink - The Zen of Flink

2025-06-30 Thread Dian Fu
tting breakpoint and running the job). Regards, Dian [1] https://issues.apache.org/jira/browse/FLINK-21222 On Tue, Jul 1, 2025 at 10:25 AM Dian Fu wrote: > > Hi Zander, > > Thanks for the reply. Makes sense to me! > > Some follow-up questions: > 1) Are there follow-up sub-FLIP di

Re: [DISCUSS] FLIP-XXX Improving PyFlink - The Zen of Flink

2025-06-30 Thread Dian Fu
rence UDF and Numpy types? Could you explain a bit more on these parts. Regards, Dian On Tue, Jul 1, 2025 at 6:37 AM Zander Matheson wrote: > > Thanks Dian Fu, > > On 1) This is more in reference to how if we modify things like the builder > pattern, we could end up changing c

Re: [DISCUSS] FLIP-XXX Improving PyFlink - The Zen of Flink

2025-06-29 Thread Dian Fu
ut a new FLIP for a rather large > umbrella of work concerning PyFlink that Dian Fu, Xingbo Huang, myself and > others have been coordinating around. > > As PyFlink continues to grow in adoption (downloads are up 10x YoY on > PyPI!!!) it is overdue for additional investment to bring i

Re: [VOTE] FLIP-531: Initiate Flink Agents as a new Sub-Project

2025-06-02 Thread Dian Fu
+1 (binding) Regards, Dian On Tue, Jun 3, 2025 at 1:50 PM Sharath wrote: > > +1(non-binding) > > On Mon, Jun 2, 2025 at 10:43 PM weijie guo > wrote: > > > +1(binding) > > > > > > Best regards, > > > > Weijie > > > > > > pranav tiwari 于2025年6月3日周二 12:47写道: > > > > > Hi Xintong, > > > > > > Than

Re: [DISCUSS] Decouple PyFlink wheel package build from Azure

2025-05-28 Thread Dian Fu
Hi Ferenc, This should have already been supported. See FLINK-34487 [1] for more details. I have checked the GHA nightly of the master branch and it works well. The problem is that the backport PRs for release branchs were not merged (which is not intended). I will follow up with the backport PRs.

Re: [DISCUSS] Deprecating/dropping support for Python 3.8

2025-05-27 Thread Dian Fu
Hi Mika, Thanks for bringing up this discussion. Regarding dropping support of Python 3.8: +1 for this. Since we will add support for Python 3.12 in Flink 2.1[1], this means we need to maintain 5 Python versions if we still support Python 3.8. Considering that 3.8 is already EOL and the issue you

Re: [DISCUSS] FLIP-531: Initiate Flink Agents as a new Sub-Project

2025-05-21 Thread Dian Fu
Thanks for the proposal. It's a promising direction to bring Flink's event driven processing capacity into AI agent. Looking forward! Regards, Dian On Thu, May 22, 2025 at 3:26 AM Yash Anand wrote: > > Thank you for the proposal—this initiative will make it much easier to > build event-driven AI

Re: Re: Long Initial Checkpoint Start Delay in PyFlink FlatMap Operator

2025-05-15 Thread Dian Fu
It uses aligned checkpoint by default in Flink which needs to process all the data buffered in the pipeline(network and operators) during checkpointing. In your use case, as the process speed is very slow and so it may take too long to process the buffered data. You could try to enable unalign chec

Re: [VOTE] Release 2.0.0, release candidate #2

2025-03-13 Thread Dian Fu
+1 (binding) - Verified checksum and signature - Install the PyFlink packages on MacOS and run a simple Python wordcount Regards, Dian On Thu, Mar 13, 2025 at 12:06 PM Jark Wu wrote: > > +1 (binding) > > - verified signatures: *OK* > - verified hashes: *OK* > - build source code with JDK11 and

Re: [DISCUSS] Adding API stability annotations (@Experimental, @PublicEvolving) to PyFlink APIs

2025-02-20 Thread Dian Fu
Hi Mika, Thanks a lot for bringing up this discussion. > Currently, the Java APIs use annotations like @PublicEvolving and > @Experimental to clearly indicate the stability status of API components. > This is super helpful for understanding which parts of the API are stable for > production us

[jira] [Created] (FLINK-37266) Python CLI arguments doesn't work in session mode

2025-02-06 Thread Dian Fu (Jira)
Dian Fu created FLINK-37266: --- Summary: Python CLI arguments doesn't work in session mode Key: FLINK-37266 URL: https://issues.apache.org/jira/browse/FLINK-37266 Project: Flink Issue Type

[jira] [Created] (FLINK-37207) Distributed cache set in the DataStream API does not work if a job use both the Table API & DataStream API

2025-01-22 Thread Dian Fu (Jira)
Dian Fu created FLINK-37207: --- Summary: Distributed cache set in the DataStream API does not work if a job use both the Table API & DataStream API Key: FLINK-37207 URL: https://issues.apache.org/jira/browse/FLINK-3

[jira] [Created] (FLINK-37205) Correct the state cache behavior during bump beam version

2025-01-22 Thread Dian Fu (Jira)
Dian Fu created FLINK-37205: --- Summary: Correct the state cache behavior during bump beam version Key: FLINK-37205 URL: https://issues.apache.org/jira/browse/FLINK-37205 Project: Flink Issue Type

[jira] [Created] (FLINK-37154) Support reading binary data from Kafka

2025-01-16 Thread Dian Fu (Jira)
Dian Fu created FLINK-37154: --- Summary: Support reading binary data from Kafka Key: FLINK-37154 URL: https://issues.apache.org/jira/browse/FLINK-37154 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-37084) NullPointerException occurs during handling timer of window in PyFlink

2025-01-09 Thread Dian Fu (Jira)
Dian Fu created FLINK-37084: --- Summary: NullPointerException occurs during handling timer of window in PyFlink Key: FLINK-37084 URL: https://issues.apache.org/jira/browse/FLINK-37084 Project: Flink

Re: [Discussion] Session Clusters Support Heterogeneous Task Manager Images

2024-12-04 Thread Dian Fu
Hi Ryan, It supports configuring the Python dependencies at job wise in PyFlink and so per my understanding, "dynamically provide dependencies in Python" should already be supported. Besides, it also supports specifying Python dependencies which are located in distributed file systems. It would be

[jira] [Created] (FLINK-35208) Respect pipeline.cached-files during processing Python dependencies

2024-04-22 Thread Dian Fu (Jira)
Dian Fu created FLINK-35208: --- Summary: Respect pipeline.cached-files during processing Python dependencies Key: FLINK-35208 URL: https://issues.apache.org/jira/browse/FLINK-35208 Project: Flink

[jira] [Created] (FLINK-34985) It doesn't support to access fields by name for map function in thread mode

2024-04-01 Thread Dian Fu (Jira)
Dian Fu created FLINK-34985: --- Summary: It doesn't support to access fields by name for map function in thread mode Key: FLINK-34985 URL: https://issues.apache.org/jira/browse/FLINK-34985 Project:

Re: Re: [VOTE] Accept Flink CDC into Apache Flink

2024-01-09 Thread Dian Fu
+1 (binding) Regards, Dian On Wed, Jan 10, 2024 at 5:09 AM Sharath wrote: > > +1 (non-binding) > > Best, > Sharath > > On Tue, Jan 9, 2024 at 1:02 PM Venkata Sanath Muppalla > wrote: > > > +1 (non-binding) > > > > Thanks, > > Sanath > > > > On Tue, Jan 9, 2024 at 11:16 AM Peter Huang > > wrote

Re: [PROPOSAL] Contribute Flink CDC Connectors project to Apache Flink

2023-12-12 Thread Dian Fu
Big +1 for this! Thanks for driving this effort! Regards, Dian On Mon, Dec 11, 2023 at 4:48 PM Leonard Xu wrote: > > Hey all, > > I want to extend my gratitude for the positive feedback we've received, > particularly from voices in other communities. It is an honor for the Flink > CDC communit

Re: Python connector question

2023-11-30 Thread Dian Fu
Hi Peter, Thanks a lot for taking care of this. Appreciate it! Re flink-sql-client-1.18.0.jar: The original motivation of including it in the PyFlink package is that we want to make sure that Python users get most things they need after piping install PyFlink. So most artifacts of a normal Flink

[jira] [Created] (FLINK-32989) PyFlink wheel package build failed

2023-08-29 Thread Dian Fu (Jira)
Dian Fu created FLINK-32989: --- Summary: PyFlink wheel package build failed Key: FLINK-32989 URL: https://issues.apache.org/jira/browse/FLINK-32989 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-32724) Mark CEP API classes as Public / PublicEvolving

2023-08-01 Thread Dian Fu (Jira)
Dian Fu created FLINK-32724: --- Summary: Mark CEP API classes as Public / PublicEvolving Key: FLINK-32724 URL: https://issues.apache.org/jira/browse/FLINK-32724 Project: Flink Issue Type

Re: [DISCUSS] Flink and Externalized connectors leads to block and circular dependency problems

2023-07-05 Thread Dian Fu
ectors underneath? > > The wrapping of connectors is a bit of a maintenance nightmare and > doesn't really work with external/custom connectors. > > On 04/07/2023 13:35, Dian Fu wrote: > > Thanks Ran Tao for proposing this discussion and Martijn for sharing > > the th

Re: [DISCUSS] Flink and Externalized connectors leads to block and circular dependency problems

2023-07-04 Thread Dian Fu
Thanks Ran Tao for proposing this discussion and Martijn for sharing the thought. > While flink-python now fails the CI, it shouldn't actually depend on the externalized connectors. I'm not sure what PyFlink does with it, but if belongs to the connector code, For each DataStream connector, there

Re: [VOTE] Apache Flink ML Release 2.3.0, release candidate #1

2023-06-29 Thread Dian Fu
+1 (binding) - Verified the checksums and signatures. - The website PR LGTM Regards, Dian On Thu, Jun 29, 2023 at 7:03 PM Zhipeng Zhang wrote: > > Thanks Dong and Xin for driving this release. > > +1 (non-binding) > > - Verified that the checksums and GPG files. > - Verified that the source dis

[jira] [Created] (FLINK-32131) Support specifying hadoop config dir for Python HiveCatalog

2023-05-18 Thread Dian Fu (Jira)
Dian Fu created FLINK-32131: --- Summary: Support specifying hadoop config dir for Python HiveCatalog Key: FLINK-32131 URL: https://issues.apache.org/jira/browse/FLINK-32131 Project: Flink Issue

[jira] [Created] (FLINK-31949) The state of CountTumblingWindowAssigner of Python DataStream API were never purged

2023-04-26 Thread Dian Fu (Jira)
Dian Fu created FLINK-31949: --- Summary: The state of CountTumblingWindowAssigner of Python DataStream API were never purged Key: FLINK-31949 URL: https://issues.apache.org/jira/browse/FLINK-31949 Project

[jira] [Created] (FLINK-31905) Exception thrown when accessing nested field of the result of Python UDF with complex type

2023-04-24 Thread Dian Fu (Jira)
Dian Fu created FLINK-31905: --- Summary: Exception thrown when accessing nested field of the result of Python UDF with complex type Key: FLINK-31905 URL: https://issues.apache.org/jira/browse/FLINK-31905

[jira] [Created] (FLINK-31861) Introduce ByteArraySchema which serialize/deserialize data of type byte array

2023-04-19 Thread Dian Fu (Jira)
Dian Fu created FLINK-31861: --- Summary: Introduce ByteArraySchema which serialize/deserialize data of type byte array Key: FLINK-31861 URL: https://issues.apache.org/jira/browse/FLINK-31861 Project: Flink

[jira] [Created] (FLINK-31707) Constant string cannot be used as input arguments of Pandas UDAF

2023-04-03 Thread Dian Fu (Jira)
Dian Fu created FLINK-31707: --- Summary: Constant string cannot be used as input arguments of Pandas UDAF Key: FLINK-31707 URL: https://issues.apache.org/jira/browse/FLINK-31707 Project: Flink

[jira] [Created] (FLINK-31690) The current key is not set for KeyedCoProcessOperator

2023-04-02 Thread Dian Fu (Jira)
Dian Fu created FLINK-31690: --- Summary: The current key is not set for KeyedCoProcessOperator Key: FLINK-31690 URL: https://issues.apache.org/jira/browse/FLINK-31690 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLIP-304: Pluggable failure handling for Apache Flink

2023-03-21 Thread Dian Fu
Hi Panagiotis, Thanks for the proposal. This is a very valuable feature and will be a good add-on for Flink. I also think that it will be great if we can consider how to make it possible for users to customize the failure handling in this FLIP. It's highly related to the problem we want to addres

[jira] [Created] (FLINK-31532) Support StreamExecutionEnvironment.socketTextStream in Python DataStream API

2023-03-21 Thread Dian Fu (Jira)
Dian Fu created FLINK-31532: --- Summary: Support StreamExecutionEnvironment.socketTextStream in Python DataStream API Key: FLINK-31532 URL: https://issues.apache.org/jira/browse/FLINK-31532 Project: Flink

[jira] [Created] (FLINK-31503) "org.apache.beam.sdk.options.PipelineOptionsRegistrar: Provider org.apache.beam.sdk.options.DefaultPipelineOptionsRegistrar not a subtype" is thrown when executing Pytho

2023-03-17 Thread Dian Fu (Jira)
Dian Fu created FLINK-31503: --- Summary: "org.apache.beam.sdk.options.PipelineOptionsRegistrar: Provider org.apache.beam.sdk.options.DefaultPipelineOptionsRegistrar not a subtype" is thrown when executing Python UDFs in SQL Client

[jira] [Created] (FLINK-31478) TypeError: a bytes-like object is required, not 'JavaList' is thrown when ds.execute_and_collect() is called on a KeyedStream

2023-03-15 Thread Dian Fu (Jira)
Dian Fu created FLINK-31478: --- Summary: TypeError: a bytes-like object is required, not 'JavaList' is thrown when ds.execute_and_collect() is called on a KeyedStream Key: FLINK-31478 URL: https://issues.apach

Re: [VOTE] Release 1.15.4, release candidate #2

2023-03-13 Thread Dian Fu
+1 (binding) - Verified the checksum and signature - Installed PyFlink on MacOS and run a word count example successfully - The website PR LGTM Regards, Dian On Thu, Mar 9, 2023 at 8:22 PM Danny Cranmer wrote: > Hi everyone, > Please review and vote on the release candidate #2 for the version

Re: [VOTE] Release 1.15.4, release candidate #1

2023-03-05 Thread Dian Fu
candidate at this point unless I get a -1 > veto. Is this issue impacting all Python Datastream apps with a Tumbling > window or a subset? I am wondering why it is only a Major? > > Thanks, > Danny > > [1] https://lists.apache.org/thread/9w99mgx3nw5tc0v26wcvlyqxrcrkpzdz >

Re: [VOTE] Release 1.15.4, release candidate #1

2023-03-02 Thread Dian Fu
Hi Danny, I'm sorry that I'm coming to this thread a little late. It seems that this will be the last bugfix release of Flink 1.15? If so, I'd like to also include https://issues.apache.org/jira/browse/FLINK-31272 into this release which fixes a serious issue of PyFlink. Regards, Dian On Thu,

[jira] [Created] (FLINK-31286) Python processes are still alive when shutting down a session cluster directly without stopping the jobs

2023-03-01 Thread Dian Fu (Jira)
Dian Fu created FLINK-31286: --- Summary: Python processes are still alive when shutting down a session cluster directly without stopping the jobs Key: FLINK-31286 URL: https://issues.apache.org/jira/browse/FLINK-31286

[jira] [Created] (FLINK-31272) Duplicate operators appear in the StreamGraph for Python DataStream API jobs

2023-02-28 Thread Dian Fu (Jira)
Dian Fu created FLINK-31272: --- Summary: Duplicate operators appear in the StreamGraph for Python DataStream API jobs Key: FLINK-31272 URL: https://issues.apache.org/jira/browse/FLINK-31272 Project: Flink

Re: [VOTE] FLIP-289: Support online inference (Flink ML)

2023-02-26 Thread Dian Fu
you all for the votes! > > > > > > The vote is now closed. I will announce the results in a separate > email. > > > > > > Cheers, > > > Dong > > > > > > On Thu, Feb 16, 2023 at 6:02 PM Zhipeng Zhang > > > > wrote: > > > >

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

2023-02-21 Thread Dian Fu
Congratulations Rui! On Tue, Feb 21, 2023 at 6:34 PM Maximilian Michels wrote: > Congrats Rui! Well done!! > > -Max > > On Tue, Feb 21, 2023 at 10:09 AM Roman Khachatryan > wrote: > > > > Congratulations Rui! > > > > Regards, > > Roman > > > > > > On Mon, Feb 20, 2023 at 5:58 PM Anton Kalashnik

Re: [ANNOUNCE] New Apache Flink Committer - Anton Kalashnikov

2023-02-21 Thread Dian Fu
Congratulations Anton! On Tue, Feb 21, 2023 at 9:12 PM Austin Cawley-Edwards < austin.caw...@gmail.com> wrote: > Congrats Anton 🥳 > > On Tue, Feb 21, 2023 at 04:08 Roman Khachatryan wrote: > > > Congratulations Anton, well deserved! > > > > Regards, > > Roman > > > > > > On Tue, Feb 21, 2023 at

Re: [ANNOUNCE] New Apache Flink Committer - Sergey Nuyanzin

2023-02-21 Thread Dian Fu
Congratulations Sergey! On Tue, Feb 21, 2023 at 9:07 PM Rui Fan wrote: > Congratulations, Sergey! > > Best > Rui Fan > > On Tue, Feb 21, 2023 at 20:55 Junrui Lee wrote: > > > Congratulations Sergey! > > > > weijie guo 于2023年2月21日周二 20:54写道: > > > > > Congratulations, Sergey~ > > > > > > Best r

[jira] [Created] (FLINK-31172) Support coGroup in Python DataStream API

2023-02-21 Thread Dian Fu (Jira)
Dian Fu created FLINK-31172: --- Summary: Support coGroup in Python DataStream API Key: FLINK-31172 URL: https://issues.apache.org/jira/browse/FLINK-31172 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-31171) Support iterate in Python DataStream API

2023-02-21 Thread Dian Fu (Jira)
Dian Fu created FLINK-31171: --- Summary: Support iterate in Python DataStream API Key: FLINK-31171 URL: https://issues.apache.org/jira/browse/FLINK-31171 Project: Flink Issue Type: New Feature

Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin

2023-02-15 Thread Dian Fu
Congratulations Dong! Regards, Dian On Thu, Feb 16, 2023 at 2:41 PM Junrui Lee wrote: > Congratulations, Dong! > > Best, > Junrui > > Guowei Ma 于2023年2月16日周四 14:21写道: > > > Hi, everyone > > > > On behalf of the PMC, I'm very happy to announce Dong Lin as a new > > Flink PMC. > > > > Do

Re: [ANNOUNCE] New Apache Flink Committer - Jing Ge

2023-02-15 Thread Dian Fu
Congratulations Jing! Regards, Dian On Wed, Feb 15, 2023 at 8:04 PM Yun Tang wrote: > Congratulations, Jing! > > Best > Yun Tang > > From: Dong Lin > Sent: Wednesday, February 15, 2023 19:40 > To: dev@flink.apache.org > Subject: Re: [ANNOUNCE] New Apache Flink

Re: Re: [ANNOUNCE] New Apache Flink Committer - Weijie Guo

2023-02-13 Thread Dian Fu
Congratulations, Weijie! Regards, Dian On Mon, Feb 13, 2023 at 10:55 PM Matthias Pohl wrote: > Congrats, Weijie! :-) > > On Mon, Feb 13, 2023 at 10:50 AM Sergey Nuyanzin > wrote: > > > Congratulations, Weijie! > > > > On Mon, Feb 13, 2023 at 10:32 AM Yun Tang wrote: > > > > > Congratulations,

Re: [VOTE] FLIP-289: Support online inference (Flink ML)

2023-02-13 Thread Dian Fu
+1 (binding) Regards, Dian On Mon, Feb 13, 2023 at 11:04 AM Dong Lin wrote: > Hi all, > > We would like to start the vote for FLIP-289: Support online inference > (Flink ML) [1]. This FLIP was discussed in this thread [2]. > > The goal of this FLIP is to enable users to use the model trained by

[jira] [Created] (FLINK-31043) KeyError exception is thrown in CachedMapState

2023-02-13 Thread Dian Fu (Jira)
Dian Fu created FLINK-31043: --- Summary: KeyError exception is thrown in CachedMapState Key: FLINK-31043 URL: https://issues.apache.org/jira/browse/FLINK-31043 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-31031) Disable the output buffer of Python process to make it more convenient for interactive users

2023-02-12 Thread Dian Fu (Jira)
Dian Fu created FLINK-31031: --- Summary: Disable the output buffer of Python process to make it more convenient for interactive users Key: FLINK-31031 URL: https://issues.apache.org/jira/browse/FLINK-31031

Re: [DISCUSS] FLIP-289: Support online inference (Flink ML)

2023-02-09 Thread Dian Fu
Hi Dong, Thanks for the reply. Got your points and it makes sense to me now~ Regards, Dian On Thu, Feb 9, 2023 at 3:45 PM Dong Lin wrote: > Hi Dian, > > Thanks for the review! Please see my reply inline. > > Regards, > Dong > > On Wed, Feb 8, 2023 at 11:58 AM Dian

Re: [DISCUSS] FLIP-289: Support online inference (Flink ML)

2023-02-07 Thread Dian Fu
Hi Dong, Thanks for driving this effort! This FLIP LGTM overall. I have just a few minor comments regarding the proposed API: 1) For the method `DataFrame.collect()`, why is it named `collect` instead of something else, e.g. `get`? Does it mean that the result will be computed during this method

Re: [ANNOUNCE] New Apache Flink Committer - Lincoln Lee

2023-01-09 Thread Dian Fu
Congratulations, Lincoln! Regards, Dian On Tue, Jan 10, 2023 at 1:31 PM weijie guo wrote: > Congratulations, Lincoln! > > Best regards, > > Weijie > > > Lijie Wang 于2023年1月10日周二 12:24写道: > > > Congratulations, Lincoln! > > > > Best, > > Lijie > > > > Jingsong Li 于2023年1月10日周二 12:07写道: > > > >

[jira] [Created] (FLINK-30364) Job failed without exception stack

2022-12-11 Thread Dian Fu (Jira)
Dian Fu created FLINK-30364: --- Summary: Job failed without exception stack Key: FLINK-30364 URL: https://issues.apache.org/jira/browse/FLINK-30364 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-30308) ClassCastException: class java.io.ObjectStreamClass$Caches$1 cannot be cast to class java.util.Map is showing in the logging when the job shutdown

2022-12-05 Thread Dian Fu (Jira)
Dian Fu created FLINK-30308: --- Summary: ClassCastException: class java.io.ObjectStreamClass$Caches$1 cannot be cast to class java.util.Map is showing in the logging when the job shutdown Key: FLINK-30308 URL: https

[ANNOUNCE] New Apache Flink PMC Members - Godfrey He, Xingbo Huang

2022-11-22 Thread Dian Fu
Hi everyone, On behalf of the Apache Flink PMC, I'm very happy to announce that Godfrey He and Xingbo Huang have joined the Flink PMC! Godfrey He becomes a Flink committer in Sep 2020. His contributions are mainly focused on the Flink table module, covering almost all important parts such as Clie

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-21 Thread Dian Fu
Congrats Matyas! On Tue, Nov 22, 2022 at 9:00 AM Tony Wei wrote: > Congrats Matyas! > > Thomas Weise 於 2022年11月22日 週二 上午8:56寫道: > > > Congrats Matyas! > > > > > > On Mon, Nov 21, 2022 at 6:28 PM Őrhidi Mátyás > > wrote: > > > > > Thanks folks, > > > > > > So proud and honored to be part of the

Re: [VOTE] Release 1.14.6, release candidate #2

2022-09-22 Thread Dian Fu
+1 (binding) - Reviewed the flink-web PR - Installed the PyFlink package and run a simple example successfully - Verified the checksum and signature Regards, Dian On Thu, Sep 22, 2022 at 8:36 PM Yun Tang wrote: > +1 (non-binding) > > > * Check the checksums of released tar packages. > *

[jira] [Created] (FLINK-29192) Add completeness test for built-in functions between Java and Python Table API

2022-09-05 Thread Dian Fu (Jira)
Dian Fu created FLINK-29192: --- Summary: Add completeness test for built-in functions between Java and Python Table API Key: FLINK-29192 URL: https://issues.apache.org/jira/browse/FLINK-29192 Project: Flink

[jira] [Created] (FLINK-28886) Support HybridSource in Python DataStream API

2022-08-09 Thread Dian Fu (Jira)
Dian Fu created FLINK-28886: --- Summary: Support HybridSource in Python DataStream API Key: FLINK-28886 URL: https://issues.apache.org/jira/browse/FLINK-28886 Project: Flink Issue Type: Improvement

Re: Python Job Support for the Kubernetes Operator

2022-07-05 Thread Dian Fu
Thanks for the confirmation Matyas! On Tue, Jul 5, 2022 at 3:00 PM Őrhidi Mátyás wrote: > Yes, this is the plan Dian. Appreciate your assistance! > > Best, > Matyas > > On Tue, Jul 5, 2022 at 8:55 AM Dian Fu wrote: > >> Hi Matyas, >> >> According to

Re: Python Job Support for the Kubernetes Operator

2022-07-04 Thread Dian Fu
>> Thank you for the info and help Dian :) >> >> Gyula >> >> On Tue, 5 Jul 2022 at 05:14, Yang Wang wrote: >> >> > Thanks Dian for the confirmation and nice help. >> > >> > Best, >> > Yang >> > >> > Dian Fu

Re: [VOTE] Apache Flink ML Release 2.1.0, release candidate #2

2022-07-04 Thread Dian Fu
+1 (binding) - Verified the checksum and signature - Installed the Python package and runs an example documented here[1] - Reviewed the website PR and LGTM overall Regards, Dian [1] https://nightlies.apache.org/flink/flink-ml-docs-master/docs/operators/clustering/kmeans/#examples On Mon, Jul 4,

Re: Python Job Support for the Kubernetes Operator

2022-07-04 Thread Dian Fu
; However, they need some manual operations, including specify the user jar, > download python script via init container, etc. > > What we could do in the Flink kubernetes operator is to make the > submission more convenient by introducing a new field(e.g. pyScript). > > cc @Dian

[jira] [Created] (FLINK-28253) LocalDateTime is not supported in PyFlink

2022-06-26 Thread Dian Fu (Jira)
Dian Fu created FLINK-28253: --- Summary: LocalDateTime is not supported in PyFlink Key: FLINK-28253 URL: https://issues.apache.org/jira/browse/FLINK-28253 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-28140) Improve the documentation by adding Python examples

2022-06-20 Thread Dian Fu (Jira)
Dian Fu created FLINK-28140: --- Summary: Improve the documentation by adding Python examples Key: FLINK-28140 URL: https://issues.apache.org/jira/browse/FLINK-28140 Project: Flink Issue Type

Re: [ANNOUNCE] New Apache Flink Committers: Qingsheng Ren, Shengkai Fang

2022-06-20 Thread Dian Fu
Congratulations, Qingsheng and ShengKai! Regards, Dian On Mon, Jun 20, 2022 at 5:41 PM Lincoln Lee wrote: > Congrats, Qingsheng and Shengkai! > > > Best, > Lincoln Lee > > > Sergey Nuyanzin 于2022年6月20日周一 17:24写道: > > > Congratulations, Qingsheng and ShengKai. > > > > On Mon, Jun 20, 2022 at 11

[jira] [Created] (FLINK-28114) The path of the Python client interpreter could not point to an archive file in distributed file system

2022-06-17 Thread Dian Fu (Jira)
Dian Fu created FLINK-28114: --- Summary: The path of the Python client interpreter could not point to an archive file in distributed file system Key: FLINK-28114 URL: https://issues.apache.org/jira/browse/FLINK-28114

Re: [VOTE] Release 1.14.5, release candidate #1

2022-06-16 Thread Dian Fu
+1 (binding) - Verified the checksum and signature - Reviewed the website PR - Go through the artifacts to be deployed to maven central repository, there should be no missing artifacts Regards, Dian On Tue, Jun 14, 2022 at 11:27 AM Xingbo Huang wrote: > +1 (non-binding) > > - verify signatures

Re: [ANNOUNCE] New Apache Flink PMC Member - Jingsong Lee

2022-06-15 Thread Dian Fu
Congratulations, Jingsong! Regards, Dian On Thu, Jun 16, 2022 at 1:08 AM Yu Li wrote: > Congrats, Jingsong! > > Best Regards, > Yu > > > On Wed, 15 Jun 2022 at 15:26, Sergey Nuyanzin wrote: > > > Congratulations, Jingsong! > > > > On Wed, Jun 15, 2022 at 8:45 AM Jingsong Li > > wrote: > > > >

[jira] [Created] (FLINK-28071) Support missing built-in functions in Table API

2022-06-14 Thread Dian Fu (Jira)
Dian Fu created FLINK-28071: --- Summary: Support missing built-in functions in Table API Key: FLINK-28071 URL: https://issues.apache.org/jira/browse/FLINK-28071 Project: Flink Issue Type: Sub-task

Re: [VOTE] FLIP-228: Support Within between events in CEP Pattern

2022-06-13 Thread Dian Fu
+1 (binding) Regards, Dian On Mon, Jun 13, 2022 at 3:55 PM Rui Fan <1996fan...@gmail.com> wrote: > Thanks for Nicholas driving this. > > +1(non-binding) > > Best, > Rui Fan > > On Mon, Jun 13, 2022 at 3:05 PM md peng wrote: > > > +1(not-binding) > > > > Best, > > Mingde Peng > > > > Martijn Vis

[jira] [Created] (FLINK-28015) FROM_UNIXTIME could not be used in Table API

2022-06-12 Thread Dian Fu (Jira)
Dian Fu created FLINK-28015: --- Summary: FROM_UNIXTIME could not be used in Table API Key: FLINK-28015 URL: https://issues.apache.org/jira/browse/FLINK-28015 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLIP-228: Support Within between events in CEP Pattern

2022-06-10 Thread Dian Fu
`WithinType` could update to > `PREVIOUS_AND_NEXT` and `FIRST_AND_LAST` which directly indicate the time > interval within the PREVIOUS and NEXT event and within the FIRST and LAST > event. `RELATIVE_TO_FIRST` and `RELATIVE_TO_PREVIOUS` are not clear to > understand wh

Re: [DISCUSS] FLIP-228: Support Within between events in CEP Pattern

2022-06-08 Thread Dian Fu
e > sparsity. > > Best regards, > > Martijn > > Op ma 6 jun. 2022 om 09:49 schreef Dian Fu : > > > Hi Nicholas, > > > > Thanks a lot for the update. > > > > Regarding the pattern API, should we also introduce APIs such as > > Pattern.times(

Re: [DISCUSS] FLIP-228: Support Within between events in CEP Pattern

2022-06-06 Thread Dian Fu
gt; > Martijn > > https://twitter.com/MartijnVisser82 > > https://github.com/MartijnVisser > > > > > > On Sat, 7 May 2022 at 11:17, Dian Fu wrote: > > > > > Hi Nicholas, > > > > > > Thanks a lot for bringing up this discussion. If

Re: [DISCUSS] Releasing Flink 1.14.5

2022-05-26 Thread Dian Fu
Hi Xingbo, Thanks for driving this release. +1 for 1.14.5 as there are already nearly 100 commits [1] since 1.14.4. Regards, Dian [1] https://github.com/apache/flink/compare/release-1.14.4...release-1.14 On Tue, May 24, 2022 at 2:23 PM Xingbo Huang wrote: > Hi all, > > I would like to start d

[jira] [Created] (FLINK-27760) NPE is thrown when executing PyFlink jobs in batch mode

2022-05-24 Thread Dian Fu (Jira)
Dian Fu created FLINK-27760: --- Summary: NPE is thrown when executing PyFlink jobs in batch mode Key: FLINK-27760 URL: https://issues.apache.org/jira/browse/FLINK-27760 Project: Flink Issue Type

[jira] [Created] (FLINK-27729) Support constructing StartCursor and StopCursor from MessageId

2022-05-21 Thread Dian Fu (Jira)
Dian Fu created FLINK-27729: --- Summary: Support constructing StartCursor and StopCursor from MessageId Key: FLINK-27729 URL: https://issues.apache.org/jira/browse/FLINK-27729 Project: Flink Issue

[jira] [Created] (FLINK-27598) Improve the exception message when mixing use Python UDF and Pandas UDF

2022-05-12 Thread Dian Fu (Jira)
Dian Fu created FLINK-27598: --- Summary: Improve the exception message when mixing use Python UDF and Pandas UDF Key: FLINK-27598 URL: https://issues.apache.org/jira/browse/FLINK-27598 Project: Flink

[jira] [Created] (FLINK-27584) Support broadcast state in PyFlink DataStream API

2022-05-12 Thread Dian Fu (Jira)
Dian Fu created FLINK-27584: --- Summary: Support broadcast state in PyFlink DataStream API Key: FLINK-27584 URL: https://issues.apache.org/jira/browse/FLINK-27584 Project: Flink Issue Type: New

[jira] [Created] (FLINK-27564) Split PyFlink DataStream connectors into separate files

2022-05-10 Thread Dian Fu (Jira)
Dian Fu created FLINK-27564: --- Summary: Split PyFlink DataStream connectors into separate files Key: FLINK-27564 URL: https://issues.apache.org/jira/browse/FLINK-27564 Project: Flink Issue Type

[jira] [Created] (FLINK-27545) Update examples in PyFlink shell

2022-05-08 Thread Dian Fu (Jira)
Dian Fu created FLINK-27545: --- Summary: Update examples in PyFlink shell Key: FLINK-27545 URL: https://issues.apache.org/jira/browse/FLINK-27545 Project: Flink Issue Type: Bug Components

Re: Re: [ANNOUNCE] New Flink PMC member: Yang Wang

2022-05-07 Thread Dian Fu
Congrats Yang! Regards, Dian On Sat, May 7, 2022 at 12:51 PM Jacky Lau wrote: > Congrats Yang and well Deserved! > > Best, > Jacky Lau > > Yun Gao 于2022年5月7日周六 10:44写道: > > > Congratulations Yang! > > > > Best, > > Yun Gao > > > > > > > > --Original Mail -- > >

Re: [DISCUSS] FLIP-228: Support Within between events in CEP Pattern

2022-05-07 Thread Dian Fu
Hi Nicholas, Thanks a lot for bringing up this discussion. If I recall it correctly, this feature has been requested many times by the users and is among one of the most requested features in CEP. So big +1 to this feature overall. Regarding the API, the name `partialWithin` sounds a little weird

[jira] [Created] (FLINK-27421) Bundle test utility classes into the PyFlink package to make users write test cases easily

2022-04-26 Thread Dian Fu (Jira)
Dian Fu created FLINK-27421: --- Summary: Bundle test utility classes into the PyFlink package to make users write test cases easily Key: FLINK-27421 URL: https://issues.apache.org/jira/browse/FLINK-27421

[jira] [Created] (FLINK-27373) Disable installing PyFlink using `python setup.py install`

2022-04-24 Thread Dian Fu (Jira)
Dian Fu created FLINK-27373: --- Summary: Disable installing PyFlink using `python setup.py install` Key: FLINK-27373 URL: https://issues.apache.org/jira/browse/FLINK-27373 Project: Flink Issue Type

  1   2   3   4   5   6   7   8   9   >