Re: [ANNOUNCE] New Apache Flink Committer - Junrui Li

Congratulations, Junrui! Best, Yu Chen > 2024年11月6日 16:32，Xuyang 写道： > > Congratulations, Junrui! > > > -- > >Best！ >Xuyang > > > > > > 在 2024-11-06 14:34:36，"Yuepeng Pan" 写道： >> Congratulations! >> >>

Re: [jira](FLINK-36127) Apply for a jira account and repair bug

Hi Yunming, Thanks for help to resolve the ticket FLINK-36127, and welcome to join flink community. I noticed that Leonard was processing request recently, and cc’ed. Best, Yu Chen. > 2024年8月22日 20:01，Yunming Tang 写道： > > Dear committers, > I'm willing to repair the bug o

[jira] [Created] (FLINK-36127) Support sorting watermark on flink web

Yu Chen created FLINK-36127: --- Summary: Support sorting watermark on flink web Key: FLINK-36127 URL: https://issues.apache.org/jira/browse/FLINK-36127 Project: Flink Issue Type: Improvement

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

ntation of stream-graphs on the web to enable fine-grained observations for users, as mentioned in Future Work. Best, Yu Chen > 2024年7月24日 16:03，Junrui Lee 写道： > > Hi all, > > Thank you for all the feedback and suggestions so far. If there are no > further comments, we wi

[jira] [Created] (FLINK-35832) IFNULL returns error result in Flink SQL

Yu Chen created FLINK-35832: --- Summary: IFNULL returns error result in Flink SQL Key: FLINK-35832 URL: https://issues.apache.org/jira/browse/FLINK-35832 Project: Flink Issue Type: Bug

Re: [VOTE] FLIP-437: Support ML Models in Flink SQL

+1 (non-binding) Looking forward to this future. Thanks, Yu Chen > 2024年4月3日 10:23，Jark Wu 写道： > > +1 (binding) > > Best, > Jark > > On Tue, 2 Apr 2024 at 15:12, Timo Walther wrote: > >> +1 (binding) >> >> Thanks, >> Timo >> >

[jira] [Created] (FLINK-34968) Update flink-web copyright to 2024

Yu Chen created FLINK-34968: --- Summary: Update flink-web copyright to 2024 Key: FLINK-34968 URL: https://issues.apache.org/jira/browse/FLINK-34968 Project: Flink Issue Type: Improvement

Re: [ANNOUNCE] Apache Flink 1.19.0 released

Congratulations! Thanks to release managers and everyone involved! Best, Yu Chen > 2024年3月19日 01:01，Jeyhun Karimov 写道： > > Congrats! > Thanks to release managers and everyone involved. > > Regards, > Jeyhun > > On Mon, Mar 18, 2024 at 9:25 AM Lincoln Lee wr

[jira] [Created] (FLINK-34622) Typo of execution_mode configuration name in Chinese document

Yu Chen created FLINK-34622: --- Summary: Typo of execution_mode configuration name in Chinese document Key: FLINK-34622 URL: https://issues.apache.org/jira/browse/FLINK-34622 Project: Flink Issue

Re: Flink autoscaler scaling report

r/blob/48df9d35ed55ae8bb513d9153e9f6f668da9e1c3/flink-autoscaler/src/main/java/org/apache/flink/autoscaler/event/LoggingEventHandler.java#L43C18-L43C18 Best, Yu Chen > 2024年1月18日 18:20，Yang LI 写道： > > Hello dear flink community, > > I noticed that there's a scaling report feature

[jira] [Created] (FLINK-34099) CheckpointIntervalDuringBacklogITCase.testNoCheckpointDuringBacklog is unstable on AZP

Yu Chen created FLINK-34099: --- Summary: CheckpointIntervalDuringBacklogITCase.testNoCheckpointDuringBacklog is unstable on AZP Key: FLINK-34099 URL: https://issues.apache.org/jira/browse/FLINK-34099

Re: [DISCUSS] FLIP 411: Chaining-agnostic Operator ID generation for improved state compatibility on parallelism change

some cases. While I have no time to find out the root cause recently. If you're interested, I'd be happy to discuss it with you and try to solve the problem. [1] https://issues.apache.org/jira/browse/FLINK-5290 Best, Yu Chen > 2024年1月11日 15:07，Zhanghao Chen 写道： > > Hi

Re: [DISCUSS] FLIP 411: Chaining-agnostic Operator ID generation for improved state compatibility on parallelism change

, which will result in the user unable to recover from the old state (old and new Operator IDs can't be mapped). Therefore switching Hasher strategy (V2->V3 or V3->V2) will lead to an incompatibility, is there any relevant compatibility design considered? Best, Yu Chen > 20

[jira] [Created] (FLINK-34029) Support different profiling mode on Flink WEB

Yu Chen created FLINK-34029: --- Summary: Support different profiling mode on Flink WEB Key: FLINK-34029 URL: https://issues.apache.org/jira/browse/FLINK-34029 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-33613) Python UDF Runner process leak in Process Mode

Yu Chen created FLINK-33613: --- Summary: Python UDF Runner process leak in Process Mode Key: FLINK-33613 URL: https://issues.apache.org/jira/browse/FLINK-33613 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-33474) ShowPlan throws undefined exception In Flink Web Submit Page

Yu Chen created FLINK-33474: --- Summary: ShowPlan throws undefined exception In Flink Web Submit Page Key: FLINK-33474 URL: https://issues.apache.org/jira/browse/FLINK-33474 Project: Flink Issue

[jira] [Created] (FLINK-33436) Documentation on the built-in Profiler

Yu Chen created FLINK-33436: --- Summary: Documentation on the built-in Profiler Key: FLINK-33436 URL: https://issues.apache.org/jira/browse/FLINK-33436 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-33435) The visualization and download capabilities of profiling history

Yu Chen created FLINK-33435: --- Summary: The visualization and download capabilities of profiling history Key: FLINK-33435 URL: https://issues.apache.org/jira/browse/FLINK-33435 Project: Flink

[jira] [Created] (FLINK-33434) Support invoke async-profiler on Taskmanager through REST API

Yu Chen created FLINK-33434: --- Summary: Support invoke async-profiler on Taskmanager through REST API Key: FLINK-33434 URL: https://issues.apache.org/jira/browse/FLINK-33434 Project: Flink Issue

[jira] [Created] (FLINK-33433) Support invoke async-profiler on Jobmanager through REST API

Yu Chen created FLINK-33433: --- Summary: Support invoke async-profiler on Jobmanager through REST API Key: FLINK-33433 URL: https://issues.apache.org/jira/browse/FLINK-33433 Project: Flink Issue

Re: [VOTE] FLIP-370: Support Balanced Tasks Scheduling

+1 (non-binding) We deeply need this capability to balance Tasks at the Taskmanager level in production, which helps to make a more sufficient usage of Taskmanager resources. Thanks for driving that. Best, Yu Chen Yangze Guo 于2023年10月23日周一 15:08写道： > +1 (binding) > > Best, > Yangz

[jira] [Created] (FLINK-33325) FLIP-375: Built-in cross-platform powerful java profiler

Yu Chen created FLINK-33325: --- Summary: FLIP-375: Built-in cross-platform powerful java profiler Key: FLINK-33325 URL: https://issues.apache.org/jira/browse/FLINK-33325 Project: Flink Issue Type

[VOTE][RESULT] FLIP-375: Built-in cross-platform powerful java profiler

dulov Mason Chen There were no -1 votes. Thus FLIP-375 has been accepted. Thanks everyone for joining the discussion and giving feedback! [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-375%3A+Built-in+cross-platform+powerful+java+profiler Best, Yu Chen

[VOTE] FLIP-375: Built-in cross-platform powerful java profiler

there is an objection or an insufficient number of votes). Thanks, Yu Chen [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-375%3A+Built-in+cross-platform+powerful+java+profiler [2] https://lists.apache.org/thread/tp5vqgspsdko66dr6vm7cgtod9k2pct7

Re: [DISCUSS] FLIP-375: Built-in cross-platform powerful java profiler on taskmanagers

can adjust the environment according to the exception information. [1] async-profiler/async-profiler: Sampling CPU and HEAP profiler for Java featuring AsyncGetCallTrace + perf_events (github.com) <https://github.com/async-profiler/async-profiler#troubleshooting> Best, Yu Chen David Christle

Re: [DISCUSS] FLIP-375: Built-in cross-platform powerful java profiler on taskmanagers

Hi all. If there are no further questions, we will start a vote on FLIP-375 next week. Best regards, Yu Chen Yu Chen 于2023年10月9日周一 17:24写道： > Hi all, > > Yun Tang and I are opening this thread to discuss our proposal to > integrate async-profiler's capabilities for profiling

[jira] [Created] (FLINK-33230) Support Expanding ExecutionGraph to StreamGraph in Flink

Yu Chen created FLINK-33230: --- Summary: Support Expanding ExecutionGraph to StreamGraph in Flink Key: FLINK-33230 URL: https://issues.apache.org/jira/browse/FLINK-33230 Project: Flink Issue Type

Re: [DISCUSS] FLIP-375: Built-in cross-platform powerful java profiler on taskmanagers

Hi zhanghao, Yes, agree with you. We'll take Jobmanager into consideration and update the FLIP later! Best, Yu Chen Zhanghao Chen 于2023年10月9日周一 19:22写道： > Hi Yun and Yu, > > Thanks for driving this. This would definitely help users identify > performance bottlenecks, especia

[DISCUSS] FLIP-375: Built-in cross-platform powerful java profiler on taskmanagers

P-375%3A+Built-in+cross-platform+powerful+java+profiler+on+taskmanagers> [2] GitHub - async-profiler/async-profiler: Sampling CPU and HEAP profiler for Java featuring AsyncGetCallTrace + perf_events <https://github.com/async-profiler/async-profiler> Best regards, Yun Tang and Yu Chen

[jira] [Created] (FLINK-32754) Using SplitEnumeratorContext.metricGroup() in restoreEnumerator causes NPE

Yu Chen created FLINK-32754: --- Summary: Using SplitEnumeratorContext.metricGroup() in restoreEnumerator causes NPE Key: FLINK-32754 URL: https://issues.apache.org/jira/browse/FLINK-32754 Project: Flink

[jira] [Created] (FLINK-32186) Support subtask stack auto-search when redirecting from subtask backpressure tab

Yu Chen created FLINK-32186: --- Summary: Support subtask stack auto-search when redirecting from subtask backpressure tab Key: FLINK-32186 URL: https://issues.apache.org/jira/browse/FLINK-32186 Project

Re: [VOTE] Release 1.17.0, release candidate #3

.19 K/s | |Total |100,000,000|14.129 |123.766 |1748.705 |57.19 K/s | +---+---+---+---+---+-------+ Thanks. Best Yu Chen. Yun Gao 于2023年3月22日周三 18:18写道

Re: [VOTE] Release 1.17.0, release candidate #3

K/s | +---+---+---+---+---+---+ [1] https://github.com/nexmark/nexmark Best Yu Chen.

Re: [DISCUSS] Cleaning up HighAvailabilityServices interface to reflect the per-JM-process LeaderElection

thanks to Matthias, I read the previous email here, and I will express my own views on some issues @Matthias My opinion is that the scheme of high-availability splitting of each component should be retained. As mentioned in David, when we need to split each component, we need to use each LeaderEl

Re: [VOTE] FLIP-273: Improve Catalog API to Support ALTER TABLE syntax

+1(no-binding) Jark Wu 于2022年12月5日周一 11:00写道： > +1 (binding) > > Best, > Jark > > On Fri, 2 Dec 2022 at 10:11, Paul Lam wrote: > > > +1 (non-binding) > > > > Best, > > Paul Lam > > > > > 2022年12月2日 09:17，yuxia 写道： > > > > > > +1 (non-binding) > > > > > > Best regards, > > > Yuxia > > > > > > -

Re: [VOTE] FLIP-271: Autoscaling

+1(no-binding) Maximilian Michels 于 2022年11月24日周四 上午12:25写道： > Hi everyone, > > I'd like to start a vote for FLIP-271 [1] which we previously discussed on > the dev mailing list [2]. > > I'm planning to keep the vote open for at least until Tuesday, Nov 29. > > -Max > > [1] > https://cwiki.apach

Re: FRocksDB Some Question

s%3Acomment-tabpanel#comment-17560179 > > [2] > > https://issues.apache.org/jira/browse/FLINK-24932?focusedCommentId=17557331&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17557331 > [3] > > https://github.com/ververica/frocksdb/blob/FRocksDB-

FRocksDB Some Question

Hi community, I want to ask a question about frocksdb I noticed that frocksdb seems to have been inactive for a long time. flink-statebackend-rocksdb is depend https://github.com/ververica/frocksdb to run state backend This Rocksdb is stuck at 6.20.3.But the current upstream version https://github

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

Congratulations ~ 🍻 Márton Balassi 于2022年11月21日周一 22:18写道： > Hi everyone, > > On behalf of the PMC, I'm very happy to announce Matyas Orhidi as a new > Flink > committer. > > Matyas has over a decade of experience of the Big Data ecosystem and has > been working with Flink full time for the past

Re: [DISCUSS] FLIP-271: Autoscaling

@Gyula Have a good news, now flip-256 now is finish and merge it . flip-271 discussion seems to have stopped and I wonder if there are any other comments. Can we get to the polls and start this exciting feature 😀 Maybe I can get involved in developing this feature Gyula Fóra 于2022年11月8日周二 18

Re: [DISCUSS] FLIP-271: Autoscaling

Hi Max Thank you for dirver this flip，I have some advice for this flip Do we not only exist in the (on/off) switch, but also have one more option for (advcie). After the user opens (advcie), it does not actually perform AutoScaling. It only outputs the notification form of tuning suggestions for t

Re: [Discuss]- Donate Iceberg Flink Connector

+1, thanks to drive it Abid Mohammed 于2022年10月10日周一 09:22写道： > Hi, > > I would like to start a discussion about contributing Iceberg Flink > Connector to Flink. > > I created a doc < > https://docs.google.com/document/d/1WC8xkPiVdwtsKL2VSPAUgzm9EjrPs8ZRjEtcwv93ISI/edit?usp=sharing> > with all th

Re: [VOTE] FLIP-254 Redis Streams connector

FLIP: > > > some > > > > typos such as "provide at-least guarantees" and the initial version > > > should > > > > not be 1.0.0 given that version 1.1.5 was already released in its > > > previous > > > > incarnation[2]. > >

Re: [DISCUSS] FLIP-265 Deprecate and remove Scala API support

Hi Martjin, Thanks for compiling the FLIP. I think the removal of Scala in the later version 2.0 will help us to align with the JDK version in a more timely manner. Scala may be difficult to maintain due to too much syntactic sugar during maintenance (only represents a personal opinion). Flink dev

Re: [RESULT][VOTE]FLIP-260: Support Job Dynamic Parameter With Flink Rest Api

[1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-256%3A+Support+Job+Dynamic+Parameter+With+Flink+Rest+Api Zheng Yu Chen 于2022年10月7日周五 00:01写道： > Hi everyone, > > FLIP-256 [1] has been accepted. > > There are 3 approving votes which are all binding [2] > > - B

[RESULT][VOTE]FLIP-260: Support Job Dynamic Parameter With Flink Rest Api

Hi everyone, FLIP-256 [1] has been accepted. There are 3 approving votes which are all binding [2] - Binding: Danny Cranmer- Binding: Gyula Fóra- Binding: Martijn Visser None against. Thanks again to everyone ! [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-256 +Support+Job+Dynam

Re: Kubernetes Operator 1.2.0 release

+1 Thanks to drive it Gyula Fóra 于2022年9月19日周一 19:37写道： > Hi Devs! > > The originally planned (October 1) release date for 1.2.0 is fast > approaching and we are already slightly behind schedule. There are a couple > outstanding bug tickets with 2 known blockers at the moment that should be > fi

Re: [DISCUSS] FLIP-256 Support Job Dynamic Parameter With Flink Rest Api

let's do it Peng Kang 于2022年9月14日周三 10:05写道： > +1 > > On Sun, Sep 11, 2022 at 8:04 PM Zheng Yu Chen wrote: > > > Now FLIP-256 is start vote in this thread url: > > > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.apache.org_thread_

Re: [VOTE] FLIP-254 Redis Streams connector

+1 (non-binding) Martijn Visser 于2022年9月12日周一 15:58写道： > Hi everyone, > > With no comments provided in the discussion thread, I'm opening a vote > thread on FLIP-254: Redis Streams connector: > > FLIP: > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-254%3A+Redis+Streams+Connector > >

Re: [DISCUSS] FLIP-256 Support Job Dynamic Parameter With Flink Rest Api

Now FLIP-256 is start vote in this thread url: https://lists.apache.org/thread/89f7kwnqgs8mfwos0h6b27lt3xn7383t zhengyu chen 于2022年8月15日周一 18:06写道： > > Hi all, > > > We would like to start a discussion thread on FLIP-256 Support Job > Dynamic Parameter With Flink Rest Api >

[VOTE] FLIP-256 Support Job Dynamic Parameter With Flink Rest Api

Since no one objected in the discuss thread, let's vote! FLIP-256 : https://cwiki.apache.org/confluence/display/FLINK/FLIP-256+Support+Job+Dynamic+Parameter+With+Flink+Rest+Api The vote will be open for at least 72h. -- Best ConradJam

Re: [ANNOUNCE] New Apache Flink PMC Member - Martijn Visser

Congratulations, Martijn Timo Walther 于2022年9月9日周五 23:08写道： > Hi everyone, > > I'm very happy to announce that Martijn Visser has joined the Flink PMC! > > Martijn has helped the community in many different ways over the past > months. Externalizing the connectors from the Flink repo to their

Re: [DISCUSS] FLIP-256 Support Job Dynamic Parameter With Flink Rest Api

rest.submit.job.override-config" cannot be overwritten in user code > (ignored), just like configuration "jobmanager.rpc.port"? > > What do you think? > > Regards, > Hong > > > > On 26/08/2022, 12:05, "Zheng Yu Chen" wrote: > > CAUTI

Re: [Discuss] Let's Session Cluster JobManager take a breather (FLIP-257: Flink JobManager Process Split)

on is feasible, I will rewrite my FLIP and organize some of my specific ideas Looking forward to your suggestions~ Zheng Yu Chen 于2022年8月16日周二 17:40写道： > Hi community ~ > > I think this title should be quite interesting. The idea is to reduce the > workload of the JobManager and make the

Re: [DISCUSS] FLIP-256 Support Job Dynamic Parameter With Flink Rest Api

set it such that the > "rest.submit.job.override-config" cannot be overwritten in user code > (ignored), just like configuration "jobmanager.rpc.port"? > > What do you think? > > Regards, > Hong > > > > On 26/08/2022, 12:05, "Zheng Yu Chen&

Re: [DISCUSS] FLIP-256 Support Job Dynamic Parameter With Flink Rest Api

s time, so the problem may still exist, and the > user > > cannot be prevented from this behavior > > Hmm, would it be better if we set it such that the > "rest.submit.job.override-config" cannot be overwritten in user code > (ignored), just like configuration &q

Re: [DISCUSS] FLIP-256 Support Job Dynamic Parameter With Flink Rest Api

ss.size). As part of > this work, I wonder if we can update the Flink docs on configuration > (https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/config/) > to specify which configuration is "cluster" and which is "job". > > Regards, > Hong &g

Re: [Discuss] Let's Session Cluster JobManager take a breather (FLIP-257: Flink JobManager Process Split)

this should be tackled. > > > > I'm gonna add Chesnay and David to this discussion. > > > > Best, > > Matthias > > > > > > [1] > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-257+Flink+JobManager+Process+Split > > [2] > > https://

[jira] [Created] (FLINK-29107) Bump up spotless version to improve efficiently

Yu Chen created FLINK-29107: --- Summary: Bump up spotless version to improve efficiently Key: FLINK-29107 URL: https://issues.apache.org/jira/browse/FLINK-29107 Project: Flink Issue Type

Re: [DISCUSS] FLIP-256 Support Job Dynamic Parameter With Flink Rest Api

ocess.size). As part of > this work, I wonder if we can update the Flink docs on configuration > (https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/config/) > to specify which configuration is "cluster" and which is "job". > > Regards, > Hon

Re: [DISCUSS] FLIP-256 Support Job Dynamic Parameter With Flink Rest Api

; > > This is because our end users do not submit their jobs directly, our > > service does it on their behalf. For our usecase we do not want to > > allow > > users to override certain values we set, since some are managed from > > our > > servi

Re: [DISCUSS] FLIP-256 Support Job Dynamic Parameter With Flink Rest Api

you can confirm the > > sender and > > > know the content is safe. > > > > > > > > > > > > +1 thanks for driving this FLIP. > > > > > > We actually have an

Re: [Discuss] Let's Session Cluster JobManager take a breather (FLIP-257: Flink JobManager Process Split)

earer picture on how this should be tackled. > > > > I'm gonna add Chesnay and David to this discussion. > > > > Best, > > Matthias > > > > > > [1] > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-257+Flink+JobManager+Pro

Re: [Discuss] Let's Session Cluster JobManager take a breather (FLIP-257: Flink JobManager Process Split)

Zheng Yu Chen 18:00 (2分钟前) 发送至 dev Thank you for your interest in this program. This proposal only takes effect for Session Cluster Mode, and will not take effect for Application Mode. I would like to answer some of your previous questions about patterns and practical cases first, and then discuss

Re: [Discuss] Let's Session Cluster JobManager take a breather (FLIP-257: Flink JobManager Process Split)

should be tackled. > > > > I'm gonna add Chesnay and David to this discussion. > > > > Best, > > Matthias > > > > > > [1] > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-257+Flink+JobManager+Process+Split > > [2

[Discuss] Let's Session Cluster JobManager take a breather (FLIP-257: Flink JobManager Process Split)

Hi community ~ I think this title should be quite interesting. The idea is to reduce the workload of the JobManager and make the SessionCluster [2] more stable in the process of running jobs. I designed a plan for splitting the JobManager on FLIP-257 [1]: https://cwiki.apache.org/confluence/displa

Re: [DISCUSS] FLIP-256 Support Job Dynamic Parameter With Flink Rest Api

This is a good suggestion, we can start this work after we finish the discussion and vote -- Best ConradJam 于2022年8月15日周一 21:01写道： > I've created a new ticket [FLINK-28973] Extending /jars/:jarid/plan API to > support setting Flink configs - ASF JIRA (apache.org)< > https://issues.apache.org/