Re: [ANNOUNCE] New Apache Flink PMC Member - Weijie Guo

2024-06-04 Thread Weihua Hu
Congratulations, Weijie! Best, Weihua On Tue, Jun 4, 2024 at 3:03 PM Yuxin Tan wrote: > Congratulations, Weijie! > > Best, > Yuxin > > > Yuepeng Pan 于2024年6月4日周二 14:57写道: > > > Congratulations ! > > > > > > Best, > > Yuepeng Pan > > > > At 2024-06-04 14:45:45, "Xintong Song" wrote: > > >Hi e

Re: [ANNOUNCE] Apache Flink 1.19.0 released

2024-03-18 Thread Weihua Hu
Congratulations Best, Weihua On Tue, Mar 19, 2024 at 10:56 AM Rodrigo Meneses wrote: > Congratulations > > On Mon, Mar 18, 2024 at 7:43 PM Yu Chen wrote: > > > Congratulations! > > Thanks to release managers and everyone involved! > > > > Best, > > Yu Chen > > > > > > > 2024年3月19日 01:01,J

Re: [ANNOUNCE] New Apache Flink Committer - Jiabao Sun

2024-02-22 Thread Weihua Hu
Congratulations, Jiabao! Best, Weihua On Thu, Feb 22, 2024 at 10:34 AM Jingsong Li wrote: > Congratulations! Well deserved! > > On Wed, Feb 21, 2024 at 4:36 PM Yuepeng Pan wrote: > > > > Congratulations~ :) > > > > Best, > > Yuepeng Pan > > > > > > > > > > > > > > > > > > > > > > 在 2024-02-21

Re: [VOTE] FLIP-407: Improve Flink Client performance in interactive scenarios

2024-01-14 Thread Weihua Hu
+1 binding Best, Weihua On Mon, Jan 15, 2024 at 11:06 AM Yangze Guo wrote: > +1 binding > > Best, > Yangze Guo > > On Thu, Jan 11, 2024 at 8:36 PM Rui Fan <1996fan...@gmail.com> wrote: > > > > +1 binding > > > > Best, > > Rui > > > > > > On Thu, 11 Jan 2024 at 19:45, xiangyu feng wrote: > > >

Re: [Discuss] FLIP-407: Improve Flink Client performance in interactive scenarios

2024-01-08 Thread Weihua Hu
Thanks for proposing this FLIP. Experiments have shown that it significantly enhances the real-time query experience. +1 for this. Best, Weihua On Mon, Jan 8, 2024 at 5:19 PM Rui Fan <1996fan...@gmail.com> wrote: > Thanks Xiangyu for the quick update! > > LGTM > > Best, > Rui > > On Mon, Jan 8

Re: [DISCUSS] FLIP-395: Deprecate Global Aggregator Manager

2023-11-26 Thread Weihua Hu
Thanks Zhanghao for driving this FLIP. +1 for this. Best, Weihua On Mon, Nov 20, 2023 at 5:49 PM Zhanghao Chen wrote: > Hi all, > > I'd like to start a discussion of FLIP-395: Deprecate Global Aggregator > Manager [1]. > > Global Aggregate Manager was introduced in [2] to support event time >

Re: [ANNOUNCE] New Apache Flink Committer - Ron Liu

2023-10-15 Thread Weihua Hu
Congrats, Ron! Best, Weihua On Mon, Oct 16, 2023 at 11:50 AM Yangze Guo wrote: > Congrats, Ron! > > Best, > Yangze Guo > > On Mon, Oct 16, 2023 at 11:48 AM Matt Wang wrote: > > > > Congratulations, Ron! > > > > > > -- > > > > Best, > > Matt Wang > > > > > > Replied Message > > | Fro

Re: [ANNOUNCE] New Apache Flink Committer - Jane Chan

2023-10-15 Thread Weihua Hu
Congrats, Jane! Best, Weihua On Mon, Oct 16, 2023 at 11:50 AM Yangze Guo wrote: > Congrats, Jane! > > Best, > Yangze Guo > > On Mon, Oct 16, 2023 at 11:49 AM Matt Wang wrote: > > > > Congratulations Jane! > > > > > > -- > > > > Best, > > Matt Wang > > > > > > Replied Message > > | F

Re: [VOTE] FLIP-374: Adding a separate configuration for specifying Java Options of the SQL Gateway

2023-10-10 Thread Weihua Hu
+1(binding) Best, Weihua On Wed, Oct 11, 2023 at 10:56 AM xiangyu feng wrote: > +1(non-binding) > > Regards, > Xiangyu > > Shammon FY 于2023年10月11日周三 10:30写道: > > > +1(binding), good job! > > > > Best, > > Shammon FY > > > > On Wed, Oct 11, 2023 at 10:18 AM Benchao Li > wrote: > > > > > +1 (b

Re: [VOTE] FLIP-367: Support Setting Parallelism for Table/SQL Sources

2023-10-08 Thread Weihua Hu
+1 (binding) Best, Weihua On Mon, Oct 9, 2023 at 11:47 AM Shammon FY wrote: > +1 (binding) > > > On Mon, Oct 9, 2023 at 11:12 AM Benchao Li wrote: > > > +1 (binding) > > > > Zhanghao Chen 于2023年10月9日周一 10:20写道: > > > > > > Hi All, > > > > > > Thanks for all the feedback on FLIP-367: Support

Re: [VOTE] FLIP-362: Support minimum resource limitation

2023-09-25 Thread Weihua Hu
+1 (binding) Best, Weihua On Tue, Sep 26, 2023 at 10:00 AM Shammon FY wrote: > +1(binding), thanks for the proposal. > > Best, > Shammon FY > > On Mon, Sep 25, 2023 at 11:20 PM Jing Ge > wrote: > > > +1(binding) Thanks! > > > > Best regards, > > Jing > > > > On Mon, Sep 25, 2023 at 3:48 AM Ch

Re: [VOTE] FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI

2023-09-19 Thread Weihua Hu
+1(binding) Best, Weihua On Tue, Sep 19, 2023 at 6:16 PM Jing Ge wrote: > +1(binding) Thanks! > > Best regards, > Jing > > On Tue, Sep 19, 2023 at 9:01 AM Chen Zhanghao > wrote: > > > Hi Devs, > > > > Thanks for all the feedbacks on FLIP-363: Unify the Representation of > > TaskManager Locati

Re: [VOTE] FLIP-361: Improve GC Metrics

2023-09-15 Thread Weihua Hu
+1 (binding) Best, Weihua On Fri, Sep 15, 2023 at 4:28 PM Yangze Guo wrote: > +1 (binding) > > Best, > Yangze Guo > > On Thu, Sep 14, 2023 at 5:47 PM Maximilian Michels wrote: > > > > +1 (binding) > > > > On Thu, Sep 14, 2023 at 4:26 AM Venkatakrishnan Sowrirajan > > wrote: > > > > > > +1 (n

Re: [DISCUSS] FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI

2023-09-10 Thread Weihua Hu
vement Proposals doc[1]. > > @Public class means the user will use this class directly, and > these rest classes won't be depended on directly. So I think > these classes related to rest don't need to be marked @Public. > > Please correct me if anything is wrong, thanks

Re: [DISCUSS] FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI

2023-09-10 Thread Weihua Hu
Hi, Zhanghao Thanks for bringing this proposal. I have a concern: I prefer to keep the "host" field and add a "location" field in future versions. Consider a scenario where a machine (host) with multiple TaskManagers has poor processing performance due to some problems. By using a host field agg

Re: [VOTE] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-09-10 Thread Weihua Hu
+1 (binding) Best, Weihua On Mon, Sep 11, 2023 at 3:16 AM Jing Ge wrote: > +1(binding) > > Best Regards, > Jing > > On Sun, Sep 10, 2023 at 10:17 AM Dong Lin wrote: > > > Thanks Allison for proposing the FLIP. > > > > +1 (binding) > > > > On Fri, Sep 8, 2023 at 4:21 AM Allison Chang > > > >

Re: [DISCUSS] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-08-22 Thread Weihua Hu
n-on-attached-exit=false". > 2. Current "execution.attached=false" would be equivalent to > "execution.shutdown-on-attached-exit=true" + > "client.attached.after.submission=true". > > This will make the same config behave the same for YARN and K8

Re: [DISCUSS] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-08-22 Thread Weihua Hu
this `execution.shutdown-on-attached-exit` is set to > true, the cluster will shutdown if the client detaches from the cluster. Is > this sufficient? Or do you mean we need another independent configuration? > > Thanks, > > Jiangjie (Becket) Qin > > On Tue, Aug 22, 2023 at 2

Re: [DISCUSS] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-08-21 Thread Weihua Hu
gt; jobmanager.shutdown-cluster-after-job-finishes) controls the cluster > > > > behavior after the job finishes normally / abnormally. This is a > > cluster > > > > level setting instead of a job level setting. Therefore it can only > be > > > set >

[jira] [Created] (FLINK-32882) FineGrainedSlotManager cause NPE when clear pending taskmanager twice

2023-08-16 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-32882: - Summary: FineGrainedSlotManager cause NPE when clear pending taskmanager twice Key: FLINK-32882 URL: https://issues.apache.org/jira/browse/FLINK-32882 Project: Flink

Re: [DISCUSS] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-08-10 Thread Weihua Hu
Hi Allison Thanks for driving this FLIP. It's a valuable feature for batch jobs. This helps keep "Drop Per-Job Mode [1]" going. +1 for this proposal. However, it seems that the change in this FLIP is not detailed enough. I have a few questions. 1. The config 'execution.attached' is not only use

Re: [ANNOUNCE] New Apache Flink Committer - Yanfei Lei

2023-08-07 Thread Weihua Hu
Congratulations Yanfei! Best, Weihua On Mon, Aug 7, 2023 at 8:08 PM Feifan Wang wrote: > Congratulations Yanfei! :) > > > > —— > Name: Feifan Wang > Email: zoltar9...@163.com > > > Replied Message > | From | Matt Wang | > | Date | 08/7/2023 19:40 | > | To | dev@flink.apac

Re: [ANNOUNCE] New Apache Flink PMC Member - Matthias Pohl

2023-08-03 Thread Weihua Hu
Congratulations, Matthias! Best, Weihua On Fri, Aug 4, 2023 at 2:49 PM Yuxin Tan wrote: > Congratulations, Matthias! > > Best, > Yuxin > > > Sergey Nuyanzin 于2023年8月4日周五 14:21写道: > > > Congratulations, Matthias! > > Well deserved! > > > > On Fri, Aug 4, 2023 at 7:59 AM liu ron wrote: > > >

Re: [ANNOUNCE] New Apache Flink Committer - Hong Teoh

2023-08-03 Thread Weihua Hu
Congratulations, Hong! Best, Weihua On Fri, Aug 4, 2023 at 10:49 AM Samrat Deb wrote: > Congratulations, Hong Teoh > > On Fri, 4 Aug 2023 at 7:52 AM, Benchao Li wrote: > > > Congratulations, Hong! > > > > yuxia 于2023年8月4日周五 09:23写道: > > > > > Congratulations, Hong Teoh! > > > > > > Best rega

[jira] [Created] (FLINK-32702) streaming examples could not run

2023-07-27 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-32702: - Summary: streaming examples could not run Key: FLINK-32702 URL: https://issues.apache.org/jira/browse/FLINK-32702 Project: Flink Issue Type: Bug

Re: [ANNOUNCE] New Apache Flink Committer - Yong Fang

2023-07-23 Thread Weihua Hu
Congratulations! Best, Weihua On Mon, Jul 24, 2023 at 11:04 AM Paul Lam wrote: > Congrats, Shammon! > > Best, > Paul Lam > > > 2023年7月24日 10:56,Jingsong Li 写道: > > > > Shammon > >

Re: JIRA Permission Opening Application

2023-07-10 Thread Weihua Hu
Hi YongPing Thank you for your willingness to contribute, no special permissions are required, just find the issue you want to contribute to or create a new one and then you contribute the code, refer to the how-to-contribute[1] [1] https://flink.apache.org/how-to-contribute/contribute-code/ Bes

Re: [ANNOUNCE] Apache Flink has won the 2023 SIGMOD Systems Award

2023-07-05 Thread Weihua Hu
Congratulations! Best, Weihua On Wed, Jul 5, 2023 at 5:46 PM Shammon FY wrote: > Congratulations! > > Best, > Shammon FY > > On Wed, Jul 5, 2023 at 2:38 PM Paul Lam wrote: > > > Congrats and cheers! > > > > Best, > > Paul Lam > > > > > 2023年7月4日 18:04,Benchao Li 写道: > > > > > > Congratulatio

[jira] [Created] (FLINK-32387) InputGateDeploymentDescriptor uses cache to avoid deserializing shuffle descriptors multiple times

2023-06-19 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-32387: - Summary: InputGateDeploymentDescriptor uses cache to avoid deserializing shuffle descriptors multiple times Key: FLINK-32387 URL: https://issues.apache.org/jira/browse/FLINK-32387

[jira] [Created] (FLINK-32386) Add ShuffleDescriptorsCache in TaskExecutor to cache ShuffleDescriptors

2023-06-19 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-32386: - Summary: Add ShuffleDescriptorsCache in TaskExecutor to cache ShuffleDescriptors Key: FLINK-32386 URL: https://issues.apache.org/jira/browse/FLINK-32386 Project: Flink

[jira] [Created] (FLINK-32385) Introduce a struct SerializedShuffleDescriptorAndIndices to identify a group of ShuffleDescriptorAndIndex

2023-06-19 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-32385: - Summary: Introduce a struct SerializedShuffleDescriptorAndIndices to identify a group of ShuffleDescriptorAndIndex Key: FLINK-32385 URL: https://issues.apache.org/jira/browse/FLINK

Re: [DISCUSS] FLIP-316: Introduce SQL Driver

2023-06-06 Thread Weihua Hu
han SQL file. To be more specific, it should be > >>>> JsonPlanGraph > >>>>>> or CompiledPlan which is the serializable representation. > CompiledPlan > >>>> is a > >>>>>> clear separation between compiling/optimization/va

Re: [DISCUSS] FLIP-316: Introduce SQL Driver

2023-05-31 Thread Weihua Hu
, > >> cause Flink SQLs could be complicated and involves lots of characters > that > >> need to escape. > >> > >> WDYT? > >> > >>> - I noticed that we don't specify the SQLDriver jar in the > >> "run-application" >

[jira] [Created] (FLINK-32225) merge task deployment related fields into a new configuration

2023-05-31 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-32225: - Summary: merge task deployment related fields into a new configuration Key: FLINK-32225 URL: https://issues.apache.org/jira/browse/FLINK-32225 Project: Flink

Re: [DISCUSS] FLIP-316: Introduce SQL Driver

2023-05-30 Thread Weihua Hu
Thanks Paul for the proposal. +1 for this. It is valuable in improving ease of use. I have a few questions. - Is SQLRunner the better name? We use this to run a SQL Job. (Not strong, the SQLDriver is fine for me) - Could we run SQL jobs using SQL in strings? Otherwise, we need to prepare a SQL fi

[jira] [Created] (FLINK-32205) Flink Rest Client should support connecting to the server using URLs.

2023-05-26 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-32205: - Summary: Flink Rest Client should support connecting to the server using URLs. Key: FLINK-32205 URL: https://issues.apache.org/jira/browse/FLINK-32205 Project: Flink

[jira] [Created] (FLINK-32201) Enable the distribution of shuffle descriptors via the blob server by connection number

2023-05-25 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-32201: - Summary: Enable the distribution of shuffle descriptors via the blob server by connection number Key: FLINK-32201 URL: https://issues.apache.org/jira/browse/FLINK-32201

Re: How to pass the TLS certs to the latest version of flink-connector-pulsar

2023-05-16 Thread Weihua Hu
Hi, Did you try set 'serviceurl' starts with "pulsar+ssl://"? [1] [1] https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/connectors/datastream/pulsar/#pulsar-client-serviceurl Best, Weihua On Mon, May 15, 2023 at 7:22 PM Bauddhik Anand wrote: > Can someone please help with this?

[jira] [Created] (FLINK-32045) optimize task deployment performance for large-scale jobs

2023-05-10 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-32045: - Summary: optimize task deployment performance for large-scale jobs Key: FLINK-32045 URL: https://issues.apache.org/jira/browse/FLINK-32045 Project: Flink Issue

Re: [DISCUSS] Preventing Mockito usage for the new code with Checkstyle

2023-04-25 Thread Weihua Hu
Thanks for driving this. +1 for Mockito and Junit4. A clarity checkstyle will be of great help to new developers. Best, Weihua On Wed, Apr 26, 2023 at 1:47 PM Jing Ge wrote: > This is a great idea, thanks for bringing this up. +1 > > Also +1 for Junit4. If I am not mistaken, it could only be

Re: [DISCUSS] FLINK-31873: Add setMaxParallelism to the DataStreamSink Class

2023-04-23 Thread Weihua Hu
Hi, Eric Thanks for bringing this discussion. I think it's reasonable to add ''setMaxParallelism" for DataStreamSink. +1 Best, Weihua On Sat, Apr 22, 2023 at 3:20 AM eric xiao wrote: > Hi there devs, > > I would like to start a discussion thread for FLINK-31873[1]. > > We are in the processi

Re: [ANNOUNCE] New Apache Flink PMC Member - Qingsheng Ren

2023-04-23 Thread Weihua Hu
Congratulations, Qingsheng! Best, Weihua On Sun, Apr 23, 2023 at 3:53 PM Yun Tang wrote: > Congratulations, Qingsheng! > > Best > Yun Tang > > From: weijie guo > Sent: Sunday, April 23, 2023 14:50 > To: dev@flink.apache.org > Subject: Re: [ANNOUNCE] New Apach

Re: [ANNOUNCE] New Apache Flink PMC Member - Leonard Xu

2023-04-23 Thread Weihua Hu
Congratulations, Leonard! Best, Weihua On Sun, Apr 23, 2023 at 3:53 PM Yun Tang wrote: > Congratulations, Leonard! > > Best, > Yun Tang > > From: weijie guo > Sent: Sunday, April 23, 2023 14:50 > To: dev@flink.apache.org > Subject: Re: [ANNOUNCE] New Apache F

Re: [VOTE] FLIP-304: Pluggable Failure Enrichers

2023-04-21 Thread Weihua Hu
+1 (non-binding) Best, Weihua On Fri, Apr 21, 2023 at 4:00 PM weijie guo wrote: > +1 (binding) > > Best regards, > > Weijie > > > Zhu Zhu 于2023年4月21日周五 11:03写道: > > > +1 (binding) > > > > Thanks, > > Zhu > > > > Anton Kalashnikov 于2023年4月20日周四 20:03写道: > > > > > > +1 (binding) > > > > > > >

[jira] [Created] (FLINK-31843) Select slots from SlotPool#freeSlots in bulk

2023-04-18 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31843: - Summary: Select slots from SlotPool#freeSlots in bulk Key: FLINK-31843 URL: https://issues.apache.org/jira/browse/FLINK-31843 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-31842) calculate task executor's utilization only when used

2023-04-18 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31842: - Summary: calculate task executor's utilization only when used Key: FLINK-31842 URL: https://issues.apache.org/jira/browse/FLINK-31842 Project: Flink Issue

[jira] [Created] (FLINK-31832) Add benchmarks for end to end  restarting tasks

2023-04-17 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31832: - Summary: Add benchmarks for end to end  restarting tasks Key: FLINK-31832 URL: https://issues.apache.org/jira/browse/FLINK-31832 Project: Flink Issue Type

[jira] [Created] (FLINK-31808) wrong examples of how to set operator name in documents

2023-04-14 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31808: - Summary: wrong examples of how to set operator name in documents Key: FLINK-31808 URL: https://issues.apache.org/jira/browse/FLINK-31808 Project: Flink Issue

[jira] [Created] (FLINK-31771) Improve select available slot from SlotPool

2023-04-11 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31771: - Summary: Improve select available slot from SlotPool Key: FLINK-31771 URL: https://issues.apache.org/jira/browse/FLINK-31771 Project: Flink Issue Type

[jira] [Created] (FLINK-31752) SourceOperatorStreamTask increments numRecordsOut twice

2023-04-07 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31752: - Summary: SourceOperatorStreamTask increments numRecordsOut twice Key: FLINK-31752 URL: https://issues.apache.org/jira/browse/FLINK-31752 Project: Flink Issue Type

Re: [jira] [Created] (FLINK-31690) The current key is not set for KeyedCoProcessOperator

2023-04-02 Thread Weihua Hu
Hi, you need send email to dev-unsubscr...@flink.apache.org with any contents or subject [1] https://flink.apache.org/community.html#how-to-subscribe-to-a-mailing-list Best, Weihua On Mon, Apr 3, 2023 at 10:35 AM 越张 wrote: > 退订 > > Dian Fu (Jira) 于2023年4月3日周一 10:33写道: > > > Dian Fu created

[jira] [Created] (FLINK-31679) [Flink][UI] Show data exchange type on web ui

2023-03-31 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31679: - Summary: [Flink][UI] Show data exchange type on web ui Key: FLINK-31679 URL: https://issues.apache.org/jira/browse/FLINK-31679 Project: Flink Issue Type

Re: Subtask distribution in Flink

2023-03-29 Thread Weihua Hu
y task failovers have happened in a > job execution and get the current execution attempt. > > Thanks. > > On Mon, Mar 27, 2023 at 2:55 AM Weihua Hu wrote: > > > Hi, > > > > 1. Does this mean that each task slot will contain an entire pipeline > in > >

Re: Subtask distribution in Flink

2023-03-27 Thread Weihua Hu
Hi, 1. Does this mean that each task slot will contain an entire pipeline in > the job? not exactly, each slot will run a subtask of each task. If the job is so simple that there is no keyby logic and we do not enable rebalance shuffle type, each slot could run all the pipeline. But if not we n

[jira] [Created] (FLINK-31537) Derive a new TaskManagerTrackerConfiguration from the SlotManagerConfiguration.

2023-03-21 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31537: - Summary: Derive a new TaskManagerTrackerConfiguration from the SlotManagerConfiguration. Key: FLINK-31537 URL: https://issues.apache.org/jira/browse/FLINK-31537 Project

Re: [DISCUSS] FLIP-304: Pluggable failure handling for Apache Flink

2023-03-20 Thread Weihua Hu
Hi Panagiotis, Thanks for your proposal. It is valuable to analyze the reason for failure with the user plug-in. Making the context immutable could make the contract stronger. Letting the listener return an enriching result may be a better way. IIUC, listeners could do two things, enrich more in

[jira] [Created] (FLINK-31529) Let yarn client exit early before JobManager running

2023-03-20 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31529: - Summary: Let yarn client exit early before JobManager running Key: FLINK-31529 URL: https://issues.apache.org/jira/browse/FLINK-31529 Project: Flink Issue Type

Re: [VOTE] FLIP-301: Hybrid Shuffle supports Remote Storage

2023-03-19 Thread Weihua Hu
+1 (non-binding) Best, Weihua On Mon, Mar 20, 2023 at 12:39 PM Wencong Liu wrote: > +1 (non-binding) > > Best regards, > > Wencong Liu > > > > > > > > > > > > > > > > At 2023-03-20 12:05:47, "Yuxin Tan" wrote: > >Hi, everyone, > > > >Thanks for all your feedback for FLIP-301: Hybrid Shuffle >

[jira] [Created] (FLINK-31498) DeclartiveSlotManager always request redundant task manager when resource is not enough

2023-03-17 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31498: - Summary: DeclartiveSlotManager always request redundant task manager when resource is not enough Key: FLINK-31498 URL: https://issues.apache.org/jira/browse/FLINK-31498

[jira] [Created] (FLINK-31449) Remove DeclarativeSlotManager related logic

2023-03-14 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31449: - Summary: Remove DeclarativeSlotManager related logic Key: FLINK-31449 URL: https://issues.apache.org/jira/browse/FLINK-31449 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-31447) Aligning unit tests of FineGrainedSlotManager with DeclarativeSlotManager

2023-03-14 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31447: - Summary: Aligning unit tests of FineGrainedSlotManager with DeclarativeSlotManager Key: FLINK-31447 URL: https://issues.apache.org/jira/browse/FLINK-31447 Project: Flink

[jira] [Created] (FLINK-31448) Use FineGrainedSlotManager as the default SlotManager

2023-03-14 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31448: - Summary: Use FineGrainedSlotManager as the default SlotManager Key: FLINK-31448 URL: https://issues.apache.org/jira/browse/FLINK-31448 Project: Flink Issue Type

[jira] [Created] (FLINK-31445) Split resource allocate/release related logic from FineGrainedSlotManager to TaskManagerTracker

2023-03-14 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31445: - Summary: Split resource allocate/release related logic from FineGrainedSlotManager to TaskManagerTracker Key: FLINK-31445 URL: https://issues.apache.org/jira/browse/FLINK-31445

[jira] [Created] (FLINK-31444) FineGrainedSlotManager reclaims slots when job is finished

2023-03-14 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31444: - Summary: FineGrainedSlotManager reclaims slots when job is finished Key: FLINK-31444 URL: https://issues.apache.org/jira/browse/FLINK-31444 Project: Flink Issue

[jira] [Created] (FLINK-31443) FineGrainedSlotManager maintain some redundant task managers

2023-03-14 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31443: - Summary: FineGrainedSlotManager maintain some redundant task managers Key: FLINK-31443 URL: https://issues.apache.org/jira/browse/FLINK-31443 Project: Flink

[jira] [Created] (FLINK-31441) FineGrainedSlotManager support select slot evenly

2023-03-14 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31441: - Summary: FineGrainedSlotManager support select slot evenly Key: FLINK-31441 URL: https://issues.apache.org/jira/browse/FLINK-31441 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-31439) FLIP-298: Unifying the Implementation of SlotManager

2023-03-14 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31439: - Summary: FLIP-298: Unifying the Implementation of SlotManager Key: FLINK-31439 URL: https://issues.apache.org/jira/browse/FLINK-31439 Project: Flink Issue Type

Re: [RESULT][Vote] FLIP-298: Unifying the Implementation of SlotManager

2023-03-14 Thread Weihua Hu
Sorry for missing the link of FLIP [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-298%3A+Unifying+the+Implementation+of+SlotManager Best, Weihua On Tue, Mar 14, 2023 at 3:05 PM Weihua Hu wrote: > I am happy to announce that FLIP-298: Unifying the Implementation of > SlotMan

[RESULT][Vote] FLIP-298: Unifying the Implementation of SlotManager

2023-03-14 Thread Weihua Hu
I am happy to announce that FLIP-298: Unifying the Implementation of SlotManager[1] has been accepted. There are 6 binding votes and 5 non-binding vote: - Xintong Song (binding) - weijie guo (binding) - David Morávek (binding) - Matthias Pohl (binding) - Yangze Guo (binding) - Maximilian Michels (

Re: [Vote] FLIP-298: Unifying the Implementation of SlotManager

2023-03-14 Thread Weihua Hu
; > Le 11/03/2023 à 07:37, Yangze Guo a écrit : > > > +1 (binding) > > > > > > Zhanghao Chen 于 2023年3月10日周五 下午5:07写道: > > > > > >> Thanks Weihua. +1 (non-binding) > > >> > > >> Best, > > >> Zhanghao Chen > > &g

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-13 Thread Weihua Hu
icating something similar. I'm > >>>> wondering whether he can add some insights here. > >>>> > >>>> 3. For me personally, having a more detailed summary comparing the > >>>> subcomponents of both SlotManager implementations with where >

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-12 Thread Weihua Hu
4:17 PM Matthias Pohl > wrote: > > > > Thanks for your clarification. I have nothing else to add to the > > discussion. +1 from my side to proceed > > > > On Wed, Mar 8, 2023 at 4:16 AM Weihua Hu wrote: > > > > > Thanks Yangze for your attention, thi

Re: Re: [ANNOUNCE] New Apache Flink Committer - Yuxia Luo

2023-03-12 Thread Weihua Hu
Congratulations, Yuxia! Best, Weihua On Mon, Mar 13, 2023 at 12:11 PM Jingsong Li wrote: > Congratulations, Yuxia! > > On Mon, Mar 13, 2023 at 11:49 AM Juntao Hu wrote: > > > > Congratulations, Yuxia! > > > > Best, > > Juntao > > > > > > Wencong Liu 于2023年3月13日周一 11:33写道: > > > > > Congratul

Re: [DISCUSS] FLIP-301: Hybrid Shuffle supports Remote Storage

2023-03-09 Thread Weihua Hu
ot > included > in the first version. We will extend and implement them in the subsequent > versions. > > Best, > Yuxin > > > Weihua Hu 于2023年3月9日周四 11:22写道: > > > Hi, Yuxin > > > > Thanks for driving this FLIP. > > > > The remote storage s

[Vote] FLIP-298: Unifying the Implementation of SlotManager

2023-03-08 Thread Weihua Hu
Hi Everyone, I would like to start the vote on FLIP-298: Unifying the Implementation of SlotManager [1]. The FLIP was discussed in this thread [2]. This FLIP aims to unify the implementation of SlotManager in order to reduce maintenance costs. The vote will last for at least 72 hours (03/14, 15:

Re: [DISCUSS] FLIP-301: Hybrid Shuffle supports Remote Storage

2023-03-08 Thread Weihua Hu
Hi, Yuxin Thanks for driving this FLIP. The remote storage shuffle could improve the stability of Batch jobs. In our internal scenario, we use a hybrid cluster to run both Streaming(high priority) and Batch jobs(low priority). When there is not enough resources(such as cpu usage reaches a thresh

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-07 Thread Weihua Hu
e, Mar 7, 2023 at 8:58 AM Yangze Guo wrote: > > > Hi Weihua, > > > > Thanks for driving this. As Xintong mentioned, this was a technical > > debt from FLIP-56. > > > > The latest version of FLIP sounds good, +1 from my side. As a > > contributor to thi

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-06 Thread Weihua Hu
Hi, @David @Matthias There are a few days after hearing your thoughts. I would like to know if there are any other concerns about this FLIP. Best, Weihua On Mon, Mar 6, 2023 at 7:53 PM Weihua Hu wrote: > > Thanks Shammon, > > I've updated FLIP to add this redundant Task M

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-06 Thread Weihua Hu
future. It may be useful for some > scenarios, such as the combination of streaming and ML. > > Best, > Shammon > > > On Mon, Mar 6, 2023 at 1:39 PM weijie guo > wrote: > > > Hi Weihua, > > > > Thanks for your clarification, SGTM. > > > >

Re: Re: obtain the broadcast stream information in sink

2023-03-06 Thread Weihua Hu
The sinks needs to get some configuration information while writing. I > want to get it from the broadcast stream ~ > > > From: Weihua Hu > Date: 2023-03-06 18:06 > To: dev; user > Subject: Re: obtain the broadcast stream information in sink > Hi, > > Could you des

Re: obtain the broadcast stream information in sink

2023-03-06 Thread Weihua Hu
Hi, Could you describe your usage scenario in detail? Why do you need to get the broadcast stream in sink? And could you split an operator from the sink to deal with broadcast stream? Best, Weihua On Mon, Mar 6, 2023 at 10:57 AM zhan...@eastcom-sw.com < zhan...@eastcom-sw.com> wrote: > > h

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-05 Thread Weihua Hu
Thanks for the test plan, Weihua! > > > > Yes, it addresses my concerns. > > > > Thanks, > > John > > > > On Wed, Mar 1, 2023, at 22:38, Weihua Hu wrote: > > > Hi, everyone, > > > Thanks for your suggestions and ideas. > > > Thanks

Re: [DISCUSS] PRs in flink-ci/flink-mirror

2023-03-02 Thread Weihua Hu
, Then I found this documentation and flows it's suggestion to submit a PR to flink-mirror. Sorry for making noise in the slack channel. +1 for removing this section in the docs. Best, Weihua On Thu, Mar 2, 2023 at 4:17 PM Matthias Pohl wrote: > Hi everyone, > Weihua Hu [1] notif

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-01 Thread Weihua Hu
t; https://cwiki.apache.org/confluence/display/FLINK/FLIP-285%3A+Refactoring+LeaderElection+to+make+Flink+support+multi-component+leader+election+out-of-the-box > > > > [2] https://issues.apache.org/jira/browse/FLINK-30338 > > > > [3] > > > > > > > &g

Re: [VOTE] Flink minor version support policy for old releases

2023-02-27 Thread Weihua Hu
Thanks, Danny. +1 (non-binding) Best, Weihua On Tue, Feb 28, 2023 at 12:38 PM weijie guo wrote: > Thanks Danny for bring this. > > +1 (non-binding) > > Best regards, > > Weijie > > > Jing Ge 于2023年2月27日周一 20:23写道: > > > +1 (non-binding) > > > > BTW, should we follow the content style [1] to

[DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-02-27 Thread Weihua Hu
Hi everyone, I would like to begin a discussion on FLIP-298: Unifying the Implementation of SlotManager[1]. There are currently two types of SlotManager in Flink: DeclarativeSlotManager and FineGrainedSlotManager. FineGrainedSlotManager should behave as DeclarativeSlotManager if the user does not

[jira] [Created] (FLINK-31234) Add an option to redirect stdout/stderr for flink on kubernetes

2023-02-26 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31234: - Summary: Add an option to redirect stdout/stderr for flink on kubernetes Key: FLINK-31234 URL: https://issues.apache.org/jira/browse/FLINK-31234 Project: Flink

[jira] [Created] (FLINK-31233) no error should be logged when retrieving the task manager's stdout if it does not exist

2023-02-26 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31233: - Summary: no error should be logged when retrieving the task manager's stdout if it does not exist Key: FLINK-31233 URL: https://issues.apache.org/jira/browse/FLINK-

Re: [VOTE] Release 1.15.4, release candidate #1

2023-02-23 Thread Weihua Hu
Thanks Danny. +1(non-binding) Tested the following: - Download the artifacts and build image - Ran WordCount on Kubernetes(session mode and application mode) Best, Weihua On Fri, Feb 24, 2023 at 12:29 PM Yanfei Lei wrote: > Thanks Danny. > +1 (non-binding) > > - Downloaded artifacts & built

Re: [ANNOUNCE] Flink project website is now powered by Hugo

2023-02-23 Thread Weihua Hu
Congrats! Thanks for your effort Best, Weihua On Fri, Feb 24, 2023 at 10:47 AM Junrui Lee wrote: > Thanks Martijn for your great work. > > Best regards, > Junrui > > Jane Chan 于2023年2月24日周五 10:37写道: > > > Thanks Martijn for your great work. > > > > Best regards, > > Jane > > > > On Fri, Fe

Re: [ANNOUNCE] New Apache Flink Committer - Anton Kalashnikov

2023-02-20 Thread Weihua Hu
Congratulations, Anton! Best, Weihua On Tue, Feb 21, 2023 at 11:22 AM weijie guo wrote: > Congratulations, Anton! > > Best regards, > > Weijie > > > Leonard Xu 于2023年2月21日周二 11:02写道: > > > Congratulations, Anton! > > > > Best, > > Leonard > > > > > > > On Feb 21, 2023, at 10:02 AM, Rui Fan w

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

2023-02-20 Thread Weihua Hu
Congratulations, Rui! Best, Weihua On Tue, Feb 21, 2023 at 11:28 AM Biao Geng wrote: > Congrats, Rui! > Best, > Biao Geng > > weijie guo 于2023年2月21日周二 11:21写道: > > > Congrats, Rui! > > > > Best regards, > > > > Weijie > > > > > > Leonard Xu 于2023年2月21日周二 11:03写道: > > > > > Congratulations, R

Re: [DISCUSS] Flink minor version support policy for old releases

2023-02-19 Thread Weihua Hu
+1 Thanks for the proposal, this is valuable for stability. Best, Weihua On Mon, Feb 20, 2023 at 10:52 AM Dong Lin wrote: > This makes a lot of sense. Thanks Danny for the proposal! > > +1 > > On Sat, Feb 18, 2023 at 12:52 AM Danny Cranmer > wrote: > > > Hello all, > > > > As proposed by Mat

Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin

2023-02-15 Thread Weihua Hu
Congratulations Dong! Best, Weihua On Thu, Feb 16, 2023 at 3:24 PM yuxia wrote: > Congratulations, Dong! > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "Junrui Lee" > 收件人: "dev" > 发送时间: 星期四, 2023年 2 月 16日 下午 2:40:39 > 主题: Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin > > Congr

Re: [ANNOUNCE] New Apache Flink Committer - Jing Ge

2023-02-15 Thread Weihua Hu
Congratulations, Jing! Best, Weihua On Thu, Feb 16, 2023 at 2:03 PM Dian Fu wrote: > Congratulations Jing! > > Regards, > Dian > > On Wed, Feb 15, 2023 at 8:04 PM Yun Tang wrote: > > > Congratulations, Jing! > > > > Best > > Yun Tang > > > > From: Dong Lin >

Re: [ANNOUNCE] New Apache Flink Committer - Weijie Guo

2023-02-12 Thread Weihua Hu
Congratulations, Weijie! Best, Weihua > On Feb 13, 2023, at 11:55, Lijie Wang wrote: > > Congratulations, Weijie!

Re: Supplying jar stored at S3 to flink to run the job in kubernetes

2023-01-16 Thread Weihua Hu
Hi, Rahul User support and questions should be sent to the user mailing list ( u...@flink.apache.org) You can resend the issue to the user mailing list with a detailed error log. Best, Weihua On Mon, Jan 16, 2023 at 11:18 PM rahul sahoo wrote: > I have been following the examples mentioned h

[jira] [Created] (FLINK-30525) Cannot open jobmanager configuration web page

2022-12-28 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-30525: - Summary: Cannot open jobmanager configuration web page Key: FLINK-30525 URL: https://issues.apache.org/jira/browse/FLINK-30525 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-30517) Decrease log output interval while waiting for YARN JobManager be allocated

2022-12-28 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-30517: - Summary: Decrease log output interval while waiting for YARN JobManager be allocated Key: FLINK-30517 URL: https://issues.apache.org/jira/browse/FLINK-30517 Project: Flink

Re: [DISCUSS] FLIP-266: Simplify network memory configurations for TaskManager

2022-12-26 Thread Weihua Hu
Hi Yuxin, Thanks for the proposal. "Insufficient number of network buffers" exceptions also bother us. It's too hard for users to figure out how much network buffer they really need. It relates to partitioner type, parallelism, slots per taskmanager. Since streaming jobs are our primary scenario,

  1   2   >