Re: [ANNOUNCE] Apache Flink 2.0 Preview released

2024-10-25 Thread weijie guo
Hi Enric I clone the code from apache/flink repo and import it to Idea, But there was nothing unexpected. 在 2024年10月23日星期三,Enric Ott <243816...@qq.com> 写道: > How to import the source code(from github) to Intelligent Idea,seems that > a project descriptor is missing. > > > -- 原始邮件

Re: Flink 1.20.0 missing linux/amd64 images

2024-08-02 Thread weijie guo
Hi, Thanks for noticing us. Actually `amd64` architectures already in the metadata file in flink-docker image repo, but it's not available in official docker-hub repo. This is uploaded by docker official, I will reach out them asap. Best regards, Weijie Bjarke Tornager 于2024年8月2日周五 20:42写道:

Re: Flink 1.18.2 release date

2024-05-30 Thread weijie guo
Hi Yang IIRC, 1.18.2 has not been kicked off yet. Best regards, Weijie Yang LI 于2024年5月30日周四 22:33写道: > Dear Flink Community, > > Anyone know about the release date for 1.18.2? > > Thanks very much, > Yang >

Re: Java 17 incompatibilities with Flink 1.18.1 version

2024-05-30 Thread weijie guo
I believe we ran cron test also on JDK17 and JDK21. Best regards, Weijie Zhanghao Chen 于2024年5月30日周四 19:35写道: > Hi Rajat, > > There's no need to get Flink libraries' compiled version on jdk17. The > only things you need to do are: > > >1. Configure the JAVA_HOME env to use JDK 17 on both

Re: [ANNOUNCE] Donation Flink CDC into Apache Flink has Completed

2024-03-20 Thread weijie guo
Congratulations! Well done. Best regards, Weijie Feng Jin 于2024年3月21日周四 11:40写道: > Congratulations! > > > Best, > Feng > > > On Thu, Mar 21, 2024 at 11:37 AM Ron liu wrote: > > > Congratulations! > > > > Best, > > Ron > > > > Jark Wu 于2024年3月21日周四 10:46写道: > > > > > Congratulations and wel

Re: Elasticsearch sink suppport

2024-03-19 Thread weijie guo
Hi Tauseef, > Any version greater than 1.17 does not support elasticsearch sink connector Can you explain in more detail what does not support mean here? IIRC, flink-connector-elasticsearch is guaranteed to compile in 1.18 and 1.19 via nightly CI workflow. Best regards, Weijie Tauseef Janveka

Re: [ANNOUNCE] Apache Flink 1.19.0 released

2024-03-18 Thread weijie guo
Congratulations! Thanks release managers and all the contributors involved. Best regards, Weijie Leonard Xu 于2024年3月18日周一 16:45写道: > Congratulations, thanks release managers and all involved for the great > work! > > > Best, > Leonard > > > 2024年3月18日 下午4:32,Jingsong Li 写道: > > > > Congratu

Re: Network Buffers

2023-06-06 Thread weijie guo
Hi Pritam, The legacy config option `taskmanager.network.numberOfBuffers` is deprecated and will be ignored, so please do not refer to it. The exact size of network memory calculated through `taskmanager.memory.network.fraction`, while also ensuring that it is within the constraints of min and max

Re: [ANNOUNCE] Apache Flink 1.16.2 released

2023-05-28 Thread weijie guo
gt; On Fri, May 26, 2023 at 4:41 PM Martijn Visser > wrote: > > > Thank you Weijie and those who helped with testing! > > > > On Fri, May 26, 2023 at 1:06 PM weijie guo > > wrote: > > > > > The Apache Flink community is very happy to announce the release

[ANNOUNCE] Apache Flink 1.17.1 released

2023-05-26 Thread weijie guo
The Apache Flink community is very happy to announce the release of Apache Flink 1.17.1, which is the first bugfix release for the Apache Flink 1.17 series. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming

[ANNOUNCE] Apache Flink 1.16.2 released

2023-05-26 Thread weijie guo
The Apache Flink community is very happy to announce the release of Apache Flink 1.16.2, which is the second bugfix release for the Apache Flink 1.16 series. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streamin

Re: Query on RestartPipelinedRegionFailoverStrategy

2023-05-15 Thread weijie guo
Hi Prabhu, If the edge between a -> b -> c -> d -> e all are point-wise, In theory, it should form two regions. Best regards, Weijie Prabhu Joseph 于2023年5月15日周一 09:58写道: > Hi, I am testing the Flink Fine-Grained Recovery >

Re: flink batch execution mode

2023-04-26 Thread weijie guo
Hi Lu, At present, Flink is still based on row format in the runtime execution layer and vectorization relies mostly on automatic compiler optimizations of the JVM. Best regards, Weijie Shammon FY 于2023年4月27日周四 10:52写道: > Hi Lu, > > Currently, Flink does not have official benchmark results

Re: unsubscribe

2023-02-27 Thread weijie guo
To unsubscribe, please send an email to user-unsubscr...@flink.apache.org Best regards, Weijie Natia Chachkhiani 于2023年2月28日周二 01:21写道: >

Re: Disable the chain of the Sink operator

2023-02-16 Thread weijie guo
Hi wu, I don't think it is a good choice to directly change the strategy of chain. Operator chain usually has better performance and resource utilization. If we directly change the chain policy between them, users can no longer chain them together, which is not a good starting point. Best regards

Re: Task Manger is getting failed

2023-02-06 Thread weijie guo
t; I am just print 15 word in beam pipeline program. Any idea why taking too > much memory? > > Get Outlook for iOS <https://aka.ms/o0ukef> > ---------- > *From:* weijie guo > *Sent:* Monday, February 6, 2023 8:37:58 AM > *To:* P Singh > *Cc:* Use

Re: Task Manger is getting failed

2023-02-05 Thread weijie guo
Hi, It seems that TM is unexpected un-reachable. You can confirm whether TM is OutOfMemory. Best regards, Weijie P Singh 于2023年2月5日周日 15:06写道: > Hi Team, > > I am submitting a beam python job to flink clusters on a local machine by > minikube. when i submit the job it appears on the flink UI

Re: Reducing Checkpoint Count for Chain Operator

2023-02-01 Thread weijie guo
> operator creates their own checkpoint at checkpointing time . Rather than > creating a checkpoint per operator in checkpointing time. Can I have one > checkpoint per OperatorChain? This is my question. > > Thanks > > On Wed, Feb 1, 2023 at 1:02 AM weijie guo > wrote: > &g

Re: [ANNOUNCE] Apache Flink 1.16.1 released

2023-02-01 Thread weijie guo
Thank Martin for managing the release and all the people involved. Best regards, Weijie Konstantin Knauf 于2023年2月2日周四 06:40写道: > Great. Thanks, Martijn for managing the release. > > Am Mi., 1. Feb. 2023 um 20:26 Uhr schrieb Martijn Visser < > martijnvis...@apache.org>: > > > The Apache Flink

Re: OOM taskmanager

2023-02-01 Thread weijie guo
Hi Marco, I think you may need to do heap-dump for TM to check whether there is memory leak. Best regards, Weijie

Re: Reducing Checkpoint Count for Chain Operator

2023-02-01 Thread weijie guo
Hi Talat, Can you elaborate on what it means to create one checkpoint object per chain operator more than all operators? If you mean to do checkpoint independently for each task, this is not supported. Best regards, Weijie Talat Uyarer via user 于2023年2月1日周三 15:34写道: > Hi, > > We have a job

Re: New blog post published - Sort-Based Blocking Shuffle Implementation in Flink

2021-11-03 Thread weijie guo
It's really an amazing job to fill in the defects of flink in batch shuffle. I really appreciate the work done in io scheduling, the sequential reading of the shuffle reader can greatly improve the disk IO performance and stability. Sort-based shuffle realizes this feature in a concise and efficien