Re:Re: [DISCUSS] Release 1.17.2

2023-11-07 Thread casel.chen
https://issues.apache.org/jira/browse/FLINK-33365 fixed or not in release 1.17.2? At 2023-11-07 09:47:29, "liu ron" wrote: >+1 > >Best, >Ron > >Jing Ge 于2023年11月6日周一 22:07写道: > >> +1 >> Thanks for your effort! >> >> Best regards, >> Jing >> >> On Mon, Nov 6, 2023 at 1:15 AM Kons

[DISCUSS] FLIP-384: Introduce TraceReporter and use it to create checkpointing and recovery traces

2023-11-07 Thread Piotr Nowojski
Hi all! I would like to start a discussion on FLIP-384: Introduce TraceReporter and use it to create checkpointing and recovery traces [1]. This proposal intends to improve observability of Flink's Checkpointing and Recovery/Initialization operations, by adding support for reporting traces from F

FLIP-385: Add OpenTelemetryTraceReporter and OpenTelemetryMetricReporter

2023-11-07 Thread Piotr Nowojski
Hi all! I would like to start a discussion on a follow up of FLIP-384: Introduce TraceReporter and use it to create checkpointing and recovery traces [1]: *FLIP-385: Add OpenTelemetryTraceReporter and OpenTelemetryMetricReporter[ 2]* This FLIP proposes to add both MetricReporter and TraceReporte

FLIP-386: Support adding custom metrics in Recovery Spans

2023-11-07 Thread Piotr Nowojski
Hi all! I would like to start a discussion on a follow up of FLIP-384: Introduce TraceReporter and use it to create checkpointing and recovery traces [1]: *FLIP-386: Support adding custom metrics in Recovery Spans [2]* This FLIP adds a functionality that will allow state backends to attach custo

Request a release of flink-connector-kafka version 3.1.0 (to consume kafka 3.4.0 with Flink 1.18)

2023-11-07 Thread Jean-Marc Paulin
Hi, I had a chat on [FLINK-31599] Update kafka version to 3.4.0 by Ge · Pull Request #11 · apache/flink-connector-kafka (github.com) . We are consuming Flink 1.18, and the flink-connector-kafka 3.0.1. Flink 3.2.3 currently in use has

Re: [DISCUSS] FLIP-384: Introduce TraceReporter and use it to create checkpointing and recovery traces

2023-11-07 Thread Rui Fan
Hi Piotr, Thanks for driving this proposal! The trace reporter is useful to check a lot of duration monitors inside of Flink. I have some questions about this proposal: 1. I see the trace just supports Span? Does it support trace events? I'm not sure whether tracing events is reasonable for Trac

[jira] [Created] (FLINK-33476) join table throw Record is too big Exception

2023-11-07 Thread zhu (Jira)
zhu created FLINK-33476: --- Summary: join table throw Record is too big Exception Key: FLINK-33476 URL: https://issues.apache.org/jira/browse/FLINK-33476 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-33477) Reduce code redundancy in PojoSerializer

2023-11-07 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-33477: - Summary: Reduce code redundancy in PojoSerializer Key: FLINK-33477 URL: https://issues.apache.org/jira/browse/FLINK-33477 Project: Flink Issue Type: Bug

Re: Adding a new channel to Apache Flink slack workspace

2023-11-07 Thread Robin Moffatt
Since there have been no objections, can we go ahead and get this channel created please? thanks :) On Thu, 26 Oct 2023 at 16:00, Alexander Fedulov wrote: > +1 > I agree that the topic is distinct enough to justify a dedicated channel > and this could lead to more active participation from peop

Re: [DISCUSS] FLIP-384: Introduce TraceReporter and use it to create checkpointing and recovery traces

2023-11-07 Thread Piotr Nowojski
Hi Rui, Thanks for the comments! > 1. I see the trace just supports Span? Does it support trace events? > I'm not sure whether tracing events is reasonable for TraceReporter. > If it supports, flink can report checkpoint and checkpoint path proactively. > Currently, checkpoint lists or the latest

[jira] [Created] (FLINK-33478) Fail to call unix_timestamp when it is in filter condition

2023-11-07 Thread yunfan (Jira)
yunfan created FLINK-33478: -- Summary: Fail to call unix_timestamp when it is in filter condition Key: FLINK-33478 URL: https://issues.apache.org/jira/browse/FLINK-33478 Project: Flink Issue Type:

Re: Re:Re: [DISCUSS] Release 1.17.2

2023-11-07 Thread Yun Tang
Hi @casel.chen It seems FLINK-33365 is more related to JDBC connector than the Flink runtime, and the discussion will focus on the release of Flink-1.17.2. Best Yun Tang From: casel.chen Sent: Tuesday, November 7, 2023 16:04 To: dev@

Re: FLIP-385: Add OpenTelemetryTraceReporter and OpenTelemetryMetricReporter

2023-11-07 Thread Timo Walther
Thanks for the FLIP, Piotr. In order to follow the FLIP process[1], please prefix the email subject with "[DISCUSS]". Also, some people might have added filters to their email clients to highlight those discussions. Thanks, Timo [1] https://cwiki.apache.org/confluence/display/Flink/Flink+

[DISCUSS] FLIP-385: Add OpenTelemetryTraceReporter and OpenTelemetryMetricReporter

2023-11-07 Thread Piotr Nowojski
Hey, sorry for the misclick. Fixed. wt., 7 lis 2023 o 14:00 Timo Walther napisał(a): > Thanks for the FLIP, Piotr. > > In order to follow the FLIP process[1], please prefix the email subject > with "[DISCUSS]". > > Also, some people might have added filters to their email clients to > highlight

[DISCUSS] FLIP-386: Support adding custom metrics in Recovery Spans

2023-11-07 Thread Piotr Nowojski
(Fixing topic) wt., 7 lis 2023 o 09:40 Piotr Nowojski napisał(a): > Hi all! > > I would like to start a discussion on a follow up of FLIP-384: Introduce > TraceReporter and use it to create checkpointing and recovery traces [1]: > > *FLIP-386: Support adding custom metrics in Recovery Spans [2]*

Re: [DISCUSS] FLIP-269: Properly Handling the Processing Timers on Job Termination

2023-11-07 Thread Yun Tang
Sorry to pick up this discussion again after a long time. @Yun Gao, could you share the PoC if possible? Best Yun Tang On 2022/12/08 10:20:21 Piotr Nowojski wrote: > Sounds good to me as well! > > Best, > Piotrek > > czw., 8 gru 2022 o 09:53 Dawid Wysakowicz > napisał(a): > > > Sounds like a

Re: [VOTE] FLIP-376: Add DISTRIBUTED BY clause

2023-11-07 Thread Jim Hughes
Hi all, +1 (non-binding) Cheers, Jim On Mon, Nov 6, 2023 at 6:39 AM Timo Walther wrote: > Hi everyone, > > I'd like to start a vote on FLIP-376: Add DISTRIBUTED BY clause[1] which > has been discussed in this thread [2]. > > The vote will be open for at least 72 hours unless there is an objec

Re: [DISCUSS] Release Flink 1.16.3

2023-11-07 Thread vikas patil
+1 for the release of flink 1.16.3. Thanks for the effort Rui. On Mon, Nov 6, 2023 at 8:05 AM Jing Ge wrote: > +1 for the final bug fix for Flink 1.16. Thanks for your effort! > > Best regards, > Jing > > On Mon, Nov 6, 2023 at 1:14 AM Konstantin Knauf wrote: > > > +1. Thank you for picking it

Re: Re:Re: [DISCUSS] Release 1.17.2

2023-11-07 Thread Danny Cranmer
+1, thanks for picking this up. I am happy to help out with the bits you need PMC support for. Thanks, Danny On Tue, Nov 7, 2023 at 4:03 AM Yun Tang wrote: > Hi @casel.chen > > It seems FLINK-33365 is more related to JDBC connector than the Flink > runtime, and the

[jira] [Created] (FLINK-33479) Add Rerouting support to KafkaSink

2023-11-07 Thread Kevin Tseng (Jira)
Kevin Tseng created FLINK-33479: --- Summary: Add Rerouting support to KafkaSink Key: FLINK-33479 URL: https://issues.apache.org/jira/browse/FLINK-33479 Project: Flink Issue Type: Improvement

Re: Adding a new channel to Apache Flink slack workspace

2023-11-07 Thread Jing Ge
+1 since there are so many questions wrt PyFlink. Best regards, Jing On Tue, Nov 7, 2023 at 2:23 AM Robin Moffatt wrote: > Since there have been no objections, can we go ahead and get this channel > created please? > > thanks :) > > On Thu, 26 Oct 2023 at 16:00, Alexander Fedulov < > alexander.

[jira] [Created] (FLINK-33480) Implement restore tests for GroupAggregate node

2023-11-07 Thread Bonnie Varghese (Jira)
Bonnie Varghese created FLINK-33480: --- Summary: Implement restore tests for GroupAggregate node Key: FLINK-33480 URL: https://issues.apache.org/jira/browse/FLINK-33480 Project: Flink Issue T

Re: [VOTE] FLIP-376: Add DISTRIBUTED BY clause

2023-11-07 Thread Jingsong Li
+1 On Tue, Nov 7, 2023 at 5:56 AM Jim Hughes wrote: > > Hi all, > > +1 (non-binding) > > Cheers, > > Jim > > On Mon, Nov 6, 2023 at 6:39 AM Timo Walther wrote: > > > Hi everyone, > > > > I'd like to start a vote on FLIP-376: Add DISTRIBUTED BY clause[1] which > > has been discussed in this threa

[jira] [Created] (FLINK-33481) Why were CheckPoints stored on ZooKeeper deleted when use Flink High Availability

2023-11-07 Thread hansonhe (Jira)
hansonhe created FLINK-33481: Summary: Why were CheckPoints stored on ZooKeeper deleted when use Flink High Availability Key: FLINK-33481 URL: https://issues.apache.org/jira/browse/FLINK-33481 Project: F

Re: Re:Re: [DISCUSS] Release 1.17.2

2023-11-07 Thread Jingsong Li
+1 thanks Yun 1.17.2 is really important. Best, Jingsong On Tue, Nov 7, 2023 at 9:32 AM Danny Cranmer wrote: > > +1, thanks for picking this up. > > I am happy to help out with the bits you need PMC support for. > > Thanks, > Danny > > On Tue, Nov 7, 2023 at 4:03 AM Yun Tang wrote: > > > Hi @

Re: [DISCUSS] Release Flink 1.16.3

2023-11-07 Thread Leonard Xu
Thanks Rui for driving this. +1 to release 1.16.3 and make it as the final bugix release of 1.16 series. Best, Leonard

Re: [DISCUSS] Release flink-shaded 16.2

2023-11-07 Thread weijie guo
Thanks Yuxin for driving this! I am willing to help release this. :) Best regards, Weijie Yuxin Tan 于2023年11月6日周一 15:45写道: > Hi, all, > > I would like to discuss creating a new 16.2 patch release for > flink-shaded[1]. > > In our ARM environment, we recently encountered a critical bug > (FLI

Re: [DISCUSS] Release 1.17.2

2023-11-07 Thread Leonard Xu
Thanks Yun for picking this. +1 Best, Leonard > 2023年11月8日 上午9:23,Jingsong Li 写道: > > +1 thanks Yun > > 1.17.2 is really important. > > Best, > Jingsong > > On Tue, Nov 7, 2023 at 9:32 AM Danny Cranmer wrote: >> >> +1, thanks for picking this up. >> >> I am happy to help out with the bi

Re: [VOTE] Release flink-connector-gcp-pubsub v3.0.2, release candidate #1

2023-11-07 Thread Leonard Xu
Thanks Danny for driving this. I'm considering -1, please correct me if I understand wrong. >> * The sources can be compiled and unit tests pass with flink.version 1.17.1 >> and flink.version 1.18.0 >> >> * Nexus has two staged artifact ids for 3.0.2-1.17 and 3.0.2-1.18 >> - flink-connector-gcp

Re: [DISCUSS] FLINK-32737: At-least-once sink connector for Snowflake

2023-11-07 Thread Mohsen Rezaei
This is now available as an open-source project: https://github.com/deltastreaminc/flink-connector-snowflake The first version, {{1.0.7-1.17}} is published on the Maven Central. On Tue, Aug 8, 2023 at 10:56 PM Mohsen Rezaei wrote: > Hi all, > > I'm in the process of writing a Snowflake sink con

Re: [DISCUSS] FLIP-384: Introduce TraceReporter and use it to create checkpointing and recovery traces

2023-11-07 Thread Zakelly Lan
Hi Piotr, Happy to see the trace! Thanks for this proposal. One minor question: It is mentioned in the interface of Span: Currently we don't support traces with multiple spans. Each span is > self-contained and represents things like a checkpoint or recovery. Does it mean the inclusion and sub

Re: [VOTE] FLIP-376: Add DISTRIBUTED BY clause

2023-11-07 Thread Zhanghao Chen
+1 (non-binding) Best, Zhanghao Chen From: Timo Walther Sent: Monday, November 6, 2023 19:38 To: dev Subject: [VOTE] FLIP-376: Add DISTRIBUTED BY clause Hi everyone, I'd like to start a vote on FLIP-376: Add DISTRIBUTED BY clause[1] which has been discussed in

Re: [VOTE] FLIP-376: Add DISTRIBUTED BY clause

2023-11-07 Thread Sergey Nuyanzin
+1 (binding) On Wed, Nov 8, 2023 at 6:02 AM Zhanghao Chen wrote: > +1 (non-binding) > > Best, > Zhanghao Chen > > From: Timo Walther > Sent: Monday, November 6, 2023 19:38 > To: dev > Subject: [VOTE] FLIP-376: Add DISTRIBUTED BY clause > > Hi everyone, > > I'd

Re: [DISCUSS] Release Flink 1.16.3

2023-11-07 Thread Sergey Nuyanzin
+1 for the final release and thanks for the efforts On Wed, Nov 8, 2023 at 4:09 AM Leonard Xu wrote: > Thanks Rui for driving this. > > +1 to release 1.16.3 and make it as the final bugix release of 1.16 > series. > > Best, > Leonard > -- Best regards, Sergey