Minutes of the Community Health Initiative (CHI) for Western time zone

2025-02-07 Thread David Radley
https://github.com/apache/flink/pull/25800 - still waiting * https://github.com/apache/flink/pull/25809 - udf backport Please let us know if there is anything around technical debt we should focus on. Listing easy merges for committers seems a quick win. Kind regards, David. Unless otherwise

RE: [VOTE] Release 1.20.1, release candidate #1

2025-02-07 Thread David Radley
ary 2025 at 17:30 To: dev@flink.apache.org Subject: [EXTERNAL] Re: [VOTE] Release 1.20.1, release candidate #1 Hi David, Thanks for verifying the release. 1. sha256 and sha512 are not expected to be the same. Try shasum -a 512 flink-1.20.1-bin-scala_2.12.tgz 2. I believe you do not have my public

Re: [VOTE] Release 1.20.1, release candidate #1

2025-02-04 Thread David Radley
where appeared to be an error message. Am I missing something? kind regards, David. From: Alexander Fedulov Date: Wednesday, 29 January 2025 at 12:32 To: dev Subject: [EXTERNAL] [VOTE] Release 1.20.1, release candidate #1 Hi everyone, Please review and vote on the release candidate #1 fo

Minutes for 9th Community Health Initiative (CHI) Eastern time zone.

2025-01-30 Thread David Radley
ing to those that are mergable. * David Radley<https://cwiki.apache.org/confluence/display/~davidrad> to analyse what we have in the non draft , open unstale PR bucket so we can see how they group and look at actions based on the data. >From this week we need to committer review a

Minutes for 8th Community Health Initiative (CHI) Western time zone.

2025-01-24 Thread David Radley
ithub.com/apache/flink/pull/26039 - labelled as a hotfix - David requested changes that have been made. Need a committer review and merge. * https://github.com/apache/flink/pull/26077 - trivial change kind regards, David. Unless otherwise stated above: IBM United Kingdom Limited Regist

Re: [jira] [Created] (FLINK-37202) Introduce TDengine connector

2025-01-22 Thread David Radley
Hi there, I think a new connector is an improvement that requires a Flip https://cwiki.apache.org/confluence/display/FLINK/Flink+Improvement+Proposals so this can be discussed and voted on by the community, Kind regards, David. From: kevinmen (Jira) Date: Wednesday, 22 January 2025 at

RE: Plans for JDBC connector for 1.20?

2025-01-20 Thread David Radley
work on PRs – if there is a committer willing to merge them. Kind regards, David. From: Xingcan Cui Date: Monday, 6 January 2025 at 22:53 To: dev@flink.apache.org Cc: jerome.gagno...@gmail.com Subject: [EXTERNAL] Re: Plans for JDBC connector for 1.20? Hi Hang, Just want to follow up on

RE: Stale PR Action running but the labels are missing

2025-01-17 Thread David Radley
Hi Rui, Looks good to me too. Yes the 4 PRs have the stale label removed as they have been updated – as you say this is expected -so the PR query numbers tally. Thank you very much for sorting this out. Kind regards, David. From: Tom Cooper Date: Friday, 17 January 2025 at 10:50 To

FW: Community Health Initiative (CHI) 9th of January minutes

2025-01-16 Thread David Radley
. kind regards, David. Unless otherwise stated above: IBM United Kingdom Limited Registered in England and Wales with number 741598 Registered office: Building C, IBM Hursley Office, Hursley Park Road, Winchester, Hampshire SO21 2JN Unless otherwise stated above: IBM United Kingdom Limited

Re: [DISCUSSION] flink-connector-hive first release of externalized connector

2025-01-16 Thread David Radley
check for the java class existence prior to using it in some way? Kind regards, David. From: Sergey Nuyanzin Date: Monday, 13 January 2025 at 22:16 To: dev@flink.apache.org Subject: [EXTERNAL] [DISCUSSION] flink-connector-hive first release of externalized connector Hi everyone, This is yet

RE: Stale PR Action running but the labels are missing

2025-01-15 Thread David Radley
://stackoverflow.com/questions/63521430/clear-cache-in-github-actions 3)Looks like a good option – WDYT? Could some with write access remove the cache for the stale git action when it is not running? Kind regards, David. From: Rui Fan <1996fan...@gmail.com> Date: Wednesday, 15 January 2025 at 07

Community Health Initiative (CHI) 9th of January minutes

2025-01-10 Thread David Radley
36 https://github.com/apache/flink/pull/25911 >From previous weeks we still need to committer review and merge * https://github.com/apache/flink/pull/25800 * https://github.com/apache/flink/pull/25809 - udf backport * https://github.com/apache/flink/pull/25646 kind regards, David.

PR introducing V1 and V2 state migration issue

2025-01-10 Thread David Radley
and feedback, Kind regards, David. Unless otherwise stated above: IBM United Kingdom Limited Registered in England and Wales with number 741598 Registered office: Building C, IBM Hursley Office, Hursley Park Road, Winchester, Hampshire SO21 2JN

[jira] [Created] (FLINK-37097) Remove

2025-01-10 Thread david radley (Jira)
david radley created FLINK-37097: Summary: Remove Key: FLINK-37097 URL: https://issues.apache.org/jira/browse/FLINK-37097 Project: Flink Issue Type: Technical Debt Components

Flink v2 download name

2025-01-10 Thread David Radley
implementations with Java versions – can we remove scala from the download name? Kind regards, David. Unless otherwise stated above: IBM United Kingdom Limited Registered in England and Wales with number 741598 Registered office: Building C, IBM Hursley Office, Hursley Park Road, Winchester

RE: Does Flink operator 1.1.0 support Flink 1.20?

2025-01-09 Thread David Radley
.20 in FLINK-36129[1]. [1] https://issues.apache.org/jira/browse/FLINK-36129 Best, Rui On Wed, Jan 8, 2025 at 9:49 PM David Radley wrote: > Hi, > > We were looking at the documentation and wondered is there a statement > saying that the 1.10.0< > https://mvnrepository.com/artifac

Does Flink operator 1.1.0 support Flink 1.20?

2025-01-08 Thread David Radley
Hi, We were looking at the documentation and wondered is there a statement saying that the 1.10.0<https://mvnrepository.com/artifact/org.apache.flink/flink-kubernetes-operator-api/1.10.0> Flink operator supports / has been verified with Flink 1.20? Kind regards, David. Unless oth

RE: [VOTE] CHI: Stale PR cleanup

2025-01-06 Thread David Radley
Thanks for driving this Tom. +1 (non-binding) David From: Gyula Fóra Date: Monday, 6 January 2025 at 16:33 To: dev@flink.apache.org Subject: [EXTERNAL] Re: [VOTE] CHI: Stale PR cleanup +1 (binding) Gyula On Mon, Jan 6, 2025 at 5:12 PM Tom Cooper wrote: > Hi all, > > Following o

Flink technical debt. Chi meeting

2024-12-20 Thread David Radley
triaging and also get bigger changes in place to help, e.g. enhancing Flink bot and a stale PR bot, so we can see what is important to address. Merry Flinkmas !! May all your streams come true 😊 Kind regards ,David, From: David Radley Date: Tuesday, 17 December 2024 at 09:23 To: dev

RE: [VOTE] FLIP-493: Add K8S conditions to CRD's Status

2024-12-20 Thread David Radley
and running as you would expect. So avoiding the ready vs running debate, Kind regards, David From: gyula.f...@gmail.com Date: Friday, 20 December 2024 at 15:08 To: dev@flink.apache.org Cc: dev@flink.apache.org Subject: [EXTERNAL] Re: [VOTE] FLIP-493: Add K8S conditions to CRD&#

FW: FW: Re: Flink technical debt. Chi meeting

2024-12-17 Thread David Radley
v list. * We talked about addressing the dependabot PRs by raising a separate Jira and PR including the notice file(s), so the impact of a dependency upgrade could be properly assessed. Kind regards, David. From: David Radley Date: Thursday, 5 December 2024 at 15:14 To: dev@flink.apac

RE: [DISCUSS] FLIP-XXX Add K8S conditions to Flink CRD

2024-12-12 Thread David Radley
Hi , I have been given authority to create the Flip on the wiki. I have asked Lajith to provide the images as files – which will make it easier to create the Flip on the wiki, Kind regards, David. From: Lajith Koova Date: Wednesday, 27 November 2024 at 09:22 To: dev@flink.apache.org

RE: Re: [DISCUSS] Flink 1.20.1 release

2024-12-10 Thread David Radley
+1 for a 1.20.1 release, Thanks for driving Alex! There is a PR [1] against master that fixes a lot of vulnerabilities in the Web UI, this requires a PR that brings in a later level of Node [2]. We would like to backport these and have them part of the 1.20.1 release, Kind regards, David. [1

RE: Plans for JDBC connector for 1.20?

2024-12-10 Thread David Radley
Hi Hang, Thankyou very much - just to confirm, are you willing to be the release manager for the JDBC connector Flink 1.20 compatible release? If so, when are you thinking of kicking this off. Kind regards, David. From: Peter Huang Date: Tuesday, 10 December 2024 at 07:11 To: dev

RE: [VOTE] FLIP-484: Add custom metric variables to operators

2024-12-09 Thread David Radley
ser variable? I am in favour of this Flip , but would like the above clarifications please, Kind regards, David. From: Piotr Nowojski Date: Friday, 6 December 2024 at 16:18 To: dev@flink.apache.org Subject: [EXTERNAL] Re: [VOTE] FLIP-484: Add custom metric variables to operators H

RE: [VOTE] FLIP-484: Add custom metric variables to operators

2024-12-06 Thread David Radley
enforce uniqueness. >From your example, I assume all the “table_name” could be any literal. If the >main use case for this is to put the table name as the metric scope – could we >not do this automatically in the code without any additional need to add code? Kind regards, David. From: Yu

FW: Re: Flink technical debt. Chi meeting

2024-12-05 Thread David Radley
regards, David. From: David Radley Date: Friday, 29 November 2024 at 12:07 To: dev@flink.apache.org , Tom Cooper , Robert Metzger Subject: FW: [EXTERNAL] Re: Flink technical debt. Hi all, We had the 2nd 30 minute working meeting of the Community Health Initiative (CHI) yesterday for Western

RE: Blue/Green Deployments support for Flink

2024-12-04 Thread David Radley
, David. From: Maximilian Michels Date: Wednesday, 4 December 2024 at 09:56 To: schong...@apple.com.invalid Cc: dev@flink.apache.org Subject: [EXTERNAL] Re: Blue/Green Deployments support for Flink Hi Sergio, Out of the box blue/green deployments would be a great addition to Flink. +1 for

RE: Plans for JDBC connector for 1.20?

2024-12-03 Thread David Radley
agree a committer to be the release manager; are you interested in doing this? Kind regards, David. From: Yanquan Lv Date: Monday, 2 December 2024 at 01:57 To: dev@flink.apache.org Subject: [EXTERNAL] Re: Plans for JDBC connector for 1.20? Hi, David. +1 to cut main into a new 1.20

Community Health Initiative (CHI) workgroup wiki content

2024-12-02 Thread David Radley
will add the meeting minutes to the wiki and send a link to the mailing list. Any feedback welcome, kind regards, David. Unless otherwise stated above: IBM United Kingdom Limited Registered in England and Wales with number 741598 Registered office: Building C, IBM Hursley Office, Hursl

FW: Plans for JDBC connector for 1.20?

2024-11-29 Thread David Radley
Hi again, A friendly nudge – any thoughts from the community? Kind regards, David. From: David Radley Date: Thursday, 21 November 2024 at 17:17 To: dev@flink.apache.org Subject: [EXTERNAL] Plans for JDBC connector for 1.20? Hi, Is there a plan to release the JDBC for Flink 1.20

FW: Re: Flink technical debt.

2024-11-29 Thread David Radley
ward and close out appropriately; so new contributions are looked at in the timely way. Any feedback on the approach and focus is welcome. Kind regards, David. From: David Radley Date: Thursday, 21 November 2024 at 11:56 To: dev@flink.apache.org , Robert Metzger , Tom Cooper Subject: FW: [EXTERNAL] R

RE: FW: Re: Flink technical debt.

2024-11-25 Thread David Radley
submitter feels that the change will get merged at LGTM time and a committer was involved, they will be willing to make the fixups. Kind regards, David. From: Sergey Nuyanzin Date: Sunday, 24 November 2024 at 21:23 To: dev@flink.apache.org Cc: Robert Metzger , Tom Cooper Subject: [EXTERNAL] Re

Plans for JDBC connector for 1.20?

2024-11-21 Thread David Radley
1.20 and subsequently to Flink v2. Kind regards, David. Unless otherwise stated above: IBM United Kingdom Limited Registered in England and Wales with number 741598 Registered office: Building C, IBM Hursley Office, Hursley Park Road, Winchester, Hampshire SO21 2JN

FW: Re: Flink technical debt.

2024-11-21 Thread David Radley
hese look like low hanging fruit for committers to merge. WDYT? I will then look at any new PRs prior to the next meeting and the next latest ones in the list. Any feedback on the approach and focus welcome. Kind regards, David. From: Robert Metzger Date: Friday, 15 November 202

RE: FW: RE: Flink technical debt.

2024-11-20 Thread David Radley
Hi Jim, No worries. I did not notice the Thanksgiving clash, we have some interest from New Zealand, so I will run this in case they choose this slot. I have not got the ASF Confluence access yet, is this something you can help with? Kind regards, David. From: Jim Hughes Date: Tuesday

FW: RE: Flink technical debt.

2024-11-19 Thread David Radley
:%22fcf67057-50c9-4ad4-98f3-ffca64add9e9%22,%22Oid%22:%229c4a6a85-e4f2-44e8-a2f2-b00cdc128be3%22%7D @Robert Metzger<mailto:rmetz...@apache.org> I will put the meeting details including the schedule on the wiki once I have access. kind regards, David. From: David Radley Date: Friday, 15 November 2

RE: Flink V1 to V2 state migration

2024-11-18 Thread David Radley
Hi Xu and Gabor, I have not started the testing yet – it is high up on the list! I will share anything I find when I get to it, Kind regards, David. From: Xu Huang Date: Monday, 18 November 2024 at 03:47 To: dev@flink.apache.org Subject: [EXTERNAL] Re: Flink V1 to V2 state migration Hi

RE: Flink technical debt.

2024-11-15 Thread David Radley
Hi Robert, Good idea - yes I put this and subsequent meeting content on the wiki – user name davidradl would be great, kind regards, David. From: Robert Metzger Date: Friday, 15 November 2024 at 08:13 To: dev@flink.apache.org Subject: [EXTERNAL] Re: Flink technical debt. Thanks David for

RE: Flink technical debt.

2024-11-14 Thread David Radley
Robert is looking to attend the next meeting on the 21st. We are all hoping to appropriately take some of this work from committers / PMC members to relieve some of the burden and make this is a win for everyone 😊 . Kind regards, David. From: David Radley mailto:david_rad...@uk.ibm.com&

RE: Re: [VOTE] FLIP-440: User-defined SQL operators / ProcessTableFunction (PTF)

2024-11-13 Thread David Radley
+1 (non-binding) kind regards, David From: Dawid Wysakowicz Date: Tuesday, 12 November 2024 at 10:47 To: dev@flink.apache.org Subject: [EXTERNAL] Re: Re: [VOTE] FLIP-440: User-defined SQL operators / ProcessTableFunction (PTF) +1 (binding) Best, Dawid On Tue, 12 Nov 2024 at 09:28, Fabian

FW: Re: Flink technical debt.

2024-11-13 Thread David Radley
478f-a5ce-0352e02bd69d?id=201596923> Phone conference ID: 201 596 923# Join on a video conferencing device Tenant key: i...@m.webex.com<mailto:i...@m.webex.com> Video ID: 116 500 390 3 Kind regards, David. From: Jim Hughes Date: Tuesday, 12 November 2024 at 03:03 To: dev@flink.apache.org Subj

RE: Flink V1 to V2 state migration

2024-11-11 Thread David Radley
adoption. Thanks for your feedback, Kind regards, David. From: Gabor Somogyi Date: Monday, 11 November 2024 at 20:13 To: dev@flink.apache.org Cc: Yuan Mei Subject: [EXTERNAL] Re: Flink V1 to V2 state migration Hi David, I think the first task would be to test and collect what is not

RE: Flink technical debt.

2024-11-11 Thread David Radley
email. I hope this works for everyone / most people, let me know if there are any issues, Kind regards, David. From: Nic Townsend Date: Thursday, 7 November 2024 at 17:26 To: dev@flink.apache.org Subject: [EXTERNAL] RE: Flink technical debt. Hi Robert, David I am very much interested in a

RE: Flink V1 to V2 state migration

2024-11-11 Thread David Radley
e migration where possible 3. Then to encourage adoption of forstdb state backend, then we should look at RockDB to forstdb state migration. WDYT? Kind regards,David. From: Zakelly Lan Date: Monday, 11 November 2024 at 09:31 To: dev@flink.apache.org Subject: [EXTERNAL] Re: Flink V1

Flink V1 to V2 state migration

2024-11-07 Thread David Radley
PMCs on the approach, Kind regards, David. Unless otherwise stated above: IBM United Kingdom Limited Registered in England and Wales with number 741598 Registered office: Building C, IBM Hursley Office, Hursley Park Road, Winchester, Hampshire SO21 2JN

RE: [DISCUSS] FLIP-440: User-defined SQL operators / ProcessTableFunction (PTF)

2024-11-07 Thread David Radley
, Duration period); what is relativeTime? relativeTime sounds like a duration. Kind regards, David. From: Fabian Hüske Date: Monday, 4 November 2024 at 15:41 To: dev@flink.apache.org Subject: [EXTERNAL] Re: [DISCUSS] FLIP-440: User-defined SQL operators / ProcessTableFunction (PTF) Hi Timo

RE: Flink technical debt.

2024-11-06 Thread David Radley
Hi Tom, Welcome 😊 Does anyone in the community know if we have considered running bots as Tom suggests, Kind regards, David. From: Tom Cooper Date: Wednesday, 6 November 2024 at 15:34 To: dev@flink.apache.org Subject: [EXTERNAL] Re: Flink technical debt. Hey David, As a newcomer to

RE: Flink technical debt.

2024-11-06 Thread David Radley
off meeting to agree goals and metrics and ongoing meeting structure – I like your proposal. Kind regards, David. From: Robert Metzger Date: Wednesday, 6 November 2024 at 15:22 To: dev@flink.apache.org Subject: [EXTERNAL] Re: Flink technical debt. Hey David, Thanks a lot for this initiative

RE: [DISCUSS] FLIP-XXX Add K8S conditions to Flink CRD

2024-11-06 Thread David Radley
over or get another committer to do this please; so we can get this moving. Kind regards, David. From: Lajith Koova Date: Monday, 14 October 2024 at 08:52 To: dev@flink.apache.org Subject: [EXTERNAL] Re: [DISCUSS] FLIP-XXX Add K8S conditions to Flink CRD Thank you all for the valuable

Flink technical debt.

2024-11-04 Thread David Radley
am happy to drive this as a community workgroup, with my team in IBM, if there is community support. We could call the community workgroup ?Community Health Initiative? CHI to energise the Flink community. WDYT? Kind regards, David. Unless otherwise stated above: IBM United Kingdom Limited

Re: [DISCUSS] FLIP-440: User-defined SQL operators / ProcessTableFunction (PTF)

2024-11-01 Thread David Anderson
ample, is @StateHint CountState state referring to the class named Count? This appears to be a typo. David On Fri, Nov 1, 2024 at 3:03 PM Timo Walther wrote: > Hi David, > > as mentioned in "Scoping and Simplifications" a PTF will not support > late events. It will filter t

Re: [DISCUSS] FLIP-440: User-defined SQL operators / ProcessTableFunction (PTF)

2024-11-01 Thread David Anderson
upstream of the split between the two statements in the resulting job graph? Otherwise, important use cases like sending late events to a side output will behave non-deterministically, and be useless. David On Fri, Nov 1, 2024 at 10:26 AM Timo Walther wrote: > Hi Xuyang, > > t

FW: RE: Kafka connector releases

2024-09-30 Thread David Radley
Hi again Arvid, I realise we actually have 3 releases (2 bug releases) supporting 1.18 – the renumbering threw me 😊. So I think your proposal looks good, kind regards, David. From: David Radley Date: Monday, 30 September 2024 at 17:07 To: dev@flink.apache.org Subject: [EXTERNAL] RE

RE: Kafka connector releases

2024-09-30 Thread David Radley
bug release for 1.19 also? I assume 1.20 as the last v1 release would have bug releases. Thoughts? Kind regards, David. From: Arvid Heise Date: Friday, 27 September 2024 at 11:12 To: dev@flink.apache.org Subject: [EXTERNAL] Re: Kafka connector releases Hi David, thank you very much for your

Re: Kafka connector releases

2024-09-27 Thread David Radley
case. WDYT? Kind regards, David. From: Arvid Heise Date: Friday, 27 September 2024 at 09:24 To: dev@flink.apache.org Subject: [EXTERNAL] Kafka connector releases Dear Flink devs, I'd like to initiate three(!) Kafka connector releases. The main reason for having three releases is th

FW: RE: [DISCUSS] FLIP-XXX Apicurio-avro format

2024-09-25 Thread David Radley
testing to confirm my understanding either way. If we can get the format name in the connector – I agree your proposed solution is neater, Warm regards, David. From: David Radley Date: Tuesday, 24 September 2024 at 22:16 To: dev@flink.apache.org Subject: [EXTERNAL] RE: [DISCUSS] FLIP-XXX

RE: [DISCUSS] FLIP-XXX Apicurio-avro format

2024-09-24 Thread David Radley
other formats. On the if you want to be fancy – a variant of this was my first proposed fix 😊 . Kind regards, David. From: Arvid Heise Date: Tuesday, 24 September 2024 at 21:11 To: Robert Metzger Cc: dev@flink.apache.org Subject: [EXTERNAL] Re: [DISCUSS] FLIP-XXX Apicurio-avro format Hi Robert

RE: [DISCUSS] FLIP-XXX Add K8S conditions to Flink CRD

2024-09-23 Thread David Radley
you say during transition, are you thinking of some small time window between states. I am not sure what you are saying here. Kind regards , David From: Lajith Koova Date: Wednesday, 11 September 2024 at 03:01 To: dev@flink.apache.org Subject: [EXTERNAL] Re: [DISCUSS] FLIP-XXX Add K8S

Re: [DISCUSS] FLIP-XXX Amazon SQS Source Connector

2024-09-19 Thread Green, David
once processing. I have very little knowledge of Flink, so will limit my feedback to SQS only. Feel free to link a design or ask specific questions. David

Non-nullable children of nullable arrays and objects in SQL not working with Avro format

2024-09-17 Thread David Radley
in case there are any further opinions around this. Kind regards, David. Unless otherwise stated above: IBM United Kingdom Limited Registered in England and Wales with number 741598 Registered office: PO Box 41, North Harbour, Portsmouth, Hants. PO6 3AU

Flink Releases

2024-09-05 Thread David Radley
Hi, I notice that https://nightlies.apache.org/flink/flink-docs-master/versions/ does not include 1.20. It seems that {{< all_versions >}} is not picking it up. I am happy to make the change, but could not see where to, Kind regards, David. Unless otherwise stated above

[DISCUSS] FLINK-34440 Support Debezium Protobuf Confluent Format #2

2024-09-05 Thread David Mariassy
t - Serialize the `AbstractMessage` object using a `io.confluent.kafka.serializers.protobuf.KafkaProtobufSerializer` --- That's hopefully enough context to get the conversation going. Looking forward to the community's response! cc @Kevin Lam -- David Mariassy Staff Production Engineer [image: Shopify] <https://www.shopify.com/?utm_medium=salessignatures&utm_source=hs_email>

Match recognize references old type system in docs.

2024-08-30 Thread David Radley
those values happened I assume this needs to be updated to use the new type system. I suggest using the test case create table [1] for the docs. I can raise an issue and make this change. Kind regards, David. [1] https://github.com/apache/flink/blob/d57b89db6b2e177d131ce2376ee17672bd42dfa8

RE: Flink aggregation docs

2024-08-30 Thread David Radley
Hi Martjin, OK thanks - I missed that, Kind regards, David. From: Martijn Visser Date: Friday, 30 August 2024 at 13:59 To: dev@flink.apache.org Subject: [EXTERNAL] Re: Flink aggregation docs Hi David, It's already mentioned in the docs: *Note: in order to better understan

Flink aggregation docs

2024-08-30 Thread David Radley
an issue and fix the docs. Is someone would be willing to assign me the issue and then merge the change, Kind regards, David. Unless otherwise stated above: IBM United Kingdom Limited Registered in England and Wales with number 741598 Registered office: PO Box 41, North Harbour, Portsmouth

[DISCUSS] FLIP-319: Integrating with Kafka’s proper support for 2PC participation (KIP-939).

2024-08-23 Thread David Radley
) does or not support 2 phase commit. How would this work? For example can we check if the Kafka clusters are at a minimal version that supports KIP 939? Kind regards, David. Unless otherwise stated above: IBM United Kingdom Limited Registered in England and Wales with number 741598 Registered

RE: [VOTE] FLIP-473: Introduce New SQL Operators Based on Asynchronous State APIs

2024-08-23 Thread David Radley
+1 (non-binding) Kind regards, David. From: Lincoln Lee Date: Thursday, 22 August 2024 at 03:35 To: dev@flink.apache.org Subject: [EXTERNAL] Re: [VOTE] FLIP-473: Introduce New SQL Operators Based on Asynchronous State APIs +1 (binding) Best, Lincoln Lee Feng Jin 于2024年8月22日周四 09:44写道

RE: [DISCUSS] FLIP-XXX Apicurio-avro format

2024-08-14 Thread David Radley
Hi Danny, Thank you for your feedback. I have brought a fork up to date with one commit so you can see the code; I need to test more scenarios and add more unit tests, but it shows the basic idea of the design, Chesnay and I agreed. Kind regards, David. From: Danny Cranmer Date: Thursday

Re: [VOTE] FLIP-468: Introducing StreamGraph-Based Job Submission

2024-08-09 Thread David Morávek
tldr, compiled plan needs to be stable and feature complete; covering sql streaming, batch and datastream api On Fri 9. 8. 2024 at 15:58, Jim Hughes wrote: > David, Junrui, > > Is there a brief description of the prerequisites for compiled plan-based > submission? > > Cheers,

Re: Re:Re: [DISCUSS] FLIP-473: Introduce New SQL Operators Based on Asynchronous State APIs

2024-08-09 Thread David Morávek
Hi Xuyang, Thank you for looking into this—great work! The overall direction seems solid. I have two minor questions: In theory, the implementation of AsyncStateOperator and SyncStateOperator > differs only in their state handling. Their state schemas, business logic, > and other aspects remain t

Re: [DISCUSS] FLIP-474: Store operator name and UID in state metadata

2024-08-09 Thread David Morávek
Hi Gabor, Thanks for taking the initiative on this. It’s clear that significant improvements are needed in this area, and parsing state files can be incredibly challenging, even for those who are well-versed in it. > Just to make it crystal clear, I’m not shooting for an ad-hoc tiny fix but start

Re: [VOTE] FLIP-468: Introducing StreamGraph-Based Job Submission

2024-08-09 Thread David Morávek
:04 PM Junrui Lee wrote: > Hi everyone, > > David, Zhu and I had an offline discussion about FLIP-468 and more. Here > are the key points: > 1. Flink lacks a stable public REST API for job submission. Such a public > REST API will allow users to create and store compiled plans

Re: [VOTE] FLIP-472: Aligning timeout logic in the AdaptiveScheduler's WaitingForResources and Executing states

2024-08-05 Thread David Morávek
+1 (binding) Best, D. On Mon, Aug 5, 2024 at 9:24 AM yuanfeng hu wrote: > +1 (no-binding) > > Rui Fan <1996fan...@gmail.com> 于2024年8月5日周一 15:18写道: > > > +1(binding) > > > > Best, > > Rui > > > > On Mon, Aug 5, 2024 at 3:11 PM Zdenek Tison > > > wrote: > > > > > Hi everyone, > > > > > > > > > T

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

2024-07-30 Thread David Morávek
y for TableAPI/SQL jobs only? Best, D. On Tue, Jul 30, 2024 at 11:25 AM Zhu Zhu wrote: > Thanks for sharing the thoughts, David! > > IIUC, there are two goals to make the APIs used for RPCs as > versionless as possible? > 1. no version mismatch happens if no code changes > 2. suppo

Re: [DISCUSS] FLINK-34440 Support Debezium Protobuf Confluent Format

2024-07-29 Thread David Mariassy
://github.com/apache/flink/pull/24482#issuecomment-2226279775> in > on Anupam's PR that we might have some time to look at this issue > FLINK-34440. > > Adding @David Mariassy to this thread, as he's > started to work > <https://github.com/apache/flink/pull/24482#iss

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

2024-07-29 Thread David Morávek
; transitioning these test cases and replacing with StreamGraph would be > >> a > >>>> highly risky and complicated action. Therefore, I am inclined not to > >>>> eliminate the pathway of submitting JobGraph within this FLIP. > >>>> > >&

Re: [VOTE] FLIP-468: Introducing StreamGraph-Based Job Submission

2024-07-29 Thread David Morávek
Hi everyone, I hope this message finds you well. I recently returned from a two-week vacation and apologize for the delay in my response. There are still a few crucial questions, especially regarding how this will work with streaming that need to be addressed. Therefore, I would like to temporari

RE: Potential Kafka Connector FLIP: Large Message Handling

2024-07-18 Thread David Radley
Hi Kevin, That sounds good, unfortunately the image did not come through in the email for me,kind regards, David From: Kevin Lam Date: Wednesday, 10 July 2024 at 19:20 To: dev@flink.apache.org Subject: [EXTERNAL] Re: Potential Kafka Connector FLIP: Large Message Handling Hey David, Yes my

Supporting fields containing "." in watermark

2024-07-17 Thread David Radley
sted field? Ideally we would actually like to run with watermarks based on nested fields. WDYT? Kind regards, David. Unless otherwise stated above: IBM United Kingdom Limited Registered in England and Wales with number 741598 Registered office: PO Box 41, North Harbour, Portsmouth, Hants. PO6 3AU

RE: [DISCUSS] FLIP-XXX Apicurio-avro format

2024-07-16 Thread David Radley
://cwiki.apache.org/confluence/display/FLINK/FLIP-454%3A+New+Apicurio+Avro+format As the design is significantly different, there will be a new period of discussion before going to vote. Fyi I will be on vacation after this week until the 13th of August. Kind regards, David. From: David Radley Date

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

2024-07-11 Thread David Morávek
l solution is still to put SQL Optimizer to > flink-runtime. > > Best, > Ron > > David Morávek 于2024年7月11日周四 19:17写道: > > > Hi Junrui, > > > > Thank you for drafting the FLIP. I really appreciate the direction it’s > > taking. We’ve discussed simil

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

2024-07-11 Thread David Morávek
Hi Junrui, Thank you for drafting the FLIP. I really appreciate the direction it’s taking. We’ve discussed similar approaches multiple times, and it’s great to see this progress. I have a few questions and thoughts: * 1. Transformations in StreamGraphGenerator:* Should we consider taking this a

RE: [VOTE] FLIP-465: Introduce DESCRIBE FUNCTION

2024-07-11 Thread David Radley
+1 (non-binding) Kind regards , David. From: Martijn Visser Date: Thursday, 11 July 2024 at 10:10 To: dev@flink.apache.org Subject: [EXTERNAL] Re: [VOTE] FLIP-465: Introduce DESCRIBE FUNCTION +1 (binding) On Sat, Jul 6, 2024 at 6:52 PM Yubin Li wrote: > +1 (non-binding) > > Best

RE: Potential Kafka Connector FLIP: Large Message Handling

2024-07-10 Thread David Radley
correctly? Kind regards, David. From: Kevin Lam Date: Wednesday, 10 July 2024 at 14:35 To: dev@flink.apache.org Subject: [EXTERNAL] Re: Potential Kafka Connector FLIP: Large Message Handling Hey all, just a follow-up here. I was able to insert our Large Message handling by overriding

RE: [DISCUSS] FLIP-XXX Apicurio-avro format

2024-07-09 Thread David Radley
identifier, I hope to put up a new design in the Flip by the end of next week, for wider review, Kind regards, David. From: Kevin Lam Date: Monday, 8 July 2024 at 21:16 To: dev@flink.apache.org Subject: [EXTERNAL] Re: [DISCUSS] FLIP-XXX Apicurio-avro format Hi David, Any updates on the Kafka

[jira] [Created] (FLINK-35794) Ability to skip kubernetes tests in e2e nightly test script

2024-07-09 Thread David Kornel (Jira)
David Kornel created FLINK-35794: Summary: Ability to skip kubernetes tests in e2e nightly test script Key: FLINK-35794 URL: https://issues.apache.org/jira/browse/FLINK-35794 Project: Flink

[jira] [Created] (FLINK-35726) Data Stream to Table API converts Map to RAW 'java.util.Map'

2024-06-28 Thread David Perkins (Jira)
David Perkins created FLINK-35726: - Summary: Data Stream to Table API converts Map to RAW 'java.util.Map' Key: FLINK-35726 URL: https://issues.apache.org/jira/browse/FLINK-35726 Proj

Re: [2.0] How to handle on-going feature development in Flink 2.0?

2024-06-25 Thread David Radley
thinking connectors with Hadoop eco-system dependencies (e.g. Paimon) which may not work nicely with Java 17, Kind regards, David. From: Matthias Pohl Date: Tuesday, 25 June 2024 at 09:57 To: dev@flink.apache.org Cc: Xintong Song , martijnvis...@apache.org , imj...@gmail.com , becket

[jira] [Created] (FLINK-35694) Flink-end-to-end-test kubernetes fails due to hostname --ip-adress command

2024-06-25 Thread David Kornel (Jira)
David Kornel created FLINK-35694: Summary: Flink-end-to-end-test kubernetes fails due to hostname --ip-adress command Key: FLINK-35694 URL: https://issues.apache.org/jira/browse/FLINK-35694 Project

FW: Non Nullable fields within objects

2024-06-20 Thread David Radley
uot;string", for last_name and title. I have done a little digging. It appears that the issue is in the createSqlTableConverter. In the debugger I see: Buyer has a nullable followed by 2 non nullable fields. The FieldsDataType are all nullable. This looks like it has lost the nullable hint. LogicalType

Re: [ANNOUNCE] New Apache Flink Committer - Zhongqiang Gong

2024-06-17 Thread David Radley
Congratulations Zhongqiang, Kind regards, David. From: Feng Jin Date: Monday, 17 June 2024 at 12:36 To: dev@flink.apache.org Subject: Re: [ANNOUNCE] New Apache Flink Committer - Zhongqiang Gong Congratulations Zhongqiang !!! Best regards Feng Jin On Mon, Jun 17, 2024 at 7:01 PM Feifan Wang

Re: [VOTE] FLIP-461: Synchronize rescaling with checkpoint creation to minimize reprocessing for the AdaptiveScheduler

2024-06-17 Thread David Morávek
+1 (binding) On Mon, Jun 17, 2024 at 10:24 AM Matthias Pohl wrote: > Hi everyone, > the discussion in [1] about FLIP-461 [2] is kind of concluded. I am > starting a vote on this one here. > > The vote will be open for at least 72 hours (i.e. until June 20, 2024; > 8:30am UTC) unless there are an

RE: [DISCUSS] FLIP-XXX Apicurio-avro format

2024-06-14 Thread David Radley
Flink interfaces. I am going to prototype this idea. WDYT? My thanks go to Chesnay and Danny for their support and insight around this Flip, Kind regards, David. From: David Radley Date: Wednesday, 29 May 2024 at 11:39 To: dev@flink.apache.org Subject: [EXTERNAL] RE: [DISCUSS] FLIP-XXX

[jira] [Created] (FLINK-35595) MailboxProcessor#processMailsWhenDefaultActionUnavailable is allocation intensive

2024-06-13 Thread David Schlosnagle (Jira)
David Schlosnagle created FLINK-35595: - Summary: MailboxProcessor#processMailsWhenDefaultActionUnavailable is allocation intensive Key: FLINK-35595 URL: https://issues.apache.org/jira/browse/FLINK-35595

RE: [VOTE] Release flink-connector-kafka v3.2.0, release candidate #1

2024-06-11 Thread David Radley
Hi Martjin, Thanks for the confirmation, Kind regards, David. From: Martijn Visser Date: Tuesday, 11 June 2024 at 15:00 To: dev@flink.apache.org Subject: [EXTERNAL] Re: [VOTE] Release flink-connector-kafka v3.2.0, release candidate #1 Hi David, That's a blocker for a Flink Kafka conn

RE: [VOTE] Release flink-connector-kafka v3.2.0, release candidate #1

2024-06-11 Thread David Radley
Hi, Sorry I am a bit late. I notice https://issues.apache.org/jira/browse/FLINK-35109 is open and a blocker. Can I confirm that we have mitigated the impacts of this issue in this release? Kind regards, David. From: Danny Cranmer Date: Friday, 7 June 2024 at 11:46 To: dev

RE: Flink Kubernetes Operator 1.9.0 release planning

2024-06-11 Thread David Radley
I agree – thanks for driving this Gyula. From: Rui Fan <1996fan...@gmail.com> Date: Tuesday, 11 June 2024 at 02:52 To: dev@flink.apache.org Cc: Mate Czagany Subject: [EXTERNAL] Re: Flink Kubernetes Operator 1.9.0 release planning Thanks Gyula for driving this release! > I suggest we cut the rel

Re: [DISCUSS] Connector Externalization Retrospective

2024-06-10 Thread David Radley
pr builds to have ?live? docs showing the supported Flink levels. PyTorch does something like this for it?s docs. Kind regards, David. From: Danny Cranmer Date: Monday, 10 June 2024 at 17:26 To: dev Subject: [EXTERNAL] [DISCUSS] Connector Externalization Retrospective Hello Flink community

RE: [ANNOUNCE] New Apache Flink PMC Member - Fan Rui

2024-06-10 Thread David Radley
Congratulations, Rui! From: Sergey Nuyanzin Date: Sunday, 9 June 2024 at 20:33 To: dev@flink.apache.org Subject: [EXTERNAL] Re: [ANNOUNCE] New Apache Flink PMC Member - Fan Rui Congratulations, Rui! On Fri, Jun 7, 2024 at 5:36 AM Xia Sun wrote: > Congratulations, Rui! > > Best, > Xia > > Paul

  1   2   3   4   5   6   7   >