[DISCUSSION] Scan mode in Table Store for Flink Stream and Batch job

Hi devs: I'm an engineer from ByteDance, and here I'd link to discuss "Scan mode in Table Store for Flink Stream and Batch job". Users can execute Flink Steam and Batch jobs on Table Store. In Table Store 0.2 there're two items which determine how the Stream and Batch jobs' sources read data: Sta

[jira] [Created] (FLINK-30335) [Umbrella] Improvement for Hive Query Syntax Compatibility-Part2

luoyuxia created FLINK-30335: Summary: [Umbrella] Improvement for Hive Query Syntax Compatibility-Part2 Key: FLINK-30335 URL: https://issues.apache.org/jira/browse/FLINK-30335 Project: Flink Iss

Re: [DISCUSS] FLIP-269: Properly Handling the Processing Timers on Job Termination

Sounds like a good plan to me. On 08/12/2022 08:58, Yun Gao wrote: Hi Dawid, Very thanks for the discussion and sorry for the delayed response since I was hesitated on some points. But as a whole, with some more thought, first I agree with that adding the trigger() / cancle() methods to some k

[jira] [Created] (FLINK-30336) Sync missing Pulsar e2e tests to external repo

Martijn Visser created FLINK-30336: -- Summary: Sync missing Pulsar e2e tests to external repo Key: FLINK-30336 URL: https://issues.apache.org/jira/browse/FLINK-30336 Project: Flink Issue Type

[DISCUSS] Hybrid Source Connector

Hi guys. HybridSource is a good feature, but now released version did not support table & sql api for a long time. I notice that there is a related ticket here: https://issues.apache.org/jira/browse/FLINK-22793 but the progress is slow, i wonder can we push forward this function. I have wrote a d

[jira] [Created] (FLINK-30337) Stateful Functions application throws an exception when stopping a job gracefully creating a final savepoint

Ali Bahadir Zeybek created FLINK-30337: -- Summary: Stateful Functions application throws an exception when stopping a job gracefully creating a final savepoint Key: FLINK-30337 URL: https://issues.apache.org/j

Re: [VOTE] Release flink-connector-pulsar v3.0.0, release candidate #1

Re 2) It's bundled under META-INF/versions/15/org/bouncycastle/.. On 07/12/2022 13:54, Danny Cranmer wrote: Hey Martijn, -1 (binding) Two things I would like to raise: 1. Seems like we did not externalise the e2e tests [1]? 2. The NOTICE file contains bcpkix-jdk15on/bcprov-ext-jdk15on

Re: [VOTE] Release flink-connector-hbase v3.0.0, release candidate #1

-1 The packaging of the sql-connector-connector-hbase-2.2 module has changed significantly, no longer bundling hbase-client (it now only bundles Flink classes). On 05/12/2022 13:24, Ferenc Csaky wrote: Hi Martijn, +1 (non-binding) - Verified hashes/signatures - Maven repo content LGTM - No

Re: [DISCUSS] FLIP-269: Properly Handling the Processing Timers on Job Termination

Sounds good to me as well! Best, Piotrek czw., 8 gru 2022 o 09:53 Dawid Wysakowicz napisał(a): > Sounds like a good plan to me. > On 08/12/2022 08:58, Yun Gao wrote: > > Hi Dawid, > > Very thanks for the discussion and sorry for the delayed response > since I was hesitated on some points. > > B

Re: [VOTE] Release flink-connector-jdbc v3.0.0, release candidate #1

Looking at the release notes, this doesn't seem to be the 1.16.0 code, but also includes a few changes from the master branch. Why is that? On 30/11/2022 12:40, Martijn Visser wrote: Hi everyone, Please review and vote on the release candidate #1 for the flink-connector-jdbc version v3.0.0, as

[jira] [Created] (FLINK-30338) Clean leader election legacy code

Matthias Pohl created FLINK-30338: - Summary: Clean leader election legacy code Key: FLINK-30338 URL: https://issues.apache.org/jira/browse/FLINK-30338 Project: Flink Issue Type: Technical Deb

[jira] [Created] (FLINK-30339) Add a unified deleagation token manager

Gabor Somogyi created FLINK-30339: - Summary: Add a unified deleagation token manager Key: FLINK-30339 URL: https://issues.apache.org/jira/browse/FLINK-30339 Project: Flink Issue Type: Sub-tas

[jira] [Created] (FLINK-30340) PulsarUnorderedSourceITCase fails with IllegalStateException

Matthias Pohl created FLINK-30340: - Summary: PulsarUnorderedSourceITCase fails with IllegalStateException Key: FLINK-30340 URL: https://issues.apache.org/jira/browse/FLINK-30340 Project: Flink

[jira] [Created] (FLINK-30341) Introduce audit_log system table

Jingsong Lee created FLINK-30341: Summary: Introduce audit_log system table Key: FLINK-30341 URL: https://issues.apache.org/jira/browse/FLINK-30341 Project: Flink Issue Type: New Feature

Re: [VOTE] Release flink-connector-hbase v3.0.0, release candidate #1

Heck, thank you Chesnay for catching this. I spent some time on removing the 1.4 hbase-client from flink-connector-hbase-2.2, cause excluding it from flink-connector-hbase-base seemed not working. I missed removing that exclusion from the 2.2 sql connector pom. Opened a PR [1] with the fix. [1]

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.3.0, release candidate #1

Thank you, Matyas. +1 (binding) - Verified Helm repo works as expected, points to correct image tag, build, version - Verified basic examples + checked operator logs everything looks as expected - Verified hashes, signatures and source release contains no binaries - Ran built-in tests, built jars

[jira] [Created] (FLINK-30342) Migrate ZooKeeperLeaderElectionTest

Matthias Pohl created FLINK-30342: - Summary: Migrate ZooKeeperLeaderElectionTest Key: FLINK-30342 URL: https://issues.apache.org/jira/browse/FLINK-30342 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-30343) Migrate KubernetesLeaderElectionAndRetrievalITCase

Matthias Pohl created FLINK-30343: - Summary: Migrate KubernetesLeaderElectionAndRetrievalITCase Key: FLINK-30343 URL: https://issues.apache.org/jira/browse/FLINK-30343 Project: Flink Issue Ty

[jira] [Created] (FLINK-30344) Migrate KubernetesHighAvailabilityTestBase and implementing test classes

Matthias Pohl created FLINK-30344: - Summary: Migrate KubernetesHighAvailabilityTestBase and implementing test classes Key: FLINK-30344 URL: https://issues.apache.org/jira/browse/FLINK-30344 Project: F

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.3.0, release candidate #1

Thanks for the rc-1 Matyas , +1 (non-binding) * Helm repo install from flink-kubernetes-operator-1.3.0-helm.tgz * podman Dockerfile build from source looks good * twistlock security scans of the proposed image look good: ghcr.io/apache/flink-kubernetes-operator:95128bf * UI and

[VOTE] Apache Flink Kubernetes Operator Release 1.3.0, release candidate #1

Thank Matyas +1(non-binding) 1. Ran bundle generator with the ghcr.io/apache/flink-kubernetes-operator:b7e40da image 2. Deploy to K8s and OpenShift and create basic examples. 3. Ran bundle CI tests suits -- Best, Ted Chang | Software Engineer | htch...@us.ibm.com

Edit Wiki for Release Verification Steps

I'd like to be able to edit the wiki page: https://cwiki.apache.org/confluence/display/FLINK/Verifying+a+Flink+Kubernetes+Operator+Release It says it's unrestricted, but maybe I need to be added to the Flink space first? jbus...@us.ibm.com Thanks! Jim

Re: Edit Wiki for Release Verification Steps

Hi Jim, You should have access now (user: jbusche) Thanks On Thu, Dec 8, 2022 at 7:30 PM Jim Busche wrote: > I'd like to be able to edit the wiki page: > https://cwiki.apache.org/confluence/display/FLINK/Verifying+a+Flink+Kubernetes+Operator+Release > > It says it's unrestricted, but maybe I

Re: [DISCUSS] FLIP-277: Native GlueCatalog Support in Flink

Hi Samrat, Sorry for the late reply. Yeah I am referring to creating a similar external repo such as flink-catalog-glue. flink-connector-aws is already named with `connector` so it seems a bit weird to put a catalog there. Thanks! Dong On Wed, Dec 7, 2022 at 1:04 PM Samrat Deb wrote: > Hi Dong

Re: [DISCUSS] Cleaning up HighAvailabilityServices interface to reflect the per-JM-process LeaderElection

Hi Matthias, Thanks for the proposal! Overall I am in favor of making this interface change to make Flink's codebase more maintainable. Regarding "Interface change might affect other projects that customize HA services", are you referring to those projects which hack into Flink's source code (as

[jira] [Created] (FLINK-30345) Improve the serializer performace of state change of changelog

Hangxiang Yu created FLINK-30345: Summary: Improve the serializer performace of state change of changelog Key: FLINK-30345 URL: https://issues.apache.org/jira/browse/FLINK-30345 Project: Flink

[jira] [Created] (FLINK-30346) wrong code comment in class Trigger

ruanliang created FLINK-30346: - Summary: wrong code comment in class Trigger Key: FLINK-30346 URL: https://issues.apache.org/jira/browse/FLINK-30346 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-30347) Connecting SqlGateway via beeline gets java.lang.UnsupportedOperationException:: Unrecognized TGetInfoType value: CLI_ODBC_KEYWORDS

Yao Zhang created FLINK-30347: - Summary: Connecting SqlGateway via beeline gets java.lang.UnsupportedOperationException:: Unrecognized TGetInfoType value: CLI_ODBC_KEYWORDS Key: FLINK-30347 URL: https://issues.apache

[jira] [Created] (FLINK-30348) Refine Transformer for RandomSplitter

weibo zhao created FLINK-30348: -- Summary: Refine Transformer for RandomSplitter Key: FLINK-30348 URL: https://issues.apache.org/jira/browse/FLINK-30348 Project: Flink Issue Type: Improvement

Edit permission

Hi Can a committer please assign me edit permission to wiki. I need to edit a page https://cwiki.apache.org/confluence/display/FLINK/Verifying+a+Flink+Kubernetes+Operator+Release. Thanks. -- Best, Ted Chang | Software Engineer | htch...@us.ibm.com

Re: [VOTE] Release flink-connector-pulsar v3.0.0, release candidate #1

Thanks all for the check. I'm cancelling the RC and will work on fixing the issues On Thu, Dec 8, 2022 at 10:52 AM Chesnay Schepler wrote: > Re 2) > > It's bundled under META-INF/versions/15/org/bouncycastle/.. > > > On 07/12/2022 13:54, Danny Cranmer wrote: > > Hey Martijn, > > > > -1 (binding)

Re: [VOTE] Release flink-connector-hbase v3.0.0, release candidate #1

Thanks all for the check. This RC is cancelled and I'll create a new one when the fixes are done. On Thu, Dec 8, 2022 at 1:22 PM Ferenc Csaky wrote: > Heck, thank you Chesnay for catching this. I spent some time on removing > the 1.4 hbase-client from flink-connector-hbase-2.2, cause excluding i