[jira] [Created] (FLINK-26534) shuffle by sink's primary key should cover the case that input changelog stream has a different parallelism

lincoln lee created FLINK-26534: --- Summary: shuffle by sink's primary key should cover the case that input changelog stream has a different parallelism Key: FLINK-26534 URL: https://issues.apache.org/jira/browse/FLIN

[jira] [Created] (FLINK-26533) KafkaSinkITCase.testRecoveryWithExactlyOnceGuarantee failed on azure due to delete topic timeout

Yun Gao created FLINK-26533: --- Summary: KafkaSinkITCase.testRecoveryWithExactlyOnceGuarantee failed on azure due to delete topic timeout Key: FLINK-26533 URL: https://issues.apache.org/jira/browse/FLINK-26533

[jira] [Created] (FLINK-26532) SinkMetricsITCase.testMetrics failed on azure

Yun Gao created FLINK-26532: --- Summary: SinkMetricsITCase.testMetrics failed on azure Key: FLINK-26532 URL: https://issues.apache.org/jira/browse/FLINK-26532 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-26531) KafkaWriterITCase.testMetadataPublisher failed on azure

Yun Gao created FLINK-26531: --- Summary: KafkaWriterITCase.testMetadataPublisher failed on azure Key: FLINK-26531 URL: https://issues.apache.org/jira/browse/FLINK-26531 Project: Flink Issue Type: Bu

[jira] [Created] (FLINK-26530) Refactor the FileStoreITCase and StoreSink

Jingsong Lee created FLINK-26530: Summary: Refactor the FileStoreITCase and StoreSink Key: FLINK-26530 URL: https://issues.apache.org/jira/browse/FLINK-26530 Project: Flink Issue Type: Sub-ta

Re: [ANNOUNCE] New Apache Flink Committer - David Morávek

Congratulations David! Best, Lincoln Lee Yun Gao 于2022年3月8日周二 11:24写道： > Congratulations David! > > Best, > Yun Gao > > > -- > From:Jing Zhang > Send Time:2022 Mar. 8 (Tue.) 11:10 > To:dev > Subject:Re: [ANNOUNCE] New Apache Fli

[jira] [Created] (FLINK-26529) PyFlink 'tuple' object has no attribute '_values'

James Schulte created FLINK-26529: - Summary: PyFlink 'tuple' object has no attribute '_values' Key: FLINK-26529 URL: https://issues.apache.org/jira/browse/FLINK-26529 Project: Flink Issue Typ

[jira] [Created] (FLINK-26528) Trigger the updateControl when the FlinkDeployment have changed

Aitozi created FLINK-26528: -- Summary: Trigger the updateControl when the FlinkDeployment have changed Key: FLINK-26528 URL: https://issues.apache.org/jira/browse/FLINK-26528 Project: Flink Issue Ty

Re:Re: [DISCUSS] Flink's supported APIs and Hive query syntax

Hi Martijn, Thanks for driving this discussion. +1 on efforts on more hive/spark syntax compatibility.The hive/spark syntax is the most popular in batch computing.Within our company, many users have the desire to use Flink to realize the integration of streaming and batching,and some users hav

Re:Re: [DISCUSS] The abstraction of cache lookupFunction and cache metric

Hi Qingsheng, > If I understand correctly these are specified in DDL table options by users. It's inconvenient for user to checkout the options when they in front of a running task. And they don't know the real underlying options in effect if there are some bugs or other incorrect configur

Re: [ANNOUNCE] New Apache Flink Committer - David Morávek

Congratulations David! Best, Yun Gao -- From:Jing Zhang Send Time:2022 Mar. 8 (Tue.) 11:10 To:dev Subject:Re: [ANNOUNCE] New Apache Flink Committer - David Morávek Congratulations David! Ryan Skraba 于2022年3月7日周一 22:18写道： > Con

[jira] [Created] (FLINK-26527) ClassCastException in TemporaryClassLoaderContext

shizhengchao created FLINK-26527: Summary: ClassCastException in TemporaryClassLoaderContext Key: FLINK-26527 URL: https://issues.apache.org/jira/browse/FLINK-26527 Project: Flink Issue Type:

[jira] [Created] (FLINK-26526) Record hasNull and allNull instead of nullCount in fieldStats

Caizhi Weng created FLINK-26526: --- Summary: Record hasNull and allNull instead of nullCount in fieldStats Key: FLINK-26526 URL: https://issues.apache.org/jira/browse/FLINK-26526 Project: Flink

Re: [ANNOUNCE] New Apache Flink Committer - David Morávek

Congratulations David! Ryan Skraba 于2022年3月7日周一 22:18写道： > Congratulations David! > > On Mon, Mar 7, 2022 at 9:54 AM Jan Lukavský wrote: > > > Congratulations David! > > > > Jan > > > > On 3/7/22 09:44, Etienne Chauchot wrote: > > > Congrats David ! > > > > > > Well deserved ! > > > > > > Eti

Re: [DISCUSS] The abstraction of cache lookupFunction and cache metric

Hi Yuan, > how can we tell the real “identifier” and “type” options in effect to users? If I understand correctly these are specified in DDL table options by users. For example: CREATE TABLE DimTable (…) WITH ( ... “cache.identifier” = “guava”, “cache.type” = “LRU” ); > Does Me

Re:Re: [DISCUSS] The abstraction of cache lookupFunction and cache metric

Hi Qingsheng Ren, Thanks for your feedback. > 1. It looks like “identifier” and “type” are options of cache instead of > metrics. I think they are finalized once the cache is created so maybe it’s > not quite helpful to report them to the metric system. Maybe it's not quite appropriate to rep

Re: Flink 1.15 Stabilisation Sync skipped tomorrow

I just ran through the testing steps on [FLINK-26462] Release Testing: Running Python UDF in different Execution Mode - ASF JIRA (apache.org) . Everything worked but I think there might be a typo in the steps to set up the tests, I left a comment

[jira] [Created] (FLINK-26525) new ArchUnit rules for SourceTestSuiteBase and SinkTestSuiteBase

Jing Ge created FLINK-26525: --- Summary: new ArchUnit rules for SourceTestSuiteBase and SinkTestSuiteBase Key: FLINK-26525 URL: https://issues.apache.org/jira/browse/FLINK-26525 Project: Flink Issue

Re: Flink 1.15 Stabilisation Sync skipped tomorrow

Since I know this area I help to test FLINK-26468 . G On Mon, Mar 7, 2022 at 5:15 PM Johannes Moser wrote: > Hello, > > We will skip tomorrows weekly stabilisation sync. > It looks like all blockers are assigned and worked on. A significant > n

[DISCUSS] [statefun] resolve placeholders in module.yaml

Hi, as far as I can tell, the way to provide a keystore/truststore password to the kafka ingress/egress config is to put it in plaintext in module.yaml, like so: kind: io.statefun.kafka.v1/ingressspec: #(...) properties:- ssl.truststore.password: changeme This isn't ideal and I think it wou

[jira] [Created] (FLINK-26524) Elasticsearch (v5.3.3) sink end-to-end test

Matthias Pohl created FLINK-26524: - Summary: Elasticsearch (v5.3.3) sink end-to-end test Key: FLINK-26524 URL: https://issues.apache.org/jira/browse/FLINK-26524 Project: Flink Issue Type: Bug

Flink 1.15 Stabilisation Sync skipped tomorrow

Hello, We will skip tomorrows weekly stabilisation sync. It looks like all blockers are assigned and worked on. A significant number of contributors are on holiday tomorrow. Currently we plan to cut off the 1.15 branch on Wednesday of Thursday this week. In case you want to contribute something

[jira] [Created] (FLINK-26523) Flink : E2E Tests : Kinesis SQL tests

Matthias Pohl created FLINK-26523: - Summary: Flink : E2E Tests : Kinesis SQL tests Key: FLINK-26523 URL: https://issues.apache.org/jira/browse/FLINK-26523 Project: Flink Issue Type: Bug

Re: [DISUCSS] When timestamp - offset + windowSize < 0, elements cannot be assigned to the correct window

Thanks for your reply, I have submitted the PR. https://github.com/apache/flink/pull/18982 Looking forward to more discussions. best wishes Martijn Visser 于2022年3月4日周五 17:09写道： > Hi Deng Ziqi & Lin Wanni & Guo Yuanfang, > > First of all, I wanted to let you know that I think the ticket that you'

[jira] [Created] (FLINK-26522) Refactoring code for multiple component leader election

Niklas Semmler created FLINK-26522: -- Summary: Refactoring code for multiple component leader election Key: FLINK-26522 URL: https://issues.apache.org/jira/browse/FLINK-26522 Project: Flink I

[jira] [Created] (FLINK-26521) Reconsider setting generationAwareEventProcessing = true

Gyula Fora created FLINK-26521: -- Summary: Reconsider setting generationAwareEventProcessing = true Key: FLINK-26521 URL: https://issues.apache.org/jira/browse/FLINK-26521 Project: Flink Issue Ty

Re: [ANNOUNCE] New Apache Flink Committer - David Morávek

Congratulations David! On Mon, Mar 7, 2022 at 9:54 AM Jan Lukavský wrote: > Congratulations David! > > Jan > > On 3/7/22 09:44, Etienne Chauchot wrote: > > Congrats David ! > > > > Well deserved ! > > > > Etienne > > > > Le 07/03/2022 à 08:47, David Morávek a écrit : > >> Thanks everyone! > >>

Re: [DISCUSS] Flink's supported APIs and Hive query syntax

Hi, Thanks Martijn for driving this discussion. Your concerns are very rational. We should do our best to keep the Flink development on the right track. I would suggest discussing it in a vision/goal oriented way. Since Flink has a clear vision of unified batch and stream processing, supporting b

[jira] [Created] (FLINK-26520) Implement SEARCH operator

Francesco Guardiani created FLINK-26520: --- Summary: Implement SEARCH operator Key: FLINK-26520 URL: https://issues.apache.org/jira/browse/FLINK-26520 Project: Flink Issue Type: Technical

[jira] [Created] (FLINK-26519) Remove FlinkTypeFactory.INSTANCE singleton

Francesco Guardiani created FLINK-26519: --- Summary: Remove FlinkTypeFactory.INSTANCE singleton Key: FLINK-26519 URL: https://issues.apache.org/jira/browse/FLINK-26519 Project: Flink Issu

Re: [DISCUSS] Flink's supported APIs and Hive query syntax

Hi Martijn, Thanks for driving this discussion. +1 on efforts on more hive syntax compatibility. With the efforts on batch processing in recent versions(1.10~1.15), many users have run batch processing jobs based on Flink. In our team, we are trying to migrate most of the existing online batch j

Re: [DISCUSS] Flink's supported APIs and Hive query syntax

Hi, thanks Martijn for bringing this up and raising very valid concerns. I agree with the notion that Flink supporting Hive should come with a proper commitment, and otherwise we should consider not supporting it at all (in Flink itself, that is). Given that Hive is an Apache project, my fir

[jira] [Created] (FLINK-26518) Support the new type inference in Scala Table API table functions

Timo Walther created FLINK-26518: Summary: Support the new type inference in Scala Table API table functions Key: FLINK-26518 URL: https://issues.apache.org/jira/browse/FLINK-26518 Project: Flink

Re: [DISCUSS] Enable scala formatting check

Big +1 This will improve the contribution experience. Even though we stopped adding more Scala code, it is still necessary from time to time. Regards, Timo Am 02.03.22 um 09:29 schrieb 刘首维: +1 I still remember my first pr. Lack of experience, I had to pay attention to Scala code format an

[DISCUSS] Flink's supported APIs and Hive query syntax

Hi everyone, Flink currently has 4 APIs with multiple language support which can be used to develop applications: * DataStream API, both Java and Scala * Table API, both Java and Scala * Flink SQL, both in Flink query syntax and Hive query syntax (partially) * Python API Since FLIP-152 [1] the F

Re: [DISCUSS] The abstraction of cache lookupFunction and cache metric

Hi Yuan, Thanks for raising this discussion! I believe this will be very helpful for lookup table developers, and standardizing metrics would be essential for users to tuning their systems. Here’s some thoughts in my mind: 1. It looks like “identifier” and “type” are options of cache instea

[jira] [Created] (FLINK-26517) Normalize the decided parallelism to power of 2 when using adaptive batch scheduler

Lijie Wang created FLINK-26517: -- Summary: Normalize the decided parallelism to power of 2 when using adaptive batch scheduler Key: FLINK-26517 URL: https://issues.apache.org/jira/browse/FLINK-26517 Proje

[jira] [Created] (FLINK-26516) Sink V2 is not state compatible with Sink V1

Fabian Paul created FLINK-26516: --- Summary: Sink V2 is not state compatible with Sink V1 Key: FLINK-26516 URL: https://issues.apache.org/jira/browse/FLINK-26516 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-26515) RetryingExecutorTest.testTimeout failed on azure

Yun Gao created FLINK-26515: --- Summary: RetryingExecutorTest.testTimeout failed on azure Key: FLINK-26515 URL: https://issues.apache.org/jira/browse/FLINK-26515 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-26514) YARNSessionFIFOITCase.testDetachedMode failed on azure

Yun Gao created FLINK-26514: --- Summary: YARNSessionFIFOITCase.testDetachedMode failed on azure Key: FLINK-26514 URL: https://issues.apache.org/jira/browse/FLINK-26514 Project: Flink Issue Type: Bug

Re: [ANNOUNCE] New Apache Flink Committer - David Morávek

Congratulations David!  Jan On 3/7/22 09:44, Etienne Chauchot wrote: Congrats David ! Well deserved ! Etienne Le 07/03/2022 à 08:47, David Morávek a écrit : Thanks everyone! Best, D. On Sun 6. 3. 2022 at 9:07, Yuan Mei wrote: Congratulations, David! Best Regards, Yuan On Sat, Mar 5,

Re: [ANNOUNCE] New Apache Flink Committer - David Morávek

Congrats David ! Well deserved ! Etienne Le 07/03/2022 à 08:47, David Morávek a écrit : Thanks everyone! Best, D. On Sun 6. 3. 2022 at 9:07, Yuan Mei wrote: Congratulations, David! Best Regards, Yuan On Sat, Mar 5, 2022 at 8:13 PM Roman Khachatryan wrote: Congratulations, David! Reg

[jira] [Created] (FLINK-26513) Document operator helm chart

Gyula Fora created FLINK-26513: -- Summary: Document operator helm chart Key: FLINK-26513 URL: https://issues.apache.org/jira/browse/FLINK-26513 Project: Flink Issue Type: Sub-task Compo

[jira] [Created] (FLINK-26512) Document debugging and manual error handling

Gyula Fora created FLINK-26512: -- Summary: Document debugging and manual error handling Key: FLINK-26512 URL: https://issues.apache.org/jira/browse/FLINK-26512 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-26511) Document FlinkDeployment lifecycle

Gyula Fora created FLINK-26511: -- Summary: Document FlinkDeployment lifecycle Key: FLINK-26511 URL: https://issues.apache.org/jira/browse/FLINK-26511 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-26510) Document FlinkDeployment CRD

Gyula Fora created FLINK-26510: -- Summary: Document FlinkDeployment CRD Key: FLINK-26510 URL: https://issues.apache.org/jira/browse/FLINK-26510 Project: Flink Issue Type: Sub-task Compo

[jira] [Created] (FLINK-26509) Improve Kubernetes Operator documentation

Gyula Fora created FLINK-26509: -- Summary: Improve Kubernetes Operator documentation Key: FLINK-26509 URL: https://issues.apache.org/jira/browse/FLINK-26509 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-26508) Webhook should only validate on /validate endpoint end log errors for others

Gyula Fora created FLINK-26508: -- Summary: Webhook should only validate on /validate endpoint end log errors for others Key: FLINK-26508 URL: https://issues.apache.org/jira/browse/FLINK-26508 Project: Fli

[jira] [Created] (FLINK-26507) Last state upgrade mode should allow reconciliation regardless of job and deployment status

Gyula Fora created FLINK-26507: -- Summary: Last state upgrade mode should allow reconciliation regardless of job and deployment status Key: FLINK-26507 URL: https://issues.apache.org/jira/browse/FLINK-26507

[DISCUSS] The abstraction of cache lookupFunction and cache metric

Hi devs, I would like to propose a discussion thread about abstraction of Cache LookupFunction with metrics for cache in connectors to make cache out of box for connector developers. There are multiple LookupFunction implementations in individual connectors [1][2][3][4] so far. At the same ti