Re: [VOTE] FLIP-187: Adaptive Batch Job Scheduler

Thanks for the FLIP, this is going to be a great improvement to the batch execution. +1 (non-binding) Best, D. On Tue, Nov 9, 2021 at 1:05 AM Guowei Ma wrote: > Thanks for your excellent FLIP! > +1 binding > > Lijie Wang 于2021年11月8日 周一下午2:53写道： > > > Hi all, > > > > I would like to start the v

[jira] [Created] (FLINK-24838) Add BaseAlgoImpl class to support link() and linkFrom()

Zhipeng Zhang created FLINK-24838: - Summary: Add BaseAlgoImpl class to support link() and linkFrom() Key: FLINK-24838 URL: https://issues.apache.org/jira/browse/FLINK-24838 Project: Flink Iss

[jira] [Created] (FLINK-24837) submit flink job failed via restapi

Spongebob created FLINK-24837: - Summary: submit flink job failed via restapi Key: FLINK-24837 URL: https://issues.apache.org/jira/browse/FLINK-24837 Project: Flink Issue Type: Bug Compo

[jira] [Created] (FLINK-24836) Over window in month time calculated an incorrect aggregation result.

Carl created FLINK-24836: Summary: Over window in month time calculated an incorrect aggregation result. Key: FLINK-24836 URL: https://issues.apache.org/jira/browse/FLINK-24836 Project: Flink Issue

Re: [DISCUSS] FLIP-191: Extend unified Sink interface to support small file compaction

Hi Fabian, Thanks for drafting the FLIP and trying to support small file compaction. I think this feature is very urgent and valuable for users(at least for me). Currently I am trying to support streaming rewrite(compact) for Iceberg on PR#3323 . As St

Re: [VOTE] FLIP-189: SQL Client Usability Improvements

+1 (non-binding) Best, JING ZHANG Leonard Xu 于2021年11月9日周二 上午10:56写道： > +1 (non-binding) > > Thanks for the Improvements. > > Best, > Leonard > > 在 2021年11月9日，10:08，Yuepeng Pan 写道： > > > > +1 (non-binding)Best, > > Roc > > > > At 2021-11-09 09:13:58, "Jark Wu" wrote: > >> +1 (binding) > >> >

[jira] [Created] (FLINK-24835) "group by" in the interval join will throw a exception

xuyang created FLINK-24835: -- Summary: "group by" in the interval join will throw a exception Key: FLINK-24835 URL: https://issues.apache.org/jira/browse/FLINK-24835 Project: Flink Issue Type: Bug

Re: [VOTE] FLIP-189: SQL Client Usability Improvements

+1 (non-binding) Thanks for the Improvements. Best, Leonard > 在 2021年11月9日，10:08，Yuepeng Pan 写道： > > +1 (non-binding)Best, > Roc > > At 2021-11-09 09:13:58, "Jark Wu" wrote: >> +1 (binding) >> >> Best, >> Jark >> >> On Mon, 8 Nov 2021 at 23:57, Till Rohrmann wrote: >> >>> +1 (binding) >>>

Re: [DISCUSS] FLIP-191: Extend unified Sink interface to support small file compaction

Hi all, Very thanks for all the warm discussion! I have no new opinions and only want to clarify some points: @Fabian > from a theoretical point you are right about exposing the DataStream > API in the sink users have the full power to write correct batch and streaming > sinks. I think in real

Re:Re: [VOTE] FLIP-189: SQL Client Usability Improvements

+1 (non-binding)Best, Roc At 2021-11-09 09:13:58, "Jark Wu" wrote: >+1 (binding) > >Best, >Jark > >On Mon, 8 Nov 2021 at 23:57, Till Rohrmann wrote: > >> +1 (binding) >> >> Cheers, >> Till >> >> On Fri, Nov 5, 2021 at 9:24 PM Ingo Bürk wrote: >> >> > +1 (non-binding) >> > >> > I think it has al

Re: [VOTE] FLIP-189: SQL Client Usability Improvements

+1 (binding) Best, Jark On Mon, 8 Nov 2021 at 23:57, Till Rohrmann wrote: > +1 (binding) > > Cheers, > Till > > On Fri, Nov 5, 2021 at 9:24 PM Ingo Bürk wrote: > > > +1 (non-binding) > > > > I think it has all been said before. :-) > > > > On Fri, Nov 5, 2021, 17:45 Konstantin Knauf wrote: >

Re: [VOTE] FLIP-187: Adaptive Batch Job Scheduler

Thanks for your excellent FLIP! +1 binding Lijie Wang 于2021年11月8日 周一下午2:53写道： > Hi all, > > I would like to start the vote for FLIP-187[1], which proposes to introduce > a new scheduler to Flink: adaptive batch job scheduler. The new scheduler > can automatically decide parallelisms of job vertic

Re: [DISCUSS] FLIP-191: Extend unified Sink interface to support small file compaction

> although I think only using a customizable shuffle won't address the generation of small files. One assumption is that at least the sink generates one file per subtask, which can already be too many. Another problem is that with low checkpointing intervals, the files do not meet the required siz

[jira] [Created] (FLINK-24834) Add typed builders to DefaultRollingPolicy

Seth Wiesman created FLINK-24834: Summary: Add typed builders to DefaultRollingPolicy Key: FLINK-24834 URL: https://issues.apache.org/jira/browse/FLINK-24834 Project: Flink Issue Type: Improv

[jira] [Created] (FLINK-24833) Prevent use of deprecated APIs in flink-examples

Seth Wiesman created FLINK-24833: Summary: Prevent use of deprecated APIs in flink-examples Key: FLINK-24833 URL: https://issues.apache.org/jira/browse/FLINK-24833 Project: Flink Issue Type:

Re: [NOTICE] Please keep flink-examples up to date

@David Morávek great idea! I've opened a subtask to add that check after we fix the existing deprecations. Seth On Mon, Nov 8, 2021 at 12:55 PM David Morávek wrote: > Hi Seth, thanks for bringing this up. What do you think about placing a > safeguard for this? We should be able to setup java c

Re: [NOTICE] Please keep flink-examples up to date

Hi Seth, thanks for bringing this up. What do you think about placing a safeguard for this? We should be able to setup java compiler for examples to fail on any usage of deprecated APIs. Something along the lines of: maven-compiler-plugin ... compile process-sources

RE: Re: [DISCUSS] FLIP-191: Extend unified Sink interface to support small file compaction

Hi Fabian, Thanks for drafting the FLIP and trying to support small file compaction. I think this feature is very urgent and valuable for users(at least for me). Currently I am trying to support streaming rewrite(compact) for Iceberg on PR#3323 . As St

Re: [NOTICE] Please keep flink-examples up to date

Thanks for raising awareness for keeping our examples up to date. I think this is a very good practice and it also helps our users better understand how to use Flink. Cheers, Till On Mon, Nov 8, 2021 at 4:57 PM Fabian Paul wrote: > Hi Seth, > > Thanks for brining up this topic. > > Huge appreci

Re: [NOTICE] Please keep flink-examples up to date

Hi Seth, Thanks for brining up this topic. Huge appreciations that you take this over initially and we should definitely take care as a community to what we show beginner users. We can also take the examples as show cases about things we have developed and are proud of. Best, Fabian

Re: [VOTE] FLIP-189: SQL Client Usability Improvements

+1 (binding) Cheers, Till On Fri, Nov 5, 2021 at 9:24 PM Ingo Bürk wrote: > +1 (non-binding) > > I think it has all been said before. :-) > > On Fri, Nov 5, 2021, 17:45 Konstantin Knauf wrote: > > > +1 (binding) > > > > On Fri, Nov 5, 2021 at 4:03 PM Martijn Visser > > wrote: > > > > > +1 (no

Re: [NOTICE] Please keep flink-examples up to date

Also, please consider adding new examples if you are developing a new API! It's a great addition to the documentation, and can help you workshop your change from a usability perspective. Seth On Mon, Nov 8, 2021 at 9:34 AM Seth Wiesman wrote: > Hi Everyone, > > I noticed recently that many of t

[jira] [Created] (FLINK-24832) Update JUnit5 to v5.8.1

Martijn Visser created FLINK-24832: -- Summary: Update JUnit5 to v5.8.1 Key: FLINK-24832 URL: https://issues.apache.org/jira/browse/FLINK-24832 Project: Flink Issue Type: Technical Debt

[jira] [Created] (FLINK-24831) Upgrade DataStream Window examples

Seth Wiesman created FLINK-24831: Summary: Upgrade DataStream Window examples Key: FLINK-24831 URL: https://issues.apache.org/jira/browse/FLINK-24831 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-24830) Update DataStream WordCount example

Seth Wiesman created FLINK-24830: Summary: Update DataStream WordCount example Key: FLINK-24830 URL: https://issues.apache.org/jira/browse/FLINK-24830 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-24829) Rename example directories based on API

Seth Wiesman created FLINK-24829: Summary: Rename example directories based on API Key: FLINK-24829 URL: https://issues.apache.org/jira/browse/FLINK-24829 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-24828) Bump Powermock to v2.0.9

Martijn Visser created FLINK-24828: -- Summary: Bump Powermock to v2.0.9 Key: FLINK-24828 URL: https://issues.apache.org/jira/browse/FLINK-24828 Project: Flink Issue Type: Technical Debt

[NOTICE] Please keep flink-examples up to date

Hi Everyone, I noticed recently that many of the example applications in `flink-examples/` rely on deprecated apis. I am going to work on upgrading the examples for the current state of master. Going forward, if you deprecate a public API please try and double check if that API is being used in an

[jira] [Created] (FLINK-24827) Bump maven-dependency-plugin to v3.2.0

Martijn Visser created FLINK-24827: -- Summary: Bump maven-dependency-plugin to v3.2.0 Key: FLINK-24827 URL: https://issues.apache.org/jira/browse/FLINK-24827 Project: Flink Issue Type: Techni

[jira] [Created] (FLINK-24826) Performance regression in HeapState benchmarks on Nov 8 2021

Roman Khachatryan created FLINK-24826: - Summary: Performance regression in HeapState benchmarks on Nov 8 2021 Key: FLINK-24826 URL: https://issues.apache.org/jira/browse/FLINK-24826 Project: Flink

[jira] [Created] (FLINK-24825) Update nifi-site-to-site-client to v1.14.0

Martijn Visser created FLINK-24825: -- Summary: Update nifi-site-to-site-client to v1.14.0 Key: FLINK-24825 URL: https://issues.apache.org/jira/browse/FLINK-24825 Project: Flink Issue Type: Te

[jira] [Created] (FLINK-24824) AdaptiveScheduler#getJobStatus never returns CREATED

Chesnay Schepler created FLINK-24824: Summary: AdaptiveScheduler#getJobStatus never returns CREATED Key: FLINK-24824 URL: https://issues.apache.org/jira/browse/FLINK-24824 Project: Flink

Re: Elasticsearch6 connector in flink stand alone

Hi Ravi, I'm moving this thread to the user@flink mailing list, which is designed for these type of questions. For your issue, I don't think it's related to the elasticsearch integration. It seems like there is something wrong with your log4j setup. Either you have a conflicting log4j jars on the

Re: [DISCUSS] FLIP-191: Extend unified Sink interface to support small file compaction

Hi all, Thanks for the lively discussions. I am really excited to see so many people participating in this thread. It also underlines the need that many people would like to see a solution soon. I have updated the FLIP and removed the parallelism configuration because it is unnecessary since user

[jira] [Created] (FLINK-24823) Yarn-session report metrics error

douyongpeng created FLINK-24823: --- Summary: Yarn-session report metrics error Key: FLINK-24823 URL: https://issues.apache.org/jira/browse/FLINK-24823 Project: Flink Issue Type: Bug Com

[jira] [Created] (FLINK-24822) Improve CatalogTableSpecBase and its subclass method parameter

dalongliu created FLINK-24822: - Summary: Improve CatalogTableSpecBase and its subclass method parameter Key: FLINK-24822 URL: https://issues.apache.org/jira/browse/FLINK-24822 Project: Flink Is

Elasticsearch6 connector in flink stand alone

Hi Team, I am migrating from flink 1.13 session cluster to stand alone. While converting whenever I added elasticsearch6 connector I am getting a error. Error: Exception in thread "main" java.lang.ExceptionInInitializerError at org.apache.logging.log4j.core.impl.MutableLogEvent.(Mutabl

[jira] [Created] (FLINK-24821) FlinkKafkaProducerMigrationOperatorTest.testRestoreProducer fails on AZP

Till Rohrmann created FLINK-24821: - Summary: FlinkKafkaProducerMigrationOperatorTest.testRestoreProducer fails on AZP Key: FLINK-24821 URL: https://issues.apache.org/jira/browse/FLINK-24821 Project: F

[jira] [Created] (FLINK-24820) Examples in documentation for value1 IS DISTINCT FROM value2 are wrong

Sergey Nuyanzin created FLINK-24820: --- Summary: Examples in documentation for value1 IS DISTINCT FROM value2 are wrong Key: FLINK-24820 URL: https://issues.apache.org/jira/browse/FLINK-24820 Project:

[jira] [Created] (FLINK-24819) Higher cpu load after using SharedIndexInformer replaced naked Kubernetes watch

Yang Wang created FLINK-24819: - Summary: Higher cpu load after using SharedIndexInformer replaced naked Kubernetes watch Key: FLINK-24819 URL: https://issues.apache.org/jira/browse/FLINK-24819 Project: Fl

[jira] [Created] (FLINK-24818) Incorrect comment of ttlConfig field in StateDescriptor

jianzhang.yjz created FLINK-24818: - Summary: Incorrect comment of ttlConfig field in StateDescriptor Key: FLINK-24818 URL: https://issues.apache.org/jira/browse/FLINK-24818 Project: Flink Iss

Re: [DISCUSS] FLIP-187: Adaptive Batch Job Scheduler

Hi all, So far, I think we have reached an agreement on this FLIP. I have started the voting thread [1]. Please cast your vote there or ask additional questions here. [1] https://lists.apache.org/thread/58yyxvnygw7oy5t556g8rm9y2xzb1l66 Best, Lijie Lijie Wang 于2021年11月5日周五 下午4:04写道： > Hi all,

[jira] [Created] (FLINK-24817) Support Naive Bayes algorithm in Flink ML

Yunfeng Zhou created FLINK-24817: Summary: Support Naive Bayes algorithm in Flink ML Key: FLINK-24817 URL: https://issues.apache.org/jira/browse/FLINK-24817 Project: Flink Issue Type: New Fea

[jira] [Created] (FLINK-24816) Bump com.rabbitmq:amqp-client to v5.13.1

Martijn Visser created FLINK-24816: -- Summary: Bump com.rabbitmq:amqp-client to v5.13.1 Key: FLINK-24816 URL: https://issues.apache.org/jira/browse/FLINK-24816 Project: Flink Issue Type: Tech