[jira] [Created] (FLINK-22753) Activate log-based Checkpoints for StateFun

2021-05-21 Thread Stephan Ewen (Jira)
Stephan Ewen created FLINK-22753: Summary: Activate log-based Checkpoints for StateFun Key: FLINK-22753 URL: https://issues.apache.org/jira/browse/FLINK-22753 Project: Flink Issue Type: Sub-t

[jira] [Created] (FLINK-22752) Add robust default state configuration to StateFun

2021-05-21 Thread Stephan Ewen (Jira)
Stephan Ewen created FLINK-22752: Summary: Add robust default state configuration to StateFun Key: FLINK-22752 URL: https://issues.apache.org/jira/browse/FLINK-22752 Project: Flink Issue Type

[jira] [Created] (FLINK-22751) Reduce JVM Metaspace memory for StateFun

2021-05-21 Thread Stephan Ewen (Jira)
Stephan Ewen created FLINK-22751: Summary: Reduce JVM Metaspace memory for StateFun Key: FLINK-22751 URL: https://issues.apache.org/jira/browse/FLINK-22751 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-22750) Simplify Unit Testing of Remote Functions

2021-05-21 Thread Konstantin Knauf (Jira)
Konstantin Knauf created FLINK-22750: Summary: Simplify Unit Testing of Remote Functions Key: FLINK-22750 URL: https://issues.apache.org/jira/browse/FLINK-22750 Project: Flink Issue Type:

[ANNOUNCE] Apache Flink 1.12.4 released

2021-05-21 Thread Arvid Heise
Dear all, The Apache Flink community is very happy to announce the release of Apache Flink 1.12.4, which is the fourth bugfix release for the Apache Flink 1.12 series. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data

[jira] [Created] (FLINK-22748) Allow dynamic target topic selection in Kafka sinks

2021-05-21 Thread Timo Walther (Jira)
Timo Walther created FLINK-22748: Summary: Allow dynamic target topic selection in Kafka sinks Key: FLINK-22748 URL: https://issues.apache.org/jira/browse/FLINK-22748 Project: Flink Issue Typ

[jira] [Created] (FLINK-22749) Apply a robust default State Backend Configuration

2021-05-21 Thread Stephan Ewen (Jira)
Stephan Ewen created FLINK-22749: Summary: Apply a robust default State Backend Configuration Key: FLINK-22749 URL: https://issues.apache.org/jira/browse/FLINK-22749 Project: Flink Issue Type

Re: [Parquet support]

2021-05-21 Thread Etienne Chauchot
Thanks Arvid ! Etienne On 21/05/2021 12:45, Arvid Heise wrote: Hi Etienne, I'm taking over and just left you a review. Sorry for the long delays. Best, Arvid On Fri, May 21, 2021 at 11:25 AM Etienne Chauchot wrote: Hi all, considering (see my email below) that the DataStream API is not

[jira] [Created] (FLINK-22747) Update commons-io to 2.8

2021-05-21 Thread Timo Walther (Jira)
Timo Walther created FLINK-22747: Summary: Update commons-io to 2.8 Key: FLINK-22747 URL: https://issues.apache.org/jira/browse/FLINK-22747 Project: Flink Issue Type: Improvement Co

[jira] [Created] (FLINK-22746) Links to connectors in docs are broken

2021-05-21 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-22746: - Summary: Links to connectors in docs are broken Key: FLINK-22746 URL: https://issues.apache.org/jira/browse/FLINK-22746 Project: Flink Issue Type:

Re: [DISCUSS] Feedback Collection Jira Bot

2021-05-21 Thread Konstantin Knauf
Hi Timo, Thanks for joining the discussion. All rules except the unassigned rule do not apply to Sub-Tasks actually (like deprioritization, closing). Additionally, activity on a Sub-Taks counts as activity for the parent. So, the parent ticket would not be touched by the bot as long as there is a

Re: [DISCUSS] Releasing Flink 1.13.1

2021-05-21 Thread Dawid Wysakowicz
Hey, As for FLINK-22686, we discovered that fixing it would uncover a more severe problem so we decided to not include it for now. I tried describing the problem in the JIRA ticket. FLINK-18934 changes the contract of StreamStatus a tiny bit. Moreover it exposed the StreamStatus to somewhat publi

[jira] [Created] (FLINK-22745) MesosWorkerStore is started with an illegal namespace

2021-05-21 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-22745: - Summary: MesosWorkerStore is started with an illegal namespace Key: FLINK-22745 URL: https://issues.apache.org/jira/browse/FLINK-22745 Project: Flink Issue

Re: [Parquet support]

2021-05-21 Thread Arvid Heise
Hi Etienne, I'm taking over and just left you a review. Sorry for the long delays. Best, Arvid On Fri, May 21, 2021 at 11:25 AM Etienne Chauchot wrote: > Hi all, > > considering (see my email below) that the DataStream API is not fully > functional yet (batch mode) and considering that the ne

Re: [DISCUSS] Feedback Collection Jira Bot

2021-05-21 Thread Timo Walther
Hi Konstantin, thanks for starting this discussion. I was also about to provide some feedback because I have the feeling that the bot is too aggressive at the moment. Even a 14 days interval is a short period of time for bigger efforts that might include several subtasks. Currently, if we sp

Re: [Statefun] Truncated Messages in Python workers

2021-05-21 Thread Igal Shilman
Hi again, Something to mention in addition, it also could be the case that StateFun reaches a write timeout trying to write the accumulated batch to the remote function (when the remote functions are overloaded.) The requests are retried automatically, but still you way want to bump these timeouts

[jira] [Created] (FLINK-22744) Simplify TableEnvironment.create()

2021-05-21 Thread Timo Walther (Jira)
Timo Walther created FLINK-22744: Summary: Simplify TableEnvironment.create() Key: FLINK-22744 URL: https://issues.apache.org/jira/browse/FLINK-22744 Project: Flink Issue Type: Sub-task

Re: [Statefun] Truncated Messages in Python workers

2021-05-21 Thread Igal Shilman
Hi Jan, I haven't stumbled upon this but I will try to reconstruct that scenario with a stress test and report back. Can you share a little bit about your environment. For example do you use gunicorn, ngnix, aiohttp/or flask perhaps? I'd suggest maybe checking for request size limits parameters

Re: [Parquet support]

2021-05-21 Thread Etienne Chauchot
Hi all, considering (see my email below) that the DataStream API is not fully functional yet (batch mode) and considering that the new sources are only available on DataStream API,  can we merge this PR (1) about existing sources in DataSet API? It has received already one LGTM. [1] https://

[jira] [Created] (FLINK-22743) Adding offsets for TUMBLE* functions for more flexible window start and end time.

2021-05-21 Thread fhan (Jira)
fhan created FLINK-22743: Summary: Adding offsets for TUMBLE* functions for more flexible window start and end time. Key: FLINK-22743 URL: https://issues.apache.org/jira/browse/FLINK-22743 Project: Flink

[jira] [Created] (FLINK-22742) Lookup join condition with process time throws org.codehaus.commons.compiler.CompileException

2021-05-21 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-22742: --- Summary: Lookup join condition with process time throws org.codehaus.commons.compiler.CompileException Key: FLINK-22742 URL: https://issues.apache.org/jira/browse/FLINK-22742

[jira] [Created] (FLINK-22741) Hide Flink complexity from Stateful Functions

2021-05-21 Thread Stephan Ewen (Jira)
Stephan Ewen created FLINK-22741: Summary: Hide Flink complexity from Stateful Functions Key: FLINK-22741 URL: https://issues.apache.org/jira/browse/FLINK-22741 Project: Flink Issue Type: New

[jira] [Created] (FLINK-22740) Drop legacy planner from docs

2021-05-21 Thread Timo Walther (Jira)
Timo Walther created FLINK-22740: Summary: Drop legacy planner from docs Key: FLINK-22740 URL: https://issues.apache.org/jira/browse/FLINK-22740 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-22739) CassandraSinkBaseTest.testTimeoutExceptionOnInvoke fail due to TestTimedOutException

2021-05-21 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-22739: - Summary: CassandraSinkBaseTest.testTimeoutExceptionOnInvoke fail due to TestTimedOutException Key: FLINK-22739 URL: https://issues.apache.org/jira/browse/FLINK-22739 Projec

[jira] [Created] (FLINK-22738) org.apache.flink.connector.jdbc.xa.JdbcExactlyOnceSinkE2eTest no output for 900 seconds due to block on downloading docker image

2021-05-21 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-22738: - Summary: org.apache.flink.connector.jdbc.xa.JdbcExactlyOnceSinkE2eTest no output for 900 seconds due to block on downloading docker image Key: FLINK-22738 URL: https://issues.apache.

[jira] [Created] (FLINK-22737) Add support for CURRENT_WATERMARK to SQL

2021-05-21 Thread David Anderson (Jira)
David Anderson created FLINK-22737: -- Summary: Add support for CURRENT_WATERMARK to SQL Key: FLINK-22737 URL: https://issues.apache.org/jira/browse/FLINK-22737 Project: Flink Issue Type: Sub-

upsert kafka sink why not send all data that contain update_before,delete

2021-05-21 Thread Jocean shi
Hi I have a question, upsert kafka sink why not send all data that contain update_before,delete. if send all data, the source dot't need add state to recover data, and the state may be very lage. Best ocean.shi

Re: [DISCUSS] Releasing Flink 1.13.1

2021-05-21 Thread Konstantin Knauf
Hi everyone, Thank you for all the updates. Let me summarize: Done or close to done: * https://issues.apache.org/jira/browse/FLINK-22666: Done * https://issues.apache.org/jira/browse/FLINK-22494: Done * https://issues.apache.org/jira/browse/FLINK-22688: Approved. Needs Merge. * https://issues.ap

Re: [DISCUSS] Feedback Collection Jira Bot

2021-05-21 Thread Konstantin Knauf
Hi Robert, Could you elaborate on your comment on test instabilities? Would test instabilities always get a fixVersion then? Background: Test instabilities are supposed to be Critical. Critical tickets are deprioritized if they are unassigned and have not received an update for 14 days. Cheers,

[jira] [Created] (FLINK-22736) Flink-SQL-Client HiveModuleFactory has been compiled by a more recent version of the Java Runtime (class file version 55.0), this version of the Java Runtime only recogn

2021-05-21 Thread Jira
张建 created FLINK-22736: -- Summary: Flink-SQL-Client HiveModuleFactory has been compiled by a more recent version of the Java Runtime (class file version 55.0), this version of the Java Runtime only recognizes class file versions up to 52.0 K

Re: Issue with using siddhi extension function with flink

2021-05-21 Thread Till Rohrmann
Hi Dipanjan, Please double check whether the libraries are really contained in the job jar you are submitting because if the library is contained in this jar, then it should be on the classpath and you should be able to load it. Cheers, Till On Thu, May 20, 2021 at 3:43 PM Dipanjan Mazumder wro