[jira] [Created] (FLINK-21989) Add a SupportsSourceWatermark ability interface

2021-03-25 Thread Timo Walther (Jira)
Timo Walther created FLINK-21989: Summary: Add a SupportsSourceWatermark ability interface Key: FLINK-21989 URL: https://issues.apache.org/jira/browse/FLINK-21989 Project: Flink Issue Type: S

[jira] [Created] (FLINK-21988) testRequestKvStateWithIrrelevantRegistration fail

2021-03-25 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-21988: - Summary: testRequestKvStateWithIrrelevantRegistration fail Key: FLINK-21988 URL: https://issues.apache.org/jira/browse/FLINK-21988 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-21987) testRequestKvStateOfWrongJob failed

2021-03-25 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-21987: - Summary: testRequestKvStateOfWrongJob failed Key: FLINK-21987 URL: https://issues.apache.org/jira/browse/FLINK-21987 Project: Flink Issue Type: Bug Compo

[jira] [Created] (FLINK-21986) taskmanager native memory not release timely after restart

2021-03-25 Thread Feifan Wang (Jira)
Feifan Wang created FLINK-21986: --- Summary: taskmanager native memory not release timely after restart Key: FLINK-21986 URL: https://issues.apache.org/jira/browse/FLINK-21986 Project: Flink Issu

[jira] [Created] (FLINK-21985) Support Explain Query/Modifcation syntax in Calcite Parser

2021-03-25 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-21985: - Summary: Support Explain Query/Modifcation syntax in Calcite Parser Key: FLINK-21985 URL: https://issues.apache.org/jira/browse/FLINK-21985 Project: Flink

[jira] [Created] (FLINK-21984) Change precision argument from optional to required in TO_TIMESTAMP_LTZ(numeric, precision)

2021-03-25 Thread Leonard Xu (Jira)
Leonard Xu created FLINK-21984: -- Summary: Change precision argument from optional to required in TO_TIMESTAMP_LTZ(numeric, precision) Key: FLINK-21984 URL: https://issues.apache.org/jira/browse/FLINK-21984

[jira] [Created] (FLINK-21983) Test failed because "mvn-${sys/mvn.forkNumber}" is not updated on time.

2021-03-25 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-21983: - Summary: Test failed because "mvn-${sys/mvn.forkNumber}" is not updated on time. Key: FLINK-21983 URL: https://issues.apache.org/jira/browse/FLINK-21983 Project: Flink

Re: Out of Memory Error-Heap when storing parquet files using Flink Table API (Flink version-1.12.0) in Google Cloud Storage

2021-03-25 Thread Xintong Song
Hi Aswin, Do you mean that the job purely moves data from Kafka to GCS. Is there any processings on the data except for reformatting? E.g., aggregation over a window? If there's barely any processing, you might want to try the following things. - Increase number of concurrent GC threads - Disable

[jira] [Created] (FLINK-21982) jobs should use client org.apache.hadoop.config on yarn

2021-03-25 Thread Bo Cui (Jira)
Bo Cui created FLINK-21982: -- Summary: jobs should use client org.apache.hadoop.config on yarn Key: FLINK-21982 URL: https://issues.apache.org/jira/browse/FLINK-21982 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-21981) Increase the priority of the parameter in flink-conf

2021-03-25 Thread Bo Cui (Jira)
Bo Cui created FLINK-21981: -- Summary: Increase the priority of the parameter in flink-conf Key: FLINK-21981 URL: https://issues.apache.org/jira/browse/FLINK-21981 Project: Flink Issue Type: Bug

Re: Out of Memory Error-Heap when storing parquet files using Flink Table API (Flink version-1.12.0) in Google Cloud Storage

2021-03-25 Thread Sivaraman Venkataraman, Aswin Ram
Hi Everyone, Hope you are doing well. We are currently using Flink Table API (Flink Version-1.12.0) to stream data from Kafka and store it in Google Cloud Storage. The file format we are using to store data is Parquet. Initially the Flink job worked perfectly fine and we were able to stream data

[jira] [Created] (FLINK-21980) ZooKeeperRunningJobsRegistry creates an empty znode

2021-03-25 Thread Ricky Burnett (Jira)
Ricky Burnett created FLINK-21980: - Summary: ZooKeeperRunningJobsRegistry creates an empty znode Key: FLINK-21980 URL: https://issues.apache.org/jira/browse/FLINK-21980 Project: Flink Issue T

About metric name truncation

2021-03-25 Thread Lu Niu
Hi, Flink dev https://issues.apache.org/jira/browse/FLINK-6898 truncates metric name to less than 80. We plan to relax this in our environment. Want to ask here whether it will cause any side effects? Thank you! Best Lu

[jira] [Created] (FLINK-21979) Job can be restarted from the beginning after it reached a terminal state

2021-03-25 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-21979: - Summary: Job can be restarted from the beginning after it reached a terminal state Key: FLINK-21979 URL: https://issues.apache.org/jira/browse/FLINK-21979 Project:

[jira] [Created] (FLINK-21978) Disable cast conversion between Numeric type and TIMESTAMP_LTZ type

2021-03-25 Thread Leonard Xu (Jira)
Leonard Xu created FLINK-21978: -- Summary: Disable cast conversion between Numeric type and TIMESTAMP_LTZ type Key: FLINK-21978 URL: https://issues.apache.org/jira/browse/FLINK-21978 Project: Flink

[jira] [Created] (FLINK-21977) Allow bigger offset in SlidingProcessingTimeWindows

2021-03-25 Thread Moritz Manner (Jira)
Moritz Manner created FLINK-21977: - Summary: Allow bigger offset in SlidingProcessingTimeWindows Key: FLINK-21977 URL: https://issues.apache.org/jira/browse/FLINK-21977 Project: Flink Issue T

[jira] [Created] (FLINK-21976) Move Flink ML pipeline API and library code to a separate repository named flink-ml

2021-03-25 Thread Dong Lin (Jira)
Dong Lin created FLINK-21976: Summary: Move Flink ML pipeline API and library code to a separate repository named flink-ml Key: FLINK-21976 URL: https://issues.apache.org/jira/browse/FLINK-21976 Project:

Re: [DISCUSS] Releasing Stateful Functions 3.0.0

2021-03-25 Thread Konstantin Knauf
Hi Gordon, Thank you for the update. +1 for a timely release. For existing Statefun users, is there already something in the documentation that describes the breaking changes/migration in more detail in order to prepare? Cheers, Konstantin On Thu, Mar 25, 2021 at 9:27 AM Tzu-Li (Gordon) Tai wr

Re: [BULK]Re: [SURVEY] Remove Mesos support

2021-03-25 Thread Konstantin Knauf
Hi Matthias, Thank you for following up on this. +1 to officially deprecate Mesos in the code and documentation, too. It will be confusing for users if this diverges from the roadmap. Cheers, Konstantin On Thu, Mar 25, 2021 at 12:23 PM Matthias Pohl wrote: > Hi everyone, > considering the upc

[jira] [Created] (FLINK-21975) Remove hamcrest dependency from SchedulerBenchmarkBase

2021-03-25 Thread Zhilong Hong (Jira)
Zhilong Hong created FLINK-21975: Summary: Remove hamcrest dependency from SchedulerBenchmarkBase Key: FLINK-21975 URL: https://issues.apache.org/jira/browse/FLINK-21975 Project: Flink Issue

Glob support on file access

2021-03-25 Thread Etienne Chauchot
Hi all, In case it is useful to some of you: I have a big batch that needs to use globs (*.parquet for example) to read input files. It seems that globs do not work out of the box (see https://issues.apache.org/jira/browse/FLINK-6417) But there is a workaround: final FileInputFormat input

[jira] [Created] (FLINK-21974) Don't match pattern `SET key= ' '` in SetOperationParseStrategy

2021-03-25 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-21974: - Summary: Don't match pattern `SET key= ' '` in SetOperationParseStrategy Key: FLINK-21974 URL: https://issues.apache.org/jira/browse/FLINK-21974 Project: Flink

Re: [BULK]Re: [SURVEY] Remove Mesos support

2021-03-25 Thread Matthias Pohl
Hi everyone, considering the upcoming release of Flink 1.13, I wanted to revive the discussion about the Mesos support ones more. Mesos is also already listed as deprecated in Flink's overall roadmap [1]. Maybe, it's time to align the documentation accordingly to make it more explicit? What do you

[jira] [Created] (FLINK-21973) Flink 1.12 has a column bug in creating views

2021-03-25 Thread xuhaiLong (Jira)
xuhaiLong created FLINK-21973: - Summary: Flink 1.12 has a column bug in creating views Key: FLINK-21973 URL: https://issues.apache.org/jira/browse/FLINK-21973 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-21972) Check whether TemporalTableSourceSpec can be serialized or not

2021-03-25 Thread Terry Wang (Jira)
Terry Wang created FLINK-21972: -- Summary: Check whether TemporalTableSourceSpec can be serialized or not Key: FLINK-21972 URL: https://issues.apache.org/jira/browse/FLINK-21972 Project: Flink

[DISCUSS] Releasing Stateful Functions 3.0.0

2021-03-25 Thread Tzu-Li (Gordon) Tai
Hi everyone, We'd like to prepare to release StateFun 3.0.0 over the next few days, ideally starting the first release candidate early next week. This is a version bump from 2.x to 3.x, with some major new features and reworks: - New request-reply protocol: the protocol has been reworked a

[jira] [Created] (FLINK-21971) Support FLIP-27 based kafka source connector in PyFlink DataStream API

2021-03-25 Thread Dian Fu (Jira)
Dian Fu created FLINK-21971: --- Summary: Support FLIP-27 based kafka source connector in PyFlink DataStream API Key: FLINK-21971 URL: https://issues.apache.org/jira/browse/FLINK-21971 Project: Flink

[jira] [Created] (FLINK-21970) DegreesWithExceptionITCase fails on azure

2021-03-25 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-21970: - Summary: DegreesWithExceptionITCase fails on azure Key: FLINK-21970 URL: https://issues.apache.org/jira/browse/FLINK-21970 Project: Flink Issue Typ