[jira] [Created] (FLINK-22605) Python UDF should only be created once regardless of how many times it is invoked

2021-05-07 Thread Yik San Chan (Jira)
Yik San Chan created FLINK-22605: Summary: Python UDF should only be created once regardless of how many times it is invoked Key: FLINK-22605 URL: https://issues.apache.org/jira/browse/FLINK-22605 Pro

Re: Activate bloom filter in RocksDB State Backend via Flink configuration

2021-05-07 Thread maver1ck
Hi Jun Qin, Do you have any example OptionsFactory for Bloom Filter. I did experiment and change Options from FLASH_SSD_OPTIMIZED to SPINNING_DISK_OPTIMIZED_HIGH_MEM. This gives me 2x better performance on NVME disk. I think the reason is that I'm doing a lot of reads and SPINNING_DISK_OPTIMIZED_H

About the windowOperator and Watermark

2021-05-07 Thread 曲洋
Hi Experts, Given that a window in the stream is configured with short window size like timeWinodw(3s), and I gotta utilize Event time and Periodic Watermark. The stream input is [watermark(7) | 6, 5, 3, 4, 1, 2], and then two windows are created (3,1,2) (6,5,4) before watermark(7) arriving. But

[jira] [Created] (FLINK-22604) NPE on bundle close when task failover after a failed task open

2021-05-07 Thread lincoln lee (Jira)
lincoln lee created FLINK-22604: --- Summary: NPE on bundle close when task failover after a failed task open Key: FLINK-22604 URL: https://issues.apache.org/jira/browse/FLINK-22604 Project: Flink

[jira] [Created] (FLINK-22603) The digest can be produced by SourceAbilitySpec

2021-05-07 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-22603: Summary: The digest can be produced by SourceAbilitySpec Key: FLINK-22603 URL: https://issues.apache.org/jira/browse/FLINK-22603 Project: Flink Issue Type: I

[jira] [Created] (FLINK-22602) Upgrade parquet to 1.12.0 due to CVEs

2021-05-07 Thread Bo Cui (Jira)
Bo Cui created FLINK-22602: -- Summary: Upgrade parquet to 1.12.0 due to CVEs Key: FLINK-22602 URL: https://issues.apache.org/jira/browse/FLINK-22602 Project: Flink Issue Type: Bug Component

[jira] [Created] (FLINK-22601) PushWatermarkIntoScan should produce digest created by Expression

2021-05-07 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-22601: Summary: PushWatermarkIntoScan should produce digest created by Expression Key: FLINK-22601 URL: https://issues.apache.org/jira/browse/FLINK-22601 Project: Flink

[jira] [Created] (FLINK-22600) TableSourceTable: extraDigests should be consistent with abilitySpecs

2021-05-07 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-22600: Summary: TableSourceTable: extraDigests should be consistent with abilitySpecs Key: FLINK-22600 URL: https://issues.apache.org/jira/browse/FLINK-22600 Project: Flink

[jira] [Created] (FLINK-22599) Point to `client.timeout` in error messages where it is used for rpc timeout

2021-05-07 Thread Xintong Song (Jira)
Xintong Song created FLINK-22599: Summary: Point to `client.timeout` in error messages where it is used for rpc timeout Key: FLINK-22599 URL: https://issues.apache.org/jira/browse/FLINK-22599 Project:

[jira] [Created] (FLINK-22598) Examples use deprecated forms of writeAsText

2021-05-07 Thread Al-assad (Jira)
Al-assad created FLINK-22598: Summary: Examples use deprecated forms of writeAsText Key: FLINK-22598 URL: https://issues.apache.org/jira/browse/FLINK-22598 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-22597) JobMaster cannot be restarted

2021-05-07 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-22597: - Summary: JobMaster cannot be restarted Key: FLINK-22597 URL: https://issues.apache.org/jira/browse/FLINK-22597 Project: Flink Issue Type: Bug Com

Re: [DISCUSS] Releasing Flink 1.12.4

2021-05-07 Thread Konstantin Knauf
+1. Thanks Arvid. On Fri, May 7, 2021 at 3:56 PM Chesnay Schepler wrote: > +1 for a releasing 1.12.4 ASAP. > > On 5/7/2021 3:46 PM, Arvid Heise wrote: > > Dear devs, > > > > To address the licencing issue of 1.12.3 [1] and the misbundled scala > 2.12, > > I'm proposing to start releasing 1.12.4

Re: [DISCUSS] Releasing Flink 1.12.4

2021-05-07 Thread Chesnay Schepler
+1 for a releasing 1.12.4 ASAP. On 5/7/2021 3:46 PM, Arvid Heise wrote: Dear devs, To address the licencing issue of 1.12.3 [1] and the misbundled scala 2.12, I'm proposing to start releasing 1.12.4 on next Monday. I'd volunteer as a release manager again. Best, Arvid [1] https://issues.apa

[DISCUSS] Releasing Flink 1.12.4

2021-05-07 Thread Arvid Heise
Dear devs, To address the licencing issue of 1.12.3 [1] and the misbundled scala 2.12, I'm proposing to start releasing 1.12.4 on next Monday. I'd volunteer as a release manager again. Best, Arvid [1] https://issues.apache.org/jira/browse/FLINK-22555

Re: Configmaps not deleted Kubernetes HA

2021-05-07 Thread Till Rohrmann
Hi Enrique, I think you are actually seeing a mixture of FLINK-20219 and FLINK-20695. If any of these problems is solved, then the problem should be gone. Also note that the K8s HA services won't clean up the ConfigMaps if you delete the deployment as documented here [1]. [1] https://ci.apache.or

[jira] [Created] (FLINK-22596) Active timeout is not triggered if there were no barriers

2021-05-07 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-22596: Summary: Active timeout is not triggered if there were no barriers Key: FLINK-22596 URL: https://issues.apache.org/jira/browse/FLINK-22596 Project: Flink

[jira] [Created] (FLINK-22595) RocksDBStateBackendWindowITCase fails on Azure

2021-05-07 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-22595: Summary: RocksDBStateBackendWindowITCase fails on Azure Key: FLINK-22595 URL: https://issues.apache.org/jira/browse/FLINK-22595 Project: Flink Issue

[jira] [Created] (FLINK-22594) Report oom killed pod in k8s resource manager

2021-05-07 Thread Aitozi (Jira)
Aitozi created FLINK-22594: -- Summary: Report oom killed pod in k8s resource manager Key: FLINK-22594 URL: https://issues.apache.org/jira/browse/FLINK-22594 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-22593) SavepointITCase.testShouldAddEntropyToSavepointPath unstable

2021-05-07 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-22593: -- Summary: SavepointITCase.testShouldAddEntropyToSavepointPath unstable Key: FLINK-22593 URL: https://issues.apache.org/jira/browse/FLINK-22593 Project: Flink

[jira] [Created] (FLINK-22592) numBuffersInLocal is always zero when using unaligned checkpoints

2021-05-07 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-22592: -- Summary: numBuffersInLocal is always zero when using unaligned checkpoints Key: FLINK-22592 URL: https://issues.apache.org/jira/browse/FLINK-22592 Project: Flink

[jira] [Created] (FLINK-22591) add sub interface MapColumnVector for ColumnVector

2021-05-07 Thread Jun Zhang (Jira)
Jun Zhang created FLINK-22591: - Summary: add sub interface MapColumnVector for ColumnVector Key: FLINK-22591 URL: https://issues.apache.org/jira/browse/FLINK-22591 Project: Flink Issue Type: Imp

[jira] [Created] (FLINK-22590) Add Scala implicit conversions for new API methods

2021-05-07 Thread Timo Walther (Jira)
Timo Walther created FLINK-22590: Summary: Add Scala implicit conversions for new API methods Key: FLINK-22590 URL: https://issues.apache.org/jira/browse/FLINK-22590 Project: Flink Issue Type

How to comsume and send data with two different kerberos cetified kafka in one flink task?

2021-05-07 Thread 1095193...@qq.com
Hi By setting security.kerberos.* configure, we can connect one kerberos certified Kafka in Flink sql task. How to consume and produce with two different kerberos cetified Kafka in one flink sql task? Kafka allow multiple SASL authenticated Java clients in a single JVM process. https://cwik

[jira] [Created] (FLINK-22589) There are quite a few Python classes doesn't appear in the Python docs

2021-05-07 Thread Dian Fu (Jira)
Dian Fu created FLINK-22589: --- Summary: There are quite a few Python classes doesn't appear in the Python docs Key: FLINK-22589 URL: https://issues.apache.org/jira/browse/FLINK-22589 Project: Flink

Re: Configmaps not deleted Kubernetes HA

2021-05-07 Thread Enrique
Hi Till, I'm not using Zookeeper HA, but the new Native Kubernetes HA. I'm deploying the Flink Cluster using a StatefulSet one for each JM/TM and PVC to store HA metadata/checkpointing/savepointing. When I delete both StatefulSets and the JM/TM pods terminate the HA Config Maps are not deleted. I

Re: [ANNOUNCE] Apache Flink 1.13.0 released

2021-05-07 Thread Yangze Guo
Thanks, Dawid & Guowei for the great work, thanks to everyone involved. Best, Yangze Guo On Thu, May 6, 2021 at 5:51 PM Rui Li wrote: > > Thanks to Dawid and Guowei for the great work! > > On Thu, May 6, 2021 at 4:48 PM Zhu Zhu wrote: >> >> Thanks Dawid and Guowei for being the release managers

Re: Configmaps not deleted Kubernetes HA

2021-05-07 Thread Yang Wang
Hi Enrique, I think it is related with FLINK-20219. Currently, the HA related ConfigMap/ZNodes could not be cleaned up properly. The HA related ConfigMaps clean up mechanism for session could get improved in the following two ways. * Delete the jobmanager leader ConfigMap once the job reached to