[jira] [Created] (FLINK-26974) Python EmbeddedThreadDependencyTests.test_add_python_file failed on azure

2022-03-31 Thread Yun Gao (Jira)
Yun Gao created FLINK-26974: --- Summary: Python EmbeddedThreadDependencyTests.test_add_python_file failed on azure Key: FLINK-26974 URL: https://issues.apache.org/jira/browse/FLINK-26974 Project: Flink

[jira] [Created] (FLINK-26973) Emit events on state transitions for FlinkDeployment

2022-03-31 Thread Matyas Orhidi (Jira)
Matyas Orhidi created FLINK-26973: - Summary: Emit events on state transitions for FlinkDeployment Key: FLINK-26973 URL: https://issues.apache.org/jira/browse/FLINK-26973 Project: Flink Issue

[jira] [Created] (FLINK-26972) Support spot instance in Flink Kubernetes operator

2022-03-31 Thread Yang Wang (Jira)
Yang Wang created FLINK-26972: - Summary: Support spot instance in Flink Kubernetes operator Key: FLINK-26972 URL: https://issues.apache.org/jira/browse/FLINK-26972 Project: Flink Issue Type: New

Re: [VOTE] Apache Flink Kubernetes Operator Release 0.1.0, release candidate #3

2022-03-31 Thread Thomas Weise
+1 (binding) * installed from staged helm chart and run example * built from source On Wed, Mar 30, 2022 at 7:39 AM Gyula Fóra wrote: > Hi everyone, > > Please review and vote on the release candidate #3 for the version 0.1.0 of > Apache Flink Kubernetes Operator, > as follows: > [ ] +1, Appro

[jira] [Created] (FLINK-26971) UniversalCompaction should pick by size ratio after picking by file num

2022-03-31 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-26971: Summary: UniversalCompaction should pick by size ratio after picking by file num Key: FLINK-26971 URL: https://issues.apache.org/jira/browse/FLINK-26971 Project: Flin

[jira] [Created] (FLINK-26970) Fix comment style error

2022-03-31 Thread yingjie.wang (Jira)
yingjie.wang created FLINK-26970: Summary: Fix comment style error Key: FLINK-26970 URL: https://issues.apache.org/jira/browse/FLINK-26970 Project: Flink Issue Type: Improvement Com

[jira] [Created] (FLINK-26969) Write operation examples of tumbling window, sliding window, session window and time window based on pyflink

2022-03-31 Thread zhangjingcun (Jira)
zhangjingcun created FLINK-26969: Summary: Write operation examples of tumbling window, sliding window, session window and time window based on pyflink Key: FLINK-26969 URL: https://issues.apache.org/jira/browse/F

[jira] [Created] (FLINK-26968) Bump CopyOnWriteStateMap entry version before write

2022-03-31 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-26968: - Summary: Bump CopyOnWriteStateMap entry version before write Key: FLINK-26968 URL: https://issues.apache.org/jira/browse/FLINK-26968 Project: Flink

[jira] [Created] (FLINK-26967) Fix race condition in CopyOnWriteStateMap

2022-03-31 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-26967: - Summary: Fix race condition in CopyOnWriteStateMap Key: FLINK-26967 URL: https://issues.apache.org/jira/browse/FLINK-26967 Project: Flink Issue Typ

[jira] [Created] (FLINK-26966) Implement incremental checkpoints

2022-03-31 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-26966: - Summary: Implement incremental checkpoints Key: FLINK-26966 URL: https://issues.apache.org/jira/browse/FLINK-26966 Project: Flink Issue Type: Sub-t

[jira] [Created] (FLINK-26965) Allow reuse of PeriodicMaterializationManager

2022-03-31 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-26965: - Summary: Allow reuse of PeriodicMaterializationManager Key: FLINK-26965 URL: https://issues.apache.org/jira/browse/FLINK-26965 Project: Flink Issue

[jira] [Created] (FLINK-26964) Notify CheckpointStrategy about checkpoint completion/abortion

2022-03-31 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-26964: - Summary: Notify CheckpointStrategy about checkpoint completion/abortion Key: FLINK-26964 URL: https://issues.apache.org/jira/browse/FLINK-26964 Project: Fli

[jira] [Created] (FLINK-26963) Allow heap state backend creation customization

2022-03-31 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-26963: - Summary: Allow heap state backend creation customization Key: FLINK-26963 URL: https://issues.apache.org/jira/browse/FLINK-26963 Project: Flink Iss

[jira] [Created] (FLINK-26962) Fix comment style error

2022-03-31 Thread yingjie.wang (Jira)
yingjie.wang created FLINK-26962: Summary: Fix comment style error Key: FLINK-26962 URL: https://issues.apache.org/jira/browse/FLINK-26962 Project: Flink Issue Type: Improvement Com

Re: Speeding up the test builds

2022-03-31 Thread Chesnay Schepler
Ah. I missed one very important line. > [unit] tests would require less memory and thus we would be able to increase the number of forks for them That's definitely a good idea, and it should be trivial to implement it. It would be interesting to see how much that would give us. Note that in

[jira] [Created] (FLINK-26961) Update multiple Jackson dependencies to v2.13.2.1

2022-03-31 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-26961: --- Summary: Update multiple Jackson dependencies to v2.13.2.1 Key: FLINK-26961 URL: https://issues.apache.org/jira/browse/FLINK-26961 Project: Flink Issu

Re: Speeding up the test builds

2022-03-31 Thread Chesnay Schepler
> we decided to limit the number of testing forks/disable fork reuse for almost all tests IT cases were generally not reusing forks for as long as I can remember. A few modules opted into fork-reuse; most didn't. The Table API recently enabled fork-reuse, started causing OOMs due to memory lea

Speeding up the test builds

2022-03-31 Thread Piotr Nowojski
Hi devs, Recently we were plagued with OOM errors and as a result we decided to limit the number of testing forks/disable fork reuse for almost all tests. Currently AFAIK each JVM fork has assigned 4GB of memory (2GB heap and 2GB off heap) and we are running two forks, on a machine that has 7GB of

[jira] [Created] (FLINK-26960) Make it possible to drop an old unused registered Kryo serializer

2022-03-31 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-26960: Summary: Make it possible to drop an old unused registered Kryo serializer Key: FLINK-26960 URL: https://issues.apache.org/jira/browse/FLINK-26960 Project: Fl

[jira] [Created] (FLINK-26959) Improve quickstart to use the release helm repo

2022-03-31 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-26959: -- Summary: Improve quickstart to use the release helm repo Key: FLINK-26959 URL: https://issues.apache.org/jira/browse/FLINK-26959 Project: Flink Issue Type: Sub-t

[jira] [Created] (FLINK-26958) Add Github Actions build pipeline for flink-connector-elasticsearch

2022-03-31 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-26958: -- Summary: Add Github Actions build pipeline for flink-connector-elasticsearch Key: FLINK-26958 URL: https://issues.apache.org/jira/browse/FLINK-26958 Project: Flin

Re: [VOTE] Apache Flink Kubernetes Operator Release 0.1.0, release candidate #3

2022-03-31 Thread Biao Geng
+1 (non-binding) 1. Verify that the checksums and GPG files 2. Verify that the source distributions do not contain any binaries 3. Build the source distribution to ensure all source files 4. Verify that POM files and the README.md file do not have anything unexpected. 6. Verify that chart and appV

[jira] [Created] (FLINK-26957) FileSystemJobResultStore calls flush on an already closed OutputStream

2022-03-31 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-26957: - Summary: FileSystemJobResultStore calls flush on an already closed OutputStream Key: FLINK-26957 URL: https://issues.apache.org/jira/browse/FLINK-26957 Project: Fl

Re: [VOTE] Apache Flink Kubernetes Operator Release 0.1.0, release candidate #3

2022-03-31 Thread Gyula Fóra
+1 (binding) Verified the following: - Verified source distribution do not contain binaries - Verified LICENSES and NOTICES - Built from source, verified maven and helm chart versions - Verified helm chart points to correct docker image and deploys it by default - Verified maven

[jira] [Created] (FLINK-26956) AZP: don't log "[ERROR] Picked up JAVA_TOOL_OPTIONS: -XX:+HeapDumpOnOutOfMemoryError"

2022-03-31 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-26956: - Summary: AZP: don't log "[ERROR] Picked up JAVA_TOOL_OPTIONS: -XX:+HeapDumpOnOutOfMemoryError" Key: FLINK-26956 URL: https://issues.apache.org/jira/browse/FLINK-26956

[jira] [Created] (FLINK-26955) Add CRD compatibility check

2022-03-31 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-26955: -- Summary: Add CRD compatibility check Key: FLINK-26955 URL: https://issues.apache.org/jira/browse/FLINK-26955 Project: Flink Issue Type: Improvement Com

[jira] [Created] (FLINK-26954) Support Kafka bounded read in TableAPI

2022-03-31 Thread Yuan Zhu (Jira)
Yuan Zhu created FLINK-26954: Summary: Support Kafka bounded read in TableAPI Key: FLINK-26954 URL: https://issues.apache.org/jira/browse/FLINK-26954 Project: Flink Issue Type: Improvement

Re: [DISCUSS] FLIP-216 Decouple Hive connector with Flink planner

2022-03-31 Thread Martijn Visser
Hi all, Thanks for opening this discussion. I agree with Francesco that we should go for the best solution instead of another bandaid or intermediate solution. I think there's actually consensus for that, given the argument provided by Yuxia: > The first way is the ideal way and we should go in t

Re: [VOTE] Apache Flink Kubernetes Operator Release 0.1.0, release candidate #3

2022-03-31 Thread Yang Wang
+1 (non-binding) Verified via the following steps: * Verify checksums and GPG signatures * Verify that the source distributions do not contain any binaries * Build source distribution successfully * Verify all the POM version is 0.1.0 * License check, the jars bundled in docker image and maven a

[jira] [Created] (FLINK-26953) Introduce Operator Specific Metrics

2022-03-31 Thread Matyas Orhidi (Jira)
Matyas Orhidi created FLINK-26953: - Summary: Introduce Operator Specific Metrics Key: FLINK-26953 URL: https://issues.apache.org/jira/browse/FLINK-26953 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-26952) Remove old CSV connector

2022-03-31 Thread Francesco Guardiani (Jira)
Francesco Guardiani created FLINK-26952: --- Summary: Remove old CSV connector Key: FLINK-26952 URL: https://issues.apache.org/jira/browse/FLINK-26952 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-26951) Add HASH supported in SQL & Table API

2022-03-31 Thread dalongliu (Jira)
dalongliu created FLINK-26951: - Summary: Add HASH supported in SQL & Table API Key: FLINK-26951 URL: https://issues.apache.org/jira/browse/FLINK-26951 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-26950) Remove TableSink and TableSource interfaces

2022-03-31 Thread Francesco Guardiani (Jira)
Francesco Guardiani created FLINK-26950: --- Summary: Remove TableSink and TableSource interfaces Key: FLINK-26950 URL: https://issues.apache.org/jira/browse/FLINK-26950 Project: Flink Iss

[jira] [Created] (FLINK-26949) Add NVL supported in SQL & Table API

2022-03-31 Thread dalongliu (Jira)
dalongliu created FLINK-26949: - Summary: Add NVL supported in SQL & Table API Key: FLINK-26949 URL: https://issues.apache.org/jira/browse/FLINK-26949 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-26948) Add SORT_ARRAY supported in SQL & Table API

2022-03-31 Thread dalongliu (Jira)
dalongliu created FLINK-26948: - Summary: Add SORT_ARRAY supported in SQL & Table API Key: FLINK-26948 URL: https://issues.apache.org/jira/browse/FLINK-26948 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-26947) Add ARRAY_CONTAINS supported in SQL & Table API

2022-03-31 Thread dalongliu (Jira)
dalongliu created FLINK-26947: - Summary: Add ARRAY_CONTAINS supported in SQL & Table API Key: FLINK-26947 URL: https://issues.apache.org/jira/browse/FLINK-26947 Project: Flink Issue Type: Sub-tas

[jira] [Created] (FLINK-26946) Add SHIFTRIGHT supported in SQL & Table API

2022-03-31 Thread dalongliu (Jira)
dalongliu created FLINK-26946: - Summary: Add SHIFTRIGHT supported in SQL & Table API Key: FLINK-26946 URL: https://issues.apache.org/jira/browse/FLINK-26946 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-26945) Add DATE_SUB supported in SQL & Table API

2022-03-31 Thread dalongliu (Jira)
dalongliu created FLINK-26945: - Summary: Add DATE_SUB supported in SQL & Table API Key: FLINK-26945 URL: https://issues.apache.org/jira/browse/FLINK-26945 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-26944) Add ADD_MONTHS supported in SQL and Table API

2022-03-31 Thread dalongliu (Jira)
dalongliu created FLINK-26944: - Summary: Add ADD_MONTHS supported in SQL and Table API Key: FLINK-26944 URL: https://issues.apache.org/jira/browse/FLINK-26944 Project: Flink Issue Type: Sub-task