Re: [DISCUSS] String literal behavior in Flink

2023-03-05 Thread Jark Wu
Hi Aitozi, I would suggest trying to contribute it to the upstream project Calcite first. Best, Jark > 2023年3月6日 11:51,Aitozi 写道: > > Hi Jark, > > Thank you for your helpful suggestion. It appears that 'E'foo\n'' is a more > versatile and widely accepted option. To assess its feasibility, I

[DISCUSS] FLIP-301: Hybrid Shuffle supports Remote Storage

2023-03-05 Thread Yuxin Tan
Hi everyone, I would like to start a discussion on FLIP-301: Hybrid Shuffle supports Remote Storage[1]. In the cloud-native environment, it is difficult to determine the appropriate disk space for Batch shuffle, which will affect job stability. This FLIP is to support Remote Storage for Hybrid S

[jira] [Created] (FLINK-31329) Fix Parquet stats extractor

2023-03-05 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-31329: Summary: Fix Parquet stats extractor Key: FLINK-31329 URL: https://issues.apache.org/jira/browse/FLINK-31329 Project: Flink Issue Type: Bug Compone

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-05 Thread weijie guo
Hi Weihua, Thanks for your clarification, SGTM. Best regards, Weijie Weihua Hu 于2023年3月6日周一 11:43写道: > Thanks Weijie. > > Heterogeneous task managers will not be considered in this FLIP since > it does not request heterogeneous resources as you said. > > My first thought is we can adjust the

Re: [DISCUSS] String literal behavior in Flink

2023-03-05 Thread Aitozi
Hi Jark, Thank you for your helpful suggestion. It appears that 'E'foo\n'' is a more versatile and widely accepted option. To assess its feasibility, I have reviewed the relevant Unicode supports and concluded that it may necessitate modifications to the Parser.jj file to accommodate this new synt

Re: [DISCUSS] Why does the Doc say "Flink requires at least Java 11 to build"?

2023-03-05 Thread Dong Lin
Given that the latest Flink version still supports Java 8, and that Flink has not officially announced the drop of Java 8 support, I think it is incorrect to say that "Flink requires at least Java 11 to build". Because dropping Java 8 support is a backward incompatible change with huge impact, it

[jira] [Created] (FLINK-31328) Greedy option on the looping pattern at the end not working

2023-03-05 Thread Juntao Hu (Jira)
Juntao Hu created FLINK-31328: - Summary: Greedy option on the looping pattern at the end not working Key: FLINK-31328 URL: https://issues.apache.org/jira/browse/FLINK-31328 Project: Flink Issue

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-05 Thread Weihua Hu
Thanks Weijie. Heterogeneous task managers will not be considered in this FLIP since it does not request heterogeneous resources as you said. My first thought is we can adjust the meaning of redundant configuration to redundant number of per resource type. These can be considered in detail when w

[jira] [Created] (FLINK-31327) Added conversion method for GenericRowData

2023-03-05 Thread hunter (Jira)
hunter created FLINK-31327: -- Summary: Added conversion method for GenericRowData Key: FLINK-31327 URL: https://issues.apache.org/jira/browse/FLINK-31327 Project: Flink Issue Type: New Feature

Re: [VOTE] Release 1.15.4, release candidate #1

2023-03-05 Thread Dian Fu
Hi Danny, It impacts all jobs using new sinks in Python DataStream API and has nothing to do with the tumbling window. I just want to ensure that it will finally be included in a patch release of 1.15.x. As it mentioned `Given that Flink 1.17 is on the horizon, it will be good to release critical

Re:Re: help: [FLINK-31321] @flinkbot run azure does not work?

2023-03-05 Thread felixzh
http://security.ubuntu.com/ubuntu/pool/main/o/openssl1.0/libssl1.0.0_1.0.2n-1ubuntu5.11_amd64.deb The above url exists. http://security.ubuntu.com/ubuntu/pool/main/o/openssl1.0/libssl1.0.0_1.0.2n-1ubuntu5.10_amd64.deb The above url doex not exists. ubuntu5.10 -> ubuntu5.11 ? 在 2023-03-06

Re: Large schemas lead to long DataStream-to-table transformation names

2023-03-05 Thread Jark Wu
Hi Xingcan, I think `physicalDataType.toString()` is indeed verbose in this case. Normal table scan generates descriptions using field names instead of the full schema. Will that help in your case? Best, Jark On Sat, 4 Mar 2023 at 06:57, Xingcan Cui wrote: > Hi all, > > We are dealing with som

Re: [DISCUSS] String literal behavior in Flink

2023-03-05 Thread Jark Wu
Hi Aitozi, I think this is a good idea to improve the backslash escape strings. However, I lean a bit more toward the Postgres approach[1], which is more standard-compliant. PG allows backslash escape string by writing the letter E (upper or lower case) just before the opening single quote, e.g.,

Re: help: [FLINK-31321] @flinkbot run azure does not work?

2023-03-05 Thread yuxia
I also encouter the same problem. I have no idea why it happens, but hope it can ne fixed assp. Best regards, Yuxia - 原始邮件 - 发件人: "felixzh" 收件人: "dev" 发送时间: 星期一, 2023年 3 月 06日 上午 8:46:49 主题: help: [FLINK-31321] @flinkbot run azure does not work? 2023-03-05T05:38:27.1951220Z libapr1 is

help: [FLINK-31321] @flinkbot run azure does not work?

2023-03-05 Thread felixzh
2023-03-05T05:38:27.1951220Z libapr1 is already the newest version (1.6.5-1ubuntu1). 2023-03-05T05:38:27.1951745Z libapr1 set to manually installed. 2023-03-05T05:38:27.1952264Z 0 upgraded, 0 newly installed, 0 to remove and 13 not upgraded. 2023-03-05T05:38:27.1984256Z --2023-03-05 05:38:27--

[jira] [Created] (FLINK-31326) Disabled source scaling breaks downstream scaling if source busyTimeMsPerSecond is 0

2023-03-05 Thread Mate Czagany (Jira)
Mate Czagany created FLINK-31326: Summary: Disabled source scaling breaks downstream scaling if source busyTimeMsPerSecond is 0 Key: FLINK-31326 URL: https://issues.apache.org/jira/browse/FLINK-31326

[jira] [Created] (FLINK-31325) Improve performance of Swing

2023-03-05 Thread Yindi Wang (Jira)
Yindi Wang created FLINK-31325: -- Summary: Improve performance of Swing Key: FLINK-31325 URL: https://issues.apache.org/jira/browse/FLINK-31325 Project: Flink Issue Type: Improvement C