[jira] [Created] (FLINK-24585) Print the change in the size of the compacted files

2021-10-18 Thread Yubin Li (Jira)
Yubin Li created FLINK-24585: Summary: Print the change in the size of the compacted files Key: FLINK-24585 URL: https://issues.apache.org/jira/browse/FLINK-24585 Project: Flink Issue Type: Impro

[jira] [Created] (FLINK-24584) ClientTest.testRequestUnavailableHost fails on azure

2021-10-18 Thread Xintong Song (Jira)
Xintong Song created FLINK-24584: Summary: ClientTest.testRequestUnavailableHost fails on azure Key: FLINK-24584 URL: https://issues.apache.org/jira/browse/FLINK-24584 Project: Flink Issue Ty

[jira] [Created] (FLINK-24583) ElasticsearchWriterITCase.testWriteOnBulkIntervalFlush timeout on azure

2021-10-18 Thread Xintong Song (Jira)
Xintong Song created FLINK-24583: Summary: ElasticsearchWriterITCase.testWriteOnBulkIntervalFlush timeout on azure Key: FLINK-24583 URL: https://issues.apache.org/jira/browse/FLINK-24583 Project: Flin

[jira] [Created] (FLINK-24582) PrometheusReporterEndToEndITCase fails due to timeout

2021-10-18 Thread Xintong Song (Jira)
Xintong Song created FLINK-24582: Summary: PrometheusReporterEndToEndITCase fails due to timeout Key: FLINK-24582 URL: https://issues.apache.org/jira/browse/FLINK-24582 Project: Flink Issue T

Re: [VOTE] Release 1.13.3, release candidate #1

2021-10-18 Thread Dian Fu
+1 (binding) - verified the checksum and signature - checked the dependency changes since 1.13.2. There is only one dependency change (commons-compress: 1.20 -> 1.21) and it is well documented in the NOTICE file - installed the PyFlink packages in MacOS and runs a few examples successfully - the w

[jira] [Created] (FLINK-24581) compatible uname command with multiple OS on ARM platform

2021-10-18 Thread zhao bo (Jira)
zhao bo created FLINK-24581: --- Summary: compatible uname command with multiple OS on ARM platform Key: FLINK-24581 URL: https://issues.apache.org/jira/browse/FLINK-24581 Project: Flink Issue Type: B

[jira] [Created] (FLINK-24580) Kinesis connect time out error is not handled as recoverable

2021-10-18 Thread John Karp (Jira)
John Karp created FLINK-24580: - Summary: Kinesis connect time out error is not handled as recoverable Key: FLINK-24580 URL: https://issues.apache.org/jira/browse/FLINK-24580 Project: Flink Issue

Re: [DISCUSS] Creating an external connector repository

2021-10-18 Thread Thomas Weise
Thanks for initiating this discussion. There are definitely a few things that are not optimal with our current management of connectors. I would not necessarily characterize it as a "mess" though. As the points raised so far show, it isn't easy to find a solution that balances competing requiremen

[jira] [Created] (FLINK-24579) FlinkSQL does not print correctly content of arrays nested into maps

2021-10-18 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-24579: --- Summary: FlinkSQL does not print correctly content of arrays nested into maps Key: FLINK-24579 URL: https://issues.apache.org/jira/browse/FLINK-24579 Project: F

[jira] [Created] (FLINK-24578) Unexpected erratic load shape for channel skew load profile

2021-10-18 Thread Anton Kalashnikov (Jira)
Anton Kalashnikov created FLINK-24578: - Summary: Unexpected erratic load shape for channel skew load profile Key: FLINK-24578 URL: https://issues.apache.org/jira/browse/FLINK-24578 Project: Flink

[DISCUSS] Should we drop Row SerializationSchema/DeserializationSchema?

2021-10-18 Thread Francesco Guardiani
Hi all, In flink-avro, flink-csv and flink-json we have implementations of SerializationSchema/DeserializationSchema for the org.apache.flink.types.Row type. In particular, I'm referring to: - org.apache.flink.formats.json.JsonRowSerializationSchema - org.apache.flink.formats.json.JsonRowDes

Re: [Discussion] Avoid redundancy of Javadoc @return tag comment

2021-10-18 Thread Chesnay Schepler
Attachments don't work on this mailing list. I don't think the redundancy really hurts anyone. In particular because this often happens for getters, where no one expects interesting documentation in the first place. Even if were to remove something: - Removing the description would make the

Re: [DISCUSS] Creating an external connector repository

2021-10-18 Thread Chesnay Schepler
Generally, the issues are reproducibility and control. Stuffs completely broken on the Flink side for a week? Well then so are the connector repos. (As-is) You can't go back to a previous version of the snapshot. Which also means that checking out older commits can be problematic because you'd

Re: [DISCUSS] Creating an external connector repository

2021-10-18 Thread Chesnay Schepler
I think you're misinterpreting my comment. Independent from the repo split we should only keep the connectors in the Flink project that we actively maintain. The rest we might as well just drop. If some external people are interested in maintaining these connectors then there's nothing stoppin

[jira] [Created] (FLINK-24577) Support cast from BINARY/VARBINARY/BYTES to of RAW()

2021-10-18 Thread Marios Trivyzas (Jira)
Marios Trivyzas created FLINK-24577: --- Summary: Support cast from BINARY/VARBINARY/BYTES to of RAW() Key: FLINK-24577 URL: https://issues.apache.org/jira/browse/FLINK-24577 Project: Flink I

[jira] [Created] (FLINK-24576) Drop support for casting decimal numerics to boolean

2021-10-18 Thread Marios Trivyzas (Jira)
Marios Trivyzas created FLINK-24576: --- Summary: Drop support for casting decimal numerics to boolean Key: FLINK-24576 URL: https://issues.apache.org/jira/browse/FLINK-24576 Project: Flink Is

Re: [DISCUSS] Creating an external connector repository

2021-10-18 Thread Arvid Heise
Hi folks, thanks for joining the discussion. I'd like to give some ideas on how certain concerns are going to be addressed: Ingo: > In general I think breaking up the big repo would be a good move with many > benefits (which you have outlined already). One concern would be how to > proceed with o

Re: [DISCUSS] Creating an external connector repository

2021-10-18 Thread Leonard Xu
Hi, all I understand very well that the maintainers of the community want to move the connector to an external system. Indeed, the development and maintenance of the connector requires a lot of energy, and these do not involve the Flink core framework, which can reduce the maintenance pressure

[jira] [Created] (FLINK-24575) Port TestCsvFileSystemFormatFactory to DeserializationSchema

2021-10-18 Thread Francesco Guardiani (Jira)
Francesco Guardiani created FLINK-24575: --- Summary: Port TestCsvFileSystemFormatFactory to DeserializationSchema Key: FLINK-24575 URL: https://issues.apache.org/jira/browse/FLINK-24575 Project: F

Re: [VOTE] Release 1.13.3, release candidate #1

2021-10-18 Thread Leonard Xu
+1 (non-binding) - verified signatures and hashsums - built from source code with scala 2.11 succeeded - started a cluster, ran a wordcount job, the result is expected, no suspicious log output - started SQL Client, used mysql-cdc connector to consumer changelog from MySQL, the result is e

[jira] [Created] (FLINK-24574) Allow metrics to be removed in UDFs

2021-10-18 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-24574: --- Summary: Allow metrics to be removed in UDFs Key: FLINK-24574 URL: https://issues.apache.org/jira/browse/FLINK-24574 Project: Flink Issue Type: Improvement

Re: [DISCUSS] Creating an external connector repository

2021-10-18 Thread David Morávek
We are mostly talking about the freedom this would bring to the connector authors, but we still don't have answers for the important topics: - How exactly are we going to maintain the high quality standard of the connectors? - How would the connector release cycle to look like? Is this going to af

Re: Beam with Flink runner - Issues when writing to S3 in Parquet Format

2021-10-18 Thread Etienne Chauchot
Hi Sandeep, hi all, I'm getting back to you on this question after a check on Beam: ParquetIO has a block group size support (see for ex https://www.dremio.com/tuning-parquet/). Default group size is 1024*1024 bytes. Have you tried playing with different values of it using Sink#withRowGroupS

Re: [DISCUSS] Creating an external connector repository

2021-10-18 Thread Qingsheng Ren
Thanks for driving this discussion Arvid! I think this will be one giant leap for Flink community. Externalizing connectors would give connector developers more freedom in developing, releasing and maintaining, which can attract more developers for contributing their connectors and expand the Fl

Re: dataStream can not use multiple classloaders

2021-10-18 Thread Arvid Heise
You also must ensure that your SourceFunction is serializable, so it's not enough to just refer to some classloader, you must ensure that you have access to it also after deserialization on the task managers. On Mon, Oct 18, 2021 at 4:24 AM Caizhi Weng wrote: > Hi! > > There is only one classloa

[jira] [Created] (FLINK-24573) ZooKeeperJobGraphsStoreITCase crashes JVM

2021-10-18 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-24573: Summary: ZooKeeperJobGraphsStoreITCase crashes JVM Key: FLINK-24573 URL: https://issues.apache.org/jira/browse/FLINK-24573 Project: Flink Issue Type:

Re: [VOTE] Release 1.13.3, release candidate #1

2021-10-18 Thread JING ZHANG
Thanks Chesnay for driving this. +1 (non-binding) - built from source code flink-1.13.3-src.tgz succeeded - started a standalone Flink cluster, ran the WordCount example, WebUI looks good, no suspicious output/l