Re: [FEEDBACK] Metadata Platforms / Catalogs / Lineage integration

2022-01-14 Thread JIN FENG
Hi I am a software engineer from Xiaomi. Last year we used metacat(https://github.com/Netflix/metacat) to manage all metadata, including Hive, Kudu, Doris, Iceberg, Elasticsearch, Talos (Xiaomi self-developed message queue), Mysql, Tidb.. Metacat is well compatible with the hive-metastore protoco

[jira] [Created] (FLINK-25655) FlinkKafkaInternalProducerITCase.testInitTransactionId failed on azure

2022-01-14 Thread Yun Gao (Jira)
Yun Gao created FLINK-25655: --- Summary: FlinkKafkaInternalProducerITCase.testInitTransactionId failed on azure Key: FLINK-25655 URL: https://issues.apache.org/jira/browse/FLINK-25655 Project: Flink

Re: [DISCUSS] FLIP-205: Support cache in DataStream for Batch Processing

2022-01-14 Thread David Morávek
Hi Xuannan, I think this already looks really good. The whole discussions is pretty long, so I'll just to summarize my current understanding of the outcome: - This only aims on the DataStream API for now, but can be used as a building block for the higher level abstractions (Table API). - We're p

[DISCUSS] Move Flink website to privacy friendly Analytics solution

2022-01-14 Thread Martijn Visser
Hi everyone, The Flink website currently uses Google Analytics to track how visitors of the website are interacting with it. It provides insights into which documentation pages are visited, how users are using the website (what's the cycle of pages they visit before exiting the page), if they are

Re: [DISCUSS] FLIP-203: Incremental savepoints

2022-01-14 Thread David Anderson
> I have a very similar question to State Processor API. Is it the same scenario in this case? > Should it also be working with checkpoints but might be just untested? I have used the State Processor API with aligned, full checkpoints. There it has worked just fine. David On Thu, Jan 13, 2022 at

Re: [DISCUSS] Move Flink website to privacy friendly Analytics solution

2022-01-14 Thread Konstantin Knauf
Hi Martijn, I think this is a great initiative. Thank you for pursuing this. It allows us to a) generate better insights into the usage of Apache Flink and its documentation as shown in the video a) do this in a privacy preserving way and c) act as a role model for other Apache projects on this m

Re: [DISCUSS] FLIP-203: Incremental savepoints

2022-01-14 Thread Konstantin Knauf
Hi everyone, Thank you, Piotr. Please find my thoughts on the topic below: 0) What exactly does the "State Processor API" row mean? Is it: Can it be read by the State Processor API? Can it be written by the State Processor API? Both? Something else? 1) If we take the assumption from FLIP-193 "th

Re: [DISCUSS] Move Flink website to privacy friendly Analytics solution

2022-01-14 Thread Till Rohrmann
Hi Martijn, big +1 for this effort. Thanks a lot for pushing this initiative forward! Cheers, Till On Fri, Jan 14, 2022 at 11:49 AM Konstantin Knauf wrote: > Hi Martijn, > > I think this is a great initiative. Thank you for pursuing this. It allows > us to > > a) generate better insights into

Re: [DISCUSS] Move Flink website to privacy friendly Analytics solution

2022-01-14 Thread Chesnay Schepler
+1 On 14/01/2022 14:47, Till Rohrmann wrote: Hi Martijn, big +1 for this effort. Thanks a lot for pushing this initiative forward! Cheers, Till On Fri, Jan 14, 2022 at 11:49 AM Konstantin Knauf wrote: Hi Martijn, I think this is a great initiative. Thank you for pursuing this. It allows u

[jira] [Created] (FLINK-25656) Upgrade software.amazon.glue:schema-registry-common and software.amazon.glue:schema-registry-serde dependency from 1.1.5 to 1.1.8

2022-01-14 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-25656: -- Summary: Upgrade software.amazon.glue:schema-registry-common and software.amazon.glue:schema-registry-serde dependency from 1.1.5 to 1.1.8 Key: FLINK-25656 URL: https://issues

[jira] [Created] (FLINK-25657) Upgrade com.amazonaws:amazon-kinesis-client dependency from 1.14.1 to 1.14.7

2022-01-14 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-25657: -- Summary: Upgrade com.amazonaws:amazon-kinesis-client dependency from 1.14.1 to 1.14.7 Key: FLINK-25657 URL: https://issues.apache.org/jira/browse/FLINK-25657 Proj

[jira] [Created] (FLINK-25658) Setup Nexus npm cache

2022-01-14 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-25658: Summary: Setup Nexus npm cache Key: FLINK-25658 URL: https://issues.apache.org/jira/browse/FLINK-25658 Project: Flink Issue Type: Technical Debt

[jira] [Created] (FLINK-25659) LogicalRelDataTypeConverterTest is flaky on Azure

2022-01-14 Thread Timo Walther (Jira)
Timo Walther created FLINK-25659: Summary: LogicalRelDataTypeConverterTest is flaky on Azure Key: FLINK-25659 URL: https://issues.apache.org/jira/browse/FLINK-25659 Project: Flink Issue Type:

Re: [DISCUSS] Move Flink website to privacy friendly Analytics solution

2022-01-14 Thread David Morávek
+1, thanks for driving this Martijn On Fri 14. 1. 2022 at 15:01, Chesnay Schepler wrote: > +1 > > On 14/01/2022 14:47, Till Rohrmann wrote: > > Hi Martijn, > > > > big +1 for this effort. Thanks a lot for pushing this initiative forward! > > > > Cheers, > > Till > > > > On Fri, Jan 14, 2022 at 1