Re: [DISCUSS] Retroactively externalize some connectors for 1.16

2022-12-06 Thread Ryan Skraba
Hello -- this makes sense to me: removing connectors from 1.17 (but not the 1.16 branch) will still give users a long time to migrate. +1 (non-binding) Ryan On Fri, Dec 2, 2022 at 11:42 AM Dong Lin wrote: > Sounds good! > > +1 > > On Fri, Dec 2, 2022 at 5:58 PM Chesnay Schepler > wrote: > > >

Re: Need right

2022-12-06 Thread Yuxin Tan
Hi, Stan You could get more contribution details here. [1] Thanks and looking forward to your contribution! [1] https://flink.apache.org/contributing/how-to-contribute.html Best, Yuxin Martijn Visser 于2022年12月5日周一 14:21写道: > Hi, > > There is no need for additional permissions: you can start

[jira] [Created] (FLINK-30311) CI error: Back-off pulling image "flink:1.14"

2022-12-06 Thread Peter Vary (Jira)
Peter Vary created FLINK-30311: -- Summary: CI error: Back-off pulling image "flink:1.14" Key: FLINK-30311 URL: https://issues.apache.org/jira/browse/FLINK-30311 Project: Flink Issue Type: Sub-tas

Re: [DISCUSS] FLIP-275: Support Remote SQL Client Based on SQL Gateway

2022-12-06 Thread yu zelin
Hi, Godfrey Thanks for your feedback. Below is my thoughts about your questions. 1. About RowFormat. I agree to your opinion. So we decided to revert the RowFormat related changes and let the client to resolve the print format. 2. About ContentType I agree that the definition of the ContentType

[ANNOUNCE] Apache flink-connector-cassandra 3.0.0 released

2022-12-06 Thread Chesnay Schepler
|The Apache Flink community is very happy to announce the release of Apache flink-connector-cassandra 3.0.0. | |Apache Flink® is an open-source stream processing framework ||for| |distributed, high-performing, always-available, and accurate data streaming applications.| |The release is availabl

[jira] [Created] (FLINK-30312) Remove cassandra connector from master branch

2022-12-06 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-30312: Summary: Remove cassandra connector from master branch Key: FLINK-30312 URL: https://issues.apache.org/jira/browse/FLINK-30312 Project: Flink Issue T

Re: [DISCUSS] FLIP-277: Native GlueCatalog Support in Flink

2022-12-06 Thread Samrat Deb
Hi Yuxia, Thank you for reviewing the flip and putting forward your observations and comments. 1: I noticed there's a YAML part in the section of "Using the Catalog", > what do you mean by that? Do you mean how to use glue catalog in sql > client? If so, just for your information, it's not suppor

Re: [DISCUSS] FLIP-277: Native GlueCatalog Support in Flink

2022-12-06 Thread Samrat Deb
Hi Dong Lin, Aws Glue Data catalog is vendor specific and in future we will get such type of implementation from different providers. We should definitely externalize these catalog libraries similar to flink connectors. I am thinking of creating flink-catalog similar to flink-connector under the r

[jira] [Created] (FLINK-30313) Flink Kubernetes Operator seems to rely on 1.15 k8s HA code but 1.16 config code

2022-12-06 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-30313: - Summary: Flink Kubernetes Operator seems to rely on 1.15 k8s HA code but 1.16 config code Key: FLINK-30313 URL: https://issues.apache.org/jira/browse/FLINK-30313 Pr

Re: [DISCUSS] TLS issues

2022-12-06 Thread Jean-Damien Hatzenbuhler
Hello, Is there a Flink Community committer that can take a look at the PR https://issues.apache.org/jira/browse/FLINK-28520? Regards, On Mon, Sep 19, 2022 at 4:10 PM Martijn Visser wrote: > Hi Jean-Damien, > > One of the volunteers from the Flink Community needs to review your PR and > if acc

Re: [DISCUSS] FLIP-275: Support Remote SQL Client Based on SQL Gateway

2022-12-06 Thread godfrey he
Hi, zeklin >The CLI will use default print style for the non-query result. Please make sure the print results of EXPLAIN/DESC/SHOW CREATE TABLE commands are clear. > We think it’s better to add the root cause to the ErrorResponseBody. LGTM Best, Godfrey yu zelin 于2022年12月6日周二 17:51写道: > > Hi,

[jira] [Created] (FLINK-30314) Unable to read all records from compressed line-delimited JSON files using Table API

2022-12-06 Thread Dmitry Yaraev (Jira)
Dmitry Yaraev created FLINK-30314: - Summary: Unable to read all records from compressed line-delimited JSON files using Table API Key: FLINK-30314 URL: https://issues.apache.org/jira/browse/FLINK-30314

[jira] [Created] (FLINK-30315) Add more information about image pull failures to the operator log

2022-12-06 Thread Peter Vary (Jira)
Peter Vary created FLINK-30315: -- Summary: Add more information about image pull failures to the operator log Key: FLINK-30315 URL: https://issues.apache.org/jira/browse/FLINK-30315 Project: Flink

[jira] [Created] (FLINK-30316) [JUnit5 Migration] Migrate flink-statebackend-common

2022-12-06 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-30316: --- Summary: [JUnit5 Migration] Migrate flink-statebackend-common Key: FLINK-30316 URL: https://issues.apache.org/jira/browse/FLINK-30316 Project: Flink Is

Re: [Cassandra] source connector

2022-12-06 Thread Etienne Chauchot
Hi all, Would anyone have time to review the PR mentioned in this thread ? Thanks in advance ! Best Etienne Le 25/10/2022 à 16:38, Etienne Chauchot a écrit : Ok thanks everyone. Etienne Le 24/10/2022 à 20:03, Martijn Visser a écrit : Hi all, @Etienne many thanks for the PR for the Cassan

[jira] [Created] (FLINK-30317) Create table in FTS catalog with s3 warehouse throws DatabaseNotExistException

2022-12-06 Thread Alex Sorokoumov (Jira)
Alex Sorokoumov created FLINK-30317: --- Summary: Create table in FTS catalog with s3 warehouse throws DatabaseNotExistException Key: FLINK-30317 URL: https://issues.apache.org/jira/browse/FLINK-30317

ABFS/WASB IT test cases not running

2022-12-06 Thread ramkrishna vasudevan
Hi devs, I was trying to write test cases for the Streaming sink support for ABFS as part of https://issues.apache.org/jira/browse/FLINK-30128. I found that the AzureFileSystemBehaviorITCase was not running in the CI build too. So if I want to add the Recoverable support for ABFS , is there a way

Re: [VOTE] Release flink-connector-aws v4.0.0, release candidate #1

2022-12-06 Thread Danny Cranmer
Hi everyone, I am reopening this vote since the issue we detected [1] cannot be fixed without AWS SDK changes, and it is an existing issue, not a regression. Please review and vote on the release candidate #1 for the version 4.0.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve th

Redis source

2022-12-06 Thread Pramod Immaneni
Hi, Could someone assign the JIRA https://issues.apache.org/jira/browse/FLINK-3033 to me, JIRA account pramod, so I can contribute a source connector. Thanks -- Thanks, Pramod http://ts.la/pramod3443

Re: ABFS/WASB IT test cases not running

2022-12-06 Thread Matthias Pohl
Hi Ramkrishna, There are Jira issues for the Azure e2e tests [1] and AzureFileSystemBehaviorITCase [2]. Essentially, it comes down to setting things up in Azure and working together with the PMC to add the secrets to the Azure CI project. The secrets are only set for CI on master and the release br

Re: Redis source

2022-12-06 Thread Martijn Visser
Hi Pramod, Can you please ping me in the Jira so I can assign it to you? Please keep in mind that new connectors need to go through the FLIP process, see https://cwiki.apache.org/confluence/display/FLINK/FLIP+Connector+Template for the template. More than happy to grant you access for creating a F

Re: Redis source

2022-12-06 Thread Pramod Immaneni
Thanks Martjin. I have pinged you through the jira ticket. My jira account is pramod. On Tue, Dec 6, 2022 at 12:23 PM Martijn Visser wrote: > Hi Pramod, > > Can you please ping me in the Jira so I can assign it to you? Please keep > in mind that new connectors need to go through the FLIP process

Re: [DISCUSS] Retroactively externalize some connectors for 1.16

2022-12-06 Thread Mason Chen
Hi all, +1 (non-binding), I agree that syncing the changes going forward would be a huge effort and a cutoff date makes sense. Best, Mason On Tue, Dec 6, 2022 at 12:10 AM Ryan Skraba wrote: > Hello -- this makes sense to me: removing connectors from 1.17 (but not the > 1.16 branch) will still

[jira] [Created] (FLINK-30318) sql-client failed to load jar passed with -j args in flink 1.16.0

2022-12-06 Thread Samrat Deb (Jira)
Samrat Deb created FLINK-30318: -- Summary: sql-client failed to load jar passed with -j args in flink 1.16.0 Key: FLINK-30318 URL: https://issues.apache.org/jira/browse/FLINK-30318 Project: Flink

[jira] [Created] (FLINK-30319) Validate illegal column name in table store

2022-12-06 Thread Shammon (Jira)
Shammon created FLINK-30319: --- Summary: Validate illegal column name in table store Key: FLINK-30319 URL: https://issues.apache.org/jira/browse/FLINK-30319 Project: Flink Issue Type: Bug C

Re: Table API thrift support

2022-12-06 Thread Chen Qin
Hi Martjin, We would like to propose split externalizing flink-connector-hive (connector) from supporting thrift format (new format encode/decode). As we discussed, Externalized+Connector+development , Hive conn

Re: ABFS/WASB IT test cases not running

2022-12-06 Thread ramkrishna vasudevan
Thank you for your email. So with this PR I should be adding ABFS related config and secrets and also ensure that the existing WASB secrets are also updated? Regards Ram On Wed, Dec 7, 2022 at 1:51 AM Matthias Pohl wrote: > Hi Ramkrishna, > There are Jira issues for the Azure e2e tests [1] and

Re: [DISCUSS] FLIP-277: Native GlueCatalog Support in Flink

2022-12-06 Thread Samrat Deb
Hi Dong Lin, Since this is the first proposal for adding a vendor-specific catalog > library in Flink, I think maybe we should also externalize those catalog > libraries similar to how we are externalizing connector libraries. It is > likely that we might want to add catalogs for other vectors in

[DISCUSS] Externalizing Kafka connector

2022-12-06 Thread Mason Chen
Hi all, I've finished the first pass on externalizing the Kafka connector under the release-1.16 branch in this https://github.com/apache/flink-connector-kafka/pull/1. The docs, connectors, and e2e tests have been relocated and CI on my fork has been running green. Thanks for everyone else's work

Re: ABFS/WASB IT test cases not running

2022-12-06 Thread Matthias Pohl
You can implement the tests. Access to the underlying filesystem should be configurable through system properties (similar to what is done in AzureFileSystemBehaviorITCase). This enables contributors to run the tests locally (if they set the corresponding resource up). You should reach out to the F