Re: Using Flink k8s operator on OKD

2023-09-19 Thread Zach Lorimer
I haven’t used OKD but it sounds like OLM. If that’s the case, I’m assuming the operator was deployed to the “operators” namespace. In that case, you’ll need to create the RBACs and such in the Flink namespace for that deployment to work. For example this needs to be in each namespace that you wan

?????? flink design pazzule

2023-09-19 Thread ??????
Thanks,Xiangyu. As you suggested,I've read the comments from 'ExternallyInducedSource.java' and also taken a look into the source code of The legacy source of Pravega Flink connector,I've figured it out now. much appreciated. --  -- ??:

Using Flink k8s operator on OKD

2023-09-19 Thread Krzysztof Chmielewski
Hi community, I was wondering if anyone tried to deploy Flink using Flink k8s operator on machine where OKD [1] is installed? We have tried to install Flink k8s operator version 1.6 which seems to succeed, however when we try to deploy simple Flink deployment we are getting an error. 2023-09-19 1

Re: Incompatible KafkaProducer version

2023-09-19 Thread Martijn Visser
Hi Krzysztof, The bundled Flink Kafka connector for 1.17 uses Kafka 3.2.3, see https://github.com/apache/flink/blob/release-1.17/flink-connectors/flink-connector-kafka/pom.xml#L38 That's also the case for the externalized Flink Kafka connector v3.0, see https://github.com/apache/flink-connector-ka

Re: [ANNOUNCE] Apache Flink Stateful Functions Release 3.3.0 released

2023-09-19 Thread Galen Warren via user
Thanks Martijn! On Tue, Sep 19, 2023 at 6:38 AM Martijn Visser wrote: > The Apache Flink community is excited to announce the release of > Stateful Functions 3.3.0! > > Stateful Functions is a cross-platform stack for building Stateful > Serverless applications, making it radically simpler to de

Re: flink design pazzule

2023-09-19 Thread xiangyu feng
Hi Zhuliang, I would suggest u reading the comments from 'ExternallyInducedSource.java'[1]. "Sources that implement this interface do not trigger checkpoints when receiving a trigger message from the checkpoint coordinator, but when their input data/events indicate that a checkpoint should be tri

[CVE-2023-41834] Apache Flink Stateful Functions allowed HTTP header injection due to Improper Neutralization of CRLF Sequences

2023-09-19 Thread Martijn Visser
CVE-2023-41834: Apache Flink Stateful Functions allowed HTTP header injection due to Improper Neutralization of CRLF Sequences Severity: moderate Vendor: The Apache Software Foundation Versions Affected: Stateful Functions 3.1.0 to 3.2.0 Description: Improper Neutralization of CRLF Sequences in

[ANNOUNCE] Apache Flink Stateful Functions Release 3.3.0 released

2023-09-19 Thread Martijn Visser
The Apache Flink community is excited to announce the release of Stateful Functions 3.3.0! Stateful Functions is a cross-platform stack for building Stateful Serverless applications, making it radically simpler to develop scalable, consistent, and elastic distributed applications. This new release

RE: About Flink parquet format

2023-09-19 Thread Kamal Mittal via user
Hello, If given page size as 1 byte then encountered exception as - ‘maxCapacityHint can't be less than initialSlabSize %d %d’. This is coming from class CapacityByteArrayOutputStream and contained in parquet-common library. Rgds, Kamal From: Feng Jin Sent: 19 September 2023 01:01 PM To: Ka

Re: FlinkML 'DenseVector' object has no attribute 'get_fields_by_names'

2023-09-19 Thread Evgeniy Lyutikov
Thanks for the answer, I'll try. Are there examples or tutorials somewhere on how to use FlinkML in real-life scenarios, such as streaming Kafka through a model? От: Xin Jiang Отправлено: 19 сентября 2023 г. 8:07:11 Кому: Evgeniy Lyutikov Копия: user@flink.apach

Query Regarding CSV Decoder

2023-09-19 Thread Kirti Dhar Upadhyay K via user
Hi Team, I am using CSV decoder with Flink file source. I am stuck with decoding issues as below- 1. In case there is any blank line in between two records or blank lines in the end of file, it returns the blank object. E.g- Input Records: id,name,age,isPermanent,tenure,salary,gender,contact

Re: About Flink parquet format

2023-09-19 Thread Feng Jin
Hi Kamal What exception did you encounter? I have tested it locally and it works fine. Best, Feng On Mon, Sep 18, 2023 at 11:04 AM Kamal Mittal wrote: > Hello, > > > > Checkpointing is enabled and works fine if configured parquet page size is > at least 64 bytes as otherwise there is excepti

Re: Maven plugin to detect issues in Flink projects

2023-09-19 Thread Kartoglu, Emre
Yes it would be used by app developers who are developing a Flink application. From: liu ron Date: Tuesday, 19 September 2023 at 03:04 To: "Kartoglu, Emre" , "user@flink.apache.org" Subject: RE: [EXTERNAL] Maven plugin to detect issues in Flink projects CAUTION: This email originated from ou