Custom TCP server socket source

2023-07-26 Thread Kamal Mittal via user
Hello, I need to write "Custom server socket source" which accepts client connections over a port. 1. How to scale it across task managers with parallelism <= no. of task managers and with same single port 2. This is needed w.r.t Kubernetes POD deployment model where each POD is running

Re: Flink netty connector for TCP source

2023-07-26 Thread Shammon FY
I cannot find any information about netty source in flink website and it is not in the connector list[1], so I'm think that it is not supported by flink community [1] https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/datastream/overview/ Best, Shammon FY On Thu, Jul 27, 2023 a

RE: Flink netty connector for TCP source

2023-07-26 Thread Kamal Mittal via user
Hello Shammon, Yes socket text stream I am aware of but was thinking if something like as ‘https://github.com/apache/bahir-flink/tree/master/flink-connector-netty’ is also supported by Flink? Rgds, Kamal From: Shammon FY Sent: 27 July 2023 08:15 AM To: Kamal Mittal Cc: user@flink.apache.org

Re: Flink netty connector for TCP source

2023-07-26 Thread Shammon FY
Hi Kamal, There's socket text stream in `DataStream` and you can refer to [1] for more details. [1] https://nightlies.apache.org/flink/flink-docs-master/docs/dev/datastream/overview/#example-program Best, Shammon FY On Wed, Jul 26, 2023 at 4:26 PM Kamal Mittal via user wrote: > Hello, > > > >

RE: Suggestions for Open Source FLINK SQL editor

2023-07-26 Thread Jiabao Sun
Hi Rajat, I think Apache StreamPark(Incubating) or Apache Zeppelin is a good choice. https://streampark.apache.org/ https://zeppelin.apache.org/ Best, Jiabao On 2023/07/19 16:47:43 Rajat Ahuja wrote: > Hi team, > > I have set up

RE: Re: flink configuration in flink kubernetes operator question about password

2023-07-26 Thread Jiabao Sun
Hi tian tian, I think we can use podTemplate to mount kubernetes secrets as file or environment variables. Then we can access the secrets in our flink program. Please refers to https://github.com/apache/flink-kubernetes-operator/blob/main/examples/pod-template.yaml

Flink netty connector for TCP source

2023-07-26 Thread Kamal Mittal via user
Hello, Does flink provides netty connector for custom TCP source? Any documentation details please share? Rgds, Kamal