Re: Flink Operator Resources Requests and Limits

We have the *kubernetes.jobmanager.cpu.limit-factor* and *kubernetes.jobmanager.memory.limit-factor* to control the limit value. The resources limit memory will be set to memory/cpu * limit-factor. Best, Yang PACE, JAMES 于2022年7月28日周四 01:26写道： > That does not seem to work. > > > > For instanc

Re: Hybrid Source stop processing files after processing 128 SourceFactories

Hi Michael, That's a great catch! I filed another ticket since this is a separate issue: https://issues.apache.org/jira/browse/FLINK-28722. Best, Mason On Tue, Jul 26, 2022 at 10:34 PM Benenson, Michael < mikhail_benen...@intuit.com> wrote: > Hi, Mason > > > > Think, the problem is related to >

Re: Is Flink SQL a good fit for alerting?

Re-pasting from Slack [cid:image001.png@01D8A1E9.DA582010] Hong Teoh 7 hours ago I can give some examples, but they are all using DataStream

RE: Flink Operator Resources Requests and Limits

That does not seem to work. For instance: jobManager: podTemplate: spec: containers: - resources: requests: cpu: "0.5" memory: "2048m" limits: cpu: "2" memory: "2048m" results

Re: Is there any Natural Language Processing samples for flink?

Yes you can there have been uses of Apache OpenNLP in Flink pipelines and other Machine Translation libraries - happy to chat with you offline. On Wed, Jul 27, 2022 at 1:07 PM John Smith wrote: > But we can use some sort of Java/Scala NLP lib within our Fink Jobs I > guess... > > On Tue, Jul 26,

Re: Is there any Natural Language Processing samples for flink?

But we can use some sort of Java/Scala NLP lib within our Fink Jobs I guess... On Tue, Jul 26, 2022 at 9:59 PM Yunfeng Zhou wrote: > Hi John, > > So far as I know, Flink does not have an official library or sample > specializing in NLP cases yet. You can refer to Flink ML[1] for machine > learni

Re: Flink Operator Resources Requests and Limits

Hi James, Have you considered using pod templates already? https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/pod-template/ Regards, Matyas On Wed, Jul 27, 2022 at 3:21 PM PACE, JAMES wrote: > We are currently evaluating the apache flink operator (versi

Flink Operator Resources Requests and Limits

We are currently evaluating the apache flink operator (version 1.1.0) to replace the operator that we currently use. Setting the memory and cpu resources sets both the request and the limit for the pod. Previously, we were only setting request allowing pods to oversubscribe to CPU when needed

Is Flink SQL a good fit for alerting?

I'm recently getting into Flink SQL, which I find great for conducting low-in-code analytics. However, I was just wondering whether it could be a good fit for alerting applications, too. Alerts of the form `cpu.usage > 75% and mem.usage > 75%` would be easy to translate into SQL, for example. For m