Re: Unable to update logback configuration in Flink Native Kubernetes

Hi Sharon Thanks a lot. I just updated the files (flink-conf.yaml and logback-console.xml) in the local conf folder and it worked as expected. Thanks & Regards Raghavendar T S MERAS Plugins <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-em

Unable to update logback configuration in Flink Native Kubernetes

work? Thanks & Regards Raghavendar T S <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-emai

Re: Flink Checkpoint for Stateless Operators

o say > that we need to use a sink instead of a flat map? > I'm not sure I understand the use case. What do you do with the results of > Flat Map? > > [1 https://arxiv.org/pdf/1506.08603.pdf > [2] > https://flink.apache.org/features/2018/03/01/end-to-end-exactly-once-apa

Re: Flink Checkpoint for Stateless Operators

//ci.apache.org/projects/flink/flink-docs-stable/dev/connectors/kafka.html#kafka-consumers-offset-committing-behaviour-configuration > > Regards, > Roman > > > On Thu, Apr 29, 2021 at 12:53 PM Raghavendar T S > wrote: > >> Hi Team >> >> Assume that we ha

Flink Checkpoint for Stateless Operators

ssful checkpoint, do we need to manually re-process (retry using queue or any other business logic) the event? Job: Kafka Source -> Flat Map Thank you -- Raghavendar T S www.teknosrc.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm

Re: Key by Kafka partition / Kinesis shard

then be uploaded to S3. >> What I don't understand is how to key my source on shard id, and do it in >> a way that doesn't induce unnecessary shuffling. >> Is this possible with Flink? >> > -- Raghavendar T S www.teknosrc.com CustomTrigger.java Description: Binary data TestWindow.java Description: Binary data

Re: Approaches for external state for Flink

- Is Cassandra the right choice here? Note, the state size is very large > and I have to feed the state from batch flow firstly. Thus I can not use > the internal state like rocksdb. > > 3- Can i improve this logic? > > 4- May be any bottleneck in that flow? I think to use asyncMap functions > for state read/write operations. > -- Raghavendar T S www.teknosrc.com

Re: Question on Flink and Rest API

)/RabbitMQ(queue) without persisting it in the data store. Let Flink do all the processing and finally write to the data store. Thank you Raghavendar T S https://www.linkedin.com/in/raghavendar-ts On Wed, Feb 3, 2021 at 11:29 AM Ejaskhan S wrote: > Team, > > It's just a random thought.

Re: Flink CheckPoint/Savepoint Behavior Question

tion phase? Basically will the code >before the RichFunction' *open()* be run? If not, would the >operators.open() functions run, when Flink restore from >checkpoint/savepoint? > > Thanks, > Jason > -- Raghavendar T S www.teknosrc.com <https://www.avast.com/sig-email?

Re: Is Apache Flink suitable for an application where messages are routed to different services

plicable laws. If you have received this > email by mistake, please (i) notify the sender immediately; (ii) delete it > from your database; and (iii) do not disclose the contents to anyone or > make copies thereof. Razorpay accepts no liability caused due to any > inadvertent/ unintentional data transmitted through this email. > > --- > -- Raghavendar T S www.teknosrc.com