Re: Redis as a State Backend

2024-01-29 Thread Junrui Lee
Hi Chirag, Indeed, the possibility of using Redis as a state backend for Flink has been considered in the past. You can find a detailed discussion about this topic in the JIRA issue FLINK-3035[1] as well as in the comments section of this PR[2]. The outcome of these discussions was that Redis is

Redis as a State Backend

2024-01-29 Thread Chirag Dewan via user
Hi, I was looking at the FLIP-254: Redis Streams Connector and I was wondering if Flink ever considered Redis as a state backend? And if yes, why was it discarded compared to RocksDB?  If someone can point me towards any deep dives on why RocksDB is a better fit as a state backend, it would be h

RE: Re: Request to provide example codes on ElasticsearchSinkFunction updaterequest

2024-01-29 Thread Jiabao Sun
Hi Fidea, When specifying an ID, the IndexedRequest[1] can perform a complete overwrite. If partial update is needed, the UpdateRequest[2] can be used. @Override public void process( Tuple2 element, RuntimeContext ctx, RequestIndexer indexer) { UpdateRequest updateRequest = new Upda

Re: Request to provide example codes on ElasticsearchSinkFunction updaterequest

2024-01-29 Thread Fidea Lidea
Hi Jiabao & Jiadong, Could you please share examples on how to "*update*" data using ElasticsearchSink? Thanks On Mon, Jan 29, 2024 at 9:07 PM Jiabao Sun wrote: > Hi Fidea, > > I found some examples in the Java documentation, and I hope they can be > helpful. > > private static class TestElas

RE: Request to provide example codes on ElasticsearchSinkFunction updaterequest

2024-01-29 Thread Jiabao Sun
Hi Fidea, I found some examples in the Java documentation, and I hope they can be helpful. private static class TestElasticSearchSinkFunction implements ElasticsearchSinkFunction> { public IndexRequest createIndexRequest(Tuple2 element) { Map json = new HashMap<>(); json.pu

Re: Request to provide example codes on ElasticsearchSinkFunction updaterequest

2024-01-29 Thread jiadong.lu
Hi, Fidea. The ElasticsearchSinkFunction Class has already marked as deprecated[1], please try to use ElasticsearchSink Class. Hope to help you. Best. Jiadong.Lu 1. https://github.com/apache/flink-connector-elasticsearch/blob/153b8fc23e14c03c4bacf2c24fbe0fee286ec6e2/flink-connector-elasticse

Request to provide example codes on ElasticsearchSinkFunction updaterequest

2024-01-29 Thread Fidea Lidea
Hi Team, Could you please share with me a few example codes on how to perform "updaterequest on elasticsearch using apache flink" I.want to use ElasticsearchSinkFunction to perform updaterequest. Thanks Nida Shaikh lideafidea...@gmail.com