Re: [FLINK-3035] Redis as State Backend

2016-11-07 Thread amir bahmanyari
scha...Cheers From: Ovidiu Cristian Marcu To: "dev@flink.apache.org" ; amir bahmanyari Sent: Monday, November 7, 2016 3:56 AM Subject: RE: [FLINK-3035] Redis as State Backend Thanks, how big was your state (GBs)? Can you share your benchmark/s? Best, Ovidiu -Original Mes

RE: [FLINK-3035] Redis as State Backend

2016-11-07 Thread Ovidiu Cristian Marcu
Thanks, how big was your state (GBs)? Can you share your benchmark/s? Best, Ovidiu -Original Message- From: amir bahmanyari [mailto:amirto...@yahoo.com.INVALID] Sent: Tuesday, October 25, 2016 7:24 PM To: dev@flink.apache.org Subject: Re: [FLINK-3035] Redis as State Backend FYI.I was

RE: [FLINK-3035] Redis as State Backend

2016-11-07 Thread Ovidiu Cristian Marcu
Great, thanks! Best, Ovidiu -Original Message- From: Aljoscha Krettek [mailto:aljos...@apache.org] Sent: Monday, October 24, 2016 3:11 PM To: dev@flink.apache.org Subject: Re: [FLINK-3035] Redis as State Backend Hi, regarding RocksDB, yes this is possible because RocksDB is essentially

Re: [FLINK-3035] Redis as State Backend

2016-10-25 Thread amir bahmanyari
@flink.apache.org Sent: Tuesday, October 25, 2016 12:40 AM Subject: Re: [FLINK-3035] Redis as State Backend Thank you! Best, Ovidiu > On 24 Oct 2016, at 16:11, Aljoscha Krettek wrote: > > Hi, > regarding RocksDB, yes this is possible because RocksDB is essentially only > used as an o

Re: [FLINK-3035] Redis as State Backend

2016-10-25 Thread Ovidiu-Cristian MARCU
es, is that possible with >> RocksDB? >> >> Best, >> Ovidiu >> >> -Original Message- >> From: Aljoscha Krettek [mailto:aljos...@apache.org] >> Sent: Monday, October 17, 2016 2:51 PM >> To: dev@flink.apache.org >> Subject: Re: [F

Re: [FLINK-3035] Redis as State Backend

2016-10-24 Thread Aljoscha Krettek
r 17, 2016 2:51 PM > To: dev@flink.apache.org > Subject: Re: [FLINK-3035] Redis as State Backend > > Hi, > there are two basic ideas for implementing a StateBackend based on Redis: > 1. Rely on Redis to keep the state, use nothing else. > 2. Use Redis to keep the state an

RE: [FLINK-3035] Redis as State Backend

2016-10-21 Thread Ovidiu Cristian Marcu
s, is that possible with RocksDB? Best, Ovidiu -Original Message- From: Aljoscha Krettek [mailto:aljos...@apache.org] Sent: Monday, October 17, 2016 2:51 PM To: dev@flink.apache.org Subject: Re: [FLINK-3035] Redis as State Backend Hi, there are two basic ideas for implementing a StateBacken

Re: [FLINK-3035] Redis as State Backend

2016-10-17 Thread Aljoscha Krettek
Hi, there are two basic ideas for implementing a StateBackend based on Redis: 1. Rely on Redis to keep the state, use nothing else. 2. Use Redis to keep the state and checkpoint to some distributed file system (such as HDFS) when checkpointing The first idea seems unwise because Redis is not a "

[FLINK-3035] Redis as State Backend

2016-10-07 Thread Ovidiu Cristian Marcu
Hi Can you please expand the last comment: "I think, however, that for other reasons we will probably not be able to implement this well. The problem is that we have to somehow get at the state in redis for checkpointing. And if we use only one Redis instance for all states then this will be p

[jira] [Created] (FLINK-3035) Redis as State Backend

2015-11-17 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created FLINK-3035: -- Summary: Redis as State Backend Key: FLINK-3035 URL: https://issues.apache.org/jira/browse/FLINK-3035 Project: Flink Issue Type: New Feature Co