Aw: Re: Kafka, Storm and Redis

[Daniela S]

Hi John

 

Thank you, but how can I tell Redis to use "on" as key as it is only part of a String? And when i would like to delete an entry, because I get an "off" message for the same ID combination, I must use a combination of the two IDs as key. Is that possible to use sometimes "on" as key and sometimes a combination of the two IDs?

 

Thank you in advance.

 

Regards,

Daniela

 

Gesendet: Montag, 16. Mai 2016 um 13:07 Uhr
Von: "John Yost" <hokiege...@gmail.com>
An: user@storm.apache.org
Betreff: Re: Kafka, Storm and Redis

I recommend a Redis SET, which you can access via a "on" key.
 

--John

 

On Fri, May 13, 2016 at 4:10 AM, Daniela S <daniela_4...@gmx.at> wrote:

Hello

 

I have a question regarding the combination of Kafka, Storm and Redis.

 

I have created a Kafka producer, which produces messages like this:

1000 100 on

2000 150 off

 

The first two values are IDs, the third value is the information about the state of a device “on” or “off”.

 

I have also created a Kafka spout in Storm and I already receive these messages in my Storm topology.

 

Now I would like to store the “on” messages in Redis and to delete the “off” messages from Redis. There should always be an actual list of all “on” devices in Redis, which I can use afterwards for my analysis.

Unfortunately I have no idea how to realize this. Do I have to split the messages or can I store/delete them as they are? How could this be realized?

 

Thank you very much in advance.

 

Regards,

Daniela