Doubt

2014-04-21 Thread Jagan Ranganathan
Dear All, We have a requirement to store 'N' columns of an entity in a CF. Mostly this is write once and read many times. What is the best way to store the data? Composite CF Simple CF with value as protobuf extracted data Both provides extendable columns which is a requirement for our usage.

Re: Queuing System

2014-02-23 Thread Jagan Ranganathan
hingshadoop / On Feb 22, 2014, at 11:49 AM, Jagan Ranganathan <ja...@zohocorp.com> wrote: Hi Joe, If my understanding is right, Kafka does not satisfy the high availability/replication part well because of the need for leader and In-Sync replicas.

Re: Queuing System

2014-02-22 Thread Jagan Ranganathan
n writing rate, the message are likely to be consumed while it's still in memory (in memtable) at server side. In this particular case, you can optimize further by deactivating compaction for the table. Regards Duy Hai On Sat, Feb 22, 2014 at 5:56

Re: Queuing System

2014-02-22 Thread Jagan Ranganathan
s provide a CAS primitive that can be used to ensure deliver-once if that is a requirement. I'd be happy to continue discussing appropriate data-models and access patterns if you decide to go down this path. -Tupshin On Sat, Feb 22, 2014 at 10:03 AM, Jagan Ranganathan <

Re: Queuing System

2014-02-22 Thread Jagan Ranganathan
v/blog/cassandra-anti-patterns-queues-and-queue-like-datasets On Sat, Feb 22, 2014 at 4:03 PM, Jagan Ranganathan <ja...@zohocorp.com> wrote: Hi, I need to decouple some of the work being processed from the user thread to provide better user experience. For that I need a qu

Re: Queuing System

2014-02-22 Thread Jagan Ranganathan
a Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop / On Feb 22, 2014, at 11:13 AM, Jagan Ranganathan <ja...@zohocorp.com> wrote: Hi Michael, Yes I am planning to use RabbitMQ for my messaging system.

Re: Queuing System

2014-02-22 Thread Jagan Ranganathan
of the worst anti patterns for Cassandra: http://www.datastax.com/dev/blog/cassandra-anti-patterns-queues-and-queue-like-datasets On Sat, Feb 22, 2014 at 4:03 PM, Jagan Ranganathan <ja...@zohocorp.com> wrote: Hi, I need to decouple some of the work being processed from

Queuing System

2014-02-22 Thread Jagan Ranganathan
Hi, I need to decouple some of the work being processed from the user thread to provide better user experience. For that I need a queuing system with the following needs, High Availability No Data Loss Better Performance. Following are some libraries that were considered along with the limitati