Facebook messaging and choice of HBase over Cassandra - what can we learn?

(Posting this to both user + dev lists) I was reviewing the blog post on the facebook engineering blog from nov 15th http://www.facebook.com/note.php?note_id=454991608919# The Underlying Technology of Messages by Kannan Muthukkaruppan

Re: Facebook messaging and choice of HBase over Cassandra - what can we learn?

Eventual consistency is not good enough for instant messaging. On Sun, Nov 21, 2010 at 6:32 PM, Simon Reavely wrote: > (Posting this to both user + dev lists) > > I was reviewing the blog post on the facebook engineering blog from nov > 15th > http://www.facebook.com/note.php?note_id=454991608919

Re: Facebook messaging and choice of HBase over Cassandra - what can we learn?

Facebook Messaging – HBase Comes of Age http://facility9.com/2010/11/18/facebook-messaging-hbase-comes-of-age 2010/11/21 David Boxenhorn > Eventual consistency is not good enough for instant messaging. > > On Sun, Nov 21, 2

Re: Facebook messaging and choice of HBase over Cassandra - what can we learn?

On Sun, Nov 21, 2010 at 12:10 PM, André Fiedler wrote: > Facebook Messaging – HBase Comes of Age > > http://facility9.com/2010/11/18/facebook-messaging-hbase-comes-of-age > > 2010/11/21 David Boxenhorn >> >> Eventual consistency is not good enough for instant messaging. >> >> On Sun, Nov 21, 2010

(newbie) ColumnFamilyOutputFormat only writes one column (per key)

(I'm new here so forgive any mistakes or mis-presumptions...) I've set up a cassandra-0.7.0-beta3 and populated it with thrift-serialised objects via a scribe server. This seems a great way to get thrift beans out of the application asap and have then sitting in cassandra for later processing. I

Re: Facebook messaging and choice of HBase over Cassandra - what can we learn?

I've been using "Tunable Consistency" when explaining Cassandra to people as well. I've also started pointing out the different Consistency models of the standard Transaction Isolation Levels of an ACID compliant DB, as well as "eventually consistent" async replication like MYSQL / Couch DB I've al

Re: Facebook messaging and choice of HBase over Cassandra - what can we learn?

On Sun, 2010-11-21 at 11:32 -0500, Simon Reavely wrote: > As a cassandra user I think the key sentence for this community is: > "We found Cassandra's eventual consistency model to be a difficult > pattern to reconcile for our new Messages infrastructure." In my experience, "we needed strong consis

Re: Facebook messaging and choice of HBase over Cassandra - what can we learn?

+1 Ed On Nov 21, 2010, at 12:13 PM, Edward Capriolo wrote: > On Sun, Nov 21, 2010 at 12:10 PM, André Fiedler > wrote: >> Facebook Messaging – HBase Comes of Age >> >> http://facility9.com/2010/11/18/facebook-messaging-hbase-comes-of-age >> >> 2010/11/21 David Boxenhorn >>> >>> Eventual

Re: Facebook messaging and choice of HBase over Cassandra - what can we learn?

> Also I believe saying HBASE is consistent is not true. This can happen: > Write to region server. -> Region Server acknowledges client-> write > to WAL -> region server fails = write lost > > I wonder how facebook will reconcile that. :) > Are you sure about that? Client writes to WAL before ack

Re: Facebook messaging and choice of HBase over Cassandra - what can we learn?

On Sun, Nov 21, 2010 at 2:06 PM, Edward Ribeiro wrote: > > Also I believe saying HBASE is consistent is not true. This can happen: >> Write to region server. -> Region Server acknowledges client-> write >> to WAL -> region server fails = write lost >> >> I wonder how facebook will reconcile that.

Re: Facebook messaging and choice of HBase over Cassandra - what can we learn?

I don't know the details of operation of HBase, so I can't speak on that point. But, I do know that Facebook hired Jonathan Grey, former CTO of Streamy, who is a huge HBase contributor. Streamy ended in Mar 2010 - although I'm not sure when he went to work for Facebook. He presented on HBase at t

Re: Facebook messaging and choice of HBase over Cassandra - what can we learn?

On Sun, Nov 21, 2010 at 6:16 PM, Todd Lipcon wrote: > [only jumping in because info was requested - those who know me know that I > think Cassandra is a very interesting architecture and a better fit for many > applications than HBase] Hey Todd! Good to see you de-lurk! > In the other mode of o

Re: Facebook messaging and choice of HBase over Cassandra - what can we learn?

On Sun, Nov 21, 2010 at 6:25 PM, Jonathan Ellis wrote: > On Sun, Nov 21, 2010 at 6:16 PM, Todd Lipcon wrote: > > [only jumping in because info was requested - those who know me know that > I > > think Cassandra is a very interesting architecture and a better fit for > many > > applications than