I believe there are architectures for the chat system that can use Kafka in a sensible fashion to achieve certain of the difficult aspects. However doing partition per user would not be advisable, nor I imagine would relying on Kafka's storage for checking for past or expired messages. (I've done the thought exercise on how to build a scalable chat system with kafka before).
Christian On Thu, Sep 4, 2014 at 11:35 AM, Aris Alexis <snowboard...@gmail.com> wrote: > Hello, > > I am building a big web application that I want to be massively scalable (I > am using cassandra and titan as a general db). > > I want to implement the following: > > real time web chat that is persisted so that user a in the future can > recall his chat with user b,c,d much like facebook. > mail like messages in the web application (not sure about this as it is > somewhat covered by the first one) > user activity streams > users subscribing to topics for example florida/musicevents > > Could i use kafka for this? can you recommend another technology maybe? >
