Re: Is Riak suitable for s small-record write-intensive billion-records application?

Thanks again everyone (and apologies for junking your mailbox with my last posts). So far, I do plan to use Riak for the task. Here's my current vision on the application design: The several nodes will be bound to a single "external" IP via CARP. Thus at any given moment only one of the nodes is

SV: Is Riak suitable for s small-record write-intensive billion-records application?

Hi Yassen, > Any given node can be stopped or additional nodes can be added with almost no > interruption. If the active node is taken down, CARP will appoint a new > active node and its front-end will start accepting requests replacing the > gone node. New nodes will announce themselves to the

Logging chat messages

Hi, I want to inquire about feasibility of using riak for logging chat messages. My architecture is as follows: There are multiple sites where a user can either send message to another user or to a room (on the same site), and these messages need to be logged. Is riak a good fit for this use case?

Re: Logging chat messages

On Mon, Oct 22, 2012 at 10:29 AM, Shashwat Srivastava wrote: > > Now, each bucket would have conversation between two users or of a room of > a site. The conversation rate for (some) rooms is very high, some 20,000 - > 30,000 messages per hour. We have observed that users usually don't access > co

Re: Logging chat messages

Don't overkill it with technology, you could use Riak with a simple 2i index (integer index MMDD for the message date so you can search day by day backward), and for the message sequence or identifier you could either user ANY SQL database sequence or a UUID generator. HTH, Guido. On 22/

Re: Is Riak suitable for s small-record write-intensive billion-records application?

riak can well do this, but you will have to be strong and willing to learn. If you want a faster solution for the same, have you checked out Couchbase Server ( http://couchbase.com) , it too, can handle this data, and its setup is painless, with already finished SDKs and stuff, JSON in-and-out and

Re: Is Riak suitable for s small-record write-intensive billion-records application?

On Mon, Oct 22, 2012 at 9:41 AM, Joshua Muzaaya wrote: > > This is not meant to down-market Riak, but you mentioned Billions of > records. Riak storage is known to have a few issues as data grows to > billions. However, Couchbase 2.0 has been kinda battle tested, using SQLite > at the storage lay

Re: Is Riak suitable for s small-record write-intensive billion-records application?

If anyone would like a comparison of Riak to Couchbase with citations for each bullet point, we took a lot of time to make sure our comparisons page is objective and fact based. http://docs.basho.com/riak/latest/references/appendices/comparisons/Riak-Compared-to-Couchbase/ is the one for Riak v. C

riak-js pre-release announcement/warning

Hey folks, I've been putting some work in the riak-js client for Node.js recently, and as we're getting pretty close to doing a release, I wanted to keep you posted on changes and especially breaking changes. About a year ago, Francisco Treacy started rewriting the code (originally written i

Re: Riak Enterprise: can it be used to migrate to a new configuration?

Hi Evan, Thanks for responding! We have five nodes now, though that will grow to 15-20. We are currently projecting 10 TB of data, so 30 TB with N=3. I cannot find the exact page on your docs site that had the 512 recommendation for five nodes. I certainly may have misinterpreted what was wr

Newbie question -- how do I turn on web-based search interface for port 8098?

Hi, I've searched around on the web for this but am coming up short. How do I turn on the web-based search interface which is documented here? (http://docs.basho.com/riak/latest/references/Riak-Search---Settings/#Default Ports

Re: Newbie question -- how do I turn on web-based search interface for port 8098?

Hi Felix, Riak Search uses the same interface/port as the normal Riak HTTP operations, so look in your app.config file for the {http, [ ... ]} line to find the host/port combination. There's no UI exported from that interface, but you should be able to use Solr-like URLs to perform queries and mo

RE: Newbie question -- how do I turn on web-based search interface for port 8098?

Hi Sean, Great. Thanks a ton. The documentation in docs.basho.com is a bit out of date, but with your help, I was able to quickly fire off a query which I'd confirmed as working with the command line utility. Looking forward to deeper dives into Riak's capabilities. Cheers, Felix -Orig

Re: MapReduce questions

Hi C, On Fri, Oct 19, 2012 at 10:04 AM, Callixte Cauchois wrote: > Hey Mark, > > really sorry if I sounded aggressive or whatever. English is not my primary > language and sometimes I do not sound as I wanted... I just wanted to > acknowledge that no answer was kind of an answer to my questions.

Re: Riak performance problems when LevelDB database grows beyond 16GB

Jan, I apologize for the delayed response. 1. Did you realize that the "log_jan.txt" file from #1 below documented a hard disk failure? You mentioned a failed drive once. I am not sure if this is the same drive. 2. The "sse4_2" tells me that your Intel cpu supports hardware CRC32c calcul

Re: Is Riak suitable for s small-record write-intensive billion-records application?

On Mon, Oct 22, 2012 at 9:00 AM, Jared Morrow wrote: > If anyone would like a comparison of Riak to Couchbase with citations for > each bullet point, we took a lot of time to make sure our comparisons page > is objective and fact based. > > http://docs.basho.com/riak/latest/references/appendices/c

Re: riakc doesn't save metadata properly?

Hello Metin - Sorry for the delay. At the moment, all metadata needs to be stored under the <<"X-Riak-Meta">> dict key. The following example illustrates how this works: %% To store metadata: Object = riakc_obj:new(<<"groceries">>, <<"mine">>, <<"eggs & bacon">>). MetaData = dict:from_list([{<

Re: riakc doesn't save metadata properly?

Oh, I see, thanks for this clarification, much appreciated. I think this should be written somewhere in bold, as 3 days later, I still wasn't able to find anything on google. On Tue, Oct 23, 2012 at 12:08 AM, David Parfitt wrote: > Hello Metin - > > Sorry for the delay. At the moment, all meta

Re: riakc doesn't save metadata properly?

Hello Metin - I'm trying to get that into the docs right now. Will italics do? :-) https://github.com/basho/riak-erlang-client/pull/74 Cheers - Dave On Mon, Oct 22, 2012 at 5:22 PM, Metin Akat wrote: > Oh, I see, thanks for this clarification, much appreciated. > I think this should be written

Re: riakc doesn't save metadata properly?

Haha, well, the bold part was a bit of a joke, but any docs will be perfect. Thanks :) On Tue, Oct 23, 2012 at 12:25 AM, David Parfitt wrote: > Hello Metin - > > I'm trying to get that into the docs right now. Will italics do? :-) > https://github.com/basho/riak-erlang-client/pull/74 > > Cheers

Re: Logging chat messages

Thanks Sergej. I will try this with Leveldb backend and use another db for incremental ids. Shashwat On Mon, Oct 22, 2012 at 2:34 PM, Rapsey wrote: > > On Mon, Oct 22, 2012 at 10:29 AM, Shashwat Srivastava > wrote: > >> >> Now, each bucket would have conversation between two users or of a room

Re: Logging chat messages

Thank you Guido. Yes, a secondary index based on date would be immensely helpful for me to navigate via date. I will do this. An incremental message id would be helpful for me to get last 50 messages and so forth. I will use another db for this. Thanks for all your help. Shashwat On Mon, Oct 22,

Re: Logging chat messages

There is also another trick you can use. Pick a number. Assign every app server you have a number between 1 and N. The number assigned to the server is your starting ID, then increment by N every time you generate an ID from that server. The only limitation is that you have to know in advance how b

Re: riakc doesn't save metadata properly?

On 22/10/2012 22:25, David Parfitt wrote: Hello Metin - I'm trying to get that into the docs right now. Will italics do? :-) https://github.com/basho/riak-erlang-client/pull/74 Cheers - Dave On Mon, Oct 22, 2012 at 5:22 PM, Metin Akat wrote: Oh, I see, thanks for this clarification, much app