Re: May allow_mult cause DoS?

2013-12-17 Thread Viable Nisei
On Wed, Dec 18, 2013 at 8:32 AM, Erik Søe Sørensen wrote: > It really is not a good idea to use siblings to represent 1-to-many > relations. That's not what it's intended for, nor what it's optimized for... > Ok, understood. > Can you tell us exactly why you need Bitcask rather than LevelDB? 2i

Re: Maps with multiple buckets

2013-12-17 Thread Bryce
Upon thinking about things a little more, if anyone has information on how to do time series with counters(current, 5 seconds ago, 10 seconds ago, and 30 seconds ago), that would be a great thing to have for the project I'm doing. Thanks again for the help! Bryce On 12/17/13 17:09, Jeremiah

Re: Maps with multiple buckets

2013-12-17 Thread Bryce Verdier
Thank you for the quick response Jeremiah. I didn't know that inputs could accept a list of buckets. I do believe that will solve my problem. I'm currently using MR to grab a list all keys/counters and use the reduce phase to sort the keys by highest count. Because I'm using counters the bac

RE: May allow_mult cause DoS?

2013-12-17 Thread Erik Søe Sørensen
It really is not a good idea to use siblings to represent 1-to-many relations. That's not what it's intended for, nor what it's optimized for... Can you tell us exactly why you need Bitcask rather than LevelDB? 2i would probably do it. Otherwise, storing a list of items under each key could be a

Re: Maps with multiple buckets

2013-12-17 Thread Jeremiah Peschka
The allowable inputs to an MR map phase include a list of bucket key pairs. If you know your keys in advance the problem is solved. Can you describe a bit more about how you're using MR? Is this an ad hoc query? A predictable report? Time based? --- sent from a tiny portion of the hive mind... in

Maps with multiple buckets

2013-12-17 Thread Bryce Verdier
Hi All, I have a question concerning map-reduce. I have two buckets with counters enabled that have similar keys to track two different metrics. At the moment in order to combine these two datasets together I have to make 2 different map-reduce queries and combine the data within the client.

accessing CRDTs in riak 2.0

2013-12-17 Thread James Moore
Hey all, I'm working on testing out some of the CRDT features but haven't been able to sort through the incantations to store/query any CRDT other than a counter. any tips? thanks, --James ___ riak-users mailing list riak-users@lists.basho.com http://

Re: May allow_mult cause DoS?

2013-12-17 Thread Brian Roach
On Tue, Dec 17, 2013 at 10:28 AM, Viable Nisei wrote: > Here you can check our code sample (in java) reproducing this behavior: > https://bitbucket.org/vsnisei/riak-allow_mult_wtf > ... > Anyway, looks like that some DoS/DDoS attack approach utilizing this > behavior may be proposed. We should onl

Re: accessing CRDTs in riak 2.0

2013-12-17 Thread James Moore
mainly a spec for the straight http or pb APIs, as far as I understand the only client with explicit support right now is erlang. thanks! --James On Tue, Dec 17, 2013 at 3:06 PM, Brian Roach wrote: > Hi James, > > Do you mean via the Erlang client, or one of the other client libs, or ... > ?

Re: accessing CRDTs in riak 2.0

2013-12-17 Thread Brian Roach
Hi James, Do you mean via the Erlang client, or one of the other client libs, or ... ? Thanks, - Roach On Tue, Dec 17, 2013 at 12:42 PM, James Moore wrote: > Hey all, > > I'm working on testing out some of the CRDT features but haven't been able > to sort through the incantations to store/query

Re: May allow_mult cause DoS?

2013-12-17 Thread Reid Draper
Hey, Are you _resolving_ the siblings that you create? It sounds like you’re purposely creating siblings and not resolving them, as I read things like ‘only 80-100 values per … keys’. Riak is not intended to be used this way. 80 siblings is a lot, and will dramatically decrease performance for tha

Riak Recap for December 10 - 17

2013-12-17 Thread Hector Castro
Greetings and salutations, Here is yet another installment of the Riak Recap. Be sure to keep all of the videos linked below playing while you online shop for the rest of the people on your holiday gift list. If you can't figure out what to get someone, just share a link and give the gift of Riak

May allow_mult cause DoS?

2013-12-17 Thread Viable Nisei
Hi. Recently we've described that something is going unexpectedly. We are using Riak 1.4.2 with some buckets with allow_mult=true. We've tried our app under load then found that... concurrently writes into bucket with allow_mult turning Riak into irresponsible slowpoke and even crash it. Core i3

Re: fsm.get time increase on a less busy system

2013-12-17 Thread kzhang
Hi Sean, To answer your questions -- yeah, the cluster is read heavy, gets:puts ratio is ~80:1. In the past day, node gets averages 1.4k and node puts averages 20. -- View this message in context: http://riak-users.197444.n3.nabble.com/fsm-get-time-increase-on-a-less-busy-system-tp4030107p403

Re: fsm.get time increase on a less busy system

2013-12-17 Thread Luke Bakken
Since you're on 1.4, could you please run "riak-debug" on every node in your cluster? Please mail me directly and we'll come up with a way to get them delivered. Could you please also provide a description of the cluster's typical workload? Any monitoring graphs or other statistics would be helpfu

Re: fsm.get time increase on a less busy system

2013-12-17 Thread kzhang
Thanks for the reply. The version is riak 1.4.0. I am looking at node.get.fsm.time.mean and node.get.fsm.time.median. Both increased. -- View this message in context: http://riak-users.197444.n3.nabble.com/fsm-get-time-increase-on-a-less-busy-system-tp4030107p4030112.html Sent from the Riak

Re: fsm.get time increase on a less busy system

2013-12-17 Thread Luke Bakken
Hello, Could you provide the Riak version you're using? Which of the get times are increasing mostly? 95th, 99th, 100th etc? Thanks. -- Luke Bakken CSE lbak...@basho.com On Tue, Dec 17, 2013 at 5:44 AM, kzhang wrote: > we have a 5 node cluster, in the past few days, all the counters indicate a

Re: fsm.get time increase on a less busy system

2013-12-17 Thread Sean Cribbs
How heavy is the traffic against the cluster? Is your workload mostly gets? Which get_fsm stats are growing, is it all of the percentiles or just the max/100%? On Tue, Dec 17, 2013 at 7:44 AM, kzhang wrote: > we have a 5 node cluster, in the past few days, all the counters indicate a > less bus

Re: Error 500 while creating admin user in Riak-CS

2013-12-17 Thread Hector Castro
Hello Holger, If you are modifying `cs_root_host` from the default, it must be set to the fully qualified domain name (FQDN) of your Riak CS endpoint. More details on this can be found in the Direct subsection of the Proxy vs. Direct Riak CS documentation. [0] If that doesn't resolve the issue, p

Re: riak-cs 503 errors

2013-12-17 Thread Hector Castro
Hi Georgio, Can you please provide your app.config files for Riak, Riak CS, and Stanchion along with log output of the errors you're seeing? -- Hector On Tue, Dec 17, 2013 at 7:00 AM, Georgio Pandarez wrote: > Hi Guys, > > I've tried a simple benchmark on riak-cs against a 5 node cluster on a

fsm.get time increase on a less busy system

2013-12-17 Thread kzhang
we have a 5 node cluster, in the past few days, all the counters indicate a less busy system (lower cpu, more available memory, less puts and gets, less network traffic), however get time increased. I am not sure what's going on. I checked the logs, nothing jumped to me. -- View this message i

riak-cs 503 errors

2013-12-17 Thread Georgio Pandarez
Hi Guys, I've tried a simple benchmark on riak-cs against a 5 node cluster on a 100mbit private network with the linux optimisations applied from the site. At about 200 simultaneous requests per second against a single node everything is OK, increasing this to 500 I will start seeing 503's back f

Error 500 while creating admin user in Riak-CS

2013-12-17 Thread Holger Amberg
Hi, i am trying to install riak-cs according to your cookbook but i am now stuck at the admin user creation. I checked all config files, all ips do match against each other. All services responding to ping requests. I have no idea at the moment, maybe someone is able to assist me. cat /etc/riak-c