[ANN] Riak San Diego and Riak Cleveland Meetups
Hi All, There are two brand-spanking-new Riak meetups happening next week in the U.S. that should be on your radar: # San Diego I'll be in San Diego on October 10th with Basho hacker Brett Hazen to make the San Diego Riak Meetup [1] official. We'll be at the Sony offices and I'll be talking about Riak 2.0 and some common Riak use cases. Join us if you're in the area. # Cleveland Matt Snyder is getting a Cleveland Riak Meetup [2] off the ground. It's slated for October 10th and if you're within driving distance of the "Forest City," you should make an appearance. And if you can't make either of these, buy a ticket for RICON West [3] to make up for it. :) See you soon (hopefully). Mark twitter.com/pharkmillups [1] http://www.meetup.com/Riak-San-Diego/events/142413432/ [2] http://www.meetup.com/Cleveland-Riak/events/139643962/ [3] http://ricon-west-2013.eventbrite.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Deleting data from LevelDB backend
Hi all, so is this a common problem? I was just casually playing around with the LevelDB backend, and observed the disk space was not freed, even though all my keys are deleted. Riak 1.4.2 Thanks ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: 2i at large scale?
Hey Reid, Just wanted to say thanks for your last thoughts on my 2i thread. I am sorry I didn't reply on a good timing, I just realized that now. Best ~W On Wed, Sep 25, 2013 at 3:44 PM, Reid Draper wrote: > > On Sep 25, 2013, at 4:35 PM, Wagner Camarao wrote: > > What size page are you using (ie. how many results per query)? > > A: 10 > > > If I understood correctly, you're paginating through a few million results > total. If so, I'd try setting your page size much larger: try 1000. > > > > When you said the results would sometimes take three minutes, is that per > page, or to paginate through all of the results? > > A: I don't observe any difference by paging the first or any next page. > That wait time is only when I start riak and run the first request > (whatever that request is, paging, key lookup, or just getting a reference > to a bucket). > > > So performance levels out after the first couple of requests? If so, this > might be explained by the leveldb cache being built up. > > > > Are you observing CPU and memory utilization while these stalls happen? > > A: Yes, I see both CPU and memory but nothing above 50% of use. If I do > bucket.keys (yes, not recommended) then it's the only way I get my CPU > usage close to 100%. I don't do that as part of my benchmarking. I did it a > couple times just to see it happening, and actually none of these times > took riak down. > > > Do you have swap disabled? > > A: Nope. Why you would recommend doing so? Could there be any downsides? > > > You can read about our rationale for this here [1]. > > [1] http://docs.basho.com/riak/latest/ops/tuning/linux/ > > > > On Wed, Sep 25, 2013 at 2:18 PM, Reid Draper wrote: > >> >> On Sep 25, 2013, at 3:39 PM, Wagner Camarao >> wrote: >> >> Reid, >> Thanks for bringing that up and yes I'm using paginated 2i. >> >> >> * What size page are you using (ie. how many results per query)? >> * When you said the results would sometimes take three minutes, is that >> per page, or to paginate through all of the results? >> * Are you observing CPU and memory utilization while these stalls happen? >> * Do you have swap disabled? >> >> Reid >> >> > > ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
simplest way to log/trace queries?
Hi all, I am using C# corrugatedIron client. I would like to get a verbose log of all of my Riak queries and calls. To help during development. Whether it's on the client side, or on the server side (maybe some lager settings in app.config?) doesnt matter. I have been searching for a way to get this type of log output but seems to be stumped. Thanks, Alex ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: simplest way to log/trace queries?
Hello Alex, CI doesn't currently have a loggin facility which supports this, I am sorry to say. I agree this would indeed be handy. Jeremiah and I have discussed the possibility of wiring in the likes of Log4net or NLog to support various levels and types of logging, but we haven't yet managed to find the time to do so. Bear in mind that adding this kind of logging does have impact on various things, including performance, and unfortunately isn't as simple as just putting something at the exit points because most of the traffic is PBC-encoded. May I request that you open a ticket on our github repo[1] to kick off a public discussion about this so that we can find a way of moving forward that's suitable? Many thanks. OJ [1]: https://github.com/DistributedNonsense/CorrugatedIron On 02/10/2013, at 10:16 AM, Alex Rice wrote: > Hi all, I am using C# corrugatedIron client. I would like to get a > verbose log of all of my Riak queries and calls. To help during > development. Whether it's on the client side, or on the server side > (maybe some lager settings in app.config?) doesnt matter. I have been > searching for a way to get this type of log output but seems to be > stumped. Thanks, > Alex > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com signature.asc Description: Message signed with OpenPGP using GPGMail ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Using /etc/hosts entry and not ip in configuration files ..
Mike,
Based on the Chef line you have there, the issue is that you aren't
providing a FQDN. If the name is just "-int" then it isn't a
fully qualified domain name and therefore Erlang complains.
Hopefully that clears up the confusion.
On Sat, Sep 21, 2013 at 8:12 PM, Mike Nathe wrote:
> Hi Alex.
>
> thanks a bunch for the info and the link to the white paper.
>
> Unfortunately we still haven't been able to use a domain name in the
> vm.args successfully.
>
> We use Chef scripts to build our EC2 instances (OpsWorks).
> The only difference in the scripts is:
>
> # use domain name
> node.set['riak']['args']['-name'] = "riak@#{node['hostname']}-int"
> # use ip
> node.set['riak']['args']['-name'] = "riak@#{node['ipaddress']}"
>
> The deployment with the ipaddress works great.
> The deployment with the hostname does start the server but the tools do
> not work ( returns "Node is not running").
> We checked /var/log/riak and the console.log and error.log looked clean,
> though there was an erlang dump.
>
> Any insight into this would be greatly appreciated.
> Thanks again.
>
> Cheers,
> Michael
>
>
>
> The result of a simple test for hostname deployment:
>
> ubuntu@riaknode1:~$ sudo /usr/local/riak/bin/riak-admin ringready
> Node is not running!
>
>
> The result of a simple test for ipaddress deployment:
>
> ubuntu@riaknode1:~$ sudo /usr/local/riak/bin/riak-admin ringready
> TRUE All nodes agree on the ring ['riak@172.31.44.73']
>
>
>
>
> On 19 September 2013 16:58, Alex Moore wrote:
>
>> Hey Mike,
>>
>> Another option for your app.config would be to bind everything to
>> "0.0.0.0", which will make Riak listen on all interfaces. This combined
>> with using a domain name in the vm.args should prevent you from having to
>> do renames/changing ips in the config files.
>> If you do this, please consider using a VPC to limit access to the
>> machines.
>>
>> A good resource to read over is Amazon's Riak Whitepaper:
>> http://media.amazonwebservices.com/AWS_NoSQL_Riak.pdf, as it goes
>> through some operation considerations and tuning points that might be
>> useful to you.
>>
>> Thanks,
>> Alex
>>
>> On September 19, 2013 at 6:52:29 PM, Mike Nathe (mna...@fathom-i.com)
>> wrote:
>>
>> hi.
>>
>> we are trying to run Riak in the Amazon cloud (using OpsWorks).
>> With every restart of the servers the ip addresses change so using an
>> entry in the /etc/hosts instead of an IP looks like a great idea.
>>
>> Google's answer is:
>>
>> http://lists.basho.com/pipermail/riak-users_lists.basho.com/2011-December/006912.html
>>
>> Just to make sure: Riak only supports IP addresses and not DNS names in
>> the config files.
>> Though in your docs it still says:
>> "Riak identifies other machines in the ring using Erlang identifiers
>> (, ex: riak@10.9.8.7)."
>>
>>
>> The error logged when changing our config from something
>> like 172.31.41.138 to riaknode2-ext is:
>>
>> 2013-09-19 21:49:53.383 [error] <0.113.0> Supervisor riak_core_sup had
>> child "http_riaknode2-ext:8098" started with
>> webmachine_mochiweb:start([{name,"http_riaknode2-ext:8098"},{ip,"riaknode2-ext"},{port,8098},{nodelay,true},{log_dir,"log"},...])
>> at undefined exit with reason
>> {'EXIT',{{badmatch,{error,einval}},[{mochiweb_socket_server,parse_options,2},{mochiweb_socket_server,start,1},{supervisor,do_start_child,2},{supervisor,start_children,3},{supervisor,init_children,2},{gen_server,init_it,6},{proc_lib,init_p_do_apply,3}]}}
>> in context start_error
>>
>> Thanks a bunch.
>>
>> Have a great day.
>> Michael
>>
>>
>
> ___
> riak-users mailing list
> riak-users@lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>
>
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Riak on SAN
Does this make sense? -- Guy Morton Web Development Manager Brüel & Kjær EMS This e-mail is confidential and may be read, copied and used only by the intended recipient. If you have received it in error, please contact the sender immediately by return e-mail. Please then delete the e-mail and do not disclose its contents to any other person. ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Riak on SAN
Could you do it? Sure. Should you do it? No. An advantage of Riak is that you can avoid the cost of SAN storage by getting duplication at the machine level rather than rely on your storage vendor to provide it. Running Riak on a SAN also exposes you to the SAN becoming your bottleneck; you only have so many fiber/iSCSI ports and a fixed number of disks. The risk of storage contention is high, too, so you can run into latency issues that are difficult to diagnose without looking into both Riak as well as the storage system. Keeping cost in mind, too, SAN storage is about 10x the cost of consumer grade SSDs. Not to mention feature licensing and support... The cost comparison isn't favorable. Please note: Even though your vendor calls it a SAN, that doesn't mean it's a SAN. On Oct 1, 2013 11:08 PM, "Guy Morton" wrote: > Does this make sense? > > -- > Guy Morton > Web Development Manager > Brüel & Kjær EMS > > This e-mail is confidential and may be read, copied and used only by the > intended recipient. If you have received it in error, please contact the > sender immediately by return e-mail. Please then delete the e-mail and do > not disclose its contents to any other person. > > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
