Re: Riak in Docker - Error folding keys - incomplete_hint

2015-10-22 Thread Hector Castro
Can't say I've paid enough attention to the logs in my single-machine Riak within Docker setups to confirm. Do you have the container image definitions somewhere public? That may help someone reproduce the issue. Also, did you ensure that the Riak data directory is setup as a Docker volume? Other

[ANN] Riak 1.4.10

2014-07-14 Thread Hector Castro
Hi all, Today Basho released a minor update to Riak and Riak Enterprise (version 1.4.10). This is a bug-fix release that addresses a possible LevelDB compaction loop and an edge case around dead cluster restores with `riak-admin reip`. In addition, two optional `riak_search` configuration options

Re: CS: Query path for storage/access statistics appears wrong?

2014-07-02 Thread Hector Castro
Hey Toby, Are you authenticating the request that uses query string parameters? -- Hector On Wed, Jul 2, 2014 at 1:23 AM, Toby Corkindale wrote: > Hi, > Maybe I'm doing something wrong, but I find I can only access the Riak > CS storage/access information per-user by using the s3-compatible >

Re: Riak for streaming video

2014-06-26 Thread Hector Castro
use cases would be difficult. > Thanks, > Alex > > > On Thu, Jun 26, 2014 at 9:28 PM, Hector Castro wrote: >> >> Hi Alex, >> >> For this type of problem, you may want to look into Riak CS. [0] It is >> an object storage platform built on top of Riak. >&

Re: Riak for streaming video

2014-06-26 Thread Hector Castro
Hi Alex, For this type of problem, you may want to look into Riak CS. [0] It is an object storage platform built on top of Riak. When you GET an object from Riak CS, you can specify a Range header to get the object by its byte offset. [1] -- Hector [0] http://docs.basho.com/riakcs/latest/ [1]

Re: [Python client] combining mapreduce with riak search

2014-06-10 Thread Hector Castro
Hey, Have you taken a look at the MapReduce API documentation outlined below? There is a specific method for combining search and MapReduce: http://basho.github.io/riak-python-client/query.html#mapreduce -- Hector On June 2, 2014 at 2:51:47 PM, skydelta98 (skydelt...@gmail.com) wrote: > Hi, >

Re: riak-cs reclaim storage

2014-06-09 Thread Hector Castro
This mailing list entry was discussed a bit in IRC today. Below are a few notes from the exchange between Tyler and our very own Joe Caswell. Hopefully they help provide some insight into Riak CS GC for others: - Riak CS data blocks are stored in Bitcask. - `riak-admin vnode-status` outputs sev

[ANN] Riak 1.4.9

2014-06-03 Thread Hector Castro
Hi all, Today Basho released a minor update to Riak and Riak Enterprise (version 1.4.9). This is a bug-fix release that addresses regressions with the memory backend and includes enhancements to LevelDB compaction. Release notes and package downloads are available below: - https://github.com/bas

Re: Error starting riak server

2014-05-20 Thread Hector Castro
[{file,"escript.erl"},{line,277}]}, > > {init,start_it,1,[]}, > > {init,start_em,1,[]}]}} > > make: *** [deps] Error 1 > > > > Thanks, > > Rachana > > > > From: Rachana S

Re: Error starting riak server

2014-05-19 Thread Hector Castro
ng - First otp_src_R14B02 and then otp_src_R15B01" >>> >>> More than likely you've compiled Riak with the old version or erlang. >>> >>> As Hector mentioned, you may want to use an RPM rather than building >>> from source. You also want to remove R

Re: Error starting riak server

2014-05-09 Thread Hector Castro
Hi Rachana, Is there any reason why you didn't elect to install via RPM? [0] That path may be easier to get started with than compiling Erlang and Riak from source, as we bundle Erlang into the RPM. -- Hector [0] http://docs.basho.com/riak/latest/ops/building/installing/rhel-centos/ On Fri, May

Re: Riak cluster on Docker

2014-05-02 Thread Hector Castro
linking via Ambassador containers. [1] I have yet to prove this out myself. -- Hector [0] https://github.com/hectcastro/docker-riak/issues/10 [1] http://docs.docker.io/use/ambassador_pattern_linking/ On Thu, May 1, 2014 at 6:50 PM, john.kline wrote: > > > Hector Castro has a wonderfu

Re: Highlighting in full-text search

2014-05-01 Thread Hector Castro
Hi Chaim, In order to take advantage of the Riak Search/Solr highlighting capabilities from Python (right now), you're best bet may be to use a Python Solr client for queries. The Riak client for Python is still not 100% compatible with Riak 2.0 (although the master branch has some support). [0]

Re: Any docs on Yokozuna with erlang client?

2014-03-20 Thread Hector Castro
Hey Buri, The snippets in our search documentation [0] have tabs for different languages (Ruby, Python, Erlang, etc). -- Hector [0] http://docs.basho.com/riak/2.0.0pre11/dev/using/search/ On Thu, Mar 20, 2014 at 10:28 AM, Buri Arslon wrote: > Hi guys! > > In yokozuna github page, I see only ht

Re: Resources needed ot hanlde a 12TB cluster, and replication factor with RAID

2014-02-27 Thread Hector Castro
s give you the ability to survive machine failures and remain available during network partitions A lot depends on the type of availability you want to give up when failures occur. > On Thu, Feb 27, 2014 at 6:18 AM, Hector Castro wrote: >> >> Hi Marco, >> >> Please see m

Re: Resources needed ot hanlde a 12TB cluster, and replication factor with RAID

2014-02-27 Thread Hector Castro
Hi Marco, Please see my responses inline below. -- Hector On Thu, Feb 27, 2014 at 3:04 AM, Marco wrote: > Hi everybody, > > I have a couple of questions regarding the performance requirements for a > 12TB Riak cluster, specifically: Have you taken the default replication factor of 3 here, or

Re: Why can't you delete a user using the riak-cs API?

2014-02-24 Thread Hector Castro
David, Unfortunately, there is no good answer around the ability to delete users. There simply isn't a way to do it via the Riak CS APIs. As an alternative, you can disable inactive users. User records (stored within LevelDB) are small. The main issue with keeping users around is that bucket owne

Re: Size of bucket

2014-02-24 Thread Hector Castro
Hi Charles, Within Riak buckets, metadata around size (number of objects or bytes houses) isn't tracked. In order to calculate something like this, my advice would be to increment another key (probably prefixed by user ID) by whatever metrics you're looking to track at the same time writes by that

Re: Facing issue related to search

2014-02-19 Thread Hector Castro
Hi Abhishek, The Riak Python client does not yet have official support for the version of Riak Search in Riak 2.0.0pre11. That said, you should be able to add values to a Riak 2.0 cluster (with search configured and enabled) and then query those values using a Python Solr client. In addition, to

Re: yokozuna Issues

2014-02-19 Thread Hector Castro
Bryce, There appears to be an incompatibility with the JVM version you have available on the system. Can you please provide the output of `java -version`? FWIW, we've been using Oracle JDK 7u25 internally for testing. -- Hector On Thu, Feb 13, 2014 at 12:07 PM, Bryce Verdier wrote: > Thanks f

Re: Stats

2014-02-05 Thread Hector Castro
Bryce, `node_gets` + `node_puts` give you the number of operations per minute (for that node). In order to get operations per second, you can simply divide that result by 60. -- Hector On Wed, Feb 5, 2014 at 12:10 AM, Bryce wrote: > Hey all, > > Within all the /stats url, is something equivale

Re: mongoimport and java-riak-client

2014-02-03 Thread Hector Castro
Hi Mark, Responses are inline below. -- Hector On Sun, Feb 2, 2014 at 5:17 AM, markrthomas wrote: > Hello > > mongoimport is blazingly fast compared with my java-riak-client inspired > groovy load script (using pb). I'm just trying to import JSON data for a > small dataset. There's just no com

Re: Node online and cannot run riak-admin test

2014-01-31 Thread Hector Castro
Hi Jose, Did you ensure that you restarted the node after changing the Protocol Buffers port to ? Your attempt to telnet attempt to the configured PB port should succeed. -- Hector On Fri, Jan 31, 2014 at 4:48 AM, jose wrote: > i have create a 1 node at virtualbox with ubuntu 12.04 with 51

Re: Is there a better way to make users in Riak CS?

2014-01-28 Thread Hector Castro
Hey David, There are two approaches that I'm aware of: 1. With Chef, we've automated the steps required to create an administrative user [0] 2. Use this [1] escript to write a user record to Riak CS with a specific user account We are definitely working to make the process of creating administra

Re: riak-2 configuration questions

2014-01-22 Thread Hector Castro
On Wed, Jan 22, 2014 at 10:33 AM, Hector Castro wrote: > Hi Bryce, > > Responses are line below. > > -- > Hector > > > On Mon, Jan 20, 2014 at 3:49 PM, Bryce Verdier wrote: >> How does one change the default bucket properties in riak2? > > `n_val` of the de

Re: riak-2 configuration questions

2014-01-22 Thread Hector Castro
Hi Bryce, Responses are line below. -- Hector On Mon, Jan 20, 2014 at 3:49 PM, Bryce Verdier wrote: > How does one change the default bucket properties in riak2? `n_val` of the default bucket properties can be set with `riak_core.default_bucket_props.n_val` https://github.com/basho/riak_core

Re: Performance Tuning in OmniOS

2014-01-21 Thread Hector Castro
Hello, Can you please clarify what type of disk you are using within AWS? EBS, EBS with PIOPS, instance storage? In addition, maybe some details on volume sizes and instance types. These details may help someone attempting to answer your question. -- Hector On Tue, Jan 21, 2014 at 8:11 AM, Har

Re: riak-2.0.0 preview refuses to start when nodename is changed to the ip or hostname of the machine

2014-01-16 Thread Hector Castro
Hi John, Did you start this Riak instance successfully with `riak@127.0.0.1` before changing `nodename`? If you did, changing the `nodename` can cause a failure similar to what you're seeing. >From here your options are: 1. Discard the existing ring metadata by removing the contents of the ring

[ANN] Riak 1.4.7

2014-01-13 Thread Hector Castro
Hello All, Riak 1.4.7 has been pushed to S3 for download from http://docs.basho.com/riak/latest/downloads/, and is also available via our apt and yum repositories. This is primarily a bug fix release including: - Fix for Bitcask's NIF mode (native IO operations instead of Erlang) that prevented

Re: 404 Error: Object Not Found

2013-12-19 Thread Hector Castro
Is your request being made against a new bucket? If not, have you altered your default bucket properties? Are you overriding any default bucket properties in your request? It might help if you could paste your test commands along with updated app.configs. -- Hector On Wed, Dec 18, 2013 at 1:16

Re: /riak-cs/stats broken

2013-12-18 Thread Hector Castro
Hi Dan, Apologizes for the delayed response. I reproduced the HTTP 403 when `admin_auth_enabled` is set to `false`, but successfully retrieved stats with it set to `true`: $ riak-cs version 1.4.2 $ grep "admin_auth_enabled" /etc/riak-cs/app.config {admin_auth_enabled, true}, $ ./s3c

Riak Recap for December 10 - 17

2013-12-17 Thread Hector Castro
outube.com/watch?v=Dpf9OqO-wK8 - RC hangout 004 Noah Isaacson posted a Dockerfile to create a Riak container to the Docker Index. - https://index.docker.io/u/nisaacson/riak/ Hector Castro hacked on a Vagrant project over the weekend to setup a local Riak backed Datomic instance. - https://github.com

Re: Error 500 while creating admin user in Riak-CS

2013-12-17 Thread Hector Castro
Hello Holger, If you are modifying `cs_root_host` from the default, it must be set to the fully qualified domain name (FQDN) of your Riak CS endpoint. More details on this can be found in the Direct subsection of the Proxy vs. Direct Riak CS documentation. [0] If that doesn't resolve the issue, p

Re: riak-cs 503 errors

2013-12-17 Thread Hector Castro
Hi Georgio, Can you please provide your app.config files for Riak, Riak CS, and Stanchion along with log output of the errors you're seeing? -- Hector On Tue, Dec 17, 2013 at 7:00 AM, Georgio Pandarez wrote: > Hi Guys, > > I've tried a simple benchmark on riak-cs against a 5 node cluster on a

Re: 404 Error: Object Not Found

2013-12-13 Thread Hector Castro
Hopefully this one resolves it: I just setup a single node on Ubuntu 12.04 using Vagrant and attempted to walk through your steps. In the process, I noticed that you are issuing the following `curl` command and receiving a 404: $ curl -v -XPUT http://10.0.2.15:8098/sessions/GA123D971 -H "content-

Re: RiakCS usage data not found

2013-12-12 Thread Hector Castro
> > > On Wed, Dec 11, 2013 at 11:02 PM, Hector Castro wrote: >> >> Gavin, >> >> After some more digging, it looks like the issue you're facing is an >> open issue against Riak CS: >> >> https://github.com/basho/riak_cs/issues/746 >> >> A

Re: Can riak use multiple disk partitions ?

2013-12-12 Thread Hector Castro
Hi, Riak exposes a `platform_data_dir` setting that allows you to tell it where to store your data. Unfortunately, there is currently no support for providing multiple data directories (outside of a multi_backend scenario). In practice, users use mdadm and LVM or ZFS to create a single volume tha

Re: RiakCS usage data not found

2013-12-11 Thread Hector Castro
> Finished storage calculation in 0 seconds. > > > I tried Riak-CS-1.4.0 and latest Riak-CS, both get no luck. was that some > configuration issue? > > Thanks. > Gavin > > > > On Mon, Dec 9, 2013 at 10:08 PM, Hector Castro wrote: >> >> Hi Gavin, >

Re: riak nagios script

2013-12-10 Thread Hector Castro
Hello Kathleen, Have you executed the `make encrypt` target to build the `check_node` binary? [0] From there, I copied it to the Riak node and invoked it like this: $ /usr/lib/riak/erts-5.9.1/bin/escript check_node --node riak@127.0.0.1 riak_kv_up OKAY: riak_kv is running on riak@127.0.0.1 I use

Re: RiakCS usage data not found

2013-12-09 Thread Hector Castro
Hi Gavin, How have you configured your `storage_schedule`? It's possible that the job for calculating storage statistics hasn't occurred (or finished) yet. You can manually trigger storage usage calculation by invoking the following command: sudo riak-cs-storage batch >From there, you can retri

Re: riak disk usage

2013-12-02 Thread Hector Castro
ded to the technical preview version 2.0... so far, it didn't help. > > Thank you, > Stefan. > > > On Sat, Nov 30, 2013 at 8:27 PM, Hector Castro wrote: >> >> Hello Silasi, >> >> Can you please explain the process you're using to

Re: riak disk usage

2013-11-30 Thread Hector Castro
Hello Silasi, Can you please explain the process you're using to add the image/video data into Riak CS? Are you overwriting objects or using multipart upload? -- Hector On Thu, Nov 28, 2013 at 5:33 AM, Silasi Stefan wrote: > Hello, > > I'm preparing an evironment for an image/video storage web

Re: Using Riak to perform aggregate queries

2013-11-22 Thread Hector Castro
On Thu, Nov 21, 2013 at 4:47 PM, NC wrote: > Our use-case is very similar to what Chris has described till now. I am new > to the riak store and have a background with RDBMS. > > Going over this thread, there was a suggestion to pre-compute things. I am > trying to understand what pre-compute exac

Re: 404 Error: Object Not Found

2013-11-21 Thread Hector Castro
Hi Ari, I applied the same changes you described to a local single instance Riak setup and was unable to reproduce your issue. Can you please answer/provide the following? - Double-check your configuration changes - Did you change IP addresses in app.config or vm.args? - Did you startup Riak bef

Re: Forcing Siblings to Occur

2013-11-13 Thread Hector Castro
The `put_index` snippet in the following blog post actually forces the creation of siblings (while `get_index` resolves them by doing a set union): http://basho.com/index-for-fun-and-for-profit/ As John said, you definitely want to be careful not to create too many siblings because that'll impact

Re: Installing using the chef recipe on ubuntu 12.04

2013-11-05 Thread Hector Castro
Hey Sujay, My responses are inline below. -- Hector On Tue, Nov 5, 2013 at 10:19 AM, Sujay Mansingh wrote: > Hello > > I've been looking at moving a mongo cluster to use riak. > > I have a question: how do people install riak? > I tried using the latest chef recipe from basho on an ubuntu 12.0

Re: Timeout problems, Riak Python Client with protocol buffers

2013-11-04 Thread Hector Castro
Hey Finkle, I attempted to reproduce your issue on my Mac and wasn't able to trigger the error same error: $ ./env/bin/pip freeze protobuf==2.4.1 riak==2.0.1 riak-pb==1.4.1.1 wsgiref==0.1.2 $ ./env/bin/python --version Python 2.7.5 Do you have any additional details on your Ubuntu environment? W

Re: Riak and Riak CS Community Survey

2013-10-23 Thread Hector Castro
t;> submitted the survey, but realized later that this is one of the data >> types I would love to see in Riak: >> >> http://redis.io/commands#sorted_set >> >> >> On Tue, Oct 15, 2013 at 2:25 PM, Hector Castro wrote: >> > Hi everyone, >> > >

Riak and Riak CS Community Survey

2013-10-15 Thread Hector Castro
Hi everyone, We'd sincerely appreciate it if you could take some time to complete our *third* quarterly Riak and Riak CS community survey. Similar to the last one, all contributors to the survey will be sent Basho swag (if we still owe you swag for the last community survey, we didn't forget about

Re: init script

2013-09-26 Thread Hector Castro
Jorge, Our packages are built using the contents of the node_package repository. [0] The init script for Debian is included. [1] --  Hector [0] https://github.com/basho/node_package [1]  https://github.com/basho/node_package/blob/develop/priv/templates/deb/init.script On September 26, 2013 at

Re: Riak and ec2 with vm.args - Node 'r...@ip-10-234-117-74.eu-west-1.compute.internal' not responding to pings.

2013-09-15 Thread Hector Castro
VPC is not a requirement, although it is definitely recommended for greenfield projects. --  Hector On September 16, 2013 at 12:46:10 AM, David Montgomery (davidmontgom...@gmail.com) wrote: I am not using VPC.  Is using VPC required? On Mon, Sep 16, 2013 at 12:16 AM, Jeremiah Peschka wro

Re: Riak and ec2 with vm.args - Node 'r...@ip-10-234-117-74.eu-west-1.compute.internal' not responding to pings.

2013-09-15 Thread Hector Castro
Hey David, I created a m1.small Ubuntu 12.04 x64 instance within EC2-Classic and executed the following commands on it: https://gist.github.com/hectcastro/6576714 Please take a look to see if I did anything differently. --  Hector On September 15, 2013 at 12:18:25 PM, Jeremiah Peschka (jerem

Re: Howto add Users without anonymous / whats the deal with URLs

2013-09-10 Thread Hector Castro
Hi Andre,We are working to improve the user management tooling for Riak CS. A pretty much read-only prototype CLI can be found under our basho-labs GitHub organization. [0]If you don't want to use Riak CS Control to manage users, your best alternatives right now are:- s3curl- fogExamples of how to

Re: Bootstrapping Riak-CS with an admin user

2013-08-29 Thread Hector Castro
Hi Daniel,It is a bit tricky to automate.While this isn't a solution for Puppet, I created a Chef cookbook [0] that creates a CS admin user, populates the proper configuration files, and restarts services. We make use of this cookbook in our Vagrant Riak CS cluster project [1] [2].Hopefully this is

[ANN] RICON West early bird pricing ends Thursday

2013-08-27 Thread Hector Castro
Hi all, RICON [1] is Basho's celebration at the intersection of theory and practice in distributed systems. RICON West [2] in San Francisco is fast approaching. Our early bird pricing [3] ends early Thursday morning. At $299 a ticket, we're making attendance as painless as possible, but this is

Re: Riak CS Questions

2013-08-19 Thread Hector Castro
Hi James, Although it is possible to interact with Riak and Riak CS on same cluster, we'll generally recommend that you use one Riak cluster to back CS and another for standard Riak usage. You can store any application data in Riak CS. Just be aware that you'll lose some of the query mechanisms R

Re: Changing the filesystem

2013-08-13 Thread Hector Castro
Hi Dilip, Are you making these changes to Riak's app.config? If the `riak-cs start` command isn't working, that's generally an indicator that Riak is not running. What happens when you execute `riak ping`? -- Hector On Tue, Aug 13, 2013 at 9:20 AM, dilip kumar wrote: > Hi, > > How do I change

Re: Practical Riak cluster choices in AWS (number of nodes? AZ's?)

2013-08-12 Thread Hector Castro
On Mon, Aug 12, 2013 at 2:38 PM, Dave Martorana wrote: > Jared - thanks for the links. I'm in the same boat with Brady with weighing > deployment options in AWS. > > Jeremiah - isn't EBS the only option once your data starts reaching into the > hundreds-of-gigs? Several instances give you > 1TB o

Re: GPG error in Apt

2013-08-07 Thread Hector Castro
Hey Matt, That issue should be resolved now. Please ping us if you hit any further issues. -- Hector On Tue, Aug 6, 2013 at 7:42 PM, Matt Black wrote: > Hey Basho peeps, > > Looks like you might have signed the latest Riak release with new > certificate (or something) - Apt is reporting that t

RICON code contest and Riak training

2013-08-05 Thread Hector Castro
Hi everyone, We wanted to single out two RICON announcements: ## RICON code contest We're putting up *five free* tickets to RICON West. If you want one, here's what you need to do: - Write a sample app leveraging either Counters or Yokozuna - Write a packaging/deployment tool with BOSH or Packe

Re: Need help regarding riak bytes in / bytes out of data

2013-08-01 Thread Hector Castro
Hi Mahesh, Can you please confirm that you're executing steps similar to what's in this Gist? [0] If your steps are similar, please provide your versions of Riak and Riak CS, along with the `app.config` files. -- Hector [0] https://gist.github.com/hectcastro/126b5657f228096775c6 On Thu, Aug 1,

Re: setting ACL in a put request, riak cs 1.3.1-1

2013-07-30 Thread Hector Castro
Hey Eugene, I believe I reproduced the issue you are seeing. I went ahead and created an issue for the Riak CS team to review. [0] -- Hector [0] https://github.com/basho/riak_cs/issues/631 On Tue, Jul 30, 2013 at 9:41 PM, Kota Uenishi wrote: > Eugene, > > Congratulations, and thank you! You ha

Re: Setting up my Riak architecture

2013-07-24 Thread Hector Castro
Hi Maksymilian, My response is inline below. -- Hector On Wed, Jul 24, 2013 at 8:51 AM, prog112 wrote: > > Hello. > I'm currently developing my database relationships with my other server > applications and I'm having a hard time figuring out how to approach it. > Here's what I'm wondering abo

Re: [ANN] Riak Community Survey

2013-07-23 Thread Hector Castro
Basho swag and discounted RICON tickets. One lucky contributor will be selected to receive a free ticket to RICON West! -- Hector On Mon, Jul 15, 2013 at 3:16 PM, Hector Castro wrote: > Hi everyone, > > We'd sincerely appreciate it if you could take some time to complete >

Riak Recap for July 11 - 22nd

2013-07-22 Thread Hector Castro
Hello all, Today's recap is coming to you from across the street of Eastern State Penitentiary in partly cloudy Philadelphia. First and foremost, we're excited to share the new Riak docs reorg and redesign. - http://docs.basho.com Jeremiah Peschka announced CorrugatedIron 1.4 with support for Ri

Re: riak 1.4.0 upgrade failed

2013-07-19 Thread Hector Castro
Hey Kathleen, Did you make sure to stop Riak before upgrading as described here? [0] Looks like the Riak service may still be running. -- Hector [0] http://docs.basho.com/riak/latest/cookbooks/Rolling-Upgrades/#RHEL-CentOS On Fri, Jul 19, 2013 at 10:10 AM, kzhang wrote: > We were on 1.3.0, I w

Re: Expire feature doesn't seem to work in Riak 1.4.0

2013-07-16 Thread Hector Castro
Hi Shrikar, It appears that you may be using incorrect expiry settings. You want `expiry_secs` and `expiry_grace_time`, not `expire_secs` and `expire_grace_time`. [0] -- Hector [0] http://docs.basho.com/riak/latest/tutorials/choosing-a-backend/Bitcask/ On Tue, Jul 16, 2013 at 6:52 PM, Shrikar a

[ANN] Riak Community Survey

2013-07-15 Thread Hector Castro
Hi everyone, We'd sincerely appreciate it if you could take some time to complete our second quarterly Riak community survey: http://riak.polldaddy.com/s/community-survey Same as last time, all contributors to the survey will be provided Basho swag, as well as discounted RICON tickets. One lucky

Re: http access to Riak objects

2013-07-03 Thread Hector Castro
Sanjeev, Is your goal to have the resource be accessible via query string authentication, or just publicly accessible? Asking because your example URL contains the query string authentication parameters. http://docs.basho.com/riakcs/latest/cookbooks/Authentication/#Query-String-Authentication Ei

Re: Riak-CS-Control

2013-07-02 Thread Hector Castro
On Tue, Jul 2, 2013 at 6:34 AM, Toby Corkindale wrote: > Riak (and Riak CS and Stanchion) all assume some level of competence at > Erlang. I found Riak was tricky to get running, but had picked up enough > knowledge of Erlang's strange syntax and foibles from working with RabbitMQ. > > Even then,

Re: Not able to get usage using riak-cs http API

2013-06-25 Thread Hector Castro
Hi Mahesh, To make this process easier, you may want to consider using s3curl [0]. It calculates the proper signature, then calls `curl` with the appropriate arguments. In addition, during initial testing, you may need to flush the access and storage statistics to get recent data out of Riak CS.

Re: Can't create first user

2013-06-24 Thread Hector Castro
On Mon, Jun 24, 2013 at 1:33 AM, Guy Morton wrote: > Hi people. I've seen posts where others have had this same issue, > specifically this on the riak_cs issues list - > https://github.com/basho/riak_cs/issues/529 > > Unfortunately the solution is not posted, if there is one. I have followed >

Re: leveldb doesn't exist

2013-06-24 Thread Hector Castro
Hi Guy, The Debian package for Riak only creates subdirectories for `ring` and `bitcask` inside `/var/lib/riak` by default. Once you start Riak with the updated `app.config`, it'll create the `leveldb` subdirectory for you. In order to back Riak CS with Riak, you should be running the updated Ria

Re: 403 forbidden while creating admin user in Riak-CS

2013-06-15 Thread Hector Castro
Hi, Borrowing from a response to a similar thread a few days ago regarding CS, this particular error message is misleading. In general it can be treated as a 500 error. Generally, it translates to Riak CS inability to speak to Stanchion (which is used for creating users and buckets). Please confi

Re: Unable to compile Riak from source (Ubuntu precise 32bit)

2013-05-25 Thread Hector Castro
Given Ubuntu's approach to packaging Erlang, I attempted to reproduce your issue after installing Erlang R15B01 from source. Using the steps in the gist below, I was able to get a Riak 1.2.1 devrel from source working on Ubuntu 12.04 32bit: https://gist.github.com/hectcastro/55886f19ada97e534e0b

[ANN] Atlanta Riak Meetup: Operating and Tuning Riak

2013-05-23 Thread Hector Castro
This coming Wednesday (5/29) at the Atlanta Tech Village [0], Basho will be holding its second Atlanta Riak meetup [1]. Tom Santero and myself will be presenting on how to properly configure and tune Riak for different use cases. We'll also cover how to monitor and profile Riak, as well as the unde

Re: Receiving ulimit warning despite setting it

2013-05-16 Thread Hector Castro
Slightly related, we just recently updated file descriptor limit support in the Riak cookbook [0]. As of right now, ulimits automatically get increased (4096 by default) for the `riak` and `riak-cs` users based on what cookbook you use. Perhaps we should make that increase conditional? -- Hector

Re: Riak 1.3.1 install from source on closed network

2013-04-15 Thread Hector Castro
Hi Peter, Despite the fact that the instructions assume you're working with Riak 1.3.0, please follow the "Installation on Closed Networks" section on the installing Riak from source page [0]. The steps there, combined with Jared's instructions to alter line 79 of Makefile [1] so that it reads:

[ANN] Atlanta Riak Meetup: Why Riak Matters

2013-04-15 Thread Hector Castro
Next Tuesday (4/23) at the Atlanta Tech Village [0], Basho will be holding the first Atlanta Riak meetup [1], as part of Big Data Week [2]. We will be joined by John Vincent (@lusis), who will explain why Riak matters as part of the bigger picture of systems engineering, especially distributed syst

Re: Using Fog with Ruby

2013-04-08 Thread Hector Castro
Hi Michael, I believe that you are seeing this error because the `cs_root_host` Riak CS configuration option and `:host` (in the script's configuration map) are not the same. Once you update `cs_root_host`, make sure that you restart Riak CS for the changes to take effect. -- Hector On Mon, Apr

Re: Mistake in Riak CS documentation re creating admin user

2013-04-08 Thread Hector Castro
Hey Toby, Thanks for bringing this to our attention. I submitted a pull request to remedy the documentation [0] – please +1 if you believe that addresses your issue. For the future, you're more than welcome to file tickets and pull requests against the documentation via GitHub [1]. [0] https://g

Re: Comparison against DynamoDB

2013-04-07 Thread Hector Castro
>From past experience, DynamoDB costs are driven primarily by desired request capacity (per table). If you're interested in a technical comparison between DynamoDB and Riak, see the comparisons section [0] on our docs site. [0] http://docs.basho.com/riak/latest/references/appendices/comparisons/R

Re: Can't set up an instance on EC2 without locking me out.

2013-03-24 Thread Hector Castro
Hey Severin, I just went through the steps to install Riak on a m1.small using AMI ami-3fec7956. After that I enabled PAM based limits and set them to 65536 as outlined in the "Enable PAM Based Limits for Debian & Ubuntu" section here [1]. I *DID NOT* uncomment `UseLogin` in the sshd configuration

Re: Which chef cookbook?

2013-03-21 Thread Hector Castro
Hey Brian, That fork was put in place temporarily until the riak_cs_kv_multi_backend specific bits were merged into basho/riak-chef-cookbook. As of right now, the changes have been merged, but the Berkshelf reference (in hectcastro/vagrant-riak-cs-cluster) hasn't been updated. The primary Chef coo

[ANN] Riak Community Survey

2013-03-18 Thread Hector Castro
Hi everyone, We'd sincerely appreciate it if you could take some time to complete our first quarterly Riak community survey. The goal of this survey is to help us better understand how you are using Riak. Our hope is that your insights will help us make better decisions moving forward with the fut

Re: riak in qeep

2013-03-14 Thread Hector Castro
That's great to hear, Ingo. Please keep us up-to-date on your progress! -- Hector On Thu, Mar 14, 2013 at 9:48 AM, Ingo Rockel wrote: > Hi List, > > just a short note: riak went live for messaging in qeep (our Mobile Social > Network) last week and everything is running quite smooth so far... h

Re: Riak vnodes not available

2013-03-05 Thread Hector Castro
Hi, You guys may want to give the following command a try: riak-admin wait-for-service riak_kv Credit to Dizzy for bringing it to my attention yesterday [0]. [0] https://twitter.com/dizzyd/status/308710172136710144 -- Hector On Tue, Mar 5, 2013 at 7:57 AM, Shane McEwan wrote: > On 05/03/

Re: [ANN] CorrugatedIron v1.2.0 Released

2013-02-20 Thread Hector Castro
Big ups on the release! -- Hector On Wed, Feb 20, 2013 at 1:06 AM, OJ Reeves wrote: > Hello Riak fans, > > Jeremiah and I are happy to announce the latest release of > CorrugatedIron[1], our .NET client for Riak. > > In this version we've fixed a couple of nagging issues to do with > Map/Reduc

Re: Import/Export and Bulk operations

2013-02-20 Thread Hector Castro
Hi Kevin, The riak-data-migrator [0] is a tool used by our own professional services team for bulk data import/export. The prebuilt JAR can be downloaded here [1]. [0] https://github.com/dankerrigan/riak-data-migrator [1] http://ps-tools.data.riakcs.net:8080/riak-data-migrator-0.1.3-bin.tar.gz -

Re: Riak Security on AWS.

2013-02-01 Thread Hector Castro
Hi, We recently published a blog post detailing methods of deployment on AWS [0]. More specifically, to secure the nodes behind an ELB you can assign them security groups as they're defined here [1]. With regard to the ELB, spinning one up in a VPC [2] is the only way to assign security groups to

Re: Leveldb backup using nodejs

2013-01-30 Thread Hector Castro
On Wed, Jan 30, 2013 at 2:52 AM, vvsanil wrote: > We want to use basic 3 node riak cluster on amazon ec2 with a leveldb > backend. The 3 nodes will be sitting under a load balancer. To be clear, for production deployments we recommend using no fewer than 5 nodes: http://docs.basho.com/riak/late

Re: Install from source

2013-01-30 Thread Hector Castro
Hi, It looks like you may not have Erlang installed, or it isn't available in your PATH. Please see the documentation below on how to install Erlang: http://docs.basho.com/riak/latest/tutorials/installation/Installing-Erlang/ -- Hector On Wed, Jan 30, 2013 at 1:25 AM, alaka wrote: > Hi , > E

Re: Riak Merge On Restarts Only

2013-01-22 Thread Hector Castro
As I read through this thread, I came across the following FAQ entry [0] in the Riak docs that echos a lot of what Brian mentioned. [0] http://docs.basho.com/riak/1.2.1/cookbooks/faqs/developing-faq/#why-does-it-seem-that-bitcask-merging-is-only-trig -- Hector On Tue, Jan 22, 2013 at 1:14 PM,

Re: Errors upgrading to 1.0.1 via Homebrew

2011-11-09 Thread Hector Castro
Hi Jon, I did the following to solve the OTP release issue with Homebrew: cd /usr/local # Checkout commit right before r14b04 release git checkout -b r14b03 9332ca98df235cf3b375ee490065947f19c6a3c8 brew install erlang git checkout master -- Hector On Nov

Riak and SEC Filings

2011-11-08 Thread Hector Castro
Hello, I'm currently in the process of evaluating solutions to index the contents of ~1TB of SEC (Securities and Exchange Commission) documents. File sizes vary between a few KB to a couple hundred KB. I started evaluating Riak first because ease of setting up and expanding a cluster are prim