RE: Having trouble setting up riak-cs using s3cmd to test

2019-04-23 Thread Nicholas Adams
Hi Greg, I’m guessing that something isn’t running. Try the following (without the back checks) and see if you get “pong” for each one: `riak ping` `riak-cs ping` `stanchion ping` You may or may not need `sudo` to execute the above depending on the user you are using. Incidentally, your s3cfg

Having trouble setting up riak-cs using s3cmd to test

2019-04-23 Thread Greg Zoller
Hello, I'm following the instructions for the Docker-ized riak-cs. The Docker container runs and (appears) healthy. I am now testing the install with s3cmd as described in the instructions. I installed s3cmd and am using this .s3cfg file: (the 2 keys I got from the running container&

Riak CS 2.1.2 and Stanchion 2.1.2 Release

2019-04-09 Thread Nicholas Adams
Dear All, We are pleased to announce the release of Riak CS 2.1.2 in coordination with Stanchion 2.1.2. As well as the standard bug fixes you'll be expecting, Riak CS 2.1.2 includes experimental support for signature_v4 authentication and experimental support for Leveled - the soon

Riak CS 2.1.2rc2 Released

2019-02-27 Thread Nicholas Adams
Dear All, In order to be in time for the start of Code Beam SF 2019, we are launching the Release Candidate for Riak CS 2.1.2 based on https://github.com/basho/riak_cs/pull/1351 Owing to the long amount of time that Riak CS has been dormant to development, we seem to be having a time lag

RE: Riak CS Backup Solutions

2018-04-29 Thread Nicholas Adams
his has been resolved in a Riak KV cluster via MDC replication. Should you want to consider MDC replication, we would highly recommend bi-directional replication as non bi-directional replication does not propagate tombstones which will lead to siblings on the standby cluster. One thing to bea

Re: Riak CS Backup Solutions

2018-04-25 Thread Bryan Hunt
Anthony, Your snapshot solution is not bad if you just want a daily version you can roll back to for disaster recovery. I presume : 1. You’re running on VM’s 2. You stop the world at the time of the snapshot Riak CS makes multiple (3 by default) copies of your data and generally speaking

Riak CS Backup Solutions

2018-04-25 Thread Anthony Valenti
We are looking to improve on our Riak CS backup strategy. We have had Riak CS in place for a while and we are currently taking a snapshot of each server. I'm not sure is this is the best method in terms of recoverability, space used, timeliness or the backups, etc. What methods has anyone

Open Source for Riak CS as well as Riak KV

2018-03-09 Thread Nicholas Adams
Dear All, As Bet365 has been kind enough to make the Riak KV repl repository available for the Open Source community, would it be possible to request the Riak CS equivalent i.e the multibag repository (https://github.com/basho/riak_cs_multibag.git) to be made Open Source as well, please

riak cs and n_val=1

2017-08-17 Thread Артём Бессонов
Hi. I'm making small riak cs storage with single node. I configured CS and KV in accordance with guide. But every file takes up to three times more space. Is it happening because n_val =3 by default? But why all three replicas store in one node? ___

Re: Status and maturity of riak-cs

2017-08-01 Thread Russell Brown
Aug 2017, at 08:50, Javier Palacios wrote: > >> -Mensaje original- >> De: riak-users [mailto:riak-users-boun...@lists.basho.com] En nombre de >> Toby Corkindale >> >> I've been actively trying to migrate over to Minio for S3 storage, instead. >&g

RE: Status and maturity of riak-cs

2017-08-01 Thread Javier Palacios
> -Mensaje original- > De: riak-users [mailto:riak-users-boun...@lists.basho.com] En nombre de > Toby Corkindale > > I've been actively trying to migrate over to Minio for S3 storage, instead. > Worth a look, and unlike riak CS, has had lots of active develo

Re: Status and maturity of riak-cs

2017-07-31 Thread Toby Corkindale
Riak CS works, but has some long-standing issues that have never been resolved. It doesn't support AWSv4 auth signatures, so some client libraries won't talk to it at all. It's quite fragile in respect to its connections to Riak KV -- if KV is slow to start up, then Riak CS

Re: Status and maturity of riak-cs

2017-07-20 Thread Stefan Funk
ote: > > > "However there are alternatives under active development."... can you > please list them? I'm also interested on a CS alternative. > > > > Thanks, > > Alex > > > > On Wed, Jul 19, 2017 at 9:27 PM, Russell Brown > wrote: > > Hi S

Re: Status and maturity of riak-cs

2017-07-19 Thread Alex De la rosa
ell Brown > wrote: > > Hi Stefan > > On the one hand, even before the demise of Basho, they’d stopped > supporting Riak CS. On the other, there is an organisation based in Japan, > but with an international remote team, that supports other CS customers, so > may well be a choice

Re: Status and maturity of riak-cs

2017-07-19 Thread Russell Brown
t;... can you please > list them? I'm also interested on a CS alternative. > > Thanks, > Alex > > On Wed, Jul 19, 2017 at 9:27 PM, Russell Brown > wrote: > Hi Stefan > On the one hand, even before the demise of Basho, they’d stopped supporting > Riak CS. On th

Re: Status and maturity of riak-cs

2017-07-19 Thread Alex De la rosa
y of people running at, in industry, at reasonable scale. > > There’s a genuine market of providers of ex-Basho products, and a > community of CS users. However there are alternatives under active > development. > > Regards > > Russell > > On 19 Jul 2017, at 17:27, S

Re: Status and maturity of riak-cs

2017-07-19 Thread Russell Brown
Hi Stefan On the one hand, even before the demise of Basho, they’d stopped supporting Riak CS. On the other, there is an organisation based in Japan, but with an international remote team, that supports other CS customers, so may well be a choice of support. The CS code base has not had a huge

Status and maturity of riak-cs

2017-07-19 Thread Stefan Funk
Hi everybody, I'm new to Riak-CS and just joined the group. We've been exploring Riak-CS now for a couple of days and consider it as a potential inhouse-alternative to external S3-based storage providers. Given the last commit was in January 2016, the question rose as to how well the

Version compatibility of Riak 2.2.3 and Riak-CS 2.1.1

2017-06-13 Thread 小暮 宗史
Hello, I would like to ask about the version compatibility of the latest versions Riak 2.2.3 and Riak-CS 2.1.1 In the document below, the list "Working Version Combinations" has no description about the latest version of Riak / Riak CS. http://docs.basho.com/riak/cs/2.1.1/cookboo

Re: Bug: Stanchion 1.5 in repo along riak cs 2.0

2017-06-06 Thread Toby Corkindale
Hey all, I was just bootstrapping a fresh Riak CS cluster, and to my disappointment ran into the same problem! Stanchion 1.5.0 gets installed, because that's the one you have in the packagecloud repositories. It's been two years since I reported this issue! Toby On Tue, 16 Jun 2015 at

riak CS and TS

2017-05-10 Thread Javier Palacios
nd instead of 2.x series? I know that I could use different nodes for TS & CS, but one of the attractive points of TS was running side by side with CS, instead of setting up a separate instance (either physical or logical). Javier Palacios [1] http://docs.basho.com/riak/cs/2.1.1/coo

riak-cs bucket performance and timeouts

2017-05-03 Thread Aaron Halstead
# riak version 2.1.4 root@cachetest001:/home/build# riak-cs version 2.1.1 root@cachetest001:/home/build# stanchion version 1.5.0 root@cachetest001:/home/build# lsb_release -a No LSB modules are available. Distributor ID: Ubuntu Description:Ubuntu 14.04.5 LTS Release:14.04 Codename:

Re: User creation not possible Riak CS

2017-05-03 Thread Luke Bakken
Hi Henry, Please use "Reply All" so that your responses are sent to the list. At this point, I recommend looking through the console.log and error.log files for Riak CS and Riak to see if anything looks obvious as to the source of the error. -- Luke Bakken Engineer lbak...@basho.c

Re: User creation not possible Riak CS

2017-05-02 Thread Luke Bakken
In addition, the correct field name should be "email", not name. http://docs.basho.com/riak/cs/2.1.1/cookbooks/configuration/riak-cs/#specifying-the-admin-user On Tue, May 2, 2017 at 6:01 AM, Luke Bakken wrote: > Hi Henry, > > In the JSON you provided, "name" is fol

Re: User creation not possible Riak CS

2017-05-02 Thread Luke Bakken
Hi Henry, In the JSON you provided, "name" is followed by a semicolon. Is this a typo? If not, that could be the cause of the error. -- Luke Bakken Engineer lbak...@basho.com On Mon, May 1, 2017 at 10:26 AM, Henry- Norbert Cocos wrote: > Hello, > > > I'm trying t

User creation not possible Riak CS

2017-05-01 Thread Henry- Norbert Cocos
Hello, I'm trying to run Riak CS on a RPI 3. I got it compiled and running, but now i'm having troubles. I already changed the necessary attributes in the riak-cs.conf. I set up stanchion, riak kv and riak cs. The attributes i changed include anonymous_user_creat

Re: Not able to run Riak CS on Raspberry Pi 3

2017-04-13 Thread Charlie Voiselle
Henry: It looks like there is a typo on the following line: > {add_paths,["/home/pi/src/riak-cs-2.1.1/rel/riak-cs/lib/riak_cs-2.1.1/ebin"$ Your advanced.config file should be similar to this: > {riak_kv, [ > > {add_paths,["/home/pi/src/riak-cs-2.1.1/rel/ria

Not able to run Riak CS on Raspberry Pi 3

2017-04-13 Thread Henry- Norbert Cocos
Hi List, i am having problems running Riak CS on the Raspberry Pi 3. I installed it from source and made the necassary changes to the "riak.config" and the "advanced.config". It currently shows me, that it has issues running the configuration. I'm also having troubl

Re: riak-cs fails to start after reimporting Docker container

2017-03-08 Thread Jean-Marc Le Roux
Done. Here it is: https://github.com/basho/riak_cs/issues/1333 2017-03-08 16:21 GMT+01:00 Jon Brisbin : > Might be good to make sure this info is encapsulated into a GitHub issue >> so we don't loose track of it. >> >> >> In the end, the ONE thing to fix is the cumbersome error message. A >> prop

Re: riak-cs fails to start after reimporting Docker container

2017-03-08 Thread Jon Brisbin
> > Might be good to make sure this info is encapsulated into a GitHub issue > so we don't loose track of it. > > > In the end, the ONE thing to fix is the cumbersome error message. A propre > error message would have saved me days of "work"... > Should I create a new issue for that ? > Please do.

Re: riak-cs fails to start after reimporting Docker container

2017-03-08 Thread Jean-Marc Le Roux
here's lots > to do, beyond just initial config and data on volumes. There's the IP > addressing and networking issues of bridges to consider, among other > things. > For now we use a single riak node so for us Docker is not much of an issue. We successfully backuped/restored riak

Re: riak-cs fails to start after reimporting Docker container

2017-03-08 Thread Jon Brisbin
's the IP addressing and networking issues of bridges to consider, among other things. Might be good to make sure this info is encapsulated into a GitHub issue so we don't loose track of it. jb On Wed, Mar 8, 2017 at 8:16 AM Jean-Marc Le Roux wrote: > Hello, > > I finally found

Re: riak-cs fails to start after reimporting Docker container

2017-03-08 Thread Jean-Marc Le Roux
Hello, I finally found the problem : the riak and riak-cs config files where stored in my app container, not in my persistent data container (where the riak data is). Whenever I upgraded the app container to a newly generated one, the conf files and especially the admin user credentials did not

Re: riak-cs fails to start after reimporting Docker container

2017-03-08 Thread Luca Favatella
On 6 March 2017 at 03:49, Toby Corkindale wrote: > > I tried quite hard to get Riak to work reliably in a Docker container, in a long-term-use kind of way. > Riak would never shutdown cleanly, though, and so at startup there would always be lots of lock files left around that had to be deleted fir

Re: riak-cs fails to start after reimporting Docker container

2017-03-05 Thread Toby Corkindale
1:12.442 [warning] <0.697.0> Hintfile > '/var/lib/riak/bitcask/68507889249886074290797726533575766546371837952/2.bitcask.hint' > invalid > 2017-02-15 23:41:12.442 [warning] <0.712.0> Hintfile > '/var/lib/riak/bitcask/15985174158306750667852802857834345527486

Re: riak-cs fails to start after reimporting Docker container

2017-02-15 Thread Jon Brisbin
> '/var/lib/riak/bitcask/68507889249886074290797726533575766546371837952/2.bitcask.hint' > invalid > 2017-02-15 23:41:12.442 [warning] <0.712.0> Hintfile > '/var/lib/riak/bitcask/159851741583067506678528028578343455274867621888/2.bitcask.hint' > invalid > 2017-0

Re: riak-cs fails to start after reimporting Docker container

2017-02-15 Thread Jean-Marc Le Roux
#x27;/var/lib/riak/bitcask/342539446249430371453988632667878832731859189760/2.bitcask.hint' invalid All of this is very surprising since I started riak-cs and riak properly. Then at the end of console.log : 2017-02-15 23:41:13.651 [info] <0.481.0>@riak_core:wait_for_service:498 Wait complete

Re: riak-cs fails to start after reimporting Docker container

2017-02-15 Thread Jean-Marc Le Roux
>> Hi Jean-Marc - >> >> Can you provide a complete archive of the log directory? I wonder if >> another file might have more information. >> >> -- >> Luke Bakken >> Engineer >> lbak...@basho.com >> >> On Thu, Feb 9, 2017 at 1:58 AM, Jean-Marc

Re: riak-cs fails to start after reimporting Docker container

2017-02-15 Thread Jean-Marc Le Roux
> > > > Hello, > > > > here is the original github issue : > > > > https://github.com/basho/riak_cs/issues/1329 > > > > I'm using riak-cs 2.1.1-1.el6 with stanchion 1.5.0-1.el6 on CentOS 6.8 > in a Docker container. > > To make the dat

Re: riak-cs fails to start after reimporting Docker container

2017-02-09 Thread Luke Bakken
: > > https://github.com/basho/riak_cs/issues/1329 > > I'm using riak-cs 2.1.1-1.el6 with stanchion 1.5.0-1.el6 on CentOS 6.8 in a > Docker container. > To make the data persistent, the following directories are mounted from > outside the container : > > /var/log > /var/

riak-cs fails to start after reimporting Docker container

2017-02-09 Thread Jean-Marc Le Roux
Hello, here is the original github issue : https://github.com/basho/riak_cs/issues/1329 I'm using riak-cs 2.1.1-1.el6 with stanchion 1.5.0-1.el6 on CentOS 6.8 in a Docker container. To make the data persistent, the following directories are mounted from outside the container : - /va

Re: Riak CS race condition at start-up (was: Riak-CS issues when Riak endpoint fails-over to new server)

2017-01-22 Thread Toby Corkindale
Thanks Luke. We're using the official Basho Ubuntu packages for Ubuntu 14.04 LTS. These don't seem to perform that step; they just start Riak CS simultaneously with Riak KV. I'm surprised if we're the only people who hit this. Don't people hit these issues in your oth

Re: Riak CS race condition at start-up (was: Riak-CS issues when Riak endpoint fails-over to new server)

2017-01-20 Thread Luke Bakken
Hi Toby, The process you use to run "riak-cs start" could use the "riak-admin wait-for-service riak_kv" command to ensure Riak is ready first: http://docs.basho.com/riak/kv/2.2.0/using/admin/riak-admin/#wait-for-service -- Luke Bakken Engineer lbak...@basho.com On Thu, Jan

Riak CS race condition at start-up (was: Riak-CS issues when Riak endpoint fails-over to new server)

2017-01-19 Thread Toby Corkindale
Hi guys, I've switched our configuration around, so that Riak CS now talks to 127.0.0.1:8087 instead of the haproxy version. We have immediately re-encountered the problems that caused us to move to haproxy. On start-up, riak takes slightly longer than riak-cs to get ready, and so riak-cs

Re: Riak CS - admin keys changing

2017-01-16 Thread Shaun McVey
gt;> provide credentials used when connecting to various parts of your CS >> cluster. >> >> -- >> Luke Bakken >> Engineer >> lbak...@basho.com >> >> On Thu, Jan 12, 2017 at 3:47 PM, Toby Corkindale wrote: >> > Hi, >> > In Riak CS, t

Re: Riak CS - admin keys changing

2017-01-15 Thread Toby Corkindale
stored in Riak (and is the > authoritative location). The values must match in the config files to > provide credentials used when connecting to various parts of your CS > cluster. > > -- > Luke Bakken > Engineer > lbak...@basho.com > > On Thu, Jan 12, 2017 at 3:47 PM, Toby Cork

Re: Riak CS - admin keys changing

2017-01-12 Thread Toby Corkindale
Bakken Engineer lbak...@basho.com On Thu, Jan 12, 2017 at 3:47 PM, Toby Corkindale wrote: > Hi, > In Riak CS, the admin key and secret is in the config files for both CS and > Stanchion. > Is that the authoritative location for the secrets, or is the > initially-created admin user

Re: Riak CS - admin keys changing

2017-01-12 Thread Luke Bakken
, Toby Corkindale wrote: > Hi, > In Riak CS, the admin key and secret is in the config files for both CS and > Stanchion. > Is that the authoritative location for the secrets, or is the > initially-created admin user the source, and those just have to match? > > I tried to fig

Riak CS - admin keys changing

2017-01-12 Thread Toby Corkindale
Hi, In Riak CS, the admin key and secret is in the config files for both CS and Stanchion. Is that the authoritative location for the secrets, or is the initially-created admin user the source, and those just have to match? I tried to figure this out from the source code, but my Erlang really

Re: Riak-CS issues when Riak endpoint fails-over to new server

2017-01-05 Thread Toby Corkindale
Hi Shaun, We've been running Riak CS since its early days, so it's possible best practice has changed.. but I'm sure at some point it was suggested to put a haproxy between CS and KV to guard against the issues of start-up race condition, individual KV losses, and brief KV restar

Re: Riak-CS issues when Riak endpoint fails-over to new server

2017-01-05 Thread Shaun McVey
it's up and running again, CS will continue to deal with new requests without problems. Any failures to connect to its KV node should be passed to the client/front-end, which should have all the proper logic for re-attempts or error reporting. > I'm surprised more people with hig

Re: Riak-CS issues when Riak endpoint fails-over to new server

2017-01-04 Thread Toby Corkindale
Hi Magnus, I thought that it was recommended AGAINST talking to a co-located Riak on the same host? The reason being, the local Riak will take longer to start up than Riak CS, once you have a sizeable amount of data. This means Riak CS starts up, fails to connect to Riak, and exits. You also end

Re: Riak-CS issues when Riak endpoint fails-over to new server

2017-01-04 Thread Magnus Kessler
Hi Toby, As far as I know Riak CS has none of the more advanced retry capabilities that Riak KV has. However, in the design of CS there seems to be an assumption that a CS instance will talk to a co-located KV node on the same host. To achieve high availability, in CS deployments HAProxy is often

Re: Riak-CS issues when Riak endpoint fails-over to new server

2017-01-03 Thread Toby Corkindale
Hello all, Now that we're all back from the end-of-year holidays, I'd like to bump this question up. I feel like this has been a long-standing problem with Riak CS not handling dropped TCP connections. Last time the cause was haproxy dropping idle TCP connections after too long, but we s

Riak-CS issues when Riak endpoint fails-over to new server

2016-12-21 Thread Toby Corkindale
Hi, We've been seeing some issues with Riak CS for a while in a specific situation. Maybe you can advise if we're doing something wrong? Our setup has redundant haproxy instances in front of a cluster of riak nodes, for both HTTP and PBC. The haproxy instances share a floating IP add

Re: S3ResponseError: 403 Forbidden,backend configuration and riak cs version.

2016-11-29 Thread Shaun McVey
what you did there - did you change the data_root for both bitcask and leveldb backends to use the same directory? Kind Regards, Shaun On Tue, Nov 29, 2016 at 9:22 AM, Neo wrote: > Hi > I'm new to riak and when i trying object storage with riak cs, i got some > problems. > i se

Riak CS Stats: pbc_pool_master_workers

2016-11-29 Thread Vladyslav Zakhozhai
Hi, I'm wondering about pbc_pool_master_workers Riak CS Stats metric. I want to clear its meaning for myself. Is this metric means free pbc (to riak) connections in the pool or it indicates count of pbc connections established to riak without consideration of its usage and state (I mean

S3ResponseError: 403 Forbidden,backend configuration and riak cs version.

2016-11-29 Thread Neo
Hi I'm new to riak and when i trying object storage with riak cs, i got some problems. i setup riak kv ,stanchion and riak cs in the same node,and configured them as files here: http://docs.basho.com/riak/kv/2.2.0/configuring/ http://docs.basho.com/riak/cs/2.1.1/cookbooks/configuration/

Re: Riak CS: avoiding RAM overflow and OOM killer

2016-11-28 Thread Daniel Miller
about 4KB/object, with > some objects being much larger (multiple MB). Is there an easy way to get > this information from a running cluster so I can give you more accurate > information? > > > On Tue, Nov 22, 2016 at 2:42 AM, Alexander Sicular > wrote: > >> Hi Daniel, &

Re: Riak CS: avoiding RAM overflow and OOM killer

2016-11-23 Thread Alexander Sicular
swap. The memory levels (ram + swap) on >>> each node are currently between 4GB and 5.5GB. >> >>> >>> >>> > How many objects (files)? What is the average file size? >>> >> >>> We currently have >30 million objects,

Re: Riak CS: avoiding RAM overflow and OOM killer

2016-11-23 Thread DeadZen
, with > some objects being much larger (multiple MB). Is there an easy way to get > this information from a running cluster so I can give you more accurate > information? > > > On Tue, Nov 22, 2016 at 2:42 AM, Alexander Sicular > wrote: > > Hi Daniel, > > How many no

Re: Riak CS: avoiding RAM overflow and OOM killer

2016-11-23 Thread Daniel Miller
ive you more accurate information? On Tue, Nov 22, 2016 at 2:42 AM, Alexander Sicular wrote: > Hi Daniel, > > How many nodes? > -You should be using 5 minimum if you using the default config. There > are reasons. > > How much ram per node? > -As you noted, in Riak CS, 1

Re: Riak CS: avoiding RAM overflow and OOM killer

2016-11-22 Thread Alexander Sicular
get this > information from a running cluster so I can give you more accurate > information? > > >> On Tue, Nov 22, 2016 at 2:42 AM, Alexander Sicular >> wrote: >> Hi Daniel, >> >> How many nodes? >> -You should be using 5 minimum if you using t

Re: Riak CS: avoiding RAM overflow and OOM killer

2016-11-21 Thread Alexander Sicular
Hi Daniel, How many nodes? -You should be using 5 minimum if you using the default config. There are reasons. How much ram per node? -As you noted, in Riak CS, 1MB file chunks are stored in bitcask. Their key names and some overhead consume memory. How many objects (files)? What is the average

Re: Riak CS: avoiding RAM overflow and OOM killer

2016-11-21 Thread Daniel Miller
using leveldb backend instead of the mutli backend for CS? On Fri, Nov 4, 2016 at 11:48 AM, Daniel Miller wrote: > Hi, > > I have a Riak CS cluster up and running, and am anticipating exponential > growth in the number of key/value pairs over the next few years. From > reading t

Riak CS, logging and admin secrets

2016-11-16 Thread Toby Corkindale
Hi, The other day I was concerned when I discovered the riak-cs console.log contained the following: ``` 2016-11-17 16:36:10.639 [warning] <0.155.0>@riak_cs_app:check_admin_creds:76 The admin user's secret is specified. Ignoring. 2016-11-17 16:36:10.680 [inf

Re: Riak-CS False 503 Service Unavailable Error on Client

2016-11-14 Thread Luke Bakken
Hi Anthony, Looking at the linked issue it appears that the 503 response can be returned erroneously when communication between a Riak CS and Riak node has an error ("If the first member of the preflist is down"). Is there anything predictable about these errors? You say they come fro

Riak CS: avoiding RAM overflow and OOM killer

2016-11-05 Thread Daniel Miller
Hi, I have a Riak CS cluster up and running, and am anticipating exponential growth in the number of key/value pairs over the next few years. From reading the documentation and experience, I've concluded that the default configuration of CS (with riak_cs_kv_multi_backend) keeps all keys i

Riak-CS False 503 Service Unavailable Error on Client

2016-11-01 Thread Valenti, Anthony
We are having a lot of 503 Service Unvailable errors for 1 particular application client(s) when connecting to Riak-CS. Everything looks fine in Riak/Riak-CS and when I check the Riak-CS access logs, I can see access from other applications to other buckets before, during and after the

Error starting Riak CS + Stanchion on NixOS -- lists:unzip/3 error

2016-09-19 Thread Matthew Daiter
ithub.com/basho/stanchion/issues/111 My current configuration files are here: https://gist.github.com/mdaiter/6ce6c00077eaef23ba50820ee1b4a2b3 And I've made Nix expressions for Stanchion, Riak-CS and Basho's version of Erlang (all of which I'd love to push to nixpkgs!) so my build syst

RE: Using Riak CS with Hadoop

2016-08-31 Thread Valenti, Anthony
thony Cc: riak-users@lists.basho.com Subject: Re: Using Riak CS with Hadoop Riak CS provides an S3 capable API, so theoretically it could work. Have you tried? If so and you're having issues, follow up here. -- Luke Bakken Engineer lbak...@basho.com On Wed, Aug 31, 2016 at 7:38 AM, Valent

Re: Using Riak CS with Hadoop

2016-08-31 Thread Luke Bakken
Riak CS provides an S3 capable API, so theoretically it could work. Have you tried? If so and you're having issues, follow up here. -- Luke Bakken Engineer lbak...@basho.com On Wed, Aug 31, 2016 at 7:38 AM, Valenti, Anthony wrote: > Has anyone setup Hadoop to be able use Raik CS as an S

Using Riak CS with Hadoop

2016-08-31 Thread Valenti, Anthony
Has anyone setup Hadoop to be able use Raik CS as an S3 source/destination instead of or in addition to Amazon S3? Hadoop assumes that it should go to Amazon S3 by default. Specifically, I am trying to use Hadoop distcp to copy files to Riak CS. Thanks, Anthony

riak-cs on riak cluster with multi storage backend

2016-08-21 Thread Ali Rıza KELEŞ
for RiakCS backend. As documented RiakCS requires its own backend and want me to define it in advanced.config like below: ``` {riak_kv, [ {add_paths, ["/usr/lib/riak-cs/lib/riak_cs-{{VERSION}}/ebin"]}, {storage_backend, riak_cs_kv_multi_backend}, {multi_backend_prefix_lis

riak cs performance question

2016-05-25 Thread M Nagaraj
Hi I am quite new to RIAK-*. I have setup riak cs on a single server (for evaluation purposes) with adequate RAM, CPU and high performance storage. I am using Cosbench to benchmark RIAK-CS using the S3 proxy connection. Cosbench is also running on the same server (the reasons being I wanted to

Re: Questions about installing Stanchion for Riak CS

2016-05-23 Thread Alex De la rosa
Hi Luke, Cool, understood :) then is not as troublesome as I thought. Thanks, Alex On Mon, May 23, 2016 at 10:37 PM, Luke Bakken wrote: > On Mon, May 23, 2016 at 11:07 AM, Alex De la rosa > wrote: > > So if the node with Stanchion fatally crashed and can not be recovered I > can > > install S

Re: Questions about installing Stanchion for Riak CS

2016-05-23 Thread Luke Bakken
On Mon, May 23, 2016 at 11:07 AM, Alex De la rosa wrote: > So if the node with Stanchion fatally crashed and can not be recovered I can > install Stanchion in another node and this node will get the "master" role? Yes. There is no concept of "master" or "slave" with Stanchion, since only one Stan

Re: Questions about installing Stanchion for Riak CS

2016-05-23 Thread Alex De la rosa
d only have one active Stanchion process running in your > >> cluster, since its purpose is to ensure consistent, ordered operations > >> with regard to users and buckets. You can have a hot-backup if you > >> configure a load balancer to proxy requests from the

Re: Questions about installing Stanchion for Riak CS

2016-05-23 Thread Sargun Dhillon
in your >>> cluster, since its purpose is to ensure consistent, ordered operations >>> with regard to users and buckets. You can have a hot-backup if you >>> configure a load balancer to proxy requests from the Riak CS >>> processes. >>> -- >&g

Re: Questions about installing Stanchion for Riak CS

2016-05-23 Thread Luke Bakken
rote: >> >> Hi Alex, >> >> You should only have one active Stanchion process running in your >> cluster, since its purpose is to ensure consistent, ordered operations >> with regard to users and buckets. You can have a hot-backup if you >> configure a load

Re: Questions about installing Stanchion for Riak CS

2016-05-23 Thread Alex De la rosa
rocess running in your > cluster, since its purpose is to ensure consistent, ordered operations > with regard to users and buckets. You can have a hot-backup if you > configure a load balancer to proxy requests from the Riak CS > processes. > -- > Luke Bakken > Engineer >

Re: Questions about installing Stanchion for Riak CS

2016-05-23 Thread Luke Bakken
Hi Alex, You should only have one active Stanchion process running in your cluster, since its purpose is to ensure consistent, ordered operations with regard to users and buckets. You can have a hot-backup if you configure a load balancer to proxy requests from the Riak CS processes. -- Luke

Questions about installing Stanchion for Riak CS

2016-05-21 Thread Alex De la rosa
Hi there, I'm creating a Riak CS cluster and I got some questions about the following sentence from the documentation: *Riak KV and Riak CS must be installed on each node in your cluster. Stanchion, however, needs to be installed on only one node.* Is this statement saying that only 1 nod

Re: trouble running riak-cs

2016-05-12 Thread Kazuhiro Suzuki
Hi David, According to the error 'error_verifying_props', it looks like your Riak KV couldn't be configured for Riak CS. Please make sure if Riak KV is configured as to allow_mult[1] and backend[2]. [1]: https://docs.basho.com/riak/cs/2.1.1/cookbooks/configuration/riak-for-c

trouble running riak-cs

2016-05-12 Thread Kensiski, David
I am installing Riak CS on Ubuntu 14.04 based on the instructions here: https://docs.basho.com/riak/cs/2.1.1/cookbooks/installing/ I followed the instructions for configuring /etc/riak-cs/riak-cs.conf: root@p01:~# diff /etc/riak-cs/riak-cs.conf-ORIG /etc/riak-cs/riak-cs.conf 8c8 < liste

Re: Riak-cs / stanchion won't find credentials

2016-05-04 Thread Jhonny Everson
Also, just for reference I am using last riak/riak-cs/stanchion available on packagecloud On Wed, May 4, 2016 at 11:34 PM, Jhonny Everson wrote: > Hi, > > I am setting up a new cluster. I followed all the setup instructions (I > think). I created admin user as doc says, then

Riak-cs / stanchion won't find credentials

2016-05-04 Thread Jhonny Everson
Hi, I am setting up a new cluster. I followed all the setup instructions (I think). I created admin user as doc says, then updated riak-cs.conf and stanchion.conf with generated keys. I get the following when starting: 2016-05-05 01:15:01.167 [error] > <0.149.0>@riak_cs_app:fetch_and_cache_admin_

Re: is Riak S2 same as Riak CS 2.1.1??

2016-04-14 Thread Alex De la rosa
Perfect, good to know :) thanks Yeah, is pretty confusing, I though I was just hitting some old release or something. Thanks, Alex On Thu, Apr 14, 2016 at 6:56 PM, Justin Pease wrote: > Alex, > > Apologies for the confusion. Riak S2 is a rebranding of Riak CS. So yes, > they

Re: is Riak S2 same as Riak CS 2.1.1??

2016-04-14 Thread Justin Pease
Alex, Apologies for the confusion. Riak S2 is a rebranding of Riak CS. So yes, they are the same. -- *Justin Pease* VP, Services Basho Technologies, Inc. On Thu, Apr 14, 2016 at 8:35 AM, Alex De la rosa wrote: > Hi there, > > I was trying to download Riak S2 to do some testings o

is Riak S2 same as Riak CS 2.1.1??

2016-04-14 Thread Alex De la rosa
Hi there, I was trying to download Riak S2 to do some testings on it, but seems the download page takes you to Riak CS2.1.1: http://docs.basho.com/riak/cs/2.1.1/downloads/ Are they the same? Also, in https://packagecloud.io/basho there is no indications of Riak-s2 but Riak-cs. Is very

riak-cs sizeing suggestions

2016-03-30 Thread Michael Walsh
There is a nice BitCask formula for creating suggested nodes for a riak-kv ring. Is there something similar for riak-cs? What are the rules around how large the key store needs to be in the multi-tenant data store, as I assume cs is only storing a reference to the large object value. Are there any

Re: riak-cs

2016-02-26 Thread Gustav Spellauge
quot;moss.access">>,<<"moss.users">>, <<48,111,58,16,121,107,99,149,64,231,6,8,234,204,240,88,62,111,225>>, <<"riak-cs-gc">>, <<48,98,58,16,121,107,99,149,64,231,6,8,234,204,240,88,62,111,225>>] so i guess, it was not the best idea to retrieve data using the htt

riak-cs

2016-02-26 Thread Gustav Spellauge
hello, i'm kind of new to the world of riak but i succeeded to install and configure riak_2.1.3 (5 instances on 5 machines running debian jessie), riak-cs_2.1.1, riak-cs-control_1.0.2 and stanchion_2.1.1. everything works fine but i'm observing a strange behavior: when i ha

Re: Riak CS/Stanchion troubleshooting (Retrieval of user record)

2015-11-25 Thread Kazuhiro Suzuki
s equal to the server timeout in order to avoid complex > situations to debug. > I want to mention again taht I have about 1000 rps to Riak CS, average object > size is 10 Kb. It seems to fit a usecase of Riak, not Riak CS, if you don't need S3 API and multi tenancy. Riak CS is

Re: Riak CS/Stanchion troubleshooting (Retrieval of user record)

2015-11-19 Thread Vladyslav Zakhozhai
ght 1 maxconn 1024 check port 8090 and so on... And config for Riak CS: frontend riakcs bind193.34.169.1:80 modehttp option contstats option httplog option http-server-close timeout client 30s default_backend riakcs_backend backend riakcs_backend mode

Re: riak-cs sync buckets from S3 to Riak-cs

2015-11-17 Thread Alberto Ayllon
llo. > > > > Thanks for your help Dmitri. > > > > Perhaps this is not the correct place to ask this, but maybe someone had > > have the same problem. > > > > I build a test environment with two nodes of RIAK-CS, not in cluster, and > > I'm tr

Re: riak-cs sync buckets from S3 to Riak-cs

2015-11-16 Thread Shunichi Shinohara
build a test environment with two nodes of RIAK-CS, not in cluster, and > I'm trying to move objects from one to another, to a bucket with the same > name (testbucket). > I'm using BOTO, and the copy_key method, but it fails, I guess that problem > is in the HEAD call, th

Re: riak-cs sync buckets from S3 to Riak-cs

2015-11-16 Thread Alberto Ayllon
Hello. Thanks for your help Dmitri. Perhaps this is not the correct place to ask this, but maybe someone had have the same problem. I build a test environment with two nodes of RIAK-CS, not in cluster, and I'm trying to move objects from one to another, to a bucket with the same

Re: Riak CS/Stanchion troubleshooting (Retrieval of user record)

2015-11-15 Thread Kazuhiro Suzuki
Hi, ha_proxy's timeout settings often causes disconnected errors on a Riak CS deployment by high work load. termination_stat [1] in tcplog [2] lets you know if timeout happens or not. > 2015-11-13 13:13:09.514 [error] > <0.11264.1387>@riak_cs_wm_common:maybe_create_user:222

Riak CS/Stanchion troubleshooting (Retrieval of user record)

2015-11-13 Thread Vladyslav Zakhozhai
Hello. I have Riak CS cluster with 18 nodes. On each node there is Riak CS and Riak service and one Stanchion node. Versions: Riak 1.4.12 Riak CS 1.5.0 Stanchion 1.5.0 Riak CS and Riak allocated behind HAProxy balancers: WAN -> HAProxy -> Riak CS nodes -> HAProxy -> Riak nodes. a

  1   2   3   4   5   6   >