Riak-cs cluster
Hello, i want to ask a question. My company will implement private cloud storage using riak cs. We have 5 servers that will be our riak nodes, and we have 1 swrver for HA proxy load balancer. The question is, the documentation says that only 1 stanchion for a cluster, so where should i install stanchion ? And what if tge stanchion is fails ? Because there is only 1 stanchion node in my cluster ? Thank you ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
bitcask dead byte and fragment for riak-cs
Hello there, i have problems with my riak-cs cluster. i have 5 riak nodes, each node have 11 TB of storage. my riak-cs deployment is just following 5 minutes installation tutorial. but, after running for 1 month. surprisingly, i have storage problem. my bitcask folder (/data/riak/bitcask) is storing a huge amount of data. and i tried to adjust bitcask merge fragment and deadbyte trigers and treshold as possible. but it's still don't give me reasonable disk usage. my purpose using riak-cs is only for storing images that has been migrated from our nfs servers. but it has only 4 TB of total size of images. why it takes a lot of disk usage for bitcask ? is it normal ? now my disk space is gona be explode. it grows rapidly. and i don't know what should i do. here is my configuration files. */etc/riak/riak.conf* ## Where to emit the default log messages (typically at 'info' ## severity): ## off: disabled ## file: the file specified by log.console.file ## console: to standard output (seen when using `riak attach-direct`) ## both: log.console.file and standard out. ## ## Default: file ## ## Acceptable values: ## - one of: off, file, console, both log.console = file ## The severity level of the console log, default is 'info'. ## ## Default: info ## ## Acceptable values: ## - one of: debug, info, notice, warning, error, critical, alert, emergency, none log.console.level = info ## When 'log.console' is set to 'file' or 'both', the file where ## console messages will be logged. ## ## Default: $(platform_log_dir)/console.log ## ## Acceptable values: ## - the path to a file log.console.file = $(platform_log_dir)/console.log ## The file where error messages will be logged. ## ## Default: $(platform_log_dir)/error.log ## ## Acceptable values: ## - the path to a file log.error.file = $(platform_log_dir)/error.log ## When set to 'on', enables log output to syslog. ## ## Default: off ## ## Acceptable values: ## - on or off log.syslog = off ## Whether to enable the crash log. ## ## Default: on ## ## Acceptable values: ## - on or off log.crash = on ## If the crash log is enabled, the file where its messages will ## be written. ## ## Default: $(platform_log_dir)/crash.log ## ## Acceptable values: ## - the path to a file log.crash.file = $(platform_log_dir)/crash.log ## Maximum size in bytes of individual messages in the crash log ## ## Default: 64KB ## ## Acceptable values: ## - a byte size with units, e.g. 10GB log.crash.maximum_message_size = 64KB ## Maximum size of the crash log in bytes, before it is rotated ## ## Default: 10MB ## ## Acceptable values: ## - a byte size with units, e.g. 10GB log.crash.size = 10MB ## The schedule on which to rotate the crash log. For more ## information see: ## https://github.com/basho/lager/blob/master/README.md#internal-log-rotation ## ## Default: $D0 ## ## Acceptable values: ## - text log.crash.rotation = $D0 ## The number of rotated crash logs to keep. When set to ## 'current', only the current open log file is kept. ## ## Default: 5 ## ## Acceptable values: ## - an integer ## - the text "current" log.crash.rotation.keep = 5 ## Name of the Erlang node ## ## Default: riak@127.0.0.1 ## ## Acceptable values: ## - text nodename = riak4@172.16.1.58 ## Cookie for distributed node communication. All nodes in the ## same cluster should use the same cookie or they will not be able to ## communicate. ## ## Default: riak ## ## Acceptable values: ## - text distributed_cookie = riak ## Sets the number of threads in async thread pool, valid range ## is 0-1024. If thread support is available, the default is 64. ## More information at: http://erlang.org/doc/man/erl.html ## ## Default: 64 ## ## Acceptable values: ## - an integer ## erlang.async_threads = 64 erlang.async_threads = 1024 ## The number of concurrent ports/sockets ## Valid range is 1024-134217727 ## ## Default: 65536 ## ## Acceptable values: ## - an integer erlang.max_ports = 65536 ## Set scheduler forced wakeup interval. All run queues will be ## scanned each Interval milliseconds. While there are sleeping ## schedulers in the system, one scheduler will be woken for each ## non-empty run queue found. An Interval of zero disables this ## feature, which also is the default. ## This feature is a workaround for lengthy executing native code, and ## native code that do not bump reductions properly. ## More information: http://www.erlang.org/doc/man/erl.html#+sfwi ## ## Default: 500 ## ## Acceptable values: ## - an integer ## erlang.schedulers.force_wakeup_interval = 500 ## Enable or disable scheduler compaction of load. By default ## scheduler compaction of load is enabled. When enabled, load ## balancing will strive for a load distribution which causes as many ## scheduler threads as possible to be fully loaded (i.e., not run out ## of work). This is accomplished by migrating load (e.g. runnable ## processes) into a smaller set of schedulers when schedulers ## frequently run out of work.
Re: Riak CS - Unable to create/view bucket details using dragon disk
Riak cs fast track would answer your question
On Oct 13, 2015 21:30, "Shawn Debnath" wrote:
> I have been using s3curl.sh with success to do the dirty work with Riak
> CS. Here’s a snippet from my docker setup files. I use the same methodology
> in production.
>
> 187 # CREATE CS BUCKET AND APPLY ACL
> 188 ##
> 189 bin/s3curl.pl \
> 190 --debug \
> 191 --id ${RIAK_ADMIN_KEY} \
> 192 --key ${RIAK_ADMIN_SECRET} \
> 193 --acl private \
> 194 -- -s -v -x social.dev.pryvy.com:50201 \
> 195 -X PUT http://social-media.cs.pryvy.com/ > /dev/null 2>&1
> 196 echo "created social-media bucket"
> 197
> 198 eval "bin/s3curl.pl --debug --id ${RIAK_ADMIN_KEY} --key
> ${RIAK_ADMIN_SECRET} -- -s -v -x social.dev.pryvy.com:50201 -H
> 'x-amz-grant-full-control: id=\"${RIAK_A DMIN_ID}\"' -H
> 'x-amz-grant-write: id=\"${RIAK_SOCIAL_ID}\"' -X PUT
> http://social-media.cs.pryvy.com/?acl"; > /dev/null 2>&1
> 199 echo "applied social bucket policy"
>
>
> Also, when applying the ACL, it has to evaluated as shown above if you are
> using bash as your shell.
>
> HTH,
> Shawn
>
>
>
>
> On 10/13/15, 1:24 AM, "riak-users on behalf of G" <
> riak-users-boun...@lists.basho.com on behalf of m.gnanen...@yahoo.co.in>
> wrote:
>
> >Hi Shino,
> >
> >I tried multiple times with the access key and secret key configured in
> >riak-cs.conf. But I'm unable to create or view buckets using s3 cmd.
> >
> >Could you let me know if there is any documentation for this?
> >
> >My aim to create buckets, upload objects to riak buckets from a HTTP
> >interface similar to aws - s3.
> >
> >
> >
> >--
> >View this message in context:
> http://riak-users.197444.n3.nabble.com/Riak-CS-Unable-to-create-view-bucket-details-using-dragon-disk-tp4033494p4033579.html
> >Sent from the Riak Users mailing list archive at Nabble.com.
> >
> >___
> >riak-users mailing list
> >riak-users@lists.basho.com
> >http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
> ___
> riak-users mailing list
> riak-users@lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Riak does not have primary partitions running ?
Whar is the right solution if i have partition not running in my cluster when i execute riak-admin transfers command ? ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Riak does not have primary partitions running ?
I've checked that all of my nodes respons pong when i execute riak ping. But i don't know how ? I tried to restart riak but it doesn't solve anything On Oct 14, 2015 20:02, "Ciprian Manea" wrote: > Hi Mohamad, > > It's possible that some of your nodes are down or just restarting which > triggers the "partition not running" in `riak-admin transfers` output. > Please ensure that all riak nodes are running. > > > Regards, > Ciprian > > On Tue, Oct 13, 2015 at 5:48 PM, Mohamad Taufiq > wrote: > >> Whar is the right solution if i have partition not running in my cluster >> when i execute riak-admin transfers command ? >> >> ___ >> riak-users mailing list >> riak-users@lists.basho.com >> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com >> >> > ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Community Competition Starts Now! (+ Riak Recap)
nice share Mathew. my issue no. 8 is still no solution. But we'll see if someone have some experience with that. Thank You. On Thu, Oct 29, 2015 at 3:33 AM, Matthew Brender wrote: > Riak Recap is a little early this week to let you know about our RICON > Community Competition! > > ## RICON Competition > Join your friends in building or updating *any* demo of Basho products > and win branging rights next week. You can participate whether you > will be at RICON or participating online, so jump in and share your > code! [0] > > ## RICON! > * There's still time to join in on RICON - the distributed systems > conference. As a community member, you can take the $100 off your > ticket with the Basho100 code. This discount code will expire on > October 31. Click here to use it: http://bit.ly/ricon15u > > ## Recently Answered > * Luke points out that the Java client uses protobuf on port 8087 by > default [1] > * Allen runs into Riak KV requiring erlang16, not 17 just yet [2] > * Jon confirms how a node handles a cluster join without getting to > cluster plan/commit [3] > * Stale key retrieval was resolved for Masanori by setting W=2 [4] > * Jon confirms you can use Riak with Spring Data [5] > * Shino helped work around a S3 API bug a user had while using Riak S2 > (aka Riak CS) [6] > * David offers a thoughtful Bahso Docs PR to clarify CRDT merge behavior > [7] > > > ## Open Discussions > * Mohamad sees some surprising disk usage he would like to explore on > bitcask [8] > * Ali has a follow up question about node status for a health check script > [9] > > ## New Releases > * Riak S2 2.1 (aka Riak CS) is available! [10] > > Have a great weekend, > Matt Brender > Developer Advocate @ Basho > @mjbrender > > [0] http://bit.ly/ricon15comp > [1] > http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-October/017695.html > [2] > http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-October/017705.html > [3] > http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-October/017708.html > [4] > http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-October/017711.html > [5] > http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-October/017720.html > [6] > http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-October/017727.html > [7] > http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-October/017752.html > [8] > http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-October/017710.html > [9] > http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-October/017714.html > [10]http://docs.basho.com/riakcs/latest/riakcs-downloads/ > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > -- *Mohamad Taufiq* System Engineer | Bukalapak.com Plaza City View Building 2nd Floor Jl. Kemang Timur No. 22 Pejaten Barat - Jakarta Selatan Indonesia, 12510 p: 021-718 - 2008 m: +628119994763 e : tau...@bukalapak.com www.bukalapak.com <http://www.bukapak.com/> ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
