Re: Riak Search on Updated buckets

2013-01-24 Thread John Daily
times true that this occurs? Do you have an example value (old and new) that caused you problems? -John Daily Technical Evangelist Basho On Jan 23, 2013, at 2:16 PM, Jorge Garrido wrote: > Hi > > Recently, i ve implemented riak search, but I am worried about a problem: > > When

Re: Differences between riak_client and riak_kv_mrc_pipe MapReduce when one node is down.

2013-01-30 Thread John Daily
ome back online without data. MapReduce will not currently trigger a read repair, but that problem should be resolved with the forthcoming Riak 1.3 release. -John Daily Technical Evangelist Basho On Jan 30, 2013, at 8:05 AM, gu...@mail.mipt.ru wrote: > We have 6 node riak cluster.I simple custom

Re: Ripple queries illuminated?

2013-01-31 Thread John Daily
v http://"; $1 ":" $2 "/riak//" }' > /tmp/runme.sh The goal is to pick out all occurrences of "{http," from the cluster information file and run: curl -v http://:/riak// -John Daily Technical Evangelist Basho On Jan 31, 2013, at 12:16 PM, Martin

Re: MapReduce javascript built-ins?

2013-02-05 Thread John Daily
I believe you're looking for this: https://github.com/basho/riak_kv/blob/master/priv/mapred_builtins.js Found via: http://docs.basho.com/riak/1.2.0/references/appendices/MapReduce-Implementation/ Thanks for checking out Riak! -John Daily Technical Evangelist Basho On

Minneapolis/St. Paul: time to duck and cover

2013-02-25 Thread John Daily
ks to DevJam for making their space available, and we hope to see you there. [0] http://devjam.com/ [1] http://www.meetup.com/Twin-Cities-Riak-Meetup/events/106353292/ [2] http://basho.com/introducing-riak-1-3/ [3] http://ricon.io/ -John Daily Technical Evangelist

Riak Recap for February 11 - 26

2013-02-26 Thread John Daily
Greetings and salutations. We're now making the Riak recap a team effort for the Basho technical evangelists, so expect to see a little more content. This latest is particularly long due to the release of 1.3 and a two week gap since our last note. John twitter.com/macintux Riak Recap for Februa

Riak Recap for February 26 - March 5

2013-03-05 Thread John Daily
Only a week since our last Recap. We might be on to something here. Another week closer to RICON in New York City in May. Even distributed systems need to leverage a little locality now and again, so come join us for some concentrated awesomeness. Early bird pricing ends March 15, so be sure to r

Re: Protection from listing buckets and other rogue queries

2013-03-06 Thread John Daily
looked into the mechanism for that. [1] application:stop(riak_kv), followed by application:start(riak_kv) -John Daily Technical Evangelist jda...@basho.com On Mar 5, 2013, at 10:01 AM, Chris Read wrote: > Greetings all... > > We have had a situation where someone ran a List Buckets query

Re: {error, notfound} items in mapreduce during ownership handoff

2013-03-06 Thread John Daily
ss common under Riak 1.3, although ownership handoff will still exacerbate the problem. [1] https://github.com/basho/riak_kv/issues/358 -John Daily Technical Evangelist jda...@basho.com On Mar 6, 2013, at 3:14 PM, Jeremy Raymond wrote: > So I should expect {error, notfound} inputs to map jo

Re: {error, notfound} items in mapreduce during ownership handoff

2013-03-06 Thread John Daily
mething(RiakObj, _, _) -> > Metadata = riak_object:get_metadata(RiakObj), > case dict:is_key(<<"X-Riak-Deleted">>, Metadata) of > true -> > []; % I have a tombstone > false -> > [ok] % I have a valid item &g

Re: Delete keys still in Riak db

2013-03-07 Thread John Daily
objects, and is effectively the only way to do so. Active anti-entropy in Riak 1.3.0 has most of what's necessary to automatically clean up all deleted objects, but that is not a current feature. I'll make sure a ticket is filed with that feature request. -John Daily Technical Evangelist jd

Riak Recap for March 6 - 12

2013-03-12 Thread John Daily
Reminder: early bird pricing for RICON East ends Friday, as does the CFP. * ---> http://ricon.io/east.html And don't forget: hoodies! John twitter.com/macintux Riak Recap for March 6 - 12 === 1) A new release of the Perl library Net::Riak has been released. It now suppo

Austin-area Riak users: Data Day tomorrow, meetup coming 4/17

2013-03-29 Thread John Daily
in Texas this year, and I'll definitely be looking for users to talk about their experiences with Riak. Please let me know if you'd be interested in sharing your pain points and successes (not necessarily in that order). And, of course, the essentials: free food and swag. -John Daily

Re: Error in documentation

2013-04-06 Thread John Daily
Actually, I believe the document is correct; there is a riak_cs_kv_multi_backend module in the CS tree which appears to be forked from riak_kv_multi_backend. In general, though, you're more than welcome to file tickets against the documentation set via github: https://github.com/basho/basho_doc

Re: cluster capacity planning, 50M of writes per day

2013-04-08 Thread John Daily
e hardware currently in your account if you're not careful.) [1] https://github.com/basho/basho_bench [2] http://docs.basho.com/riak/latest/cookbooks/Benchmarking/ [3] http://www.baremetalcloud.com/ -John Daily Technical Evangelist Basho Technologies ___

Riak Recap for April 3 - April 19

2013-04-19 Thread John Daily
om/Atlanta-Riak-Meetup/events/112848852/ Eric Redmond will be talking about Riak at Railsberry in Krakow - April 23-24 / http://railsberry.com/ Steve Vinoski and Andy Gross will be talking at GOTO Chicago, where you can also find a Basho booth with John Daily talking Riak, Erlang, or chromatic harmon

Riak Recap for April 27 - April 30

2013-04-30 Thread John Daily
We're back with yet another Recap. Big news for the week: SoftLayer now offers Riak and Riak Enterprise out of the box in their bare metal server hosting environment. Big news for everyone at RICON East or NYC environs is that SoftLayer is sponsoring the after party, so if you somehow can't mak

Riak 1.3.1 and w=1 performance change

2013-05-08 Thread John Daily
As you may have noticed, this week on the blog I've been tackling the deeper meanings of various behavioral configuration parameters, ranging from ye olde r/w parameters to the much more obscure basic_quorum. After posting today's missive, the esteemed Andrew Thompson noticed that something I d

Re: On siblings

2013-05-15 Thread John Daily
Thanks for the kind words, Jeremiah. Jeremy, if you find anything that's wrong with that description of sibling behavior, please let me know. It's always possible I missed something important. -John On Wednesday, May 15, 2013, Jeremiah Peschka wrote: > John Daily (@macintux) wrote

Re: First Write Wins

2013-05-19 Thread John Daily
and pr=quorum (which would mean that attempting to write the same key in a partitioned scenario would fail unless a majority of the primary vnodes are reachable). Hopefully someone else who's given this some thought in the past will jump in; I'll make further inquiries tomorrow. -John

Re: First Write Wins

2013-05-20 Thread John Daily
=pr=quorum. > > Immutable values is a much better way of putting it, although I technically > need deletion as well for this particular example. > > Cheers, > Jeremy > > > On Sun, May 19, 2013 at 7:24 PM, John Daily wrote: > A few quick thoughts... > > W

RICON West CFP now open

2013-06-04 Thread John Daily
r. If you have interesting Riak experiences to share (or other distributed systems theory/learnings), please contact us. Your active involvement can only improve RICON. CFP: http://ricon.io/blog/2013-06-03-West-cfp-officially-open.html RICON West: http://ricon.io/west.html -John Daily Technical E

Re: setting n_val

2013-06-10 Thread John Daily
Two important points: First, n_val determines how many partitions (or virtual nodes) the data will be distributed to. The ring size determines how many partitions exist, and should be a much larger number than the number of servers your cluster will run on. Riak's default ring size is 64, so de

Re: 0 byte images saved to riak cluster

2013-06-12 Thread John Daily
> Correct. With lww = true, the vector clocks will be ignored and the > most-recent timestamp will win. Is this not what you're seeing? To be precise, the most recent timestamp will win as long as allow_mult=false. lww=true just optimizes the code path a bit. http://basho.com/understanding-riak

Re: bucket properties

2013-06-17 Thread John Daily
A couple of quick notes (that may be perfectly obvious, but just in case) to augment Joe's response: Nodes will have to be restarted before those properties take effect. Increasing n_val on buckets is risky: old keys will still only live on the original n_val (smaller) number of nodes, but requ

Re: Help... Something is wrong with my restore

2013-07-18 Thread John Daily
Per http://docs.basho.com/riak/latest/cookbooks/Backups/, you need not only Bitcask data but also ring data and configuration. -John On Jul 18, 2013, at 1:40 PM, Mark Wagner wrote: > Here is what I am doing: on OSX > > # Install riak on my local OSX development box > brew install riak > >

Re: Scaling Riak CS to hundreds or thousands of servers

2013-07-25 Thread John Daily
riak cs for large files (50MB-15GB) is it possible to raise > the chunk size up to these Filesizes, to prevent the system from heavy > network traffic? Definitely not. Erlang's distribution protocol will behave badly with objects that large.

Critical issue with Riak Control in Riak 1.4.0.

2013-07-30 Thread John Daily
atest/ops/advanced/riak-control/ [1] http://docs.basho.com/riak/latest/ops/running/rolling-upgrades/ -John Daily Technical Evangelist Basho ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo

Riak Recap for July 23-31

2013-07-31 Thread John Daily
Greetings, Riak world. It's time to say farewell to July. There will be many opportunities to see the Basho crew out and about in August, so I've included the next couple of weeks below, and you can always visit http://basho.com/events to see what's coming to your community. Don't forget that

Re: performance

2013-08-02 Thread John Daily
Excellent news. How many buckets with custom settings did you create? Sent from my iPhone On Aug 2, 2013, at 6:51 PM, Paul Ingalls wrote: For those interested, I identified my performance problem. I was creating a lot of buckets, and the properties did not match the default bucket properties o

Re: performance

2013-08-02 Thread John Daily
Maybe 50k or so... Paul Ingalls Founder & CEO Fanzo p...@fanzo.me @paulingalls http://www.linkedin.com/in/paulingalls On Aug 2, 2013, at 3:54 PM, John Daily wrote: Excellent news. How many buckets with custom settings did you create? Sent from my iPhone On Aug 2, 2013, at 6:51 PM, Paul

Re: performance

2013-08-05 Thread John Daily
gt; Paul Ingalls > Founder & CEO Fanzo > p...@fanzo.me > @paulingalls > http://www.linkedin.com/in/paulingalls > > > > On Aug 2, 2013, at 5:08 PM, John Daily wrote: > >> 50k definitely is a fair few. What's the objective for that many, if I may >&g

Dallas, SoftLayer, and Riak

2013-08-12 Thread John Daily
in us for free food and drinks on August 27th. http://www.meetup.com/DFW-Riak-Meetup/events/134337442/ -John Daily Technical Evangelist Basho Technologies ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo

Tweaked Riak development process

2013-08-26 Thread John Daily
ntact us on this list or via issues on GitHub if you have questions or concerns. [1] https://github.com/basho [2] https://github.com/basho/riak_cs/wiki/Git-Flow [3] http://nvie.com/posts/a-successful-git-branching-model/ [4] https://github.com/basho/riak/wiki/Basho-repository-management -Jo

Riak Recap for August 1-27

2013-08-27 Thread John Daily
The Recap took an (unplanned) August vacation, rather like the rest of the civilized world, but we're back. The most important news: RICON West tickets are still available, but early bird ticket sales end Thursday morning (US). If you've been to a RICON, you know why you shouldn't miss this; if

Riak Recap for August 28 - September 5

2013-09-05 Thread John Daily
Summer draws to its unofficial close in the northern hemisphere, but that just means tech conferences are spinning back up. We know RICON will be high on the priority list for anyone reading this; check out the speakers list and ask yourself if you really want to miss a chance to bend the ear of

Riak Recap for September 5 - September 25

2013-09-25 Thread John Daily
Riak Recap returns after a busy couple of weeks, including one of the more spectacular developer conferences anywhere in the world, Strange Loop. If you've not yet attended, you're missing out. Garrett Eardley of Riot Games talked at Strange Loop about migrating from MySQL to Riak for scale; we

Re: distribution of data among riak cluster physical nodes

2013-10-09 Thread John Daily
What you saw is actually quite typical when using R=1. When you turn off a node, Riak's sloppy quorum behavior will kick in and hand off some of your read requests to an empty data partition to supplement the two remaining partitions that still have a copy. Since the partition is empty, it can

[ANN] Riak CS 1.4.2 (and reorganized docs)

2013-10-14 Thread John Daily
oads: http://docs.basho.com/riakcs/latest/riakcs-downloads/ Thanks. -John Daily Technical Evangelist, Basho ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: distribution of data among riak cluster physical nodes

2013-10-14 Thread John Daily
Responses inline. On Oct 11, 2013, at 7:10 PM, kzhang wrote: > I read the documentation again > (http://docs.basho.com/riak/latest/dev/references/http/fetch-object/). > > r - (read quorum) how many replicas need to agree when retrieving the object > (default is defined by the bucket) Not agree

Re: distribution of data among riak cluster physical nodes

2013-10-15 Thread John Daily
Replies inline On Oct 15, 2013, at 9:49 AM, kzhang wrote: > I think the below setting is what we want to use for our environment >> r = 1 >> notfound_ok=false >> basic_quorum = true >> >> the client gets notfound if the first two replies are notfound? if the >> first >> reply is found, the clie

Re: Riak CS with a NFS storage backend

2013-10-21 Thread John Daily
If you really want an S3 API layer around NFS, I suspect you'd be better off taking the code from Riak CS and creating your own solution than attempting this approach. One example of how this would run into trouble: if any server fails, nearly every large object would be unavailable because of

Re: Riak occasionally not storing objects

2013-10-23 Thread John Daily
How well-synchronized are your system clocks? Sent from my iPhone > On Oct 23, 2013, at 5:00 PM, David Greenstein wrote: > > > We’re doing new puts with a blank vector clock. There are several seconds > between updates to the object though. > > Dave > > >> On Oct 23, 2013, at 5:32 PM, Andrew Th

Riak Recap for September 26 - October 25

2013-10-25 Thread John Daily
solutions - http://lists.basho.com/pipermail/riak-users_lists.basho.com/2013-October/013475.html Drew Searcy posted a blog on troubleshooting Riak daemon startup problems - http://drewsearcy.com/troubleshooting-riak-startup/ John Daily captured some of the differences between Riak and Riak CS

Re: Riak Recap for September 26 - October 25

2013-10-25 Thread John Daily
com/index.html (for those of you who haven't seen > > Salt Stack yet) > > > > Basho now has a dedicated conference page on Lanyrd, if you're curious > > where you can find us next > > - http://lanyrd.com/basho/ > > > > While we're talking abo

[ANN] Weekly Riak Community Hangout (1st one happening shortly)

2013-11-08 Thread John Daily
The Basho TE team is kicking off a new weekly forum an hour from now: the Riak Community Hangout[1]. Most[2] Fridays at 11am Pacific/2pm Eastern/7pm[3] GMT we'll be holding a 15-30 minute, development-focused Google Hangout, with the video to be posted later on YouTube[4]. A primary focus for

Re: Forcing Siblings to Occur

2013-11-08 Thread John Daily
Updating any key without supplying a vector clock is guaranteed to create a sibling. -John On Nov 8, 2013, at 1:29 PM, Mark A. Basil, Jr. wrote: > Is there some method that is either guaranteed or very highly likely to > create Siblings of an object (that isn’t a counter)? I would like to ha

▶ RC Hangout 001: Data Types and Search in 2.0 - YouTube

2013-11-08 Thread John Daily
And so it begins: http://www.youtube.com/watch?v=bxzGY6_DnQU -John ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Corrupted data using Riak Python Client on Win7 64 bit

2013-11-08 Thread John Daily
If you upload the files from Windows, and download them to the Ubuntu VM, do inconsistencies ever appear? -John On Nov 8, 2013, at 4:58 PM, Engel Sanchez wrote: > Hello there, > > This looks puzzling. Just from looking at the code we haven't found anything > suspicious. Would you mind postin

Re: Corrupted data using Riak Python Client on Win7 64 bit

2013-11-08 Thread John Daily
(And the inverse would also be interesting to know.) -John On Nov 8, 2013, at 6:41 PM, John Daily wrote: > If you upload the files from Windows, and download them to the Ubuntu VM, do > inconsistencies ever appear? > > -John > > On Nov 8, 2013, at 4:58 PM, Engel Sanchez

Re: Forcing Siblings to Occur

2013-11-12 Thread John Daily
Forcing siblings other than for testing purposes is not typically a good idea; as you indicate, the object size can easily become a problem as all siblings will live inside the same Riak value. Your counter-example sounds a lot like a use case for server-side CRDTs; data structures that allow t

Re: Forcing Siblings to Occur

2013-11-12 Thread John Daily
r my use case, but they > seem overkill for simple append operations when I don't need delete > functionality. Creating your own CRDTs are trivial if you never need to > delete. > > Thoughts are welcome, > Jason > From: John Daily > Sent: Wednesday, 13 November 2013

Re: Search Crashes

2013-11-23 Thread John Daily
allow_mult=true is the recommended approach for addressing conflict resolution; when multiple writes to the same object are received and vector clocks cannot determine a causal history, all copies of the writes are retained for future merging/selection by the application. We are planning to make

[ANN] Riak CS 1.4.3

2013-11-25 Thread John Daily
-Release-Notes/ Downloads: http://docs.basho.com/riakcs/latest/riakcs-downloads/ Thanks. -John Daily Technical Evangelist Basho ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Worried about the backends to use

2013-11-29 Thread John Daily
> > 2) You could set your default backend in the confgs to use multi-backend. > When it comes time to age out your data, you can switch the backend on a > bucket by bucket basis and hope for the best. This isn't supported or tested > by Basho (as far as I know), so you'll be on your own on this

Riak Community Hangout #3 in 20 minutes

2013-12-06 Thread John Daily
We’ll be continuing our discussions of Riak 2.0: specifically, security and conflict resolution. 2pm Eastern. http://youtu.be/_QomrZc29fw -John ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/ria

Updated Hangout link

2013-12-06 Thread John Daily
Technical difficulties, new link http://youtu.be/n8m8xlizekg -John ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Riak Community Hangout ideas

2013-12-16 Thread John Daily
for a great 2013. -John Daily Technical Evangelist Basho Technologies ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Maps with multiple buckets

2013-12-18 Thread John Daily
Alex Moore and I provided some general time series advice and links on StackOverflow recently: http://stackoverflow.com/questions/19384686/what-is-the-most-efficient-way-to-store-time-series-in-riak-with-heavy-reads Broadly speaking, issuing dynamic queries via MapReduce is going to be less des

[ANN]: Riak 1.4.6

2013-12-20 Thread John Daily
Riak users, Riak 1.4.6 was pushed to the apt and yum repositories and is now available for download from docs.basho.com. Along with bug fixes, the most notable changes involve 2i. We have reverted to unsorted key lists by default for better performance, added regular expression filters for ran

Re: May allow_mult cause DoS?

2013-12-20 Thread John Daily
I could be wrong, but I believe there’s metadata overhead for each sibling, so even if all data in all siblings needs to be retained, it’s still more efficient to merge and save them as one object. -John On Dec 20, 2013, at 6:01 PM, Andrew Stone wrote: > Think of an object with thousands of s

Re: Cluster restarted and doesn’t respond to queries

2013-12-23 Thread John Daily
Note this: {multi_backend, [ %% Here's where you set the individual multiplexed backends {<<"eleveldb_mult">>, riak_kv_eleveldb_backend, [ {data_root, "

Re: anti_entropy_expire

2013-12-27 Thread John Daily
That'd be version 1.4.6. Sent from my iPhone > On Dec 27, 2013, at 4:42 PM, Matthew Von-Maszewski wrote: > > P.S. Unrelated to your question: Riak 1.4.4 is available for download. It > has a couple of nice bug fixes for leveldb. ___ riak-users mai

Riak Recap for December 18 - January 7

2014-01-07 Thread John Daily
Welcome to the first 2014 Riak Recap. Since last we spoke, Riak 1.4.6 was unveiled, along with an updated Chef cookbook: - http://lists.basho.com/pipermail/riak-users_lists.basho.com/2013-December/014327.html - http://community.opscode.com/cookbooks/riak We've also hosted another Riak Community

Riak Hangout starting shortly

2014-01-17 Thread John Daily
We’ll be talking CorrugatedIron with Jeremiah Peschka and David Rusek at 2 Eastern. Learn more about sausage-making in the client libraries. https://plus.google.com/events/cmovsvget093sa91rjas3ac4a3s -John ___ riak-users mailing list riak-users@lists

Impending Community Hangout

2014-01-24 Thread John Daily
If you’ve been a part of the Riak community for a while, you won’t want to miss today’s Community Hangout. Hector Castro and I will be joined by two people who have been among the more prominent faces for Basho for a very long time: Andy Gross and Mark Phillips. We’ll take a look back at where w

Re: last_write_wins

2014-01-30 Thread John Daily
Replies inline. (Thanks to Russell for the link to my blog series, but honestly, as I now re-read the section on conflict resolution, I’m unhappy with it. It’s a very confusing topic and I regret not doing a better job of clarifying it. This answer will undoubtedly also be more confusing than I

[ANN] Riak CS 1.4.4

2014-02-03 Thread John Daily
A minor Riak CS bugfix release, 1.4.4, is available. There are no Stanchion or Riak CS Control updates, so versions 1.4.3 and 1.0.2 remain the latest releases of those components. http://docs.basho.com/riakcs/latest/riakcs-downloads/ http://docs.basho.com/riakcs/latest/cookbooks/Riak-CS-Re

Re: Level-db cluster

2014-02-11 Thread John Daily
After asking around a bit, I think we’re likely to remove that recommendation from the documentation. Tuning is always a bit of a dark art, so as always your mileage may vary, but there doesn’t seem to be any real advantage to lowering the thread count. Thanks for raising the issue. -John On

Riak Recap for January 24th - February 11th

2014-02-11 Thread John Daily
week...). John Daily twitter.com/macintux --- Riak Recap for January 24th - February 11th === Riak CS 1.4.4 (bugfixes only) was released. - http://lists.basho.com/pipermail/riak-users_lists.basho.com/2014-February/014599.html -

Riak Community Hangout: 3:30 Eastern

2014-02-14 Thread John Daily
We pushed this week’s hangout back a bit due to scheduling conflicts. I’ll send out a link after 3pm. Today’s topic: data modeling. Don’t miss it. As a reminder, previous hangouts can be viewed at our YouTube page (and that’s another way to watch today’s live without waiting for me to send a di

Riak Community Hangout #10: Data modeling

2014-02-14 Thread John Daily
Will be starting at ~3:30 Eastern. http://youtu.be/uDR-sdBCPug -John ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: 1.4 or 2.0?

2014-02-15 Thread John Daily
I strongly recommend sticking with the 1.4 series until 2.0 is formally released. The 2.0 features are great, but making certain that upgrades will go smoothly is a top priority for every major release of Riak, and this will be no exception. You can upgrade when the time is right for your needs

Re: Riak CS Siblings

2014-04-28 Thread John Daily
Siblings in CS are strictly for internal purposes, and handled by the CS layer. They aren't exposed to S3 (or similar) clients. Sent from my iPhone > On Apr 28, 2014, at 12:37 PM, Lee Sylvester wrote: > > Hey guys, > > So, I'm using a Riak CS cluster and interfacing with it using Erlcloud. My

Re: Help on bucket quorums

2014-06-28 Thread John Daily
I don't have time at the moment to respond in more detail, I'm afraid, but you should find this blog series quite useful. http://basho.com/understanding-riaks-configurable-behaviors-part-1/ Sent from my iPhone On Jun 28, 2014, at 5:56 AM, Alex De la rosa wrote: Hi there, Can somebody help me

Re: Cluster rebalancing

2014-07-07 Thread John Daily
Weighted claim is indeed on the wishlist, but I don't believe it has yet been assigned to any particular planned release. -John On Sun, Jul 6, 2014 at 9:09 AM, Thomas Santero wrote: > Hi Chaim, > > Inline > > On Jul 6, 2014, at 1:13 AM, Chaim Solomon > wrote: > > I don't think I was quite cle

Re: Riak backup and restore for ubuntu

2014-07-23 Thread John Daily
We are disabling the backup component in riak-admin in 2.0. Instead, we recommend following the detailed instructions in http://docs.basho.com/riak/2.0.0/ops/running/backups/ -John On Wed, Jul 23, 2014 at 3:21 PM, Alfonso Hooker wrote: > I am looking for some information regarding the backup

Re: Riak CS with hadoop over s3 protocol

2014-07-31 Thread John Daily
This blog post on configuring S3 clients to work with CS may be useful: http://basho.com/riak-cs-proxy-vs-direct-configuration/ Sent from my iPhone On Jul 31, 2014, at 2:53 PM, Andrew Stone wrote: Hi Charles, AFAIK we haven't ever tested Riak Cs with the MapR connector. However, if MapR works

Re: Riak Search VS other query systems

2014-08-20 Thread John Daily
I don't have benchmarks to discuss query performance for different tools at different sizes, but I'd like to point out that the ultimate search tool for Riak is to not search at all. Riak Search, 2i, MapReduce are all capable tools, but they don't scale nearly as well as straight key/value request

Re: Avoid siblings in "data-type" bucket

2014-08-21 Thread John Daily
Siblings are resolved automatically by Riak when using our data types, thus the requirement that allow_mult=true. -John On Thu, Aug 21, 2014 at 3:17 PM, Alex De la rosa wrote: > Hi there, > > I was trying to create a bucket-type using the datatype MAP and it didn't > allow me to create it with

Re: Single node, nval = 1

2014-09-11 Thread John Daily
On Thu, Sep 11, 2014 at 7:42 AM, Dmitri Zagidulin wrote: > If you're running a single-node Riak instance to start with (such as a > prototype web app), but there's the possibility of expanding the cluster > and adding other nodes, you should run with n_val=3. (It's not recommended > to change th

Re: Rolling upgrade from 1.2 to 2.0

2014-09-19 Thread John Daily
Basho only tests and supports upgrades 2 major releases forward, so 1.3 or 1.4 can be upgraded to 2.0, but 1.2 may or may not work. I'd strongly recommend upgrading to 1.4.10 before moving to 2.0. Some useful links: * http://docs.basho.com/riak/latest/ops/upgrading/rolling-upgrades/ * http://docs

Re: Connecting to a single host vs balancing requests

2014-10-08 Thread John Daily
If you can help us what goal is trying to be achieved by taking that approach, perhaps we can refute the logic (or find a better solution). It sounds suspiciously like someone is trying to avoid the complexities of siblings and conflict resolution (a goal which your architecture doesn't actually ac

Re: Is it possible to start with One node and increase later

2014-11-14 Thread John Daily
The n_val represents the number of copies of the data, regardless of the number of servers in the cluster. If you have n_val=3 and only 1 server, 3 copies of each piece of data will be on that server (and performance will be generally abysmal because every read and write request will effectively

Re: Data Modelling

2014-11-25 Thread John Daily
I’ve written a bit about modeling patterns at http://basho.com/riak-development-anti-patterns/ I expanded a bit on it in contributions to the latest version of Eric Redmond’s outstanding http://littleriakbook.com (make sure to grab one of the downloads, the HTML is out of date). -John On Nov

Re: Data Modelling

2014-11-25 Thread John Daily
Agreed, that’s a useful article, highly recommended. -John On Nov 25, 2014, at 2:03 PM, Troy Melhase wrote: > Lots of insight here: > > https://highlyscalable.wordpress.com/2012/03/01/nosql-data-modeling-techniques/ > > > > On Tue, Nov 25, 2014 at 1:47 PM, John Daily

Re: Implementation of the possibility of "subscribe"

2015-01-23 Thread John Daily
You may wish to take a look at the support for post-commit hooks: http://docs.basho.com/riak/latest/dev/advanced/commit-hooks/ -John On Jan 23, 2015, at 1:54 PM, Никита Нежевский wrote: > Hello. > I've used riak for online processing of incoming data and faced with problem. > I've used riak-er

Re: Implementation of the possibility of "subscribe"

2015-01-27 Thread John Daily
otaryPhone > > On Jan 24, 2015, at 08:55, Никита Нежевский > wrote: > > Thank you for your reply, I will try to use post-commit hooks. But is it > possible to realize this possibility at riak-erlang-client? > > Sat Jan 24 2015 at 0:12:57, John Daily >: > >&g

Re: Riak 1.3.1 high swap usage

2015-02-19 Thread John Daily
Daniel, you may be aware of this, but a 3-node Riak cluster is not recommended and may be playing a minor role in your resource problems. Every request will hit every server (except for some requests that are being made twice against a single server, making I/O that much worse), and depending on yo

Re: [riak-user] can store images directly in Riak?

2015-02-20 Thread John Daily
You certainly can with some careful tuning. However, if Riak is being used for heavy traffic loads, you’ll likely see poor performance as a consequence. Those large objects effectively clog the pipes temporarily. Hopefully someone can chime in with tuning recommendations, but make certain allo

Re: [riak-user] can store images directly in Riak?

2015-02-20 Thread John Daily
Both LevelDB and Bitcask are optimized for smaller objects, so neither will be particularly good at it. Again: this is possible but discouraged. -John On Feb 20, 2015, at 10:01 AM, SeanProtain wrote: > HI John, > > Thank you! Then which backend I should choose to store images? > > Subject:

Re: Android client, Riak server

2015-04-16 Thread John Daily
Agreed: exposing any database directly to the Internet is risky, and Riak’s security introduced in 2.0 doesn’t really change that. -John On Apr 16, 2015, at 4:25 PM, Alexander Sicular wrote: > That should work but are you sure you want to expose your riak server to the > Internet? I would rec

Re: riak 2.0 + riak-cs 2.0 trouble

2015-04-17 Thread John Daily
Unfortunately it’s very easy to introduce syntax errors into Erlang configuration files (and tricky to diagnose them without Erlang experience), which is why we’re moving toward the newer sysctl-style files like riak.conf. The example in the documentation looks ok; can we see a copy of your adv

Re: riak 2.0 + riak-cs 2.0 trouble

2015-04-17 Thread John Daily
provided in an Erlang array, with square brackets and a period terminating it. See http://pastebin.com/90gh6amg. -John On Apr 17, 2015, at 8:24 AM, Stanislav Vlasov wrote: > 2015-04-17 17:04 GMT+05:00 John Daily : >> Unfortunately it’s very easy to introduce syntax errors in

Re: scaling up vertically upgrading HD

2015-04-23 Thread John Daily
Riak does not currently try to protect you against dumping 2 gallons of water in a 1 gallon jug, so each node will write data until it can’t. -John On Apr 23, 2015, at 10:42 AM, Alex De la rosa wrote: > Cool, thank you :) however, is true that if 4 nodes are 1TB and the other one > is 2TB; th

Re: Rolling upgrade from 1.4.2 to 2.0.5

2015-08-05 Thread John Daily
That’s correct: upgrades to either 2.0.x or 2.1.x are supported from the 1.4 series. Side note: I definitely recommend testing the upgrade process in a QA environment first. -John On Aug 5, 2015, at 12:13 PM, Sujay Mansingh wrote: Hello all, I have a 5 node riak cluster, all nodes running 1.4

Re: Build Riak wirh Erlang 18

2015-11-17 Thread John Daily
One of our engineers has been working on 18 for a while now. He’s not around today, but hopefully will chime in soon. -John > On Nov 17, 2015, at 1:45 PM, Victor Medina wrote: > > =)first of all thanks! > > Im building it with OTP17. Everything seems to be just fine with 17 so far... > Thin

Re: Riak Character Encoding

2015-11-29 Thread John Daily
retrieved from the <<"відро"/utf8>> bucket. -John Daily jda...@basho.com On Thu, Nov 26, 2015 at 3:10 AM, Fasil K wrote: > Thanks Daniel. This means a lot > > With Regards, > > Fasil K > > On Thu, Nov 26, 2015 at 1:10 PM, Daniel Abrahamsson < > da

Re: A put is not put in Riak

2015-12-30 Thread John Daily
This smells like a clock problem. Are you confident all of your servers’ clocks are set to the same time? Updates can be treacherous if clocks are not synchronized and multiple writes to the same key occur in a period of time short enough to fit within the clock skew. I wrote about this after

Re: Creating riak-kv bucket type programmatically

2016-07-05 Thread John Daily
We punted on a bucket type API with Riak 2.0 because we tied authorization heavily to bucket types and didn’t have the time to unravel that knot. Since then we have yet to prioritize it. I will make sure this is on the roadmap. -John > On Jul 5, 2016, at 2:15 PM, Nguyen, Kyle wrote: > > Hi a

  1   2   >