Re: What kind of protocol are used between Riak nodes?
AFAIK Rial uses Erlang's distribution system. If you want to find more info search about "epmd" and Erlang Distribution. -Alvaro Sent from my iPhone On May 28, 2012, at 7:40 PM, Alek Morfi wrote: > Hi there, > > What kind of protocol is used betwwen Riak nodes to communicate. Because if > all Riak nodes are located in the same cluster (LAN network scale) there is > no problem. > But when Riak nodes are located on different clusters which are connected > through Internet, there are some limitations. Because some ISPs only allow > communicating by HTTP and SMTP protocol and I am wondering how Riak nodes can > communicate over the Internet. We know that each Riak node is an Erlang > application and Erlang application can communicate with each other by 1) > distributed erlang 2) secure socket > > 1) Do Riak nodes communicate with HTTP protocol ? ( I mean internal > communcation between Riak nodes) > 2) If NO, then how we can connect Riak nodes in a large scale area such as > WAN or Internet scale? (please consider the limitation that some ISP have on > port number and communication protocol) > > Cheers, > Alek > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Riak as Binary File Store
Like this perhaps: https://github.com/johnthethird/riak-fuse *cough* *cough* On Tue, May 29, 2012 at 2:49 PM, Shuhao Wu wrote: > It'll be interesting if you can write a filesystem on top of Riak. > > That would be a cool project to see on github :P > > Shuhao > > > On Tue, May 29, 2012 at 8:36 AM, Praveen Baratam < > praveen.bara...@gmail.com> wrote: > >> Hello Everybody! >> >> I have read abundantly over the web that Riak is very well suited to >> store and retrieve small binary objects such as images, docs, etc. >> >> In our scenario we are planning to use Riak to store uploads to our >> portal which is a Social Network. Uploads are mostly images with maximum >> size of 2 MB and typical size ranges between few KBs to few 100 KBs. >> >> Does this usage pattern fit Riak? What are the caveats if any? >> >> Thank you! >> >> ___ >> riak-users mailing list >> riak-users@lists.basho.com >> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com >> >> > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: riak doesn't start on new Macbook Pro Retina
You seem to be running Riak already or something in the same port.
See the "duplicate name" part of the error.
Regards,
Alvaro
Sent from my iPhone
On Jul 14, 2012, at 2:53 AM, Steve Hull wrote:
> Hi everyone!
>
> I recently attended a users' group / conference at the Basho offices in SF,
> led by Casey.
>
> Everything was working fine on my 2011 MBP, but when I got this new Retina
> MBP, I found that riak would not start properly.
>
> ! riak-1.1.4/bin/riak start
> Riak failed to start within 15 seconds,
> see the output of 'riak console' for more information.
> If you want to wait longer, set the environment variable
> WAIT_FOR_ERLANG to the number of seconds to wait.
>
> ! riak-1.1.4/bin/riak console
> Exec: /Users/shull/Dev/prodar/riak-1.1.4/erts-5.8.5/bin/erlexec -boot
> /Users/shull/Dev/prodar/riak-1.1.4/releases/1.1.4/riak -embedded
> -config /Users/shull/Dev/prodar/riak-1.1.4/etc/app.config -pa
> ./lib/basho-patches -args_file
> /Users/shull/Dev/prodar/riak-1.1.4/etc/vm.args -- console
> Root: /Users/shull/Dev/prodar/riak-1.1.4
> {error_logger,{{2012,7,13},{14,8,56}},"Protocol: ~p: register error:
> ~p~n",["inet_tcp",{{badmatch,{error,duplicate_name}},[{inet_tcp_dist,listen,1},{net_kernel,start_protos,4},{net_kernel,start_protos,3},{net_kernel,init_node,2},{net_kernel,init,1},{gen_server,init_it,6},{proc_lib,init_p_do_apply,3}]}]}
> {error_logger,{{2012,7,13},{14,8,56}},crash_report,[[{initial_call,{net_kernel,init,['Argument__1']}},{pid,<0.20.0>},{registered_name,[]},{error_info,{exit,{error,badarg},[{gen_server,init_it,6},{proc_lib,init_p_do_apply,3}]}},{ancestors,[net_sup,kernel_sup,<0.10.0>]},{messages,[]},{links,[#Port<0.216>,<0.17.0>]},{dictionary,[{longnames,true}]},{trap_exit,true},{status,running},{heap_size,233},{stack_size,24},{reductions,484}],[]]}
> {error_logger,{{2012,7,13},{14,8,56}},supervisor_report,[{supervisor,{local,net_sup}},{errorContext,start_error},{reason,{'EXIT',nodistribution}},{offender,[{pid,undefined},{name,net_kernel},{mfargs,{net_kernel,start_link,[['riak@127.0.0.1',longnames]]}},{restart_type,permanent},{shutdown,2000},{child_type,worker}]}]}
> {error_logger,{{2012,7,13},{14,8,56}},supervisor_report,[{supervisor,{local,kernel_sup}},{errorContext,start_error},{reason,shutdown},{offender,[{pid,undefined},{name,net_sup},{mfargs,{erl_distribution,start_link,[]}},{restart_type,permanent},{shutdown,infinity},{child_type,supervisor}]}]}
> {error_logger,{{2012,7,13},{14,8,56}},std_info,[{application,kernel},{exited,{shutdown,{kernel,start,[normal,[]]}}},{type,permanent}]}
> {"Kernel pid
> terminated",application_controller,"{application_start_failure,kernel,{shutdown,{kernel,start,[normal,[]]}}}"}
>
> Crash dump was written to: ./log/erl_crash.dump
> Kernel pid terminated (application_controller)
> ({application_start_failure,kernel,{shutdown,{kernel,start,[normal,[]]}}})
>
>
> Any ideas? I tried with `brew install riak` but same outcome.
>
> -S
>
> --
> Steve Hull | TaskRabbit |Software Engineer
> P: 510.928.4719
> ___
> riak-users mailing list
> riak-users@lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Problems starting riak
Hi,
I'm trying to build riak using the latest Erlang release built with these
options:
./configure --enable-smp-support --enable-darwin-64bit --enable-kernel-poll
I've got riak using: git clone git://github.com/basho/riak.git
After I did *make rel* I tried bin/riak console
And I got the following errors:
The on_load function for module bitcask_nifs returned {error,
{bad_lib,
"Library version (1.0)
not compatible (with 2.2)."}}
And:
=INFO REPORT 4-Jun-2011::14:20:15 ===
alarm_handler: {clear,{disk_almost_full,"/"}}
{"Kernel pid
terminated",application_controller,"{application_start_failure,riak_kv,{shutdown,{riak_kv_app,start,[normal,[]]}}}"}
If I run df -h it shows that I have available 32GB on my HD.
head erl_crash.dump
=erl_crash_dump:0.1
Sat Jun 4 14:20:16 2011
Slogan: Kernel pid terminated (application_controller)
({application_start_failure,riak_kv,{shutdown,{riak_kv_app,start,[normal,[]]}}})
System version: Erlang R14B03 (erts-5.8.4) [source] [64-bit] [smp:2:2] [rq:2]
[async-threads:64] [hipe] [kernel-poll:true]
Here's the full output: https://gist.github.com/1007857
Any help or hints?
Cheers,
Alvaro
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Problems starting riak
Hi,
@roidrage told me to use an older version of Erlang. Problem is another library
I want to use only compiles with latest Erlang.
On Jun 4, 2011, at 10:48 PM, Jason J. W. Williams wrote:
> Have you tried with Erlang R14B02?
>
> Sent via iPhone
>
> Is your email Premiere?
>
> On Jun 4, 2011, at 5:25, Alvaro Videla wrote:
>
>> Hi,
>>
>> I'm trying to build riak using the latest Erlang release built with these
>> options:
>>
>> ./configure --enable-smp-support --enable-darwin-64bit --enable-kernel-poll
>>
>> I've got riak using: git clone git://github.com/basho/riak.git
>>
>> After I did *make rel* I tried bin/riak console
>>
>> And I got the following errors:
>>
>> The on_load function for module bitcask_nifs returned {error,
>> {bad_lib,
>> "Library version (1.0)
>> not compatible (with 2.2)."}}
>>
>> And:
>>
>> =INFO REPORT 4-Jun-2011::14:20:15 ===
>> alarm_handler: {clear,{disk_almost_full,"/"}}
>> {"Kernel pid
>> terminated",application_controller,"{application_start_failure,riak_kv,{shutdown,{riak_kv_app,start,[normal,[]]}}}"}
>>
>> If I run df -h it shows that I have available 32GB on my HD.
>>
>> head erl_crash.dump
>>
>> =erl_crash_dump:0.1
>> Sat Jun 4 14:20:16 2011
>> Slogan: Kernel pid terminated (application_controller)
>> ({application_start_failure,riak_kv,{shutdown,{riak_kv_app,start,[normal,[]]}}})
>> System version: Erlang R14B03 (erts-5.8.4) [source] [64-bit] [smp:2:2]
>> [rq:2] [async-threads:64] [hipe] [kernel-poll:true]
>>
>> Here's the full output: https://gist.github.com/1007857
>>
>> Any help or hints?
>>
>> Cheers,
>>
>> Alvaro
>> ___
>> riak-users mailing list
>> riak-users@lists.basho.com
>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Sent form my Nokia 1100
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Riak compile error: Module gen_server2 potentially included by two different applications: rabbit_common and riak_core
Hi,
Yes, the module gen_server2 from riak core is part of RabbitMQ from the days
the company was part of LShift.
Why it fails on you I don't know. Are you running both systems in the same
Erlang VM?
Probably the Riak guys know more about this issue.
Cheers,
Alvaro
On Tue, Jul 26, 2011 at 10:03 PM, Brett Hoerner wrote:
> Ubuntu 11.04 x86_64
> Erlang R14B03 (erts-5.8.4) [source] [64-bit] [smp:4:4] [rq:4]
> [async-threads:0] [kernel-poll:false]
>
> Fresh git master checkout, any thoughts?
>
> make rel
> ... [snip] ...
> ==> rel (generate)
> {"init terminating in do_boot","Module gen_server2 potentially
> included by two different applications: rabbit_common and riak_core."}
>
> Crash dump was written to: erl_crash.dump
> init terminating in do_boot (Module gen_server2 potentially included
> by two different applications: rabbit_common and riak_core.)
> make: *** [rel] Error 1
>
> Full output: https://gist.github.com/1107843
>
> ___
> riak-users mailing list
> riak-users@lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Riak and Clojure
Hi Kresten, A while ago I did some Clojure integration with Riak and I could even run m/r jobs in Clojure using code as data as you say. I used the JInterface to have remote nodes as Erlang workers in a similar design of the Javascript workers. Sadly my code is totally outdated now but It Worked™ Please node that this was written a year ago or so when I was learning Clojure, so please don't set me on fire: https://github.com/videlalvaro/closerl Some related blog posts here: http://videlalvaro.github.com/2010/08/closer-clojure-erlang-bridge.html and here: http://videlalvaro.github.com/2010/08/riak-map-reduce-queries-in-clojure.html showing what I could do back then. Regards, Alvaro On Dec 9, 2011, at 1:40 AM, Kresten Krab Thorup wrote: > If someone was to enable m/r jobs in clojure that could be an outstanding > integration, exactly because clojure represents code as data .. the > intergration could be so smooth. With JavaScript you have this ugliness of > putting scripts inside strings that makes it so painful. > > Perhaps using clojurescript (clj->js compiler) w/runtime library installed > inside riak could do it. > > Kresten > > > Mobile: + 45 2343 4626 | Skype: krestenkrabthorup | Twitter: @drkrab > Trifork A/S | Margrethepladsen 4 | DK- 8000 Aarhus C | Phone : +45 8732 > 8787 | www.trifork.com > > > On Dec 8, 2011, at 10:02 PM, Mark Phillips wrote: > >> Hi All, >> >> Anyone out there using Riak with Clojure in some capacity? Or wanting >> to use Riak with Clojure? I was hoping I might borrow a few minutes of >> your time for the betterment of Riak and Clojure. (I'm not afraid to >> use stickers and t-shirts to make it worth your while.) >> >> If this is you, please email me off-list. >> >> Thanks. >> >> Mark >> >> Community Manager >> Basho Technologies >> wiki.basho.com >> twitter.com/pharkmillups >> >> ___ >> riak-users mailing list >> riak-users@lists.basho.com >> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com Sent form my Nokia 1100 ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Hello, Bitcask!
Hi,
As many of you know from twitter/irc I've put together a bare bones PHP client
for Bitcask:
http://github.com/videlalvaro/phpcask
If some guys/gals here think that this project might be helpful for someone
please let me know, so I can spend some more time on it.
To name an example where I can improve it is that now is just a PHP Class
wrapper around the bitcask API, with no error handling at all. Thinks like that
can be improved quite easily.
Regards and congratz to Basho for the good work.
Alvaro
On May 5, 2010, at 11:46 PM, Justin Sheehy wrote:
> Riak Users,
>
> You might have noticed that we released a new local key/value store
> recently: http://blog.basho.com/2010/04/27/hello,-bitcask/
>
> As of just now, it is available as a storage engine ("backend") in the
> tip of the Riak repository.
>
> You can use it like any other backend just by setting the
> storage_backend application variable in the riak_kv application to
> riak_kv_bitcask_backend (in your "app.config") on a fresh node so that
> it will use Bitcask for storage.
>
> There is a new application in app.config, "bitcask", for more detailed
> configuration of bitcask behavior. Some of the variables you can set
> in there are:
>
> data_root: string (required) - the directory for bitcask to use for
> storage and metadata
>
> merge_strategy: {hours, N} - perform a data file merge every N hours
>
> sync_strategy: how to manage syncing of data files being written. choices:
> none (default)- let the O/S decide
> o_sync - use the O_SYNC flag to sync each write
> {seconds, N} - call bitcask:sync/1 every N seconds
>
> A couple of things aren't done yet, including more proactive
> generation of hintfiles, faster startup time, smarter merge
> strategies, more extensive testing on more platforms, documentation on
> usage, and more. We are not yet recommending this as a primary
> production backend, but we expect to very soon. Your feedback is
> welcomed.
>
> -Justin
>
> p.s. -- it's not slow.
>
> ___
> riak-users mailing list
> riak-users@lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
running map-reduce queries in Clojure
Hi all, For learning Clojure I started a pet project to communicate Clojure and Erlang using JInterface. To test that project I wrote a small and dirty server that can run map-reduce queries in Clojure. I've come up with a very basic proof of concept that is described here: http://videlalvaro.github.com/2010/08/riak-map-reduce-queries-in-clojure.html I don't know up to where this will work, If it is performant enough, or if is just convenient for Clojure people using riak, etc. So please take it as it is. There are some TODOs that I mention in that blog post that I will try to address in the upcoming days. If you think this could be useful for your project let me know and share your thoughts. Regards, Alvaro ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Riak won't die all the way on OS X
Jon, Here you have some docs on the epmd: http://erlang.org/doc/man/epmd.html -Alvaro On Dec 1, 2010, at 2:02 PM, Ulf Wiger wrote: > Actually, in general, you _should_ leave it running, as other applications on > your system may depend on it. > > BR, > Ulf W > > Ulf Wiger > CTO, Erlang Solutions, Ltd > http://www.erlang-solutions.com > > Justin Sheehy skrev: > >> Jon, >> >> You can just leave empd running. That is standard erlang runtime >> behavior and generally won't cause any problems. >> >> -Justin >> >> >> >> On Tue, Nov 30, 2010 at 9:59 AM, Jon Brisbin wrote: >>> I'm running the pre-built binaries for Riak 0.13 (and 0.12 x64, for that >>> matter) for OS X 10.6. >>> When I do a "riak stop", there is one process still running. The epmd >>> -daemon process. I have to kill it manually. >>> In my testing, I'm starting 0.13, running a test, then shutting it down, >>> starting 0.12 and running another test. If I'm not switching versions, then >>> I just leave it running. >>> Will this cause a problem if I restart the server and leave this last >>> process running? What about if I switch from 0.13 to 0.12 (or vice versa)? >>> Will it interfere with anything? Do I even need to kill it? >>> >>> Thanks! >>> J. Brisbin >>> http://jbrisbin.com/ >>> >>> >>> >>> >>> >>> >>> ___ >>> riak-users mailing list >>> riak-users@lists.basho.com >>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com >>> >>> >> >> ___ >> riak-users mailing list >> riak-users@lists.basho.com >> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
