It will not negate that need necessarily (Hadoop is a large ecosystem), but it could be an alternative for run-of-the-mill batch mapred jobs. There's still a long way to go for that to be possible, but we encourage you to push its limits and find the pain points.
Sean Cribbs <s...@basho.com> Developer Advocate Basho Technologies, Inc. http://basho.com/ On Jun 14, 2011, at 11:41 AM, Jonathan Langevin wrote: > So to be clear, will Riak Pipe negate the need for someone to use Hadoop in > front of Riak KV? > > > Jonathan Langevin > Systems Administrator > Loom Inc. > Wilmington, NC: (910) 241-0433 - jlange...@loomlearning.com - > www.loomlearning.com - Skype: intel352 > > > > On Mon, Jun 13, 2011 at 9:44 PM, Sean Cribbs <s...@basho.com> wrote: > > On Jun 13, 2011, at 9:40 PM, Antonio Rohman Fernandez wrote: > > > > Can a same job be performed by several servers distributed as a > > cluster? or only 1 Pipe server will do the job and Riak KV will be the > > distributed cluster?... the good thing of Hadoop is that you can have a > > Hadoop cluster and a Riak cluster and both clusters would work > > distributed to perform jobs ( Hadoop ) and to deliver data ( Riak KV > > )... i wonder how Riak Pipe will work, i hope that it would be like > > Hadoop and the computation of a job can be distributed. > > > Riak Pipe builds on the abstractions already available in riak_core for > distribution, namely vnodes and consistent hashing. The existing MapReduce in > Riak KV also uses these abstractions, but Pipe is a lot smarter about how it > coordinates and monitors data processing. > > Sean Cribbs <s...@basho.com> > Developer Advocate > Basho Technologies, Inc. > http://basho.com/ > > > _______________________________________________ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com >
_______________________________________________ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
