Re: Multiple node Hadoop cluster on Docker for test and debugging

2016-11-12 Thread Sasaki Kai
Roman, Zhe Thanks for the response! I was not familiar with Apache BigTop. I also try to use it. Thanks! Kai Sasaki > On 2016 Nov 10, at 9:07, Roman Shaposhnik wrote: > > On Wed, Nov 9, 2016 at 9:30 AM, Zhe Zhang > wrote: >> Nice work Kai! Quick comment: have you considered Bigtop? It allow

Re: Multiple node Hadoop cluster on Docker for test and debugging

2016-11-09 Thread Roman Shaposhnik
On Wed, Nov 9, 2016 at 9:30 AM, Zhe Zhang wrote: > Nice work Kai! Quick comment: have you considered Bigtop? It allows > creating a multi-node docker cluster too. But I'm not sure if Bigtop takes > a custom built Hadoop (from the instructions I read, it builds from a > certain git branch; I'm not

Re: Multiple node Hadoop cluster on Docker for test and debugging

2016-11-09 Thread Zhe Zhang
Nice work Kai! Quick comment: have you considered Bigtop? It allows creating a multi-node docker cluster too. But I'm not sure if Bigtop takes a custom built Hadoop (from the instructions I read, it builds from a certain git branch; I'm not sure if that customizable). On Wed, Nov 9, 2016 at 5:39 A

Multiple node Hadoop cluster on Docker for test and debugging

2016-11-09 Thread Sasaki Kai
Hi Hadoop developers The other day I created a tool for launching multiple node hadoop cluster on docker container. You can easily launch multiple node hadoop cluster from your Hadoop source code. It is useful for testing and debugging. Actually I often use it before submitting a patch to Hado