Re: Setting number of parallel Reducers and Mappers for optimal performance

Pavan, On Aug 10, 2012, at 9:17 PM, Pavan Kulkarni wrote: > Arun, > > Thanks a lot for your response. > > I am running on a 16 core Xeon processor and 12 spindles.So running 12 > Mappers with 2G and 6 Reducers with 3G might give me the best > performance. Hmm... ok. You actually _may_ have e

Re: Cannot create a new Jira issue for MapReduce

I made some suggestions to hbase dev mailing list a few weeks ago. The following suggestion is about hbase development which can be extrapolated to other Apache projects. People can continue discussion through dev mailing list when JIRA is down. When JIRA comes back up, transcript of such discuss

Re: Cannot create a new Jira issue for MapReduce

Yes. I saw JIRA is in maintenance now and the schedule is as below: Host Name Service Entry Time Author Comment Start Time End TimeTypeDurationDowntime ID Trigger ID Actions ull.zones.apache.orgIssues - JIRA - General 2012-08-11 19:06:08 dani

Re: Adding hadoop usage

done On 11 August 2012 11:33, Aggelos Dimitratos wrote: > I would like to add our site rodacino > We use hadoop for crawling news sites and log analysis. > We also use Apache Cassandra as our back end and Apache Lucene for > searching capabilities > -- Steve Loughran

Re: fs.local.block.size vs file.blocksize

Hi Ellis, fs.local.block.size is the default FileSystem block size, note however that most file systems (like HDFS, see DistributedFileSystem) override this, eg when using HDFS the default block size is configured with dfs.blocksize which defaults to 64mb. Note in v1 the default block size for hd

fs.local.block.size vs file.blocksize

Hi guys and gals, I originally posted a version of this question on the user list on a few days ago to no response, so I thought perhaps it delved a bit too far into the nitty-gritty to warrant one. My apologies for cross-listing. Can someone please briefly summarize the difference between t

Build failed in Jenkins: Hadoop-Common-trunk #500

See -- [...truncated 27123 lines...] [DEBUG] (s) debug = false [DEBUG] (s) effort = Default [DEBUG] (s) failOnError = true [DEBUG] (s) findbugsXmlOutput = false [DEBUG] (s) findbugsXmlOutputD