RE: Release with PB and HA

2012-03-12 Thread Dave Shine
rmation in Sanjay's document here: https://issues.apache.org/jira/browse/HADOOP-7347 (and all its associated JIRAs) On Mon, Mar 12, 2012 at 5:47 PM, Dave Shine wrote: > I apologize for asking a dumb question.  I know what HA is, but what does PB > stand for? > > Thanks, > Da

RE: Release with PB and HA

2012-03-12 Thread Dave Shine
I apologize for asking a dumb question. I know what HA is, but what does PB stand for? Thanks, Dave -Original Message- From: Todd Lipcon [mailto:t...@cloudera.com] Sent: Friday, March 09, 2012 8:40 PM To: common-dev@hadoop.apache.org Subject: Re: Release with PB and HA +1, I agree we

RE: Looking for a place to start

2012-03-06 Thread Dave Shine
I suggest you get a copy of Hadoop, The Definitive Guide by Tom White. I found it very informative when I was first starting out. As for sample "big data" , the book uses weather data from the NCDC. You can download it from https://github.com/tomwhite/hadoop-book/tree/master/input/ncdc/all D

RE: [jira] [Created] (HADOOP-7325) hadoop command - do not accept class names starting with a hyphen

2011-05-24 Thread Dave Shine
I'm not sure if this is the intended behavior, but it sounds like this JIRA will change it. I found out the hard way that running hadoop jar myMapReduceJob.jar runs the M/R job with the current hadoop configuration. However running hadoop -jar myMarReduceJob.jar runs the M/R

RE: Why mergeParts() is not parallel with collect() on map?

2011-05-03 Thread Dave Shine
I'm a relative newbie to Hadoop, but your assumption below is not correct in my organization. It is common for us to call output.collect() more than once in a map() function. Dave Shine -Original Message- From: elton sky [mailto:eltonsky9...@gmail.com] Sent: Tuesday, May 03, 2

RE: mapreduce.job.split.metainfo.maxsize misspelled in mapred-default.xml

2011-04-12 Thread Dave Shine
Does this mean I can change the metainfo maxsize by mapreduce.jobtracker.split.metainfo.maxsize? I tried changing mapreduce.job.split.metainfo.maxsize with no effect. Now I understand why. Thanks, Dave Shine -Original Message- From: Michael Naseef [mailto:mtnaseef...@gmail.com] Sent

RE: Configuring Heap Size for Name Node

2010-12-03 Thread Dave Shine
t; > -- Philip > > On Wed, Dec 1, 2010 at 4:27 AM, Dave Shine > wrote: >> I'm using 0.20.2. >> >> I've seen references to HADOOP_NAMENODE_OPTS, but nothing that clearly >> explains how to set them. >> >> Any help would be greatl

hadoop.tmp.dir

2010-12-01 Thread Dave Shine
problem, but I'm not sure I fully understand how the Secondary Name Node and the checkpoint stuff actually works. Thanks, Dave Shine Sr. Software Engineer 1180 Celebration Blvd Suite 101 Celebration FL 34747 Office 321-939-5093 Mobile 407-314-0122 Fax 321-939-5604 dave.sh...@channelintellenc

RE: Configuring Heap Size for Name Node

2010-12-01 Thread Dave Shine
I'm using 0.20.2. I've seen references to HADOOP_NAMENODE_OPTS, but nothing that clearly explains how to set them. Any help would be greatly appreciated. Dave Shine -Original Message- From: Hemanth Yamijala [mailto:yhema...@gmail.com] Sent: Tuesday, November 30, 2010

Configuring Heap Size for Name Node

2010-11-30 Thread Dave Shine
How do I change the heap size for the Name Node (and Secondary Name Node) without changing the heap size for the data nodes, job tracker, and task trackers? Thanks, Dave Shine Sr. Software Engineer 1180 Celebration Blvd Suite 101 Celebration FL 34747 Office 321-939-5093 Mobile 407-314-0122 Fax

FileSystem.moveToLocalFile getting chmod: ... Operation not permitted

2010-09-23 Thread Dave Shine
in CentOS and the shared folder in Windows. Any assistance would be greatly appreciated. Dave Shine Sr. Software Engineer 1180 Celebration Blvd Suite 101 Celebration FL 34747 Office 321-939-5093 Mobile 407-314-0122 Fax 321-939-5604 dave.sh...@channelintellence.com<mailto:dave.sh...