What version of pig are you using? William Watson Software Engineer (904) 705-7056 PCS
On Thu, Apr 23, 2015 at 2:57 PM, Jim Green <[email protected]> wrote: > Hi Team, > > Pig will put “unbar-xxx” directory in /tmp/hadoop-<user> by default, and > this is controlled by hadoop.tmp.dir. > If many pig jobs are running in parallel, it may fill /tmp or it may cause > IO storm to /tmp. > The goal is to set hadoop.tmp.dir to other directories to give a better > life to /tmp. > > I know we can set hadoop.tmp.dir in core-site.xml and it works fine. > However I could not find a way to set it at job level. > > I tried “set hadoop.tmp.dir /xxx” in pig scripts and also put it in: > export PIG_OPTS="-Dhadoop.tmp.dir=/xxx" > However none of them works. > > *So is there anyway to set hadoop.tmp.dir instead of putting it in > core-site.xml?* > -- > Thanks, > www.openkb.info > (Open KnowledgeBase for Hadoop/Database/OS/Network/Tool) >
