Hi Billy, Yes, I tried both and none of them work.
Thanks. On Wed, Apr 29, 2015 at 6:21 PM, Billy Watson <[email protected]> wrote: > Have you tried putting it in HADOOP_OPTS instead of PIG_OPTS? > > William Watson > Software Engineer > (904) 705-7056 PCS > > On Wed, Apr 29, 2015 at 6:18 PM, Jim Green <[email protected]> wrote: > > > Pig 0.13. > > > > Here is one typo in my previous email: “unbar” => “unjar”. > > > > > > On Wed, Apr 29, 2015 at 12:09 PM, Billy Watson <[email protected] > > > > wrote: > > > > > What version of pig are you using? > > > > > > William Watson > > > Software Engineer > > > (904) 705-7056 PCS > > > > > > On Thu, Apr 23, 2015 at 2:57 PM, Jim Green <[email protected]> > wrote: > > > > > > > Hi Team, > > > > > > > > Pig will put “unbar-xxx” directory in /tmp/hadoop-<user> by default, > > and > > > > this is controlled by hadoop.tmp.dir. > > > > If many pig jobs are running in parallel, it may fill /tmp or it may > > > cause > > > > IO storm to /tmp. > > > > The goal is to set hadoop.tmp.dir to other directories to give a > better > > > > life to /tmp. > > > > > > > > I know we can set hadoop.tmp.dir in core-site.xml and it works fine. > > > > However I could not find a way to set it at job level. > > > > > > > > I tried “set hadoop.tmp.dir /xxx” in pig scripts and also put it in: > > > > export PIG_OPTS="-Dhadoop.tmp.dir=/xxx" > > > > However none of them works. > > > > > > > > *So is there anyway to set hadoop.tmp.dir instead of putting it in > > > > core-site.xml?* > > > > -- > > > > Thanks, > > > > www.openkb.info > > > > (Open KnowledgeBase for Hadoop/Database/OS/Network/Tool) > > > > > > > > > > > > > > > -- > > Thanks, > > www.openkb.info > > (Open KnowledgeBase for Hadoop/Database/OS/Network/Tool) > > > -- Thanks, www.openkb.info (Open KnowledgeBase for Hadoop/Database/OS/Network/Tool)
