Pig launcher script would benefit from exec'ing hadoop instead of java (in 
cases where Hadoop is available)
-----------------------------------------------------------------------------------------------------------

                 Key: PIG-2383
                 URL: https://issues.apache.org/jira/browse/PIG-2383
             Project: Pig
          Issue Type: Improvement
          Components: grunt
    Affects Versions: 0.9.0, 0.8.1, 0.8.0
            Reporter: Roman Shaposhnik
            Priority: Minor


It seems that pig launcher script needs to replicate a lot of hadoop launcher 
script functionality if it wants to set things like java library path and 
classpath just right. Currently users are burdened with the need to do it 
manually even when all the appropriate setting are available for Hadoop. For 
instance, in order for the following to succeed, Pig has to be explicitly told 
about lzo libs (PIG_OPTS="$PIG_OPTS 
-Djava.library.path=..path..to.hadoop..native..libs"

{noformat}
E = LOAD 'foo.txt.lzo' USING PigStorage() as (a:int);
DUMP E;
{noformat}

The suggestion is to follow the trend set by Hive and use hadoop launcher 
script instead of Java. If the Hadoop launcher script is not available we can 
alway fall back on the default behavior.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to