Hi Filix,
You should not include the lib_<timestamp> part of the path in the
oozie-site property. Oozie knows to look for the latest lib_<timestamp>
dir under that location.
e.g
<property>
<name>oozie.service.WorkflowAppService.system.libpath</name>
<value>/user/${user.name}/share/lib</value>
<description>
System library path to use for workflow applications.
This path is added to workflow application if their job properties
sets
the property 'oozie.use.system.libpath' to true.
</description>
</property>
On Wed, Aug 13, 2014 at 7:49 PM, Filix Suo <[email protected]> wrote:
> hi all,
>
> I build and install oozie, then I try to run the examples in oozie.
> It throw a org.apache.oozie.action.ActionExecutorException: File
> /user/filix/share/lib does not exist.
>
> 2014-08-14 10:44:23,891 INFO ActionStartXCommand:541 -
> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[] APP[shell-wf]
> JOB[0000000-140814104417138-oozie-fili-W]
> ACTION[0000000-140814104417138-oozie-fili-W@:start:] Start action
> [0000000-140814104417138-oozie-fili-W@:start:] with user-retry state :
> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> 2014-08-14 10:44:23,892 INFO ActionStartXCommand:541 -
> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[] APP[shell-wf]
> JOB[0000000-140814104417138-oozie-fili-W]
> ACTION[0000000-140814104417138-oozie-fili-W@:start:]
> [***0000000-140814104417138-oozie-fili-W@:start:***]Action status=DONE
> 2014-08-14 10:44:23,892 INFO ActionStartXCommand:541 -
> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[] APP[shell-wf]
> JOB[0000000-140814104417138-oozie-fili-W]
> ACTION[0000000-140814104417138-oozie-fili-W@:start:]
> [***0000000-140814104417138-oozie-fili-W@:start:***]Action updated in DB!
> 2014-08-14 10:44:24,136 INFO ActionStartXCommand:541 -
> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[] APP[shell-wf]
> JOB[0000000-140814104417138-oozie-fili-W]
> ACTION[0000000-140814104417138-oozie-fili-W@shell-node] Start action
> [0000000-140814104417138-oozie-fili-W@shell-node] with user-retry state :
> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
> 2014-08-14 10:44:24,220 WARN ActionStartXCommand:544 -
> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[] APP[shell-wf]
> JOB[0000000-140814104417138-oozie-fili-W]
> ACTION[0000000-140814104417138-oozie-fili-W@shell-node] Error starting
> action [shell-node]. ErrorType [FAILED], ErrorCode [It should never
> happen], Message [File /user/filix/share/lib/lib_20140814100844 does not
> exist]
> org.apache.oozie.action.ActionExecutorException: File
> /user/filix/share/lib/lib_20140814100844 does not exist
> at
> org.apache.oozie.action.hadoop.JavaActionExecutor.addSystemShareLibForAction(JavaActionExecutor.java:620)
> at
> org.apache.oozie.action.hadoop.JavaActionExecutor.addAllShareLibs(JavaActionExecutor.java:698)
> at
> org.apache.oozie.action.hadoop.JavaActionExecutor.setLibFilesArchives(JavaActionExecutor.java:689)
> at
> org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:884)
> at
> org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1134)
> at
> org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:228)
> at
> org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:63)
> at org.apache.oozie.command.XCommand.call(XCommand.java:281)
> at
> org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:323)
> at
> org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:252)
> at
> org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:174)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:744)
> 2014-08-14 10:44:24,222 WARN ActionStartXCommand:544 -
> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[] APP[shell-wf]
> JOB[0000000-140814104417138-oozie-fili-W]
> ACTION[0000000-140814104417138-oozie-fili-W@shell-node] Failing Job due
> to failed action [shell-node]
> 2014-08-14 10:44:24,224 WARN LiteWorkflowInstance:544 -
> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[] APP[shell-wf]
> JOB[0000000-140814104417138-oozie-fili-W]
> ACTION[0000000-140814104417138-oozie-fili-W@shell-node] Workflow Failed.
> Failing node [shell-node]
> 2014-08-14 10:44:24,370 INFO KillXCommand:541 -
> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[] APP[shell-wf]
> JOB[0000000-140814104417138-oozie-fili-W] ACTION[-] STARTED
> WorkflowKillXCommand for jobId=0000000-140814104417138-oozie-fili-W
> 2014-08-14 10:44:24,394 INFO KillXCommand:541 -
> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[] APP[shell-wf]
> JOB[0000000-140814104417138-oozie-fili-W] ACTION[-] ENDED
> WorkflowKillXCommand for jobId=0000000-140814104417138-oozie-fili-W
>
>
> However I have uploaded the share lib to hdfs:
>
> $ hadoop fs -ls /user/filix/share/lib/lib_20140814100844
> Found 8 items
> drwxr-xr-x - filix supergroup 0 2014-08-14 10:08
> /user/filix/share/lib/lib_20140814100844/distcp
> drwxr-xr-x - filix supergroup 0 2014-08-14 10:08
> /user/filix/share/lib/lib_20140814100844/hcatalog
> drwxr-xr-x - filix supergroup 0 2014-08-14 10:08
> /user/filix/share/lib/lib_20140814100844/hive
> drwxr-xr-x - filix supergroup 0 2014-08-14 10:08
> /user/filix/share/lib/lib_20140814100844/mapreduce-streaming
> drwxr-xr-x - filix supergroup 0 2014-08-14 10:08
> /user/filix/share/lib/lib_20140814100844/oozie
> drwxr-xr-x - filix supergroup 0 2014-08-14 10:08
> /user/filix/share/lib/lib_20140814100844/pig
> -rw-r--r-- 3 filix supergroup 1384 2014-08-14 10:08
> /user/filix/share/lib/lib_20140814100844/sharelib.properties
> drwxr-xr-x - filix supergroup 0 2014-08-14 10:08
> /user/filix/share/lib/lib_20140814100844/sqoop
>
> here is my conf/oozie-site.xml:
> <property>
> <name>oozie.service.WorkflowAppService.system.libpath</name>
> <value>/user/${user.name}/share/lib/lib_20140814100844</value>
> <description>
> System library path to use for workflow applications.
> This path is added to workflow application if their job properties
> sets
> the property 'oozie.use.system.libpath' to true.
> </description>
> </property>
>
>
> I set the oozie.use.system.libpath=false in job.properties, but it seems
> does not work(still throw the exception).
>
> My hadoop is v2.2.0 and oozie is4.2.0-SNAPSHOT.
>
> Anyone help?
>
> Best regards!
>
