Please ignore the previous mail. Your sharelib setup looks correct.
Somehow I didn’t see the last part of email.
Please share the error message after setting below property.
<property>
<name>oozie.service.WorkflowAppService.system.libpath</name>
<value>/user/${user.name}/share/lib</value>
</property>
Puru.
On 8/14/14, 7:11 PM, "Purshotam Shah" <[email protected]>
wrote:
>Filix,
> Oozie doesn’t create sharelib dir(parent dir), it expect that it will be
>there with proper permission.
>Can you try creating "/user/filix/share/lib”?
>
>How are you deploying sharelib?
>
>Please refer below Doc.
>https://oozie.apache.org/docs/4.0.1/AG_Install.html#Oozie_Share_Lib
>
>https://oozie.apache.org/docs/4.0.1/AG_Install.html#Oozie_Server_Setup
>
>
>-----
>sharelib create -fs FS_URI [-locallib SHARED_LIBRARY] (create sharelib for
>oozie,"
> FS_URI is the fs.default.name"
> for hdfs uri; SHARED_LIBRARY, path to the"
> Oozie sharelib to install, it can be a tarball"
> or an expanded version of it. If ommited,"
> the Oozie sharelib tarball from the Oozie"
> installation directory will be used)"
> (action failes if sharelib is already installed"
> in HDFS)”
>
>----
>Let us know it still fails.
>
>Puru.
>
>
>
>
>
>On 8/14/14, 6:53 PM, "Filix Suo" <[email protected]> wrote:
>
>>Hi Robert,
>>
>>Thanks for your answer.
>>I tried as you said, but it still throw the error.
>>
>>
>>在 2014年8月15日，上午1:36，Robert Kanter <[email protected]> 写道：
>>
>>> Hi Filix,
>>>
>>> You should not include the lib_<timestamp> part of the path in the
>>> oozie-site property. Oozie knows to look for the latest
>>>lib_<timestamp>
>>> dir under that location.
>>>
>>> e.g
>>> <property>
>>> <name>oozie.service.WorkflowAppService.system.libpath</name>
>>> <value>/user/${user.name}/share/lib</value>
>>> <description>
>>> System library path to use for workflow applications.
>>> This path is added to workflow application if their job
>>>properties
>>> sets
>>> the property 'oozie.use.system.libpath' to true.
>>> </description>
>>> </property>
>>>
>>>
>>>
>>>
>>>
>>> On Wed, Aug 13, 2014 at 7:49 PM, Filix Suo <[email protected]> wrote:
>>>
>>>> hi all,
>>>>
>>>> I build and install oozie, then I try to run the examples in oozie.
>>>> It throw a org.apache.oozie.action.ActionExecutorException: File
>>>> /user/filix/share/lib does not exist.
>>>>
>>>> 2014-08-14 10:44:23,891 INFO ActionStartXCommand:541 -
>>>> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[]
>>>>APP[shell-wf]
>>>> JOB[0000000-140814104417138-oozie-fili-W]
>>>> ACTION[0000000-140814104417138-oozie-fili-W@:start:] Start action
>>>> [0000000-140814104417138-oozie-fili-W@:start:] with user-retry state :
>>>> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
>>>> 2014-08-14 10:44:23,892 INFO ActionStartXCommand:541 -
>>>> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[]
>>>>APP[shell-wf]
>>>> JOB[0000000-140814104417138-oozie-fili-W]
>>>> ACTION[0000000-140814104417138-oozie-fili-W@:start:]
>>>> [***0000000-140814104417138-oozie-fili-W@:start:***]Action status=DONE
>>>> 2014-08-14 10:44:23,892 INFO ActionStartXCommand:541 -
>>>> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[]
>>>>APP[shell-wf]
>>>> JOB[0000000-140814104417138-oozie-fili-W]
>>>> ACTION[0000000-140814104417138-oozie-fili-W@:start:]
>>>> [***0000000-140814104417138-oozie-fili-W@:start:***]Action updated in
>>>>DB!
>>>> 2014-08-14 10:44:24,136 INFO ActionStartXCommand:541 -
>>>> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[]
>>>>APP[shell-wf]
>>>> JOB[0000000-140814104417138-oozie-fili-W]
>>>> ACTION[0000000-140814104417138-oozie-fili-W@shell-node] Start action
>>>> [0000000-140814104417138-oozie-fili-W@shell-node] with user-retry
>>>>state :
>>>> userRetryCount [0], userRetryMax [0], userRetryInterval [10]
>>>> 2014-08-14 10:44:24,220 WARN ActionStartXCommand:544 -
>>>> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[]
>>>>APP[shell-wf]
>>>> JOB[0000000-140814104417138-oozie-fili-W]
>>>> ACTION[0000000-140814104417138-oozie-fili-W@shell-node] Error starting
>>>> action [shell-node]. ErrorType [FAILED], ErrorCode [It should never
>>>> happen], Message [File /user/filix/share/lib/lib_20140814100844 does
>>>>not
>>>> exist]
>>>> org.apache.oozie.action.ActionExecutorException: File
>>>> /user/filix/share/lib/lib_20140814100844 does not exist
>>>> at
>>>>
>>>>org.apache.oozie.action.hadoop.JavaActionExecutor.addSystemShareLibForA
>>>>c
>>>>tion(JavaActionExecutor.java:620)
>>>> at
>>>>
>>>>org.apache.oozie.action.hadoop.JavaActionExecutor.addAllShareLibs(JavaA
>>>>c
>>>>tionExecutor.java:698)
>>>> at
>>>>
>>>>org.apache.oozie.action.hadoop.JavaActionExecutor.setLibFilesArchives(J
>>>>a
>>>>vaActionExecutor.java:689)
>>>> at
>>>>
>>>>org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaAc
>>>>t
>>>>ionExecutor.java:884)
>>>> at
>>>>
>>>>org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecu
>>>>t
>>>>or.java:1134)
>>>> at
>>>>
>>>>org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCom
>>>>m
>>>>and.java:228)
>>>> at
>>>>
>>>>org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCom
>>>>m
>>>>and.java:63)
>>>> at org.apache.oozie.command.XCommand.call(XCommand.java:281)
>>>> at
>>>>
>>>>org.apache.oozie.service.CallableQueueService$CompositeCallable.call(Ca
>>>>l
>>>>lableQueueService.java:323)
>>>> at
>>>>
>>>>org.apache.oozie.service.CallableQueueService$CompositeCallable.call(Ca
>>>>l
>>>>lableQueueService.java:252)
>>>> at
>>>>
>>>>org.apache.oozie.service.CallableQueueService$CallableWrapper.run(Calla
>>>>b
>>>>leQueueService.java:174)
>>>> at
>>>>
>>>>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.ja
>>>>v
>>>>a:1145)
>>>> at
>>>>
>>>>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.j
>>>>a
>>>>va:615)
>>>> at java.lang.Thread.run(Thread.java:744)
>>>> 2014-08-14 10:44:24,222 WARN ActionStartXCommand:544 -
>>>> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[]
>>>>APP[shell-wf]
>>>> JOB[0000000-140814104417138-oozie-fili-W]
>>>> ACTION[0000000-140814104417138-oozie-fili-W@shell-node] Failing Job
>>>>due
>>>> to failed action [shell-node]
>>>> 2014-08-14 10:44:24,224 WARN LiteWorkflowInstance:544 -
>>>> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[]
>>>>APP[shell-wf]
>>>> JOB[0000000-140814104417138-oozie-fili-W]
>>>> ACTION[0000000-140814104417138-oozie-fili-W@shell-node] Workflow
>>>>Failed.
>>>> Failing node [shell-node]
>>>> 2014-08-14 10:44:24,370 INFO KillXCommand:541 -
>>>> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[]
>>>>APP[shell-wf]
>>>> JOB[0000000-140814104417138-oozie-fili-W] ACTION[-] STARTED
>>>> WorkflowKillXCommand for jobId=0000000-140814104417138-oozie-fili-W
>>>> 2014-08-14 10:44:24,394 INFO KillXCommand:541 -
>>>> SERVER[Filix-MacBook-Pro.local] USER[filix] GROUP[-] TOKEN[]
>>>>APP[shell-wf]
>>>> JOB[0000000-140814104417138-oozie-fili-W] ACTION[-] ENDED
>>>> WorkflowKillXCommand for jobId=0000000-140814104417138-oozie-fili-W
>>>>
>>>>
>>>> However I have uploaded the share lib to hdfs:
>>>>
>>>> $ hadoop fs -ls /user/filix/share/lib/lib_20140814100844
>>>> Found 8 items
>>>> drwxr-xr-x - filix supergroup 0 2014-08-14 10:08
>>>> /user/filix/share/lib/lib_20140814100844/distcp
>>>> drwxr-xr-x - filix supergroup 0 2014-08-14 10:08
>>>> /user/filix/share/lib/lib_20140814100844/hcatalog
>>>> drwxr-xr-x - filix supergroup 0 2014-08-14 10:08
>>>> /user/filix/share/lib/lib_20140814100844/hive
>>>> drwxr-xr-x - filix supergroup 0 2014-08-14 10:08
>>>> /user/filix/share/lib/lib_20140814100844/mapreduce-streaming
>>>> drwxr-xr-x - filix supergroup 0 2014-08-14 10:08
>>>> /user/filix/share/lib/lib_20140814100844/oozie
>>>> drwxr-xr-x - filix supergroup 0 2014-08-14 10:08
>>>> /user/filix/share/lib/lib_20140814100844/pig
>>>> -rw-r--r-- 3 filix supergroup 1384 2014-08-14 10:08
>>>> /user/filix/share/lib/lib_20140814100844/sharelib.properties
>>>> drwxr-xr-x - filix supergroup 0 2014-08-14 10:08
>>>> /user/filix/share/lib/lib_20140814100844/sqoop
>>>>
>>>> here is my conf/oozie-site.xml:
>>>> <property>
>>>> <name>oozie.service.WorkflowAppService.system.libpath</name>
>>>> <value>/user/${user.name}/share/lib/lib_20140814100844</value>
>>>> <description>
>>>> System library path to use for workflow applications.
>>>> This path is added to workflow application if their job
>>>>properties
>>>> sets
>>>> the property 'oozie.use.system.libpath' to true.
>>>> </description>
>>>> </property>
>>>>
>>>>
>>>> I set the oozie.use.system.libpath=false in job.properties, but it
>>>>seems
>>>> does not work(still throw the exception).
>>>>
>>>> My hadoop is v2.2.0 and oozie is4.2.0-SNAPSHOT.
>>>>
>>>> Anyone help?
>>>>
>>>> Best regards!
>>>>
>>
>
