Re: [VOTE] Release Oozie 3.3.0 (candidate 0)

2012-11-25 Thread Rohini Palaniswamy
Context on that issue is in https://issues.apache.org/jira/browse/MAPREDUCE-4549. Failing with that error in hadoop has been reverted in 0.23.x line but not in 2.0.x line. Regards, Rohini On Wed, Nov 21, 2012 at 6:17 PM, Roman Shaposhnik wrote: > -1 based on Bigtop testing against Hadoop 2.0.2

Re: Question about secure Impersonation of oozie -- Are real Unix users still needed?

2013-02-16 Thread Rohini Palaniswamy
Jun, It is not something specific to hadoop. It is general configuration and management of user accounts in Linux. LDAP is a directory standard that is used for managing user accounts apart from other things. Active Directory(Microsoft), OpenLDAP are some of the LDAP server implementations avail

Re: NoClassDefFoundError: org/apache/hadoop/hbase/client/HTableInterface

2013-02-16 Thread Rohini Palaniswamy
Jinye, This is happening in ApplicationMaster code and you will be seeing the error in AM logs. http://svn.apache.org/viewvc/hadoop/common/branches/branch-2.0.1-alpha/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/jo

Re: NoClassDefFoundError: org/apache/hadoop/hbase/client/HTableInterface

2013-02-18 Thread Rohini Palaniswamy
t; After all, do you know if there is any document on how to use shared jars > from an oozie action? I got information from a blog which might not be > completed. > > Thx. > > Jinye > > -Original Message- > From: Rohini Palaniswamy [mailto:rohini.adi...@gmail.c

Re: NoClassDefFoundError: org/apache/hadoop/hbase/client/HTableInterface

2013-02-19 Thread Rohini Palaniswamy
ClassLoader.java:202) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.java:190) > at java.lang.ClassLoader.loadClass(ClassLoader.java:306) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) >

Re: NoClassDefFoundError: org/apache/hadoop/hbase/client/HTableInterface

2013-03-01 Thread Rohini Palaniswamy
ilecache/-5716822313188611937/zookeeper.jar > > ls -l > /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/filecache/3126140985408287414/hbase-0.92.1-cdh4.1.1.jar > -r-xr-xr-x 1 yarn yarn 0 Feb 26 11:46 > /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/filecache/3126140985408287414/hbase-0.92.1-cdh4.1.1.

Re: Oozie uses different M/R than the one specified in jar

2013-03-04 Thread Rohini Palaniswamy
Do you have some other jar containing file with same package name and class name somewhere in the classpath? You should try removing the duplicate Regards, Rohini On Sat, Mar 2, 2013 at 6:05 AM, Artem Ervits wrote: > > Hello all, > > I'm trying to write a M/R workflow. It simply counts the rec

Re: HiveAction and hive-site.xml

2013-03-21 Thread Rohini Palaniswamy
+user mailing list. Am I missing something? Can someone confirm that specifying all hive properties in action conf is the only way to launch Hive Action of Oozie 3.3 with hive 0.9/0.10? Regards, Rohini On Thu, Mar 21, 2013 at 10:07 AM, Rohini Palaniswamy < rohini.adi...@gmail.com> wrote:

Re: HiveAction and hive-site.xml

2013-03-21 Thread Rohini Palaniswamy
Paul Chavez wrote: > >> Have you tried putting a hive-site.xml in the deployment directory and >> then referencing it in the element? >> >> -Original Message- >> From: Rohini Palaniswamy >> [mailto:rohini.aditya@gmail.**com >> ] >> Sent: Thursda

Re: Oozie problems with Pig 0.11

2013-04-25 Thread Rohini Palaniswamy
Pig 0.11 has more dependencies than pig-0.9 and those need to be included as dependencies in the oozie pom to work. branch 3.3: Pig Stack Trace --- ERROR 2998: Unhandled internal error. org/codehaus/jackson/map/util/LRUMap java.lang.NoClassDefFoundError: org/codehaus/jackson/map/util

Re: no _SUCCESS file in MR output directory.

2013-05-06 Thread Rohini Palaniswamy
Actually oozie sets it to true for all the actions in launches. So by default you should see _SUCCESS file, unless you specifically override it in the action. What version of hadoop and oozie are you using? Regards, Rohini On Mon, May 6, 2013 at 7:24 AM, Eduardo Afonso Ferreira wrote: > I'm not

Re: MultipleInputs and multiple mappers

2013-05-06 Thread Rohini Palaniswamy
Hi Tom, You can either 1) write a Java action which has the above code. (or) 2) You can mimick what MultipleInputs.addInputPath does, and set those settings yourself in the action conf of the MR action. http://svn.apache.org/viewvc/hadoop/common/branches/branch-1.0/src/mapred/org/apache/hado

Re: Welcome Mona Chitnis as new Oozie PMC

2013-06-03 Thread Rohini Palaniswamy
Congrats Mona !! On Mon, Jun 3, 2013 at 4:14 PM, Robert Kanter wrote: > Congrats! > > > On Mon, Jun 3, 2013 at 4:12 PM, Alejandro Abdelnur > wrote: > > > Congratulations Mona, well deserved. > > > > > > On Mon, Jun 3, 2013 at 3:57 PM, Mohammad Islam > wrote: > > > > > Hi Oozie community, > >

Re: Oozie Meetup before summit: Interested in short presentation?

2013-06-18 Thread Rohini Palaniswamy
Hi, We at Y! are planning to do a presentation on the features in soon to be released 4.0 (HCatalog integration, SLA support) and the performance work going forward. Will take about 20 mins. Regards, Rohini On Tue, Jun 18, 2013 at 12:34 AM, Mohammad Islam wrote: > Hi All, > As you know, th

Re: Oozie PM chair change, new chair Mohammad Islam

2013-09-16 Thread Rohini Palaniswamy
Congrats Mohammad !!! Regards, Rohini On Mon, Sep 16, 2013 at 5:04 AM, Jarek Jarcec Cecho wrote: > Congratulations Mohammad! > > Jarcec > > On Mon, Sep 16, 2013 at 02:00:40PM +0200, Alejandro Abdelnur wrote: > > First of all, my apologies for the delay getting the word out. > > > > Last month,

Re: java.io.UTFDataFormatException: encoded string too long: 69390 bytes

2013-11-12 Thread Rohini Palaniswamy
http://www.drillio.com/en/software-development/java/encoded-string-too-long-64kb-limit/ This is a limitation of the java serialization that is used by Oozie. You have to reduce your string length. Regards, Rohini On Thu, Nov 7, 2013 at 9:34 AM, Purshotam Shah wrote: > Hi Giridhar, > There i

Re: Data Pipeline - Does oozie support the newly created partitions from step 1 as the input events and parameters for step 2?

2013-12-17 Thread Rohini Palaniswamy
The newly generated partitions should be part of data-out. You can pass the partitions using coord:dataOut() EL function Regards, Rohini On Thu, Dec 12, 2013 at 2:12 AM, Huiting Li wrote: > Hi, > > In oozie coordinator, we can Using ${coord:current(int n)} to create a > data-pipeline using a

Re: HBase Action

2013-12-17 Thread Rohini Palaniswamy
You need to write a java action that launches the hbase mapreduce job. The scan information cannot be encapsulated as a readable config for mapreduce as it serializes lot of information. Regards, Rohini On Fri, Dec 13, 2013 at 9:13 AM, Jerry Lam wrote: > Hello Oozie users, > > Anyone has experi

Re: Data Pipeline - Does oozie support the newly created partitions from step 1 as the input events and parameters for step 2?

2013-12-18 Thread Rohini Palaniswamy
initial-instance="2009-01-01T24:00Z" timezone="UTC"> > > hdfs://bar:8020/app/daily-logs/${YEAR}/${MONTH}/${DAY} > > > ... > > > ${coord:current(0)} > > > . > > wfOutput > ${coord:dat

Re: Welcoming Bowen Zhang as Oozie committer

2014-06-13 Thread Rohini Palaniswamy
Congratulations Bowen !!! On Fri, Jun 13, 2014 at 9:30 AM, Ryota Egashira < egash...@yahoo-inc.com.invalid> wrote: > Congrats, Bowen! > > Ryota > > On 6/12/14, 10:36 AM, "Mona Chitnis" wrote: > > >Congrats Bowen. Looking forward to more contributions from you. > > > > -- > >Mona Chitnis > > > >

Welcome new Oozie Committer - Shwetha GS

2014-07-22 Thread Rohini Palaniswamy
Hi folks, It is my pleasure to announce that Shwetha has become the newest addition to the Oozie Committers! Shwetha has been involved with Oozie for more than two years now and has been very actively contributing for over a year now with patches and reviews. She is also Committer/PPMC of

Re: Oozie BoF at Hadoop Summit San Jose.

2016-06-27 Thread Rohini Palaniswamy
Puru, I am not sure if 1 and 3 make sense given that your talk on Oozie is also about the same and it will be a repeat of information. Robert, It would be good to talk about the Oozie and unmanaged AM branch work. Possible for you to do a 5 min talk or get someone else from Cloudera do tha

Re: Does oozie-4.3.0 support spark-2.0?

2016-11-16 Thread Rohini Palaniswamy
Please do send questions to user mailing list in future. There is a wider audience and committers who can answer the question. Oozie 4.3.0 (branch) and master do support Spark 2.0. What issue are you facing with compilation? Regards, Rohini On Wed, Nov 16, 2016 at 11:24 AM, Huizhi Lu wrote: >

[CVE-2017-15712] Apache Oozie Server vulnerability

2018-02-15 Thread Rohini Palaniswamy
Apache Oozie is a workflow scheduler system to manage Apache Hadoop jobs. Severity: Severe Vendor: The Apache Software Foundation Versions Affected: Oozie 3.1.3-incubating to Oozie 4.3.0 Oozie 5.0.0-beta1 Description: Vulnerability allows a user of Oozie to expose private files on the Oozie ser