Even when I do explicit casting im getting same error:
sensitiveSet = foreach sensitiveSet generate (long) $0, (chararray) $1,
(long) $2, (chararray) $3, (chararray) $4, (chararray) $5;
On Mon, Jan 11, 2016 at 6:03 PM, John Smith wrote:
> Hi,
>
> Im trying to dump relation into AVRO
Hi,
Im trying to dump relation into AVRO file but im getting strange error:
org.apache.pig.data.DataByteArray cannot be cast to java.lang.CharSequence
I dont use DataByteArray (bytearray), see description of the relation
below.
sensitiveSet: {rank_ID: long,name: chararray,customerId: long,VIN:
Hi All,
I wrote a UDF that returns a string and here is a sample code:
split data into purchased IF ((boolean) (myudf(param)), failed OTHERWISE;
As an example, here is the example of that my udf returns:split data into
purchased IF ((boolean) (retcode == 'SUCCESS')), failed OTHERWISE;
Unfortunat
at
> > java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> > > > > > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> > > > > > at
> > > > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > > > >
ss(ClassLoader.java:247)
> > > > > at java.lang.Class.forName0(Native Method)
> > > > > at java.lang.Class.forName(Class.java:247)
> > > > >
> > > > >
> > > > > events = LOAD 'hbase://events'
>
> > events = LOAD 'hbase://events'
> > > > USING org.apache.pig.backend.hadoop.hbase.HBaseStorage('info:field1
> > > > info:field2 info:field3')
> > > > AS (field1: chararray, field2:chararray, field3:chararray);
> > > > It s
> > > AS (field1: chararray, field2:chararray, field3:chararray);
> > > It seems to work if I use bytearray instead of chararray (or no type at
> > > all.)
> > > AS (field1: bytearray, field2:bytearray, field3:bytearray);
> > >
> > > or
> > &
gt; > all.)
> > AS (field1: bytearray, field2:bytearray, field3:bytearray);
> >
> > or
> >
> > AS (field1, field2, field3);
> >
> > My question is that why do we get the ClassNotFoundException for
> > TableInpuFormat which is kind of misleading? Plus,
fo:field2 info:field3')
> AS (field1: chararray, field2:chararray, field3:chararray);
> It seems to work if I use bytearray instead of chararray (or no type at
> all.)
> AS (field1: bytearray, field2:bytearray, field3:bytearray);
>
> or
>
> AS (field1, field2, field3);
>
ion is that why do we get the ClassNotFoundException for
TableInpuFormat which is kind of misleading? Plus, is it even type casting
really the issue? Wouldn't automatic byte-to-char conversion happen?
This issue has been discussed earlier also but it doesn't seem any
conclusion was reache
Hi,
I've got some objects originally loaded, using the JSON loader from
elephantbird, into nested maps, and subsequently stored using
LZOPigStorage after various stages of processing.
When I subsequently load these nested maps, and pass them into a UDF for
modification, pretty much any attempt to
A = LOAD '/foo/replace_me_with_regex' USING MyLoadFunc((int)$year,
> (int)$month, (int)$day);
>
> This does, but it forces my LoadFunc to accept String parameters and do
> the casting within:
>
> A = LOAD '/foo/replace_me_with_regex' USING MyLoadFunc('$year',
> '$month', '$day');
>
> Thanks,
> Ian.
>
A = LOAD '/foo/replace_me_with_regex' USING MyLoadFunc($year, $month,
$day);
A = LOAD '/foo/replace_me_with_regex' USING MyLoadFunc((int)$year,
(int)$month, (int)$day);
This does, but it forces my LoadFunc to accept String parameters and do the
casting within:
You have to write little checking udfs.
In the future you'll just use the error handling feature (see wiki) to
deal with this :)
D
On Thu, Feb 3, 2011 at 12:51 PM, Kris Coward wrote:
> Hey there,
>
> I've just started butting heads against a problem where I'm trying to
> cast bytearrays in cust
Hey there,
I've just started butting heads against a problem where I'm trying to
cast bytearrays in customer-provided data to integers. The overwhelming
majority of the time, we seem to get actual integers, but I just had a
job choke when one of these should-be-integers wasn't. Is there some
sort
15 matches
Mail list logo