Re: UDFs in Beeline w/ Hive 0.13.0

2014-04-30 Thread Bryan Jeffrey
Jason, The issue was indeed that the class needed to be in the public scope. Thank you for the help! Regards, Bryan Jeffrey On Wed, Apr 30, 2014 at 6:07 PM, Jason Dere wrote: > Is this embedded beeline, or going against HiveServer2? Which one is > picking up the .hiverc? > > Hive really sh

Re: UDFs in Beeline w/ Hive 0.13.0

2014-04-30 Thread Jason Dere
Is this embedded beeline, or going against HiveServer2? Which one is picking up the .hiverc? Hive really should be printing the exact exception message there (GenericUDFBridge), it prints that error on any exception it encounters in that part of the logic. It might be hiding what the actual er

ArrayIndexOutOfBoundsException while writing MapReduce output as RCFile

2014-04-30 Thread John Zeng
That is exactly the fix. Thanks Yin.

Re: UDFs in Beeline w/ Hive 0.13.0

2014-04-30 Thread Brad Ruderman
Post your exact code. I think you might be using a reserved word perhaps? Thanks, Brad On Wed, Apr 30, 2014 at 11:32 AM, Bryan Jeffrey wrote: > Hello. > > We have a number of UDFs that were working under Hive 0.12.0. After > upgrade to Hive 13 we are seeing errors executing queries with UDFs.

UDFs in Beeline w/ Hive 0.13.0

2014-04-30 Thread Bryan Jeffrey
Hello. We have a number of UDFs that were working under Hive 0.12.0. After upgrade to Hive 13 we are seeing errors executing queries with UDFs.The UDF jar file is in the $HIVE_CONF/.hiverc file as 'add jar ', and the 'create temporary function' call is there too. We are continuing to see the

Re: Create hive table to support multiple delimiters

2014-04-30 Thread unmesha sreeveni
I belive you are having | as delimiter And you can create the table using this link: http://www.unmeshasreeveni.blogspot.in/2014/04/how-to-create-tables-in-hive.html On Wed, Apr 30, 2014 at 3:59 PM, Arafat, Moiz wrote: > I think \x22 represent double quotes . Try storing the second column as >

Re: OrcOutputFormat

2014-04-30 Thread Seema Datar
Hi All, Does anybody have ideas to solve this issue? Thanks, Seema From: Seema Datar mailto:sda...@yahoo-inc.com>> Date: Tuesday, April 29, 2014 at 11:10 PM To: "user@hive.apache.org" mailto:user@hive.apache.org>> Subject: Re: OrcOutputFormat Hi Abhishek, I was re

Re: Reduce Job Start

2014-04-30 Thread unmesha sreeveni
Reduce starts only after all Map task finishes.Reducers pull data from mappers ,but processing is done only after all map get finished. It is better to look into JObtracker UI instead of looking into console. There you can see only after map 100% Reducer starts -- *Thanks & Regards * *Unmesha S

Re: when to use hive vs hbase

2014-04-30 Thread Shushant Arora
Mapping Existing Hbase table to Hive will be better or Creating direct Hive tables will be better ? I am reiterating 2 scenarios I have a requirement of processing huge weblogs on daily basis. Scenario 1. data will come incremental to datastore (containing timestamp,userid,operation performed) o

Re: when to use hive vs hbase

2014-04-30 Thread unmesha sreeveni
HDFS lacks random read and write accees. This is where HBase comes into picture.It stores data as key/value pairs. Hive provides data warehousing facilities on top of an existing Hadoop cluster. It provides an SQL like interface which makes your work easier. You can create tables in Hive and store

RE: Create hive table to support multiple delimiters

2014-04-30 Thread Arafat, Moiz
I think \x22 represent double quotes . Try storing the second column as MAP data type and then get the value of appid etc. Thanks, Moiz From: unmesha sreeveni [mailto:unmeshab...@gmail.com] Sent: Wednesday, April 30, 2014 3:39 PM To: User - Hive Subject: Re: Create hive table to support multiple

Re: Create hive table to support multiple delimiters

2014-04-30 Thread unmesha sreeveni
So your delimiters are | and \x22? Can you show me how should be your table structure. So that I can help you On Wed, Apr 30, 2014 at 3:14 PM, Kishore kumar wrote: > > Hi All, > > My input data looks like below as | delimited and I want to extract appid, > appname, bundleid etc, please help m

Create hive table to support multiple delimiters

2014-04-30 Thread Kishore kumar
Hi All, My input data looks like below as | delimited and I want to extract appid, appname, bundleid etc, please help me to create hive table , |0|{\x22appid\x22:\x228\x22,\x22appname\x22:\x22CONVX-0008\x22,\x22bundleid\x22:\x22com.zeptolab.timetravel.free.google\x22}|14| -- Thanks, *Kishore *

when to use hive vs hbase

2014-04-30 Thread Shushant Arora
I have a requirement of processing huge weblogs on daily basis. 1. data will come incremental to datastore on daily basis and I need cumulative and daily distinct user count from logs and after that aggregated data will be loaded in RDBMS like mydql. 2.data will be loaded in hdfs datawarehouse o