Kryo - Class cannot be created (missing no-arg constructor): org.apache.hadoop.hive.serde2.objectinspector.primitive.PrimitiveObjectInspectorConverter$IntConverter

2014-03-28 Thread Juraj jiv
Hello, im testing CDH5 beta2 with Hive 0.12+ and notice issue while using custom UDF. Function decode from nextR-hive-udf-0.2 ( https://github.com/nexr/hive-udf) add jar nexr-hive-udf-0.2-SNAPSHOT.jar; CREATE TEMPORARY FUNCTION decode AS 'com.nexr.platform.hive.udf.GenericUDFDecode'; then i did s

Re: How do I get the php client to run?

2014-03-28 Thread Jeremy
First of all thank you so much for taking the time to reply to my question. When I do that I get this error PHP Parse error: syntax error, unexpected ';', expecting T_STRING or T_NS_SEPARATOR or '{' in /apache-hive-0.14.0-SNAPSHOT-bin/lib/php/packages/hive_service/ThriftHive.php on line 2 and on

Re: CLI, HiveServer2, Beeline

2014-03-28 Thread Prasad Mujumdar
That's correct. Beeline is being used as a thin client, it's making JDBC calls to the HiveServer2, which invokes the Hive driver to execute the query. The HiveServer2 interface supports both remote as well as local calls. The Beeline (more accurately the Hive JDBC driver used by Beeline), invokes

Re: CLI, HiveServer2, Beeline

2014-03-28 Thread Prasad Mujumdar
Hello Uber, Please see the comments inline. thanks Prasad On Fri, Mar 28, 2014 at 8:28 AM, Uber Slacker wrote: > Hi folks. I'm trying to wrap my head around the latest Hive architecture > (as of 0.12 at least). From what I've gathered: > > - HiveServer2 is the new Thrift based Hive server

Re: CLI, HiveServer2, Beeline

2014-03-28 Thread Uber Slacker
Thanks Prasad! This is helping. A newb question about Beeline and embedded: So when Beeline is being used as a thin client, it's making JDBC calls to the HiveServer2. HiveServer2 is then interacting with the Hive driver. Hopefully that understanding is correct. Now when HiveServer2 is in embedded

CLI, HiveServer2, Beeline

2014-03-28 Thread Uber Slacker
Hi folks. I'm trying to wrap my head around the latest Hive architecture (as of 0.12 at least). From what I've gathered: - HiveServer2 is the new Thrift based Hive server. - We can use Thrift, JDBC, and ODBC tools to connect to HiveServer2. - Beeline is an included CLI that connects to HiveServe

Re: Number of Mapper when reading from Cassandra

2014-03-28 Thread Amjad ALSHABANI
Thanx Chinna, I have another question. Now I know that InputForamt is an interface in apache hadoop, so what I get (and correct me if I m wrong) that it is Hive implementation who makes all that splits , is it ? or it is because of using of Cassandra? In both cases, can I do anything to manage th

Re: Number of Mapper when reading from Cassandra

2014-03-28 Thread Chinna Rao Lalam
Hi, Number of mappers will depend on some factors like, 1.The number of mappers is defined based on our data size (By default set to one per HDFS block). 2.The number of mappers depends on amount of InputSplit generated by InputFormat#getInputSplits method. In particular FileInputSplit splits in

Number of Mapper when reading from Cassandra

2014-03-28 Thread Amjad ALSHABANI
Hello All, I have tow tables created in Hive, one read the data immidiately from Cassandra DB and the other takes the data from stored files (data already exported in somewhow from the same Cassandra DB) Both tables are identical (in data) but when running the same request it gives me very differ

Re: How do I get the php client to run?

2014-03-28 Thread Chinna Rao Lalam
Hi, 1. Start Hiveserver 2. In php client code set THRIFT_ROOT to php lib of hive distribution (Ex: /home/install/apache-hive-0.14.0-SNAPSHOT-bin/lib/php) Hope It Helps, Chinna On Fri, Mar 28, 2014 at 12:14 AM, Jeremy wrote: > Or how do query hive from php? > > On 03/27/2014 12:25 PM, Jere

Re: optimize hive query for multitable join where one table is huge

2014-03-28 Thread Chinna Rao Lalam
Hi, In hive different types of joins are there like join, map join , bucket map join and etc. Please take a look of these it may help you to optimize your query https://cwiki.apache.org/confluence/display/Hive/LanguageManual+JoinOptimization https://www.facebook.com/notes/facebook-engineering/j

RE: Input from Hbase into Hive partition

2014-03-28 Thread sreenivasulu y
Hive Over HBase one feature is there in HIVE, In HBase already logic is there to scan only one day or specific range of days The below command will help to scan in HBase Syntax: scan '', {TIMERANGE => [, ]} scan 't1', {TIMERANGE => [1303668804, 1303668904]} Regards, Seenu. From: Manju M [mailto

Re: Input from Hbase into Hive partition

2014-03-28 Thread Manju M
Hbase table ( key , cf1:column1 , cf1:column2, cf1:column n ) key is + Hive mounting few columns from hbase table i want to collect a day's( 2014-03-28 ) 's data from hbase table and insert that data into hive ( partition : 2014-03-28 ) On Fri, Mar 28, 2014 at 12:16 AM, Mohammad

Re: Input from Hbase into Hive partition

2014-03-28 Thread Mohammad Tariq
Hi Manju, How are you storing your data in HBase?What is your rowkey? Warm Regards, Tariq cloudfront.blogspot.com On Fri, Mar 28, 2014 at 12:03 PM, Manju M wrote: > How can i scan one day's data from Hbase table and insert that into Hbase > partition ( date) ? > > is it possible? >