Re: DATA UPLOADTION

2012-07-16 Thread Bejoy KS
Hi Yogesh You can connect reporting tools like tableau , micro strategy etc direcly with hive. If you are looking for some static reports based on aggregate data. You can process the data in hive move the resultant data into some rdbms and use some common reporting tools over the same. I know

Re: Hive Thrift Client

2012-07-16 Thread Navis류승우
It seemed to be https://issues.apache.org/jira/browse/HIVE-2937 HIVE-2397 is expected to be included in hive-0.9 but missed by some reason. You can try applying the patch or using hive in trunk. 2012/7/17 Ben Kim > I tested it on 0.8.1 and 0.9.0 > > Ben > > > On Tue, Jul 17, 2012 at 3:03 PM, Na

RE: DATA UPLOADTION

2012-07-16 Thread yogesh.kumar13
Thanks Gesli and Bejoy, I have created tables in hive and uploaded data into it. I can perform query on it, please suggest me how to generate reports from that tables. Mr. Gesli, If I create tables with single string column like ( create table Log_table( Data STRING); ) then how can perform con

Re: Hive Thrift Client

2012-07-16 Thread Ben Kim
I tested it on 0.8.1 and 0.9.0 Ben On Tue, Jul 17, 2012 at 3:03 PM, Navis류승우 wrote: > Can I ask the hive version you are currently using? > > > 2012/7/17 Ben Kim > >> Did you get around to solve this problem? >> >> I running into the same problem and can't find a fix anywhere. >> >> For Hivese

Re: Hive Thrift Client

2012-07-16 Thread Navis류승우
Can I ask the hive version you are currently using? 2012/7/17 Ben Kim > Did you get around to solve this problem? > > I running into the same problem and can't find a fix anywhere. > > For Hiveserver you will need to create your own when running the server > such as running "hive --service hives

Re: Hive Thrift Client

2012-07-16 Thread Ben Kim
Did you get around to solve this problem? I running into the same problem and can't find a fix anywhere. For Hiveserver you will need to create your own when running the server such as running "hive --service hiveserver & >> hiveserver.log 2>&1" but it writes no logs. I think a connection is gett

Re: Searching for a string off a group by query

2012-07-16 Thread John Omernik
Not sure what you are trying to do, but you may want to check out the array_contains function. Also, if you are using Hive 9 you can use the concat_ws() function. This is taken from a google search: select concat_ws(‘.’, array(‘www’,’apache’,’org’)) from src limit 1; www.apache.org https://cwiki

Re: Hive and CDH4 GA

2012-07-16 Thread kulkarni.swar...@gmail.com
Yeah. I did override hadoop.security.version to 2.0.0-alpha. That gives me a whole bunch of compilation errors in HadoopShimsSecure.java [javac] /Users/sk018283/git-repo/hive/shims/src/common-secure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java:37: package org.apache.hadoop.mapred d

Re: Hive and CDH4 GA

2012-07-16 Thread Ted Yu
I see the following in build.properties : hadoop.version=${hadoop-0.20.version} hadoop.security.version=${hadoop-0.20S.version} Have you tried to override the above property values when building ? If it still fails, please comment on HIVE-3029 .

Re: Hive and CDH4 GA

2012-07-16 Thread kulkarni.swar...@gmail.com
I found this issue [1] and applied the patch but still the issue persists. Any different way that I should be creating my assembly (currently just doing "ant clean tar") so that it works with hadoop 2.0.0 on its classpath? Any help is appreciated. Thanks, [1] https://issues.apache.org/jira/brow

Searching for a string off a group by query

2012-07-16 Thread Tharindu Mathew
Hi everyone, I'd like to do $subject and was approaching it with the following query: select activityId, count(activityId), *find_in_set("CCC", collect_set(msgBody))* from ActivityStream group by activityId; But find_in_set doesn't seem to accept arrays. Is there a way to cast this string array

Re: External Table Question

2012-07-16 Thread Bejoy KS
Hi George Your understanding is right. If your data has more columns that those defined for the table, the rest of columns at the end in your data won't be considered. Also if your table has more columns and the data has less then the last columns on your table row will have NULL. Regards B

Re: DATA UPLOADTION

2012-07-16 Thread Gesli, Nicole
If you are just trying to find certain text in the data files and you just want to do bulk process to create reports once a day or so, and prefer to use Hive: you can create a table with with single string column. You need to pre-process your data to replace the default column delimiter in your

External Table Question

2012-07-16 Thread george teVelde
I have two questions regarding external tables: Every day I create a staging table based on a data dump of the previous days data, the table and feed have 10 columns. Yesterday they added an 11th column to the feed without teling me. If I create an external table with 10 columns and point it

Re: connection error

2012-07-16 Thread kulkarni.swar...@gmail.com
This error is more related to hadoop than hive. Looking at the exception, it looks like your namenode is not running/configured properly. Check you namenode log to see why it failed to start. Swarnim On Mon, Jul 16, 2012 at 2:53 AM, shaik ahamed wrote: > Hi All, > >How to rectify the b

Re: unable to view the data in the hive tables

2012-07-16 Thread shaik ahamed
Thanks for the reply bejoy yes ur right as i login with different user prev ,now it got resolved. On Mon, Jul 16, 2012 at 1:24 PM, Bejoy KS wrote: > ** > Hi Shaik > > What is your metastore db? If it is the default derby db, please ensure > that you have the right permissions on the dir

hive script: stop when error occurs

2012-07-16 Thread Richard
hi I am wondering if there is any configuration option that allows the hive script to stop when an error occurs. e.g., hive command 1; hive command 2; hive command 3; if error occurs when hive command 2 is excuted, I want it to stop at this line so that I can easily find that something is wron

Re: unable to view the data in the hive tables

2012-07-16 Thread Bejoy KS
Hi Shaik What is your metastore db? If it is the default derby db, please ensure that you have the right permissions on the directory. If you had made any permission changes recently, reverting those should resolve the issue. Regards Bejoy KS Sent from handheld, please excuse typos. -Ori

Re: DATA UPLOADTION

2012-07-16 Thread Bejoy KS
Hi Yogesh If you are looking at some indexing and search kind of operation you can take a look at lucene. Whether you are using hive or Hbase you cannot do any operation without having a table structure defined for the data. So you need to create tables for each dataset and then only you can g