RE: not able to access Hive Web Interface

2012-07-17 Thread yogesh.kumar13
Hi all :-), Iam trying to access Hive Web Interface but it fails. I have this changes in hive-site.xml hive.hwi.listen.host 0.0.0.0 This is the host address the Hive Web

Re: Run simple HiveQL query using shell script?

2012-07-17 Thread Vinod Singh
That is what I meant. Hive CLI can be invoked from a shell script. And query can be changed to something like- "INSERT OVERWRITE LOCAL DIRECTORY SELECT count(*) from pds_table" Thanks, Vinod On Wed, Jul 18, 2012 at 12:04 PM, Raihan Jamal wrote: > I know by that way I can pipe the output to som

Re: Run simple HiveQL query using shell script?

2012-07-17 Thread Raihan Jamal
I know by that way I can pipe the output to some txt file, but is there any way I can do within some sort of shell script so that If I need to schedule that shell script to run daily at some particular time, then it should work that way also and also I need to send that txt file as an attachment in

Re: Run simple HiveQL query using shell script?

2012-07-17 Thread Vinod Singh
hive -e "SELECT count(*) from pds_table" > a.txt Thanks, Vinod On Wed, Jul 18, 2012 at 10:58 AM, Raihan Jamal wrote: > I am new to Unix Shell Scripting world. I wanted to run a simple > *HiveQL*query from the Unix Shell script and output the result in a .txt file > and > then send that .txt f

RE: not able to access Hive web Interface

2012-07-17 Thread yogesh.kumar13
Thanks Kulkarni, I uploaded the hole hive directory and created path like. Hadoop dfs -mkdir /HADOOP/ Hadoop dfs -put /HADOOP/hive /HADOOP/ and also tried hive> SET fs.default.name='/HADOOP/hive/lib/' but still the same. FATAL hwi.HWIServer: HWI WAR file not found at /HADOOP/hive/lib/hive-hw

Run simple HiveQL query using shell script?

2012-07-17 Thread Raihan Jamal
I am new to Unix Shell Scripting world. I wanted to run a simple *HiveQL*query from the Unix Shell script and output the result in a .txt file and then send that .txt file as an attachment in an email. SQL Query and piping the output to a txt file is below: SELECT count(*) from pds_table > a.

Re: How to CONCAT 18 columns

2012-07-17 Thread Cdy Chen
Thank you Nicole! SELECT CONCAT(COALESCE(test_type, '-'),COALESCE(context_id, '-') ... It works! 2012/7/18 Gesli, Nicole > If any of the columns concatenated is NULL the result will be NULL. Use > COALESCE function around each column. You also need to CAST the numeric > fields to STRING to a

Re: DATA UPLOADTION

2012-07-17 Thread Gesli, Nicole
For the Hive query approach, check the string functions (https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF#LanguageManualUDF-StringFunctions) or write your own (UDF), if needed. It depends on what you are trying to get. Example: SELECT TRIM(SUBSTR(data, LOCATE(LOWER(data), ' t

Re: How to CONCAT 18 columns

2012-07-17 Thread Gesli, Nicole
If any of the columns concatenated is NULL the result will be NULL. Use COALESCE function around each column. You also need to CAST the numeric fields to STRING to able to use COALESCE. You can use CONCAT_WS to put delimiters in between each column. -Nicole From: Cdy Chen mailto:dongyong.c...@

Re: ipc.RemoteException in Hive

2012-07-17 Thread Павел Мезенцев
We don't change anything in hive configuration. And several days ago all was working fine. Today this strange exception has appeared. How we can find root of the problem and solve it? Pavel 2012/7/17 kulkarni.swar...@gmail.com > "select *" queries don't really run a M/R job. Rather directly hit

Re: ipc.RemoteException in Hive

2012-07-17 Thread kulkarni.swar...@gmail.com
"select *" queries don't really run a M/R job. Rather directly hit HDFS to grab the results. While "select count(*)" run mappers/reducers to perform the count on the data. The former running and the latter not suspects something might be wrong with your hadoop installation. Looking at the stacktrac

error while inserting data into hive dynamic partition table

2012-07-17 Thread shaik ahamed
. Hi users, As im inserting 1GB data in to hive partition table and the job was ended with the below error Below is my vender1gb data vender string supplierstring order_date string quantity int Vendor_1Supplier_1212012-03-06 2763 Vendor_1

Re: not able to access Hive web Interface

2012-07-17 Thread kulkarni.swar...@gmail.com
The problem is that it is probably looking for these files in HDFS instead of your local file system. As a workaround, try creating that path on HDFS and uploading these files there and see if it works. Also, try setting the fs.default.name property in conf-site.xml to point to your local filesyste

Re: How would you write a query for a use-case I have

2012-07-17 Thread Cdy Chen
Use String functions https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF#LanguageManualUDF-StringFunctions 2012/7/16 Guy Doulberg > Hi guys, > > I have a table with three fields, (uid,event_guid,timestamp) I need to > find out for each event_guid the index of it in the context o

Re: Searching for a string off a group by query

2012-07-17 Thread John Omernik
Then I think the array_contains is your best bet. See my example query below. I used a subquery (always handy) also I replaced count(activityID) in your SQL with count(1) The results returned are exactly the same (at least in my data set) and for some reason, my cluster seemed to run faster with

not able to access Hive web Interface

2012-07-17 Thread yogesh.kumar13
Hi all :-), Iam trying to access Hive Web Interface but it fails. I have this changes in hive-site.xml hive.hwi.listen.host 0.0.0.0 This is the host address the Hive Web

Re: Searching for a string off a group by query

2012-07-17 Thread Tharindu Mathew
I'm basically trying to search for a string (ex: "CCC") for a set of strings (ex: * *collect_set(msgBody)*)* that comes as a result of a group by query. On Tue, Jul 17, 2012 at 8:50 AM, John Omernik wrote: > Not sure what you are trying to do, but you may want to check out the > array_contains f

Re: Hive Thrift Client

2012-07-17 Thread Ben Kim
alright the problem solved! Now I'm able to connect to the hiveserver. I appreciate your help Navis :) Ben On Tue, Jul 17, 2012 at 3:34 PM, Navis류승우 wrote: > It seemed to be https://issues.apache.org/jira/browse/HIVE-2937 > > HIVE-2397 is expected to be included in hive-0.9 but missed by some

Re: 回复: [ANNOUNCE] New PMC member - Ashutosh Chauhan

2012-07-17 Thread Bejoy KS
Well deserved one. Congrats Ashutosh. Regards Bejoy KS Sent from handheld, please excuse typos. -Original Message- From: "Andes" Date: Tue, 17 Jul 2012 15:37:32 To: user Reply-To: user@hive.apache.org Subject: 回复: [ANNOUNCE] New PMC member - Ashutosh Chauhan congratulates~! 2012-07-

回复: [ANNOUNCE] New PMC member - Ashutosh Chauhan

2012-07-17 Thread Andes
congratulates~! 2012-07-17 Best Regards Andes 发件人:John Sichi 发送时间:2012-07-17 15:35 主题:[ANNOUNCE] New PMC member - Ashutosh Chauhan 收件人:"user","dev" 抄送: I am happy to announce that the Apache Hive PMC has voted to add existing committer Ashutosh Chauhan as a new PMC member. Thanks Ashutos

[ANNOUNCE] New PMC member - Ashutosh Chauhan

2012-07-17 Thread John Sichi
I am happy to announce that the Apache Hive PMC has voted to add existing committer Ashutosh Chauhan as a new PMC member. Thanks Ashutosh for all of your work on the project! JVS