Hadoop based product recomendations.

2013-05-28 Thread Sai Sai
Just wondering if anyone would have any suggestions. We r a bunch of developers on bench for a few months trained on Hadoop but do not have any projects to work. We would like to develop a Hadoop/Hive/Pig based product for our company so we can be of value to the company and not be scared of lay

Re: Partitioning confusion

2013-05-27 Thread Sai Sai
to create 10 partitions that would end up in 2.5 TB * 3 = 7.5TB. Is this expected. Thanks S From: Nitin Pawar To: user@hive.apache.org; Sai Sai Sent: Monday, 27 May 2013 2:08 PM Subject: Re: Partitioning confusion when you specify the load data query with

Re:Partitioning confusion

2013-05-27 Thread Sai Sai
After creating a partition for a country (USA) and state (IL) and when we go to the the hdfs site to look at the partition in the browser we r seeing  all the records for all the countries and states rather than just for the partition created for US and IL given below, is this correct behavior

Re: Issue with Json tuple lateral view

2013-05-27 Thread Sai Sai
Thanks Navis From: Navis류승우 To: user@hive.apache.org; Sai Sai Sent: Monday, 27 May 2013 12:15 PM Subject: Re: Issue with Json tuple lateral view Removing last ',' in second row would make result as you expected. I can't tell it's bu

Re: Issue with Json tuple lateral view

2013-05-26 Thread Sai Sai
* Here is the json-data that i load: * { "blogID" : "FJY26J1333", "date" : "2012-04-01", "name" : "vpxnksu", "comment" : "good stuff", "contact" : { "email" : "vpxn...@gmail.com", "website" : "vpxnksu.wordpress.com" } } { "blogID" : "VSAUMDFGSD"

Re: How to look at the metadata of the tables we have created.

2013-05-24 Thread Sai Sai
Is it possible to look at the metadata of the databases/tables/views we have created in hive. Is there some thing like sysobjects in hive. Thanks Sai

Re: Difference between like %A% and %a%

2013-05-24 Thread Sai Sai
But it should get more results for this: %a% than for %A% Please let me know if i am missing something. Thanks Sai From: Jov To: user@hive.apache.org; Sai Sai Sent: Friday, 24 May 2013 4:39 PM Subject: Re: Difference between like %A% and %a% 2013/5

Re: Where to find the external table file in HDFS

2013-05-24 Thread Sai Sai
I have created an external table states and loaded it from a file under /tmp/states.txt Then in the url:  http://localhost.localdomain:50070/dfshealth.jsp I have looked to see if this file states table exists and do not see it. Just wondering if it is saved in hdfs or not. How many days will t

Re: Where can we see the results of Select * from states

2013-05-24 Thread Sai Sai
I have created an external table called states under a database called test, Then loaded the table successfully; The i have tried: Select * from states; It successfully executes MR and displays the results in the console but wondering where to look in hdfs to see these results. I have looked un

Re: Difference between like %A% and %a%

2013-05-24 Thread Sai Sai
Just wondering about this, please let me know if you have any suggestions why we r getting these results: This  query does not return any data: Query1:hive (test)> select full_name from states where abbreviation like '%a%'; But this query returns data successfully: Query2:hive (test)> selec

Re: java.lang.NoClassDefFoundError: com/jayway/jsonpath/PathUtil

2013-03-10 Thread Sai Sai
Many Thanks Guys, you guys r really helpful. Really appreciate it. Thanks Sai From: "bejoy...@yahoo.com" To: user@hive.apache.org; Sai Sai Sent: Sunday, 10 March 2013 12:06 PM Subject: Re: java.lang.NoClassDefFoundError: com/jayway/jsonpath/Path

Re: java.lang.NoClassDefFoundError: com/jayway/jsonpath/PathUtil

2013-03-10 Thread Sai Sai
Palle To: user@hive.apache.org; Sai Sai Sent: Sunday, 10 March 2013 4:22 AM Subject: Re: java.lang.NoClassDefFoundError: com/jayway/jsonpath/PathUtil When you execute the following query, hive> select * from twitter limit 5; Hive runs it in local mode and not use MapReduce. For the qu

Re: java.lang.NoClassDefFoundError: com/jayway/jsonpath/PathUtil

2013-03-10 Thread Sai Sai
uce CPU Time Spent: 0 msec Thanks Sai From: Dean Wampler To: user@hive.apache.org; Sai Sai Sent: Friday, 8 March 2013 5:22 AM Subject: Re: java.lang.NoClassDefFoundError: com/jayway/jsonpath/PathUtil Unfortunately, you have to also add the json jars to Hi

Re: java.lang.NoClassDefFoundError: com/jayway/jsonpath/PathUtil

2013-03-08 Thread Sai Sai
I have added the jar files successfully like this: hive (testdb)> ADD JAR lib/hive-json-serde-0.3.jar;    Added lib/hive-json-serde-0.3.jar to class path    Added resource: lib/hive-json-serde-0.3.jar hive (testdb)> ADD JAR lib/json-path-0.5.4.jar;    Added

Re: Find current db we r using in Hive

2013-03-07 Thread Sai Sai
Just wondering if there is any command in Hive which will show us the current db we r using similar to pwd in Unix. Thanks Sai

Re: Partition not displaying in the browser

2013-03-07 Thread Sai Sai
Many Thanks for your help Venkatesh. I have verified the partition exists and also the data displays successfully in the partition when i execute the select in the console. But it does not appear in the web browser. I have verified multiple time the path i have given and is given below: Here i

Re: Partition not displaying in the browser

2013-03-07 Thread Sai Sai
I get this ouput for: hive> show partitions dividends; OK partition exchange=NASDAQ/symbol=AAPL exchange=NASDAQ/symbol=INTC Time taken: 0.133 seconds But when i navigate to my browser folder the partition INTC is not displayed even after refreshing it a bunch of times, any suggestions will be ap

Re: Accessing sub column in hive

2013-03-07 Thread Sai Sai
I have a table created like this successfully: CREATE TABLE IF NOT EXISTS employees (name STRING,salary FLOAT,subordinates ARRAY,deductions   MAP,address STRUCT) I would like to access/display country column from my address struct. I have tried this: select address["country"] from employees; I

Re: syslog from hive

2013-03-07 Thread Sai Sai
Just wondering what is syslog and if we can access it from hive. Any example will help. Thanks Sai

Re: Where is the location of hive queries

2013-03-06 Thread Sai Sai
After we run a query in hive shell as: Select * from myTable; Are these results getting saved to any file apart from the console/terminal display. If so where is the location of the results. Thanks Sai

Re: Read map value from a table

2013-03-06 Thread Sai Sai
Here is my data in a file which i have successfully loaded into a table test and successfully get the data for: Select * from test; Name    ph    category Name1    ph1    {"type":1000,"color":200,"shape":610} Name2    ph2    {"type":2000,"color":200,"shape":150} Name3    ph3    {"type":300

Re: Location of external table in hdfs

2013-03-05 Thread Sai Sai
Thanks I figured this is in tmp/states Thanks for your attention. From: Sai Sai To: "user@hive.apache.org" Sent: Tuesday, 5 March 2013 8:56 AM Subject: Re: Location of external table in hdfs I have created an external table like below and wonde

Re: Location of external table in hdfs

2013-03-05 Thread Sai Sai
I have created an external table like below and wondering where (folder) in hdfs i can find this: CREATE EXTERNAL TABLE states(abbreviation string, full_name string) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' LOCATION '/tmp/states' ; Any help is really appreciated. Thanks Sai

Re: Done SemanticException Line 1:17 issue

2013-03-05 Thread Sai Sai
Thanks for your help Nitin. I have restarted my VM and tried again and it appears to work. Thanks again. Sai From: Sai Sai To: "user@hive.apache.org" Sent: Tuesday, 5 March 2013 4:42 AM Subject: Re: SemanticException Line 1:17 issue Thanks for

Re: SemanticException Line 1:17 issue

2013-03-05 Thread Sai Sai
know if you have any other suggestions. In the meantime i will try with the [LOCAL] file and let you know. Thanks Sai From: Nitin Pawar To: user@hive.apache.org; Sai Sai Sent: Tuesday, 5 March 2013 4:24 AM Subject: Re: SemanticException Line 1:17 issue it

Re: SemanticException Line 1:17 issue

2013-03-05 Thread Sai Sai
Yes Nitin it exists... but still getting the same issue. From: Nitin Pawar To: user@hive.apache.org; Sai Sai Sent: Tuesday, 5 March 2013 4:14 AM Subject: Re: SemanticException Line 1:17 issue this file /tmp/o_small.tsv is on your local filesystem or hdfs

Re: SemanticException Line 1:17 issue

2013-03-05 Thread Sai Sai
Hello I have been stuck on this issue for quite some time and was wondering if anyone sees any problem with this that i am not seeing: I have verified the file exists here and have also manually pasted the file into the tmp folder but still running into the same issue. I am also wondering whic

Re: show tables in bin does not display the tables

2013-03-05 Thread Sai Sai
Hello I have noticed when i execute the following command from hive shell in diff folders it behaves in diff ways and was wondering if this is right: show tables; from the bin folder under my hive install folder it just shows tab_name: myUser@ubuntu:~/work/hive-0.1

Re: hive commands from a file

2013-03-04 Thread Sai Sai
Thanks Krishna/Nitin. From: Nitin Pawar To: user@hive.apache.org Sent: Monday, 4 March 2013 2:28 AM Subject: Re: hive commands from a file Try hive -f filename On Mar 4, 2013 3:55 PM, "Sai Sai" wrote: Just wondering if it is possible to run

Re: hive commands from a file

2013-03-04 Thread Sai Sai
Just wondering if it is possible to run a bunch of  hive commands from a file rather than one a time. For ex: 1. Create external... 2. Load ... 3. Select * from ... 4 Thanks Sai

Re: hive light weight reporting tool

2013-03-04 Thread Sai Sai
Thanks Jagat. From: Jagat Singh To: user@hive.apache.org; Sai Sai Sent: Monday, 4 March 2013 1:23 AM Subject: Re: hive light weight reporting tool Yes just wait for sometime. We have awesome people here , they would suggest wonderful solutions to you

Re: hive light weight reporting tool

2013-03-04 Thread Sai Sai
Thanks again Jagat. just wanted to get a second opinion about my excel question. Thanks again for the input. Sai. From: Jagat Singh To: user@hive.apache.org; Sai Sai Sent: Monday, 4 March 2013 1:01 AM Subject: Re: hive light weight reporting tool Hi

Re: hive light weight reporting tool

2013-03-04 Thread Sai Sai
Just wondering if there is any light weight reporting tool with hive/hadoop which we can use for quick POCs. Thanks Sai

Re: hive to excel

2013-03-04 Thread Sai Sai
Just wondering how to save the data of a query to excel file. For ex: After running the query: Select * from myTable; we would like to save the query results to xls file. Any help is appreciated. Thanks Sai

Re: hive columns display

2013-03-04 Thread Sai Sai
Many Thanks Jagat. Sai From: Jagat Singh To: user@hive.apache.org; Sai Sai Sent: Monday, 4 March 2013 12:44 AM Subject: Re: hive columns display Hi, See this http://svn.apache.org/repos/asf/hive/trunk/conf/hive-default.xml.template There is one

Re: hive columns display

2013-03-04 Thread Sai Sai
When we run a query in hive like: Select * from myTable limit 10; We get the results successfully but the column names r not displayed. Is it possible to display the column names also so the data and the columns can be related right away without running a describe table. Thanks, Sai

hive newb questions

2013-03-04 Thread Sai Sai
Hi I was wondering if it is right to assume: 1. The first time we create a table in hive and load it followed by running the first query like Select * from Table1 will result in a MR job running and will get the data to us. If we run the same query second time MR job will not run but will res