Data for Testing in Hadoop

Dear all, Designing the architecture is very important for the Hadoop in Production Clusters. We are researching to run Hadoop in Cloud in Individual Nodes and in Cloud Environment ( VM's ). For this, I require some data for testing. Would anyone send me some links for data of different si

Adding job level pre/post execute hook?

Hi all, Hive already have query (statement) level pre/post execute hook, I think implementing job level pre/post execute hook is also needed, based on the reasons listed below: 1. The `set key=value' statement changes session level configurations, not able to change job-wise config like "hive.gro

RE: select count(1) causes java.io.IOException

solved in thread "select count(1)" on Mon, 03 Jan

Re: select count(1)

Hello Carl and Dilip, yep, was the HADOOP_HOME. The jars and classpath are allright. I didn't realize that eclipse ignores user specific system vars (under osx). I solved it with this: http://efreedom.com/Question/1-829749/Launch-Mac-Eclipse-Environment-Variables-Set Thank you Malte 2011/1/3 Car

Re: select count(1)

Hi Malte, This is the root of your problem: > java.io.IOException: Cannot run program "null/bin/hadoop": error=2, No such file or directory If you look at MapRedTask.execute() you'll see that the location of the hadoop script is determined based on the value of the hadoop.bin.path configuration

Re: select count(1)

Another possibility is that some required jars are not in your classpath when running your JDBC client. That could explain why everything works from the Hive CLI and HiveServer. I had written an article on using Hive from Jython - http://csgrad.blogspot.com/2010/04/to-use-language-other-than-java

Re: select count(1)

To specify things: I run the embedded mode with the url: "jdbc:hive://". If I take "jdbc:hive://localhost:1/default" with the hiveserver mode, the error will not occur and everything's fine. But I need multithreated access to my data. Malte 2011/1/3 kiteraddict : > Hi Dilip, > Unfortunately, n

Re: select count(1)

Hi Dilip, Unfortunately, not. No special characters. Tried a symlink as well... The Path seems ok, and the strange is: select count(1) from the cli woks. I get the same error in Eclipse and in Netbeans (OSX 10.6.4). However thank you for your tip! Malte 2011/1/3 Dilip Joseph : > Does the full path

Re: select count(1)

Does the full path to your hadoop installation contain a '+' character? I ran into a similar problem where a bug in the DataNucleus libraries used by hive prevented it from constructing the full path to your hadoop installation, if the path contained a '+'. The solution was to remove the '+' from

RE: select count(1)

see more specific question at Mon, 03 Jan, 13:55

RE: client / jdbc tables

my fault, didn't realize the different locations of the derby-database for the metadata and that only one client per time may able to connect.

select count(1) causes java.io.IOException

Hi there, I'am trying the jdbc example http://wiki.apache.org/hadoop/Hive/HiveClient#JDBC and getting that for the select count(1) query 11/01/03 12:34:35 INFO exec.MapRedTask: Generating plan file /tmp/hive-malte/hive_2011-01-03_12-34-35_503_9118509121830839307/plan4525595563698858213.xml 11/01

client / jdbc tables

Hi there, I'am trying the jdbc example http://wiki.apache.org/hadoop/Hive/HiveClient#JDBC Creating and inserting works. The problem is I don't see the created table witin the hive client and i can't query on it. Same problem vice versa. Why this? Likely its my fault... Hadoop and Hive is set

HNY-2011

Dear all, A very-very Happy New Year 2011 to all. May God Bless all of us to solve future problems. Thanks and Regards Adarsh Sharma

select count(1)

Hi there, I'am trying the jdbc example http://wiki.apache.org/hadoop/Hive/HiveClient#JDBC and getting that for the select count(1) query 11/01/03 12:34:35 INFO exec.MapRedTask: Generating plan file /tmp/hive-malte/hive_2011-01-03_12-34-35_503_9118509121830839307/plan4525595563698858213.xml 11

RE: Regarding Number of Jobs Created for One Hive-Query

Thank you sreekanth . *** This e-mail and attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information cont

Re: Regarding Number of Jobs Created for One Hive-Query

Hi Sandeep, If you try running the explain query it will show you number of stages which a query will use. Each stage will correspond to a MapReduce job. Also, there are conditional tasks, which points to one set of stage will be executed in lieu of the other. Please take a look at the follow

Regarding Number of Jobs Created for One Hive-Query

Hi, While executing a query from hive ,a Job will get created. Please let me know the Mapping Between Hive Query And the Jobs that are created for that query. ?Is it One-One ? Thanks sandeep **