Re: External Table to Sequence File on HDFS

2013-04-03 Thread Sanjay Subramanian
Check this out http://stackoverflow.com/questions/13203770/reading-hadoop-sequencefiles-with-hive From: Ranjitha Chandrashekar mailto:ranjitha...@hcl.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Wednesday, April 3, 2013 10:43 PM To: "user

External Table to Sequence File on HDFS

2013-04-03 Thread Ranjitha Chandrashekar
Hi I want to create a external hive table to a sequence file(each record -> key value) on HDFS. How will the field names be mapped to the column names. Please Suggest. Thanks Ranjitha. ::DISCLAIMER:: -

Re: Bucketing external tables

2013-04-03 Thread Mark Grover
Can you please check your Jobtracker logs? The is a generic error related to grabbing the Task Attempt Log URL, the real error is in JT logs. On Wed, Apr 3, 2013 at 7:17 PM, Sadananda Hegde wrote: > Hi Dean, > > I tried inserting a bucketed hive table from a non-bucketed table using > insert ove

Re: Bucketing external tables

2013-04-03 Thread Sadananda Hegde
Hi Dean, I tried inserting a bucketed hive table from a non-bucketed table using insert overwrite select from clause; but I get the following error. -- Exception in thread "Thread-225" java.lang.NullPointerExcepti

Re: Upgrade from Hive 0.9 to Hive 0.10 Heap Error on show tables;

2013-04-03 Thread John Omernik
Ya, the issue ended up being I had some thirft settings that came with previous versions of MapR !-- hive.metastore.local true controls whether to connect to remove metastore server or open a new metastore server in Hive Client JVM --> Once commented out, it worked... *shrug* I di

Re: Metastore question

2013-04-03 Thread Dean Wampler
Yes, the property name is misleading. The DATA is stored under that directory (for managed tables, as opposed to external tables where you explicit tell Hive the location). The METADATA is stored in MySQL (or other database). On Wed, Apr 3, 2013 at 7:26 PM, Mark wrote: > Trying to make sure I un

Metastore question

2013-04-03 Thread Mark
Trying to make sure I understand this correctly. All databases and tables are stored in hive.metastore.warehouse.dir but the actual metadata for the database and tables (columns, types, partitions, etc) are stored in the hive database (ie.. mysql)? Is that correct?

Re: Upgrade from Hive 0.9 to Hive 0.10 Heap Error on show tables;

2013-04-03 Thread Richard Nadeau
Hi John, Do you have a copy of the MySQL JDBC driver in your Hive library path? Rick On Apr 3, 2013 3:57 PM, "John Omernik" wrote: > Not sure what the issues is, conf is good, validated I can log in to mysql > with username in the hive-site, and I ran the metastore update scripts. > > show tabl

Upgrade from Hive 0.9 to Hive 0.10 Heap Error on show tables;

2013-04-03 Thread John Omernik
Not sure what the issues is, conf is good, validated I can log in to mysql with username in the hive-site, and I ran the metastore update scripts. show tables; java.lang.OutOfMemoryError: Java heap space at org.apache.thrift.protocol.TBinaryProtocol.readStringBody(TBinaryProtocol.java:353) at org

Loopup objects in distributed cache

2013-04-03 Thread vivek thakre
Hello, I want to write a functionality using UDTF. The functionality involves reading 7 different text files and create lookup structures such as Map, Set, List , Map of String and List etc to be used in the logic. These files are small size average 15 MB. I can add these files in distributed ca