Re: Loading files into tables

2011-02-02 Thread Edward Capriolo
On Wed, Feb 2, 2011 at 8:20 AM, Amlan Mandal wrote: > > > Sent from Amlan's iPhone > On 02-Feb-2011, at 2:17 AM, Thiruvel Thirumoolan > wrote: > > > > Local tables are like hive tables in all other senses except that they are > on the local disk rather than HDFS. The only other difference I know

Re: Loading files into tables

2011-02-02 Thread Amlan Mandal
Sent from Amlan's iPhone On 02-Feb-2011, at 2:17 AM, Thiruvel Thirumoolan wrote: > > >> Local tables are like hive tables in all other senses except that they are >> on the local disk rather than HDFS. The only other difference I know of is >> that when you call "drop table" on a local tab

Re: Loading files into tables

2011-02-01 Thread Thiruvel Thirumoolan
Local tables are like hive tables in all other senses except that they are on the local disk rather than HDFS. The only other difference I know of is that when you call "drop table" on a local table, only the metadata on the table gets deleted. For tables on HDFS, the table data gets deleted w

Re: Loading files into tables

2011-02-01 Thread Ajo Fod
HDFS gives you the ability to distribute disk access for jobs across computers. You don't need to have the file in HDFS to run a hive job. Local tables are like hive tables in all other senses except that they are on the local disk rather than HDFS. The only other difference I know of is that whe

Re: Loading files into tables

2011-02-01 Thread Ping Zhu
create table test_table ( test string); load data local inpath '/root/1.csv' into table test_table; describe extended test_table; # "find the hdfs dir of table test_table, for my case the data of table test_table is saved under hdfs /root/hive/warehouse/test_table dfs -ls /root/hive/warehouse/test_

Re: Loading files into tables

2011-02-01 Thread Amlan Mandal
Thanks Ajo. Please confirm if my understanding is correct. That means when I do "LOAD DATA *LOCAL* INPATH 'filepath' [OVERWRITE] INTO TABLE tablename" data in is local file system. If I need to run HIVE queries (which in turn would be converted to Map Reduce jobs) I need to pull the data some other

Re: Loading files into tables

2011-02-01 Thread Ajo Fod
Look up for local : http://wiki.apache.org/hadoop/Hive/GettingStarted -Ajo. On Tue, Feb 1, 2011 at 3:15 AM, Amlan Mandal wrote: > Hi All, > I am a hive newbie. > > LOAD DATA *LOCAL* INPATH 'filepath' [OVERWRITE] INTO TABLE tablename > > When I use LOCAL keyword does hive create a hdfs file for

Loading files into tables

2011-02-01 Thread Amlan Mandal
Hi All, I am a hive newbie. LOAD DATA *LOCAL* INPATH 'filepath' [OVERWRITE] INTO TABLE tablename When I use LOCAL keyword does hive create a hdfs file for it? I used above statement to put data into a hive table. But I could not see any hdfs file in my hive.metastore.warehouse.dir (which comes f