No problem Keith - it was a worthwhile exercise for me to go back and double
check everything was working as expected.
-Original Message-
From: Keith Wiley [mailto:kwi...@keithwiley.com]
Sent: 27 March 2013 17:03
To: user@hive.apache.org
Subject: Re: S3/EMR Hive: Load contents of a
Okay, I also saw your previous response which analyzed queries into two tables
built around two files in the same directory. I guess I was simply wrong in my
understanding that a Hive table is fundamentally associated with a directory
instead of a file. Turns out, it be can either one. A dire
singly) "location:s3://mybucket/path/to/data/"
From: Tony Burton [mailto:tbur...@sportingindex.com]
Sent: 27 March 2013 08:46
To: 'user@hive.apache.org'
Subject: RE: S3/EMR Hive: Load contents of a single file
Thanks for the reply Keith.
> you could have dispensed with the addi
iles in s3. Maybe other readers could try
a similar exercise and present their results? Are there other tests I could try
to further verify my findings?
Tony
-Original Message-
From: Keith Wiley [mailto:kwi...@keithwiley.com]
Sent: 26 March 2013 19:40
To: user@hive.apache.org
Subject:
LOCATION is a directory. Cool!
>
> Tony
>
>
>
>
>
>
>
> From: Sanjay Subramanian [mailto:sanjay.subraman...@wizecommerce.com]
> Sent: 26 March 2013 17:22
> To: user@hive.apache.org
> Subject: Re: S3/EMR Hive: Load contents of a single file
>
e.org<mailto:user@hive.apache.org>"
mailto:user@hive.apache.org>>
Subject: RE: S3/EMR Hive: Load contents of a single file
Thanks for the quick reply Sanjay.
ALTER TABLE is the key, but slightly different to your suggestion. I create the
table as before, but don’t specify location:
$ crea
First of all, you cannot point a table to a file. Each table will have a
corresponding table. If you want to have all the in the table contains in
only one file, simply copy that one file into the directory. The table does
not need to know the name of the file. It only matters whether the
structure
Sent: 26 March 2013 17:22
To: user@hive.apache.org
Subject: Re: S3/EMR Hive: Load contents of a single file
Hi Tony
Can u create the table without any location.
After that you could do an ALTER TABLE add location and partition
ALTER TABLE myData ADD PARTITION (partitionColumn1='$value1&
Hi Tony
Can u create the table without any location.
After that you could do an ALTER TABLE add location and partition
ALTER TABLE myData ADD PARTITION (partitionColumn1='$value1' ,
partitionColumn2='$value2') LOCATION '/path/to/your/directory/in/hdfs';"
An example Without Partitions
-
