to add it globally to have better persistence and control, you could
add it in hive-site.xml
hive.aux.jars.path
file:///${HIVE_HOME/auxlib/all_new.jar
On Thu, Jul 7, 2011 at 2:09 PM, Sal Scalisi wrote:
>
> That did it, thanks!
>
> On 7/7/2011 1:30 PM, Norbert Burger wrote:
>
> There is likely
at
>> org.apache.hadoop.hive.ql.io.HiveInputFormat.getSplits(HiveInputFormat.java:261)
>>
>> I am not sure why it looks for 1970 year!
>> Also, I am assuming I have to add all the partitions manually, but that
>> seems reasonable.
>>
>> Thanks,
>&
Pasting an example here:
CREATE EXTERNAL TABLE IF NOT EXISTS tablename (...) partitioned by
(insertdate string) ROW FORMAT SERDE
'org.apache.hadoop.hive.contrib.serde2.JsonSerde';
alter table tablename add partition (insertdate='2008-01-01') LOCATION
's3n://' or 'hdfs:///abc/xyz/'
- Prashant
Hi,
Just throwing this out to get some good ideas. Is anyone aware of any sink
for flume that would write / load data directly to the hive tables? If not,
one solution that I could think of is dump the data to hdfs or s3 and have a
periodic map reduce job load it to hive.
--
- Prash
Hi,
The Hive documentation describes keyword "external" as following:
The EXTERNAL keyword lets you create a table and provide a LOCATION so that
Hive does not use a default location for this table. This comes in handy if
you already have data generated.
I have my data available in a directory i
Hi,
I am trying to load data that is in HDFS to the hive table whose data store
is in s3. However, while performing a load operation, i get this error:
org.apache.hadoop.hive.ql.parse.SemanticException: line 1:17 Path is not
legal 'hdfs:///output/*': Move from: hdfs:///output/*
to: s3:///mslog is
