Re: Dynamic partition set to null

2011-02-12 Thread khassounah
Hi Pat.. I have hive.exec.dynamic.partition.mode=nonstrict and hive.exec.dynamic.partition=true. That let hive accept the dynamic partitions, but it still fails. Khaled > Check that you have hive.exec.dynamic.partition.mode set to false. That > or have a static partition column first in your par

Re: Dynamic partition set to null

2011-02-12 Thread Christopher, Pat
Check that you have hive.exec.dynamic.partition.mode set to false. That or have a static partition column first in your partitioning clause. Pat -- Sent from my Palm Pre On Feb 12, 2011 11:09 PM, khassou...@mediumware.net wrote: Hello, I have the followin

Dynamic partition set to null

2011-02-12 Thread khassounah
Hello, I have the following table definition (simplified to help in debugging): create external table pvs ( time INT, server STRING, thread_id STRING ) partitioned by ( dt string ) row format delimited fields terminated by '\t' stored as textfile

outputting to external file

2011-02-12 Thread Cam Bazz
Hello, When we write to an extermal file I noticed that it creates a directory and files like: attempt_201102130126_0014_m_00_0, attempt_201102130126_0014_m_01_0 with different parts of the data inside them. i will be loading these files to rdbms for quick lookup, that is at a remote se

Re: how to delete data for a partition

2011-02-12 Thread Cam Bazz
well, i decided to programmatically intervene, when something goes wrong. I am doing: load data local inpath '/var/mylog/daily/log.PROD.20110213' into table item_raw partition(date_hour=20110213) and when that partition file exists, I will get Exception in thread "main" java.sql.SQLException: Q

Re: how to delete data for a partition

2011-02-12 Thread Edward Capriolo
On Sat, Feb 12, 2011 at 5:17 PM, Cam Bazz wrote: > Hello, > > Is it possible to delete rows belonging to a partition? or is it > undeletable like a table's data? > > best regards, > -c.b. > Remove the files inside the partition.

how to delete data for a partition

2011-02-12 Thread Cam Bazz
Hello, Is it possible to delete rows belonging to a partition? or is it undeletable like a table's data? best regards, -c.b.

Re: how to delete data for a partition

2011-02-12 Thread Edward Capriolo
On Sat, Feb 12, 2011 at 5:30 PM, Cam Bazz wrote: > ok, is there a way to do it from the > http://localhost:50075/browseDirectory.jsp interface? > > On Sun, Feb 13, 2011 at 12:19 AM, Edward Capriolo > wrote: >> On Sat, Feb 12, 2011 at 5:17 PM, Cam Bazz wrote: >>> Hello, >>> >>> Is it possible to

Re: how to delete data for a partition

2011-02-12 Thread Cam Bazz
ok, is there a way to do it from the http://localhost:50075/browseDirectory.jsp interface? On Sun, Feb 13, 2011 at 12:19 AM, Edward Capriolo wrote: > On Sat, Feb 12, 2011 at 5:17 PM, Cam Bazz wrote: >> Hello, >> >> Is it possible to delete rows belonging to a partition? or is it >> undeletable l

Re: error out of all sudden

2011-02-12 Thread Vinithra Varadharajan
Viraj, Regarding file handles, you were most likely running into this: https://issues.apache.org/jira/browse/HIVE-1508 -Vinithra On Fri, Feb 11, 2011 at 7:08 PM, Viral Bajaria wrote: > are you running out of open file handles ? you should look in

Re: error out of all sudden

2011-02-12 Thread Cam Bazz
yes I am runnning on a single node, pseudo distributed mode. i have increased the file handles, epoll interval, and lastly dfs max xcievers was increased to 1024 it wont give errors any more. best regards, -c.b. On Sat, Feb 12, 2011 at 5:08 AM, Viral Bajaria wrote: > are you running out of ope