Re: Can't drop table

make a serde with that name just so you will not get the class not found > error :) Okay, thanks. Still a pretty weird bug all in all, considering that the conclusion of that bug report was to not fix the bug. ________

Re: Can't drop table

son based tables. > > > On Wed, Jun 11, 2014 at 2:24 AM, Keith Wiley wrote: > I tried to create a table that would use a csv serde. There were various > problems with it, primarily in that I couldn't figure out how to specify the > path to the serde (whether I indicate

Re: Can't drop table

it works for my json based tables. > > > On Wed, Jun 11, 2014 at 2:24 AM, Keith Wiley wrote: > I tried to create a table that would use a csv serde. There were various > problems with it, primarily in that I couldn't figure out how to specify the > path to the ser

Can't drop table

ests the problem is officially classified as "won't be fixed". Note, this problem also prevents me from renaming the table via "alter". I don't know what to do at this point. Any ideas? _____

Re: bucketed table problems

Thanks. :-) It's working better for me now. On Mar 7, 2014, at 17:37 , Stephen Sprague wrote: > short answer: its by position. > ____ Keith Wiley kwi...@keithwiley.com keithwiley.commusic.kei

Re: bucketed table problems

ames of the columns? On Mar 7, 2014, at 13:52 , Stephen Sprague wrote: > yeah. that's not right. > > 1. lets see the output of "show create table foo" > > 2. what version of hive are you using. > > > On Fri, Mar 7, 2014 at 11:46 AM, Keith Wiley wrote: &

bucketed table problems

insertion (which might explain how they all ended up in a single bucket of course). Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "Yet mark his perfect self-contentment, and

Use distribute to spread across reducers

bove. So far I have not even gotten any syntax to parse, much less run. Only the original query at the top will even pass the parsing stage of processing. Any ideas? Thanks. ________ Keith Wiley kwi...@keithwiley.com

Re: Want query to use more reducers

> files (search for "merge" in the configuration property list) to avoid > getting lots of little outputs. > > HTH > > [1]: > https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-QueryExecution > > -Sean > > On

Want query to use more reducers

) ) s ORDER BY output_column_1; ________ Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "Luminous beings are we, not this crude matter." -- Yoda

Re: .sql vs. .hql

ql and .hql files. Thanks. ________ Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "And what if we picked the wrong religion? Every week, we're just making God madder and madder!" -- Homer Simpson

Re: .sql vs. .hql

elpŠ > > sanjay > > On 5/31/13 1:17 PM, "Keith Wiley" wrote: > >> I'm looking for documentation on how to use .sql and .hql files in Hive >> and what the differences are between the two file types. I'm not even >> certain .hql is a real thing, b

.sql vs. .hql

clearly indicated in the index. Thanks. ____ Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "Luminous beings are we, not this crude matter." -- Yoda

Query doesn't filter UDF result as expected

0 11 foo bar user3 catC200 12 foo bar user3 catA300 13 foo bar user3 catB300 14 foo bar user3 catC300 15 Time taken: 87.933 seconds hive> _______

Rank(): here's how I did it, for better or worse...

surely right that the best method would be to use the powerful tools made available by the large developer community such as git and maven. Cheers! Keith Wiley kwi...@keit

Re: Need rank()

t sometimes you're on a deadline and have to go for the low-hanging fruit. I fully understand the motivation behind your approach. I'll circle back around it when I get some free time. Cheers! ____ Keit

Re: Need rank()

k(user) > FROM (SELECT ... DISTRIBUTE BY ... SORT BY) > > igor > decide.com > > > On Tue, Apr 2, 2013 at 10:03 AM, Keith Wiley wrote: > On Apr 1, 2013, at 16:12 , Alexander Pivovarov wrote: > > > http://ragrawal.wordpress.com/2011/11/18/extract-top-n-records-in-each-group

Re: Need rank()

operly ranked results yet. I'm still working on it. On Apr 2, 2013, at 10:03 , Keith Wiley wrote: > On Apr 1, 2013, at 16:12 , Alexander Pivovarov wrote: > >> http://ragrawal.wordpress.com/2011/11/18/extract-top-n-records-in-each-group-in-hadoophive/ > > Is there any poss

Re: Need rank()

>DISTRIBUTE BY > category,country >SORT BY > category,country,sales desc) t1) t2 > WHERE rank <= 3 > > > On Tue, Apr 2, 2013 at 10:45 PM, Keith Wiley wrote: > I did all that, I just didn't paste it into the email. That isn't the >

Re: Need rank()

ter-then...obviously...but that isn't the problem either. On Apr 2, 2013, at 10:06 , Nitin Pawar wrote: > I dont see you added rank in the classpath and defined rank function > > can you try add jar and define the function and try again > > > > On Tue, Apr 2, 2013 at 1

Re: Need rank()

umn reference 'rank': (possible column names are: _col0, _col1, _col2) hive> ________ Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "What I primarily learned in grad school

Re: Need rank(), can't build m6d's version

> mvn -Dmaven.test.skip=true install ____ Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "The easy confidence with which I know another man's religion is folly

Re: Need rank(), can't build m6d's version

doophive/ ____ Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "And what if we picked the wrong religion? Every week, we're just making God madder and madder!" -- Homer Simpson

Need rank(), can't build m6d's version

fire.booter.ForkedBooter.main(ForkedBooter.java:69) ________ Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "I do not feel obliged to believe that the same God who has endowed us with sense, r

Re: S3/EMR Hive: Load contents of a single file

://mybucket/path/to/data/” > ________ Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "I used to be with it, but then they changed what it was. Now, what I'm with isn't it,

Re: S3/EMR Hive: Load contents of a single file

by replying by email and then delete > the email completely from your system. Neither Sporting Index nor the sender > accepts responsibility for any virus, or any other defect which might affect > any computer or IT system into which the email is received and/or opened. It

Re: Query crawls through reducer

matters as well. > Which one are you using? > how many partitions are there? > what's the size of the cluster? > you can set the number of reducers but if your query just has one key then > only one reducer will get the data and rest will run empty > > > > On S

Query crawls through reducer

ucer heavy? Is it the order by or the limit (I'm sure it's not the partition-specific where clause, right?)? Are there ways to improve its performance? ____ Keith Wiley kwi...@keithwiley.com keithwiley

Rename external table, including HDFS directory

partitions all over again. Thoughts? ____ Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "Luminous beings are we, not this crude matter." -- Yoda

Re: Combine two overlapping schema?

values, e.g. using nested > SELECTs, something like > > SELECT * FROM ( > SELECT a,b,c, Y, NULL AS Z FROM table1 > UNION ALL > SELECT a,b,c, NULL AS Y, Z FROM table2 > ) table12; > > > > On Wed, Mar 6, 2013 at 12:03 PM, Keith Wiley wrote: > I have two

Combine two overlapping schema?

ow to do this. Any ideas? Thanks. ________ Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "You can scratch an itch, but you can't itch a scratch. Furthermore, an itch can itch but a scratch can't scratch. Finally, a scratch can itch, but an

Re: Can hive show external table filenames?

.org/Hive/languagemanual-virtualcolumns.html > > However there is no direct command in hive to list the files in a > table/partition. > > On Thu, Jan 31, 2013 at 4:55 PM, Keith Wiley wrote: >> Hmmm, that doesn't seem to list the files in the directory. >> >>

Re: Can hive show external table filenames?

Hmmm, that doesn't seem to list the files in the directory. On Jan 31, 2013, at 12:12 , Edward Capriolo wrote: > Try > describe extended > or > describe extended () > > the location is one of the properties > > Edward > > > On Thu, Jan 31, 2013 at

Can hive show external table filenames?

w the HDFS filenames? Or is "hadoop fs -ls" the only way to do that? Thanks. ____ Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "The easy confidence with which I know anothe

apache can't access hive

ode 1 from org.apache.hadoop.hive.ql.exec.DDLTask ________ Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "It's a fine line between meticulous and obsessive-compulsive and a slippe

Re: Error in semantic analysis: Unable to fetch table

;') > or something like that in php? > > On Fri, Oct 19, 2012 at 4:46 AM, Keith Wiley wrote: >> If I run a select command on the command line with -e it works. If I run >> the same command inside hive (without -e) it still works...but if I exec it >> with a -e f

Re: Error in semantic analysis: Unable to fetch table

or the apache account or as a HIVE parameter? ________ Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "What I primarily learned in grad school is how much I *don't* know. Consequently,

Error in semantic analysis: Unable to fetch table

ons. What does this error mean and how do I fix it? Thanks. ____ Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "The easy confidence with which I know another man's religion is fo

Increase max tablename length?

The default seems to be 128. Can it be increased? I haven't found a configuration parameter for that yet. Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "Luminous bei

Re: drop table: no err on nonexistant table?

Oye, got it. Sorry. RTFM: hive.exec.drop.ignorenonexistent On Aug 6, 2012, at 11:06 , Keith Wiley wrote: > I'm wrapping hive in a web tool and would like to do some basic > error-checking. If an attempt is made to drop a table that doesn't exist, I > would like to sh

drop table: no err on nonexistant table?

an error of some sort on this or is it not possible? Thank you. ____ Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "I do not feel obliged to believe that the same God who has endo

HQL vs. HiveQL

e the right term. Thanks. Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "And what if we picked the wrong religion? Every week, we're just making God ma

Re: LIKE Statement

Thanks for the followup. Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "I used to be with it, but then they changed what it was. Now, what I'm with isn't it, and

Re: LIKE Statement

wks ago) with no followups. I'm generally curious about HiveQL's similarities and differences w.r.t. other SQL environments, so questions like this are of interest to me as well. Cheers! ________ Keith Wiley

Re: Hive performance vs. SQL?

comparable. ____ Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "What I primarily learned in grad school is how much I *don't* know. Consequently, I left grad school with a higher ignorance to knowledge rati

Hive performance vs. SQL?

fore Hive offer significant gains? I am really just trying to get a basic feel for how I might anticipate's Hive's behavior vs. SQL once I get a large system up and running. Thanks. ____ Keith Wiley kwi...@keithwil

Re: csv boolean type

I obviously intended '1', not '0' as an example of a true value. ____ Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "The easy confidence with which I know

csv boolean type

yes Yes YES etc. Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "I used to be with it, but then they changed what it was. Now, what I'm with isn't it, and what'

Re: order by having no effect?!

On Mar 13, 2012, at 13:57 , Igor Tatarinov wrote: > You have attributevalue in quotes which makes it a constant literal. > > igor > decide.com Argh! You are correct good sir! ____ Keith W

order by having no effect?!

ult Value 1 3 foo 2 10332 - ddd 2 3 foo 1 10331 - eee 1 3 foo 5 10335 - fff 5 Time taken: 17.954 seconds hive> Keith Wiley

Re: order by date

Thanks for all the feedback on this. I'll take a look at all the suggestions I received. Cheers! Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "Yet mark his pe

Re: order by date

n > > www: oanda.com www: fxtrade.com > e: mgro...@oanda.com ____ Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "It's a fine line between meticulous and obsessive-c

Re: order by date

; few functions that will translate between unix timestamps and datetime > strings. > > Matt Tucker Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "I do not feel obliged t

Re: non-equality joins

hm should be in order to fit in the > MapReduce framework? Could you refer me to some references? > > Thanks and Regards, > Mahsa > Keith Wiley kwi...@keithwiley.c

How to import extremely "wide" csv tables

r a simpler solution. Thoughts? Thanks. ____ Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "You can scratch an itch, but you can't itch a scratch. Furthermore, an itch can it

Re: order by date

o saves us the trouble of > whipping out a unix timestamp calculator to figure out what we're looking at. > > There is supposed to be a TIMESTAMP data type in Hive 0.8, but I haven't > found any documentation on it yet. > > Matt Tucker > > -Original Message-

Re: non-equality joins

ns in Hive? In > other words, is there any usage for theta-join, if implemented? > > Thank you in advance for your response, > Mahsa ____ Keith Wiley kwi...@keithwiley.com keithwiley.comm

order by date

y a date column? Am I on the right track? Thanks. ________ Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "What I primarily learned in grad school is how much I *don't* know.

External table point of clarification

k you. Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "It's a fine line between meticulous and obsessive-compulsive and a slippery rope between obsessive-compulsive and debilitatingly slow."

Re: Basic statement problems

rs will almost certainly improve with time. Thanks for the concerted efforts to help. Cheers! ____ Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "What I primarily learned in gr

Re: Basic statement problems

a basic query doesn't return any results. What else should I try here? ____ Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "I used to be with it, but then they changed what it was. Now, what I'm with isn't it, and

Re: Error

directory > > And try again > > Thanks > > Jagat > > > > On Sat, Mar 10, 2012 at 5:07 AM, Keith Wiley wrote: > Considering that I don't even konw what the metastore is, I doubt I did > anything specifically aside from the instructions. All I did was

Re: Error

t; > Thanks > > Jagat ____ Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "The easy confidence with which I know another man's religion is folly teaches me to suspect that my own is also." -- Mark Twain

Re: Basic statement problems

data files. ____ Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "And what if we picked the wrong religion? Every week, we're just making God madder and madder!" -- Homer Simpson

0.7.1 vs. 0.8.1

I generally use CDH3 and it provides 0.7.1. I'm curious if I should use a more recent version of Hive with the version of Hadoop in CDH3 (0.20.2). Thanks. ____ Keith Wiley kwi...@keithwiley.co

Basic statement problems

ment Tool for the same. 2012-03-09 16:20:22,946 WARN snappy.LoadSnappy (LoadSnappy.java:(36)) - Snappy native library is available I admit, that does look rather erroneous, but I'm not sure what to make of it. I looked those errors up online but didn't find much th

Re: Error

Forex Awards 2009. > "The One to Watch" - Treasury Today's Adam Smith Awards 2009. > > > - Original Message - > From: "Keith Wiley" > To: user@hive.apache.org > Sent: Friday, March 9, 2012 3:02:40 PM > Subject: Error > > I'm

Error

ecution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask ____ Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com "The easy confidence with which I know another man's r