Re: missing documentation?

2013-01-28 Thread Lefty Leverenz
- Hive wiki docs: https://cwiki.apache.org/confluence/display/Hive/Home - non-wiki docs: variable substitution, reflect UDF New documentation for Hive 0.10.0 will be added to the Apache website as time permits. – Lefty Leverenz On Tue, Jan 22, 2013 at 3:59 PM, Lauren

Re: hive 0.10.0 doc

2013-02-21 Thread Lefty Leverenz
he wiki versions are the same as the regular docs or better. Here are the new wikidocs: 1. https://cwiki.apache.org/confluence/display/Hive/LanguageManual+VariableSubstitution 2. https://cwiki.apache.org/confluence/display/Hive/ReflectUDF – Lefty Leverenz On Mon, Jan 28, 2013 at 11:2

Re: Books and good starting point for Hive

2013-02-24 Thread Lefty Leverenz
/display/Hive/Home)? In particular: - https://cwiki.apache.org/confluence/display/Hive/GettingStarted - https://cwiki.apache.org/confluence/display/Hive/Tutorial – Lefty Leverenz On Sun, Feb 24, 2013 at 9:04 AM, Joey D'Antoni wrote: > I second this recommendation. Dean'

Re: installing hive-0.10.0 from source

2013-03-01 Thread Lefty Leverenz
RA: https://issues.apache.org/jira/browse/HIVE-4107 -- Update Hive 0.10.0 RELEASE_NOTES.txt. – Lefty Leverenz On Tue, Feb 26, 2013 at 2:16 PM, Eric Chu wrote: > To update this thread, I also did a git clone and checked out branch-0.10. > The release notes there also says it's 0.8.0, an

Re: HiveServer2 released in some branch

2013-03-22 Thread Lefty Leverenz
A discussion of the next Hive release date has just gotten started on hive-dev : - next hive release

Re: Who is the hive admin user?

2013-05-10 Thread Lefty Leverenz
Hive 0.10's metastore server security is documented in the revised Authorization wiki, which your link didn't go to because the name had been changed from "auth" to "Authorization" (sorry about that): https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Authorization . The jira is HIVE-

Review Request: Import/Export wiki

2013-05-14 Thread Lefty Leverenz
The Hive IMPORT and EXPORT wiki had incomplete syntax and needed examples, so I've updated it. - The examples are based on the test suite. - The overview comes from the description of HIVE-1918. If you find any errors or want to add more information, please let me know (or edit the wiki you

Re: adding "create or replace view" documentation to the wiki

2013-05-15 Thread Lefty Leverenz
Glad to see someone paying attention to the docs. I can't tackle these tasks right now, so I'm adding d...@hive.apache.org to the mailing list. Hope springs eternal – Lefty On Wed, May 15, 2013 at 11:50 AM, Darren Yin wrote: > I also just realized that partitioned views have also been i

Re: Create table like with partitions

2013-06-11 Thread Lefty Leverenz
Dynamic partitions are described in the Hive design docs here: https://cwiki.apache.org/confluence/display/Hive/DynamicPartitions. For the configuration parameters, though, you need to look in the language manual here: https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties (sear

Re: Create table like with partitions

2013-06-11 Thread Lefty Leverenz
book online like this is likely > pirated. > > > > > On Tue, Jun 11, 2013 at 8:34 AM, Richa Sharma > wrote: > >> Hi all, >> >> Found a very useful guide online. Link -> >> http://it-ebooks.info/book/941/ >> >> Richa >> >

Re: LZO compression implementation in Hive

2013-06-17 Thread Lefty Leverenz
Perhaps you'd like to write up your insights in the Hive wiki, and others could add their insights. Then the information would be available to all, immediately. – Lefty On Mon, Jun 17, 2013 at 4:39 PM, Ramki Palle wrote: > Hi Sanjay, > > Can you quickly give your insights on thip topic, if p

Re: LZO compression implementation in Hive

2013-06-18 Thread Lefty Leverenz
s://cwiki.apache.org/confluence<https://cwiki.apache.org/confluence/dashboard.action> > > thanks > sanjay > > > From: Lefty Leverenz > Reply-To: "user@hive.apache.org" > Date: Monday, June 17, 2013 7:08 PM > To: "user@hive.apache.org" > Subje

Re: New to hive.

2013-06-19 Thread Lefty Leverenz
"Programming Hive" and "Hadoop: The Definitive Guide" are available at the O'Reilly website (http://oreilly.com/) and on Amazon. But don't forget the Hive wiki: - Hive Home -- https://cwiki.apache.org/confluence/display/Hive/Home - Getting Started -- https://cwiki.apache.org/confluence/d

Review & improvement request: Hive indexing doc

2013-06-28 Thread Lefty Leverenz
rtitioned tables. - Hive Indexes wikidoc: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Indexing - Language Manual: https://cwiki.apache.org/confluence/display/Hive/LanguageManual Or you can send revisions to me and I'll put them in the doc for you. Thanks. – Lefty Leverenz

Re: Hive UDAF extending UDAF class: iterate or evaluate method

2013-08-04 Thread Lefty Leverenz
You might find this wikidoc useful: GenericUDAFCaseStudy . The O'Reilly book "Programming Hive" also has a section called "User-Defined Aggregate Functions" in chapter 13 (Functions), pages 172 to 176. -- Lefty On Sun, Aug 4

Re: Hive UDAF extending UDAF class: iterate or evaluate method

2013-08-07 Thread Lefty Leverenz
und it to be utterly complex, especially for storing partial results as I > am not very familiar with hive API. Then I found another example of UDAF in > the hadoop the definitive guide book and it had much simpler code but using > different method. Instead of using iterate it was using

Re: documentation issue for RLIKE/REGEXP

2013-08-09 Thread Lefty Leverenz
13 (version 47 changed by Siyang Chen<https://cwiki.apache.org/confluence/pages/diffpagesbyversion.action?pageId=27362046&selectedPageVersions=47&selectedPageVersions=46> )* NULL if A or B is NULL, TRUE if any (possibly empty) substring of A matches the Java regular expression B, otherwi

Re: Hive and Lzo Compression

2013-08-10 Thread Lefty Leverenz
I'm not seeing any documentation link in Sanjay's message, so here it is again (in the Hive wiki's language manual): https://cwiki.apache.org/confluence/display/Hive/LanguageManual+LZO. On Thu, Aug 8, 2013 at 3:30 PM, Sanjay Subramanian < sanjay.subraman...@wizecommerce.com> wrote: > Please ref

Re: Hive Wiki Partition Protection

2013-08-10 Thread Lefty Leverenz
essage): "For tables that are protected by NO DROP CASCADE, you can use the predicate IGNORE PROTECTION to drop a specified partition or set of partitions (for example, when splitting a table between two Hadoop clusters)." -- Lefty Leverenz, *retired tech writer* On Mon, Jul 22, 2013

Re: Wildcard support in specifying file location

2013-08-10 Thread Lefty Leverenz
VE-1083) - HIVE-951 Selectively include EXTERNAL TABLE source files via REGEX ( https://issues.apache.org/jira/browse/HIVE-951) If my guess is wrong and you're able to use wildcards, please let me know so I can add that information to the Hive wiki. -- Lefty Leverenz On Mon, Jul 22, 2013

Re: documentation issue for RLIKE/REGEXP

2013-08-11 Thread Lefty Leverenz
gt; I just confirmed that for Hive v0.10 (and probably all versions) "foobar" > rlike "foo" returns true, just to be clear. In other words, the Java > regular expression does NOT have to match the whole string. > > The wiki should be changed. If someone wants to give

Re: BNF for Hive Views

2013-08-25 Thread Lefty Leverenz
Let me introduce you to the Hive wiki. - Hive wiki home page: https://cwiki.apache.org/confluence/display/Hive/Home - Language manual: https://cwiki.apache.org/confluence/display/Hive/LanguageManual - DDL: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL - V

Re: BNF for Hive Views

2013-08-25 Thread Lefty Leverenz
uestion about the BNF for views (and potentially other > ddl/dml) that does not appear to be addressed . Thanks. > > > > 2013/8/25 Lefty Leverenz > >> Let me introduce you to the Hive wiki. >> >>- Hive wiki home page: >>https://cwiki.apache.org/co

Re: What is this windowing query supposed to do?

2013-09-02 Thread Lefty Leverenz
Once again the /confluence/display version of the wiki is fine while the non-display version is glitchy. First the {code} tags gave invisible sample code, and now some of the doc links don't work -- but they're fine here: https://cwiki.apache.org/confluence/display/Hive/LanguageManual. Can anyon

Re: DISCUSS: Hive language manual to be source control managed

2013-09-02 Thread Lefty Leverenz
d. Adding and improving the content seems crucial, but why not do that in the wiki? Also, the xdocs weren't removed deliberately -- they broke in December ( HIVE-3896 <https://issues.apache.org/jira/browse/HIVE-3896>) and no one had the time or inclination to fix them. Has that situati

Re: What is this windowing query supposed to do?

2013-09-02 Thread Lefty Leverenz
f you follow our site from the main page you find the > broken docs, not the confluence ones. > > > On Mon, Sep 2, 2013 at 4:21 AM, Lefty Leverenz wrote: > >> Once again the /confluence/display version of the wiki is fine while the >> non-display version is glitchy. First th

Broken Hive docs -- links not working

2013-09-02 Thread Lefty Leverenz
Edward Capriolo talked about broken links in the Hive wiki in another thread on the users list ("What is this windowing query supposed to do?") so I'm moving the discussion here. Recap: Edward: > Most of the links here: > https://cwiki.apache.org/Hive/languagemanual.html > > are broken... > What

Re: Semantics of Rank.

2013-09-03 Thread Lefty Leverenz
What's the answer -- does the "rank" keyword have to be lowercase? If lowercase is obligatory we need to revise the wiki, which shows all uppercase ( https://cwiki.apache.org/confluence/display/Hive/LanguageManual+WindowingAndAnalytics ). In the test files it's lowercase (windowing_rank.q, ptf_ne

Re: Semantics of Rank.

2013-09-03 Thread Lefty Leverenz
27;m catching up on a huge backlog. -- Lefty On Tue, Sep 3, 2013 at 4:03 AM, Lefty Leverenz wrote: > What's the answer -- does the "rank" keyword have to be lowercase? > > If lowercase is obligatory we need to revise the wiki, which shows all > uppercase ( > https:/

Re: DISCUSS: Hive language manual to be source control managed

2013-09-04 Thread Lefty Leverenz
> > I believe I converted a majority of the wiki before you did > https://github.com/mislam77/hive-li/blob/master/docs/xdocs/language_manual/cli.xml, > but that is splitting hairs :) Go ahead and split hairs, Edward, because you deserve plenty of credit. And last year you warned me that the comm

Re: Interesting claims that seem untrue

2013-09-17 Thread Lefty Leverenz
> Whatever you count, you get more of :) Then let's count lines of documentation! ;) -- Lefty On Tue, Sep 17, 2013 at 12:15 PM, Edward Capriolo wrote: > Whatever you count, you get more of :) > > > On Tue, Sep 17, 2013 at 1:57 PM, Konstantin Boudnik wrote: > >> Carter, >> >> what you are doin

Re: Semantics of Rank.

2013-09-24 Thread Lefty Leverenz
t; wrote: > >> I filed HIVE-5038. My issue was that it seemed incorrect that rank took >> an arg. I haven't verified that the issue is fixed in trunk as claimed in >> the JIRA.However, between the reponse in JIRA and in this thread it seems >> resolved. &

Re: Need help with Installation hive 0.11

2013-10-05 Thread Lefty Leverenz
Do you have any suggestions for improving the Hive wiki instructions? -- Lefty On Fri, Oct 4, 2013 at 7:30 PM, Baahu wrote: > Apache hive. > On Oct 5, 2013 1:06 AM, "Mikhail Antonov" wrote: > >> Are you using apache hive or one from cloudera/Horton works? >> >> On Oct 4, 2013, at 11:52, Baahu

Re: Need help with Installation hive 0.11

2013-10-05 Thread Lefty Leverenz
ions to build from source code just after "Installing Hive > from a Stable Release" section, which is kinda confusing.I bump in to the > error mentioned above while I execute the instructions in "Running Hive" > section. > > Thanks, > Baahu > > >

Re: Need help with Installation hive 0.11

2013-10-05 Thread Lefty Leverenz
ested." -- Lefty On Sat, Oct 5, 2013 at 2:44 AM, Lefty Leverenz wrote: > I'm out of my depth, but based on existing documentation I'll make some > suggestions you could try while waiting for replies from people who > actually know about installation. > > Following Mikhai

Re: Hive Server 2 Python Client Drivers

2013-10-29 Thread Lefty Leverenz
When it's ready, I can add it to the wikidoc for you if you don't have editing access. -- Lefty On Wed, Oct 23, 2013 at 7:24 PM, Brad Ruderman wrote: > Thanks Stephen- > I will submit it, its definitely still kinda beta mode. > > Looking for feedback and contributors if anyone is interested. >

Re: [ANNOUNCE] New Hive Committer - Xuefu Zhang

2013-11-03 Thread Lefty Leverenz
Bravo Xuefu! -- Lefty On Sun, Nov 3, 2013 at 11:09 PM, Zhang Xiaoyu wrote: > Congratulations! Xuefu, well deserved! > > Johnny > > > On Sun, Nov 3, 2013 at 8:06 PM, Carl Steinbach wrote: > >> The Apache Hive PMC has voted to make Xuefu Zhang a committer on the >> Apache Hive project. >> >> Plea

Re: [ANNOUNCE] New Hive Committer - Prasad Mujumdar

2013-11-10 Thread Lefty Leverenz
Congratulations Prasad! -- Lefty On Sun, Nov 10, 2013 at 11:04 PM, Brock Noland wrote: > Congratulations!! > > On Sunday, November 10, 2013, Thejas Nair wrote: > > > Congrats Prasad! > > > > On Sun, Nov 10, 2013 at 6:46 PM, Jarek Jarcec Cecho > > > wrote: > > > Congratulations Prasad, good jo

Re: ORC Tuning - Examples?

2013-11-12 Thread Lefty Leverenz
If you get some useful advice, let's improve the doc. -- Lefty On Tue, Nov 12, 2013 at 6:15 PM, John Omernik wrote: > I am looking for guidance (read examples) on tuning ORC settings for my > data. I see the documentation that shows the defaults, as well as a brief > description of what it is

Re: [ANNOUNCE] New Hive Committers - Jitendra Nath Pandey and Eric Hanson

2013-11-21 Thread Lefty Leverenz
Congratulations, Jitendra and Eric! The more the merrier. -- Lefty On Thu, Nov 21, 2013 at 6:31 PM, Jarek Jarcec Cecho wrote: > Congratulations, good job! > > Jarcec > > On Thu, Nov 21, 2013 at 03:29:07PM -0800, Carl Steinbach wrote: > > The Apache Hive PMC has voted to make Jitendra Nath Pand

Re: DROP command fails with error message

2013-12-04 Thread Lefty Leverenz
You can find documentation for installation and configuration here: - Old versions of HCatalog: http://hive.apache.org/docs/hcat_r0.5.0/install.html - Current HCatalog: https://cwiki.apache.org/confluence/display/Hive/HCatalog+InstallHCat - Hive metastore: https://cwiki.apache.or

Re: Hive + Secure Hbase

2013-12-11 Thread Lefty Leverenz
Did you see this JIRA? https://issues.apache.org/jira/browse/HBASE-8662 -- Lefty On Mon, Dec 9, 2013 at 8:35 AM, Justin Workman wrote: > I have just started to experiment with Hbase in our cluster. I have an > secure Hbase cluster setup and would like to create an external Hive table > around

Re: Hive + Secure Hbase

2013-12-15 Thread Lefty Leverenz
. Many unit tests failed during build. > > Any pointers? > > Sent from my iPhone > > On Dec 11, 2013, at 3:13 AM, Lefty Leverenz > wrote: > > Did you see this JIRA? https://issues.apache.org/jira/browse/HBASE-8662 > > -- Lefty > > > On Mon, Dec 9, 2013

Re: Question about running Hive on Tez

2013-12-18 Thread Lefty Leverenz
Should hive-on-tez-conf.txt be added to the wiki, or is it not soup yet? -- Lefty On Mon, Dec 16, 2013 at 10:25 AM, Cheolsoo Park wrote: > Closing the loop. We identified the issue with help from the Tez team. It > was mis-configured mapreduce.reduce.cpu.vcores that caused problems. > > If anyo

Re: Upgrading Hive 0.7/0.8/0.9 to Hive 0.10.0

2013-12-19 Thread Lefty Leverenz
You should be aware of a new offline tool in Hive 0.12: The Hive Schema Tool . This tool can be used to initialize the metastore schema for the current > Hive version. It can also handle upgrading

Re: STREAMTABLE And MAPJOIN

2013-12-24 Thread Lefty Leverenz
This seems useful, so I added a sentence to the explanation of STREAMTABLE in the JOINS wikidoc : >- > >In every map/reduce stage of the join, the table to be streamed can be >specifie

Re: [ANNOUNCE] New Hive PMC Member - Gunther Hagleitner

2013-12-27 Thread Lefty Leverenz
Congratulations Gunther, well deserved! -- Lefty On Fri, Dec 27, 2013 at 12:00 AM, Jarek Jarcec Cecho wrote: > Congratulations Gunther, good job! > > Jarcec > > On Thu, Dec 26, 2013 at 08:59:37PM -0800, Carl Steinbach wrote: > > I am pleased to announce that Gunther Hagleitner has been elected

Re: Hive, datanucleus, jdbc, localmode.

2013-12-28 Thread Lefty Leverenz
This sounds like something the documentation should cover. - What information should be added to the Local Modesection? - Should the wiki have a link to hive_test

Re: [DISCUSS] Proposed Changes to the Apache Hive Project Bylaws

2013-12-29 Thread Lefty Leverenz
Let's discuss annual rotation of the PMC chair a bit more. Although I agree with the points made in favor, I wonder about frequent loss of expertise and needing to establish new relationships. What's the ramp-up time? Could a current chair be chosen for another consecutive term? Could two chair

Re: [DISCUSS] Proposed Changes to the Apache Hive Project Bylaws

2013-12-31 Thread Lefty Leverenz
;patch available" and ignoring it until it has been committed. Then if I find some minor typo or doc issue, I'm embarrassed at posting a comment after the commit because nobody wants to revert a patch just for documentation. -- Lefty On Sun, Dec 29, 2013 at 12:06 PM, Thejas Nair wrote:

Re: working with HIVE VARIALBE: Pls suggest

2014-01-06 Thread Lefty Leverenz
Here's the same wikidoc in its usual display mode: Variable Substitution . -- Lefty On Sun, Jan 5, 2014 at 11:06 PM, lxw wrote: > > maybe you can see: > > > https://cwiki.apache.org/confluence/plugins/viewso

Re: [DISCUSS] Proposed Changes to the Apache Hive Project Bylaws

2014-01-09 Thread Lefty Leverenz
> ... to nudge committers to review patches sooner ... I'm of two minds about this, so I'd like to hear more opinions. In theory, picking up the pace seems like a good idea. But in practice, everybody has other tasks to juggle so reviewing patches doesn't always find a place in the daily schedu

Re: Hive on Amazon

2014-01-13 Thread Lefty Leverenz
Welcome back, Sanjay. -- Lefty On Sun, Jan 12, 2014 at 10:33 PM, Subramanian, Sanjay (HQP) < sanjay.subraman...@roberthalf.com> wrote: > Greetings Hive-ians > > > Great to be writing to this group once more. > > > After using Cloudera CDH distributions in production for almost 2 years > , I

Re: [DISCUSS] Proposed Changes to the Apache Hive Project Bylaws

2014-01-14 Thread Lefty Leverenz
This wording seems fine. You could add "a" here: "Committers should wait for [a] reasonable time" The guidance is good. +1 -- Lefty On Tue, Jan 14, 2014 at 7:53 PM, Thejas Nair wrote: > I guess the silence from others on the changing the '24 hours from +1' > to a guidance of '24 hours

Re: complex datatypes filling

2014-01-17 Thread Lefty Leverenz
Here's the wikidoc for transform: Transform/Map-Reduce Syntax . -- Lefty On Thu, Jan 16, 2014 at 10:44 PM, Bogala, Chandra Reddy < chandra.bog...@gs.com> wrote: > Thanks for quick reply. I will take a look at stream job

Re: DESCRIBE EXTENDED show numRows=0

2014-01-27 Thread Lefty Leverenz
Can the ANALYZE statement be used to gather statistics if hive.stats.autogather was 'false' when the data was loaded? (See the wiki's Statistics in Hive doc: Existing Tables .) -- Lefty On Sun, Jan 26, 2014 at 8

Re: Building Hive

2014-01-28 Thread Lefty Leverenz
I can only answer your last question about rebuilding the metastore: a new Hive schema tool can do that for you, as described in the wiki here . This tool can be used to initialize the metastore sc

Re: Building Hive

2014-01-28 Thread Lefty Leverenz
uestions -- Lefty On Tue, Jan 28, 2014 at 3:47 AM, Peter Marron < peter.mar...@trilliumsoftware.com> wrote: > Ah, thank you. > > I think that I probably should have known that already. > > Z > > > > *From:* Lefty Leverenz [mailto:leftylever...@gmail.com] >

Re: Group By and Partion By in Hive

2014-01-29 Thread Lefty Leverenz
OVER is documented here: Windowing and Analytics Functions . -- Lefty On Wed, Jan 29, 2014 at 3:41 AM, Andre Araujo wrote: > The first is available in Hive since early versions (in versions older > than 0.6

Re: DESCRIBE EXTENDED show numRows=0

2014-01-29 Thread Lefty Leverenz
tableType:MANAGED_TABLE) > > {noformat} > > > On Mon, Jan 27, 2014 at 3:52 AM, Lefty Leverenz > wrote: > >> Can the ANALYZE statement be used to gather statistics if >> hive.stats.autogather was 'false' when the data was loaded? (See the >>

Re: DESCRIBE EXTENDED show numRows=0

2014-01-29 Thread Lefty Leverenz
I forgot, there's already a ticket: HIVE-6285<https://issues.apache.org/jira/browse/HIVE-6285> . -- Lefty On Wed, Jan 29, 2014 at 10:36 PM, Lefty Leverenz wrote: > Oops, then I'd better correct what I just put in the wiki -- Describe > Table/View/Column<https://cw

Re: Map-side join memory limit is too low

2014-02-03 Thread Lefty Leverenz
Searching the JIRA for HADOOP_HEAPSIZE turned up this new ticket (and related ones mentioned in the comments): HADOOP-10245 : The Hadoop command line scripts (hadoop.sh or hadoop.cmd) will call java > with "-Xmx" options twice. The impact is that

Re: Hive Server 2 Python Client Drivers

2014-02-03 Thread Lefty Leverenz
tDriver> - HiveServer2 Clients: Python Client<https://cwiki.apache.org/confluence/display/Hive/HiveServer2+Clients#HiveServer2Clients-PythonClient> Thanks for your contribution. -- Lefty On Tue, Oct 29, 2013 at 12:55 AM, Lefty Leverenz wrote: > When it's ready, I can add it to the wiki

Re: Optimising mappers for number of nodes

2014-02-04 Thread Lefty Leverenz
Actually that's mapred.max.split.size. Hive doesn't have a configuration parameter named "hive.max.split.size". -- Lefty On Mon, Feb 3, 2014 at 10:59 AM, Prasanth Jayachandran < pjayachand...@hortonworks.com> wrote: > Hi > > hive.max.split.size can be tuned to decrease the number of mappers. >

Re: Hive on Windows w/Hadoop 2.2.0

2014-02-04 Thread Lefty Leverenz
That's from the first sentence of Getting Started, which needs to be rewritten: DISCLAIMER: Hive has only been tested on unix(linux) and mac systems using > Java 1.6 for now - although it may very well work on other similar > platforms. It does not work on Cygwin. What should it say instead? --

Re: Hive on Windows w/Hadoop 2.2.0

2014-02-05 Thread Lefty Leverenz
ay anything different.. I would like to > run Hive on Windows. I was wondering if any details existed on why Cygwin > didn't work or an alternative for Windows other than using Hortonworks. > > > > From my point of view is it valid to say that no other details exist and >

Re: Configuring Apache Hive using Kerberos Authentication

2014-02-14 Thread Lefty Leverenz
If the Hive wikidocs need improvement, please let me know what to change (or do it yourself if you have edit access). Thanks. -- Lefty On Thu, Feb 13, 2014 at 9:52 AM, Prasad Mujumdar wrote: > > On the client side, you need to run kinit manually. Beeline doesn't > support getting TGT program

Re: Sampling from a single column

2014-02-14 Thread Lefty Leverenz
> > ... saw a simple sample() function while browsing the documentation ... I grepped an export of the Hive wiki for 'sample(' and 'sample (' but only found tablesample in these three docs: - https://cwiki.apache.org/confluence/display/Hive/Tutorial#Tutorial-Sampling - https://cwiki.

Re: Hive 0.13

2014-02-26 Thread Lefty Leverenz
The release process is currently scheduled to begin on March 4th. It takes a couple of weeks, minimum, so if all goes well Hive 0.13 will be ready sometime in the second half of March. Here's the message thread on dev@hive: Timeline for the Hive 0.13 release?

Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

2014-02-28 Thread Lefty Leverenz
Congrats Xuefu! -- Lefty On Fri, Feb 28, 2014 at 2:52 PM, Eric Hanson (BIG DATA) < eric.n.han...@microsoft.com> wrote: > Congratulations Xuefu! > > -Original Message- > From: Remus Rusanu [mailto:rem...@microsoft.com] > Sent: Friday, February 28, 2014 11:43 AM > To: d...@hive.apache.org

Re: move hive tables from one cluster to another cluster

2014-03-04 Thread Lefty Leverenz
Here's the doc for "msck repair table" (or on EMR, "alter table recover partitions"): https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-RecoverPartitions(MSCKREPAIRTABLE) . -- Lefty On Fri, Feb 28, 2014 at 5:04 PM, Brad Ruderman wrote: > Hi, just want to give

Re: read a Hive Map without knowing keys

2014-03-18 Thread Lefty Leverenz
> What is "select *?" ? I think he just meant "select *" and ended the suggestion with a question mark. Admittedly, "select *?" looks like syntax with an extra wildcard. -- Lefty On Tue, Mar 18, 2014 at 3:07 AM, Szehon Ho wrote: > You can try to check other string udf's for that case, here

Re: [ANNOUNCE] New Hive Committers - Alan Gates, Daniel Dai, and Sushanth Sowmyan

2014-04-14 Thread Lefty Leverenz
Congratulations [ Sushanth | Daniel | Alan ] -- well deserved! -- Lefty On Mon, Apr 14, 2014 at 3:06 PM, Xuefu Zhang wrote: > Congrats Alan, Daniel and Sushanth! > > --Xuefu > > > On Mon, Apr 14, 2014 at 12:01 PM, Sushanth Sowmyan >wrote: > > > Thanks, all. :) > > > > And congrats to Alan and

Re: Hive on Tez

2014-04-23 Thread Lefty Leverenz
The release notes on HIVE-6098might be what you need. They also refer to INSTALL.txtin github. -- Lefty On Wed, Apr 23, 2014 at 12:47 PM, Bryan Jeffrey wrote: > All, > > Is t

Re: Skewed Tables

2014-04-24 Thread Lefty Leverenz
I'm looking at the docs and thinking of ways to include this information. But Prasanth, if you want to do it yourself that would be great. -- Lefty On Thu, Apr 24, 2014 at 5:33 AM, Mayur Gupta wrote: > Thanks a lot Prasanth for the reply. I would have never figured that out > as the documentat

Re: [ANNOUNCE] New Hive Committers - Prasanth J and Vaibhav Gumashta

2014-04-25 Thread Lefty Leverenz
Congratulations! -- Lefty On Fri, Apr 25, 2014 at 12:10 AM, Hari Subramaniyan < hsubramani...@hortonworks.com> wrote: > Congrats Prasanth and Vaibhav! > > Thanks > Hari > > > On Thu, Apr 24, 2014 at 8:45 PM, Chinna Rao Lalam < > lalamchinnara...@gmail.com> wrote: > > > Congratulations to Prasan

Re: Skewed Tables

2014-04-26 Thread Lefty Leverenz
can add this information. Can you please point me to the location to add > this? Perhaps, you can help reviewing it. > > Thanks > Prasanth Jayachandran > > On Apr 24, 2014, at 1:13 PM, Lefty Leverenz > wrote: > > I'm looking at the docs and thinking of ways to inc

Re: Error in sasl_client_start (-4) SASL(-4): no mechanism available: No worthy mechs found

2014-04-26 Thread Lefty Leverenz
I tend to think of the Hive community as an elaborate video game. -- Lefty On Sat, Apr 26, 2014 at 9:59 AM, Edward Capriolo wrote: > Sorry to create list trash but when I saw "mech" I got really excited... > > > http://en.wikipedia.org/wiki/MechWarrior_2:_31st_Century_Combat#MechWarrior_2:_Ghos

Re: What is the minimal required version of Hadoop for Hive 0.13.0?

2014-04-27 Thread Lefty Leverenz
This needs to be documented somewhere. -- Lefty On Wed, Apr 23, 2014 at 11:45 PM, Edward Capriolo wrote: > LOL. I thought I was the last 0.20.2 hold out. > > > On Wed, Apr 23, 2014 at 4:01 PM, Thejas Nair > wrote: > > > There is a jira for the hadoop 1.0.x compatibility issue. > > https://issu

Re: Skewed Tables

2014-04-27 Thread Lefty Leverenz
Prasanth, Hive's user docs are wiki-only at this point so there's no version control. We just add notes about which release introduced or changed something. For an example see the beginning of the Skewed Tables

Re: build Hive-0,13

2014-05-10 Thread Lefty Leverenz
http://mail-archives.apache.org/mod_mbox/hive-user/201405.mbox/date> .> -- Lefty On Wed, May 7, 2014 at 2:04 AM, Lefty Leverenz wrote: > I've added the information to the wiki here: Hive Developer FAQ - How to > specify the Hadoop > version<https://cwiki.apache.org/

Re: testing subscription

2014-05-11 Thread Lefty Leverenz
Same here. The archivesonly have a few messages recently, but at least one failed to reach me and a reply I sent on the thread "Re: build Hive-0,13

Re: build Hive-0,13

2014-05-14 Thread Lefty Leverenz
I've added the information to the wiki here: Hive Developer FAQ - How to specify the Hadoop version. Thanks for pointing out that this was needed. -- Lefty On Tue, May 6, 2014 at 2

Re: Hive + hadoop 2.2.0 configuration setting

2014-05-17 Thread Lefty Leverenz
Hive 0.13 installs with Maven but you're using Hive 0.12, so the Ant instructions in the wiki's Installation docshould be correct. The Hive Metastore section has links to configuration docs. We would like to update the wi

Re: unsubscribe

2014-05-17 Thread Lefty Leverenz
To unsubscribe, send a message to this address: user-unsubscr...@hive.apache.org . This is explained on the Hive site's mailing lists page . -- Lefty On Sat, May 17, 2014 at 4:06 AM, Xia, Junluan wrote: > > > > > regards, > > Andrew > > >

Re: Hive can I contribute to Hive confluence wiki documents?

2014-05-29 Thread Lefty Leverenz
Thank you for pointing this out. The 'hive.cache.expr.evaluation' parameter was added by HIVE-4209 and it needs to be included in the wiki. Its description is in hive-default.xml.template: If true, evaluation result of deterministic expression ref

Re: UDF development group details

2014-06-09 Thread Lefty Leverenz
The Hive wiki has useful information for contributors here: https://cwiki.apache.org/confluence/display/Hive/Home#Home-ResourcesforContributors . -- Lefty On Mon, Jun 9, 2014 at 2:19 AM, Nitin Pawar wrote: > there is no custom group for U

Re: HCatalog access from a Java app

2014-06-14 Thread Lefty Leverenz
Excluding HCatalog JavaDocs was a production error in some of the Hive releases after HCatalog graduated from the Apache incubator and merged with Hive, but the HCatalog API has always been public. - Pre-merge HCatalog 0.5.0 JavaDocs are here: http://hive.apache.org/javadocs/hcat-r0.5.0/api/

Re: mismatched input '' expecting FROM near 'CURRENT_TIME' in from clause

2014-06-20 Thread Lefty Leverenz
The Hive wiki describes the SELECT syntax here . -- Lefty On Thu, Jun 19, 2014 at 9:52 AM, Nitin Pawar wrote: > Please take a look at hive's query language support. > > its pro-sql but no

Re: hive variables

2014-06-21 Thread Lefty Leverenz
Thanks Nitin, I've added that information to the wiki on the Variable Substitution page . Please check my wording and let me know if revisio

Request write access to the Hive wiki

2012-07-19 Thread Lefty Leverenz
Please grant me write access to the Hive wiki so that I can work on improving the documentation. Thank you. – Lefty Leverenz le...@hortonworks.com

Re: Hive Join-Query

2012-07-25 Thread Lefty Leverenz
Your query says "JOIN supplier s ON (s.supplierid=v.supplier)" but s.supplierid should be s.supplier_id. Also, the vender schema shows a "quantiry" column which might be just a message typo, but if you cut-&-pasted the schema data into the message then you should change the name to "quantity". –

Re: Passing date as command line arguments

2012-08-04 Thread Lefty Leverenz
Does Hive 0.6 support underscores in variable names? Just a thought. The examples I've seen contain letters and dots (".") but no other characters. – Lefty On Sat, Aug 4, 2012 at 12:39 AM, Bejoy KS wrote: > ** > Yes that is the right issue. Variable substitution is not happening. I > can't

Re: DECIMAL precision is too small

2014-06-28 Thread Lefty Leverenz
What was your work-around? (If it's generally applicable, we could include it in the documentation.) -- Lefty On Sat, Jun 28, 2014 at 10:08 AM, Brian Jeltema < brian.jelt...@digitalenvoy.net> wrote: > Hive doesn’t support a BigDecimal data type, as far as I know. It supports > a Decimal type t

Re: Hive Query (Replace)

2014-07-01 Thread Lefty Leverenz
I'm no expert, but could you use the regexp_replace or translate function? >From the Hive wiki : regexp_replace(string INITIAL_STRING, string PATTERN, string REPLACEMENT) > > Returns the string

Re: Column selection in Hive

2014-07-01 Thread Lefty Leverenz
Here's the wikidoc for dropping columns with ALTER TABLE ... REPLACE COLUMNS: Add/Replace Columns . But you'd still have to list 190 columns, so CTAS would be more direct. AFAIK, HiveQL doesn

Re: Skewed vs ListBucketing

2014-07-01 Thread Lefty Leverenz
Does anyone have time to answer this? It would be good to clarify things in the wiki. HIVE-3649 added the list bucketing feature in release 0.10.0. The description says: We need to differ normal skewed table from list bucketing table. we use an

Re: Skewed vs ListBucketing

2014-07-01 Thread Lefty Leverenz
Wed, Jul 2, 2014 at 1:25 AM, Lefty Leverenz wrote: > Does anyone have time to answer this? It would be good to clarify things > in the wiki. > > HIVE-3649 <https://issues.apache.org/jira/browse/HIVE-3649> added the > list bucketing feature in release 0.10.0. The description say

Re: Skewed vs ListBucketing

2014-07-02 Thread Lefty Leverenz
he > difference between the two. “STORED AS DIRECTORIES” is used by only one > optimization i.e list bucketing. I'm open to suggestions about how to improve the doc, or I'll tackle it as best I can with the given information. -- Lefty On Wed, Jul 2, 2014 at 1:55 AM, Lefty Lev

Re: Hive can I contribute to Hive confluence wiki documents?

2014-07-03 Thread Lefty Leverenz
oc? If so, I'll link the docs to each other. -- Lefty On Thu, May 29, 2014 at 5:31 AM, Lefty Leverenz wrote: > Thank you for pointing this out. The 'hive.cache.expr.evaluation' > parameter was added by HIVE-4209 > <https://issues.apache.org/jira/browse/HIVE-4209> a

  1   2   3   4   >