Timestamp format

we can get the hour out using hour(cast(regexp_replace(table_timestamp, "T|Z", " ") as timestamp)) which works for the two kinds of formats that we’re getting from our tables. I just wanted to see if anyone has dealt with this before, and if there are any better ideas for this? Thanks in advance, Merry Christmas! Jay

Re: Support Parquet through HCatalog

Hi Peter, Do you have any pointers for next steps to take? Thanks in advance, Jay From: Jay Green Stevens Reply-To: "user@hive.apache.org" Date: Friday, 27 September 2019 at 14:53 To: "user@hive.apache.org" Subject: Re: Support Parquet through HCatalog Ah okay. I have

Re: Support Parquet through HCatalog

Ah okay. I have opened a new ticket<https://issues.apache.org/jira/browse/HIVE-22249>. Thanks Peter! Jay From: Peter Vary Reply-To: "user@hive.apache.org" Date: Friday, 27 September 2019 at 13:37 To: "user@hive.apache.org" Subject: Re: Support Parquet through HCa

Re: Support Parquet through HCatalog

Hi Peter, Thanks for your reply. The patch applies cleanly but I don’t have the ability to reopen the ticket. Would you be able to do it for me, please? Thanks, Jay From: Peter Vary Reply-To: "user@hive.apache.org" Date: Thursday, 26 September 2019 at 18:07 To: "user@

Support Parquet through HCatalog

for me to reopen the ticket, or should I open a new ticket for this? Let me know which is preferred. Thanks, Jay Green-Stevens

Re: HQL parser internals

some way to stop the ‘as’ from being stripped out? Any ideas would be greatly appreciated! Thanks, Jay From: Elliot West mailto:tea...@gmail.com>> Date: 19 March 2018 at 21:33 Subject: Re: HQL parser internals To: user@hive.apache.org<mailto:user@hive.apache.org> Hello again

Wiki Access Request

I would like to request write access for the Hive wiki; my user name is jgreenstevens. Thanks, Jay Green-Stevens

Wiki Access Request

Hi, I would like to request write access to the Hive wiki page. Thanks, Jay Green-Stevens

Hive Issue - View

ggestions as to what the problem is/ how to fix it. Thanks Jay Green-Stevens Software Development Intern Hotels.com – an Expedia Inc Brand Expedia.com Ltd – 407 St John St, London EC1V4EX [ignature_1304619991]

Re: Out of Memory while generating ORC Splits

this? Thanks, Jayadeep On Wed, Sep 13, 2017 at 3:14 PM, Rajesh Balamohan wrote: > With "HYBRID" can you try with "hive.orc.cache.use.soft.references=true"? > That should help in preventing OOM with Hybrid strategy. > > ~Rajesh.B > > On Wed, Sep 13, 20

Out of Memory while generating ORC Splits

Hi All, I am running a simple select query as below select distinct vehicle_no from rmd.gets_dw_eoa_eng_rec_dtl_orc_ext_concat_final_eng3 where incident_dt = '2999-01-01'; The table is a 2 level partitioned table as shown below drwx-- - gpadmin hdfs 0 2017-09-12 14:36 /apps/hive/

Re: Running a hive script from Java via API.

So i guess your saying "yes : just use the JDBC driver with the jdbc:hive2://", and that is the equivalent of PigServer (with caveat that it can't run a hive script).

Running a hive script from Java via API.

Hi hive. Is there an API akin to PigServer, which allows you to run a hive script from Java directly, using hive embedded mode, without use of JDBC? -- Jay Vyas http://jayunit100.blogspot.com

Hive jdbc access to HiveServer2. How to debug?

g last message (now what)? at this point, the code just hangs. -- Jay Vyas http://jayunit100.blogspot.com

Running hive from java without jdbc

Is there a way to execute hive commands without the jdbc driver (similar to how we can call the PigServer API hooks)? For example, id like to register an entire hive script to run from java, programmatically.

Running hive jdbc, local metastore, local mapreduce.

. Im finding that there are references to JobConf in stack traces, even when i use the right hadoop 2x JDBC drivers. So, i find its pretty easy to run using hive drivers with hadoop 1x, but not with 2x tarballs in local mode. -- Jay Vyas http://jayunit100.blogspot.com

Re: help ! Does hive depend on hadoop-core?

Ahh,,, looks like there is a new client for Hive2 :) http://grokbase.com/p/cloudera/cdh-user/12bwb8fdbd/hive-jdbc-timeout But im getting other errors now. Oh well, maybe ill post them in another thread. On Thu, Mar 27, 2014 at 1:05 PM, Jay Vyas wrote: > yes but this appears to be an old

Re: help ! Does hive depend on hadoop-core?

yes but this appears to be an old one (mapred.*). Why is hive 0.12.0 referencing mapred, instead of mapreduce.*? On Thu, Mar 27, 2014 at 12:52 PM, Nitin Pawar wrote: > hive needs hadoop libraries to work > > > On Thu, Mar 27, 2014 at 11:13 PM, Jay Vyas wrote: > >> Im run

help ! Does hive depend on hadoop-core?

:247) ... 3 more Execution failed with exit status: 1 Obtaining error information Task failed! However, im using hive-0.12.0 ? Does this mean that the latest hive actually has a runtime dependency on the older mapred.* libraries? -- Jay Vyas http://jayunit100.blogspot.com

Re: Hive_test and hadoop 2x

gt; On Sat, Feb 1, 2014 at 8:35 AM, Jay Vyas wrote: > >> Looks like hive_test is >> >> 1) mainly built to test hive only apps >> 2) specified for hadoop 0.2x >> >> Any one running hive_test in different environments? If so and any hints >> would l

Hive_test and hadoop 2x

Looks like hive_test is 1) mainly built to test hive only apps 2) specified for hadoop 0.2x Any one running hive_test in different environments? If so and any hints would love to adopt it ... We've opened a jira about the complexity of running hive embedded from maven due to the jdo/datanucleu

Re: JSON data to HIVE table

One nice way to do this stuff is using a special SERDE, possible like the JsonSerde: A simpler scenario, where you have to load a multidelimiter CSV file, can be addressed using the RegexSerde : which maps columns to each group matching. In your case, the JsonSerde could be used essentially to ma

NullPointerException : Utilities.setColumnTypeList

T_REGEX", "(?:BigPetStore,storeCode_)" + "([A-Z][A-Z])," + // state (CT) "([0-9]*)" + // state transaction id (1) "(?:\t)" + // [tab] "([a-z]*)," + // fname (jay)

Re: RegExSerde over JDBC... is it possible>

ant way to integrate hive/hadoop that im not thinking of (hive_test maybe :)) On Mon, Dec 30, 2013 at 7:17 AM, Jay Vyas wrote: > Hi folks.. > > > Is there an JDBC or other API driven, programmatic way to launch a Hive > Job using SerDe's from the contrib library? > >

RegExSerde over JDBC... is it possible>

oadClass(ClassLoader.java:356) ... 44 more I've seen a JIRA alluding that custom serdes may *not* work in Hive JDBC... Is that still the case https://issues.apache.org/jira/browse/HIVE-2685 ? -- Jay Vyas http://jayunit100.blogspot.com

Re: Hive, datanucleus, jdbc, localmode.

Yes this blog + hive_test should be merged into a jira and then officially integrated into hive in some way I think. > On Dec 29, 2013, at 8:44 AM, Edward Capriolo wrote: > > This article describes exactly what hive test does. > > :) > > >> On Sat, Dec 28, 2013

Re: Hive, datanucleus, jdbc, localmode.

Anyone try this yet : http://hadoop-pig-hive-thejas.blogspot.com/2013/04/running-hive-in-local-mode.html ? On Sat, Dec 28, 2013 at 8:09 PM, Jay Vyas wrote: > -Local mode should have clear instructions on how to run fully local hive > jobs, with no hadoop installation. > >

Re: Hive, datanucleus, jdbc, localmode.

c 28, 2013 at 8:02 AM, Edward Capriolo >> wrote: >> I do not think so. Local mode, just implies the job tracker is local (and >> some of the temp storage directories) it does not imply hive will use hadoop >> without forking. >> >> >>> On Sat, Dec 28, 201

Re: Hive, datanucleus, jdbc, localmode.

ssentially hive requires a HADOOP_HOME because it always wants to fork a > bin/hadoop process. Hive-test helps you unpack hadoop inside target and > change your hadoop_home to some other directory. > > It would be nice if there was some other way to do this. > > >>

Hive, datanucleus, jdbc, localmode.

Hi Hive: I'm attempting to create a robust eclipse based dev environment for testing my hive jobs in localmode however I run into classnotfound errors depending on which maven dependencies I use. Also, it seems when I change these dependencies from hive 0.12 to hive 0.11, I get other errors rel

The role of servers in HIVE

-modes.pdf?version=1&modificationDate=1360856723000 And I've asked a similar question on stackoverflow that could use some comments http://stackoverflow.com/questions/18477440/why-does-hive-depend-on-a-server-url-and-hbase -- Jay Vyas http://jayunit100.blogspot.com

Loading data into a Clustered/bucketed table

/bucketed table other than to first get the data into a temp table and the INSERT OVERWRITE SELECT from it? - Can INSERT OVERWRITE take its input from STDIN or a file instead of a Hive table? thanks Jay

Re: Extract Create Table statement from Hive

Thank you, Ed. Works like a charm after I remove the Hive2rdbms references. I've uploaded the jar to the JIRA for those who want to use it. On Feb 22, 2011, at 1:13 PM, Edward Capriolo wrote: > On Tue, Feb 22, 2011 at 1:09 PM, Jay Ramadorai > wrote: >> Thank you, Ed. Try

Re: Extract Create Table statement from Hive

>> On Mon, Feb 21, 2011 at 6:42 PM, Jay Ramadorai >> wrote: >>> Does anyone have a way of generating the create table statement for a table >>> that is in Hive? I see a jira for >>> this https://issues.apache.org/jira/browse/HIVE-967 and it appears that Ed &g

Extract Create Table statement from Hive

ee to suggest alternative approaches. thanks Jay

Multi-user use and tracking in Hive with Cloudera Hadoop

I want different clients from various machines outside the cluster running queries on hive as different users, and I want to be able to track who is running what, and use the Fair Scheduler or something similar as governor to throttle usage. So bottom line I need fine grained tracking and contro

Re: [VOTE] Sponsoring Howl as an Apache Incubator project

Food for thought, what if the metastore were moved to Howl more aggressively? It seems like the end state everyone's aiming for is that Hive and Pig share Howl as a metastore layer, which makes all kinds of sense.. would it increase the chances of long term success if you guys just went for it an

Re: Making Thrift work with Hive in client-server mode

at 9:22 AM, Jay Ramadorai wrote: > Can someone explain how the Thriftserver finds the Hive metastore? > > I am running with all non-default values and need to know how to connect to > Thrift so it finds Hive with the right metastore. > > I am running Derby in server mode o

Making Thrift work with Hive in client-server mode

Can someone explain how the Thriftserver finds the Hive metastore? I am running with all non-default values and need to know how to connect to Thrift so it finds Hive with the right metastore. I am running Derby in server mode on a non-default port. And my metastore name is non-default. And I w

Newlines in data

How can we preserve newlines in data in Hive columns? Currently newlines in data terminate the Hive record. I am using Sqoop to import data into Hive from external databases. Even using the the Escaped By clause of CREATE TABLE, Hive does not escape newlines. I see there is a JIRA for this http

Hive Concurrency Model - does it work?

trick, until concurrency truly works. Thanks Jay