Re: read-only mode for hive

2016-03-08 Thread Jörn Franke
What is the use case? You can try security solutions such as Ranger or Sentry. As already mentioned another alternative could be a view. > On 08 Mar 2016, at 21:09, PG User wrote: > > Hi All, > I have one question about putting hive in read-only mode. > > What are the ways of putting hive in r

Re: read-only mode for hive

2016-03-08 Thread Sabarish Sasidharan
Does views solve your purpose? Regards Sab On 09-Mar-2016 6:23 am, "PG User" wrote: > Yes, putting any database or any table to read-only mode will serve my > purpose. > > On Tue, Mar 8, 2016 at 3:15 PM, Mich Talebzadeh > wrote: > >> Hive much like MSSQL or SAP ASE has multiple databases. Are y

HiveServer2 session hook

2016-03-08 Thread Ravuri, Venkata Puneet
Hi, I am trying to use HiveServer2 session hook to get query string within a session. The hook returns an identifier to the SessionHandle through getSessionHandle() method. I am not able to get the SessionHandle using the identifier. Can you please provide a way using which I can retrieve the s

Re: read-only mode for hive

2016-03-08 Thread PG User
Yes, putting any database or any table to read-only mode will serve my purpose. On Tue, Mar 8, 2016 at 3:15 PM, Mich Talebzadeh wrote: > Hive much like MSSQL or SAP ASE has multiple databases. Are you implying > to put one of these databases in READ ONLY mode? > > Dr Mich Talebzadeh > > > > Link

Re: Simple UDFS and IN Operator

2016-03-08 Thread Gopal Vijayaraghavan
> In Hive 0.11, I¹ve written a UDF that returns a list of Integers. I¹d >like to use this in a WHERE clause of a query, something like SELECT * >FROM WHERE in ( getList()). ... > Joins would be ideal, but we haven¹t upgraded yet. IN() is actually rewritten into a JOIN (distinct ...) intern

Re: Simple UDFS and IN Operator

2016-03-08 Thread Edward Capriolo
The IN UDF is a special one in that unlike many others there is support in the ANTLR language and parsers for it. The rough answer is it can be done but it is not as direct as making other UDFs. On Tue, Mar 8, 2016 at 2:32 PM, Lavelle, Shawn wrote: > Hello All, > >I hope that this question

Re: Hive Context: Hive Metastore Client

2016-03-08 Thread Mich Talebzadeh
The current scenario resembles a three tier architecture but without the security of second tier. In a typical three-tier you have users connecting to the application server (read Hive server2) are independently authenticated and if OK, the second tier creates new ,NET type or JDBC threads to conne

Re: read-only mode for hive

2016-03-08 Thread Mich Talebzadeh
Hive much like MSSQL or SAP ASE has multiple databases. Are you implying to put one of these databases in READ ONLY mode? Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

read-only mode for hive

2016-03-08 Thread PG User
Hi All, I have one question about putting hive in read-only mode. What are the ways of putting hive in read-only mode? Can I take a lock at database level to serve purpose? What will happen to existing transaction? My guess is it will not grant a lock until all transactions are complete. I read t

Simple UDFS and IN Operator

2016-03-08 Thread Lavelle, Shawn
Hello All, I hope that this question isn’t too rudimentary – but I’m relatively new to HIVE. In Hive 0.11, I’ve written a UDF that returns a list of Integers. I’d like to use this in a WHERE clause of a query, something like SELECT * FROM WHERE in ( getList() ). (Extra parenthesis need

hive cast string to date in 'dd/MMM/yyyy' format order by and group by issue

2016-03-08 Thread dhruv kapatel
Hi, I've date stored as [27/Feb/2016:00:24:31 +0530] in string format. I want to cast it to dd/MMM/ format and also want to perform group by from it. More details and tried queries see below question on stackoverflow. http://stackoverflow.com/questions/35668624/hive-cast-string-to-date-in-dd-m

Re: Big + small + small 3 table mapjoin?

2016-03-08 Thread Yang
ah never mind I found that we are using an old version of hive without this feature On Tue, Mar 8, 2016 at 9:57 AM, Yang wrote: > by documentation I'm referring to this: > https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Joins#LanguageManualJoins-MapJoinRestrictions > > " the foll

Re: Big + small + small 3 table mapjoin?

2016-03-08 Thread Yang
by documentation I'm referring to this: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Joins#LanguageManualJoins-MapJoinRestrictions " the following configurable parameters can be used to make sure that the query executes in a single map-reduce job." On Tue, Mar 8, 2016 at 9:31 A

Hive 2 and versions of Spark as the execution engine for Hive

2016-03-08 Thread Mich Talebzadeh
Hi, As I recall Hive 2 now officially recommends using Spark or Tez as execution engine instead of Map-Reduce (MR) hive> *set hive.execution.engine=mr;*Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. tez, spark)

Big + small + small 3 table mapjoin?

2016-03-08 Thread Yang
>From the documentation it says that if my tables are small enough and i set the conver join parameters, without the join hints hive should be able to convert the joins into 1 mapjoin in 1 mr job But in practice i found that it always ends up in 2 mr jobs (2 map joins). What is wrong?

Re: Field delimiter in hive

2016-03-08 Thread Mich Talebzadeh
try "~|~" as field delimiter. It normally works for most conditions Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpr

Re: Field delimiter in hive

2016-03-08 Thread Chandeep Singh
I’ve been pretty successful with two pipes (||) or two carets (^^) based on my dataset even though they aren’t unicode. > On Mar 7, 2016, at 8:32 PM, mahender bigdata > wrote: > > Any help on this. > > On 3/3/2016 2:38 PM, mahender bigdata wrote: >> Hi, >> >> I'm bit confused to know which c

Re: Hive alter table concatenate loses data - can parquet help?

2016-03-08 Thread Marcin Tustin
Hi Mich, ddl as below. Hi Prasanth, Hive version as reported by Hortonworks is 1.2.1.2.3. Thanks, Marcin CREATE TABLE ``( `col1` string, `col2` bigint, `col3` string, `col4` string, `col4` string, `col5` bigint, `col6` string, `col7` string, `col8` string, `col9`

Re: Hive alter table concatenate loses data - can parquet help?

2016-03-08 Thread Prasanth Jayachandran
Hi Marcin What hive version are you using? There has been some fixes to concatenate lately. I will let you know if your hive version contains all fixes. Thanks Prasanth On Mar 8, 2016, at 3:29 AM, Mich Talebzadeh mailto:mich.talebza...@gmail.com>> wrote: Hi can you please provide DDL for thi

Re: Hive alter table concatenate loses data - can parquet help?

2016-03-08 Thread Mich Talebzadeh
Hi can you please provide DDL for this table "show create table " Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpre

Re: Hive 2 insert error

2016-03-08 Thread Mich Talebzadeh
Ok, When table is created as ORC but with no transactional property INSERT/SELECT works CREATE TABLE sales3 ( PROD_IDbigint , CUST_IDbigint , TIME_IDtimestamp, CHANNEL_ID bigint