Re: Hive Cli ORC table read error with limit option

Gopal, Any plan of provide the fix to Hive 1.x versions or to backport it? Regards Biswa On Tue, Mar 1, 2016 at 11:44 AM, Biswajit Nayak wrote: > Thanks Gopal for the details .. happy to know it has been counted and > fixed. > > Biswa > > > On Tue, Mar 1, 2016 at 11:37 AM, Gopal Vijayaraghavan

Re: Creating hive external table gives GC pool 'PS MarkSweep' had collection(s)

Hi Found that in my config there was hive.exec.dynamic.partition = true; I turned it false and most of the times I can create table now but not every time. Margus (margusja) Roo http://margus.roo.ee skype: margusja +372 51 48 780 On 29/02/16 09:27, Margus Roo wrote: Hi Can someone confirm

Re: Hive-2.0.1 Release date

Mich, >What is best way of using with Hive now? If we are talking about the command line: Hive/beeline CLI to execute standalone SQL statements; Hplsql if you need to surround them with procedural SQL (flow of control, loops, exception handlers, dynamic SQL etc.) Dmitry On Tue, Mar 1, 2016 at

Re: Hive-2.0.1 Release date

Thanks Dmitry I can see cd $HIVE_HOME find ./ -name '*hplsql*' ./bin/ext/hplsql.sh ./bin/hplsql.cmd ./bin/hplsql ./lib/hive-hplsql-2.0.0.jar hplsql usage: hplsql -d,--define Variable subsitution e.g. -d A=B or --define A=B -e HPL/SQL from c

Re: Hive-2.0.1 Release date

Mich, To avoid confusion: HPLSQL is shipped with Hive 2.0 (and will be shipped with all further versions). So you can use it with Hive on Tez, Hive on MR, and Hive on Spark. But now it is a separate tool: hplsql (like hive CLI, beeline CLI). What Alan meant is that it is not integrated to Hive *pa

Re: Hive-2.0.1 Release date

Thanks Alan much appreciated Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com On 1 March 2016 at 00:38, Al

Re: Hive Cli ORC table read error with limit option

Thanks Gopal for the details .. happy to know it has been counted and fixed. Biswa On Tue, Mar 1, 2016 at 11:37 AM, Gopal Vijayaraghavan wrote: > > > Yes it is kerberos cluster. > ... > > After disabling the optimization in hive cli, it works with limit > >option. > > Alright, then it is fixed

Re: Hive Cli ORC table read error with limit option

> Yes it is kerberos cluster. ... > After disabling the optimization in hive cli, it works with limit >option. Alright, then it is fixed in - https://issues.apache.org/jira/browse/HIVE-13120 Cheers, Gopal

Re: Hive Cli ORC table read error with limit option

Thanks Gopal for the response. Yes it is kerberos cluster. After disabling the optimization in hive cli, it works with limit option. Below is the DESC details of the table that you asked for. *hive> desc formatted *testdb.table_orc*;* *OK* *# col_namedata_type comment

Re: Sqoop Hcat Int partition error

The fix in the https://issues.apache.org/jira/browse/HIVE-7164. does not works. On Tue, Mar 1, 2016 at 10:51 AM, Richa Sharma wrote: > Great! > > So what is the interim fix you are implementing > > Richa > On Mar 1, 2016 4:06 PM, "Biswajit Nayak" wrote: > >> Thanks Richa. >> >> The issue was s

Reg: Hive Patch Released on January 28 2016 for authorization issue in Hive

Hi, A release was made for fix an authorization issue in Hive wherein parent tables of partitions are not authenticated against for some partition-level operations which was released on January 18 2016. In the release notes, it was mentioned, this fix was released to all branches. Can some one plea

Re: Hive Cli ORC table read error with limit option

> Failed with exception java.io.IOException:java.lang.RuntimeException: >serious problem > Time taken: 0.32 seconds ... > Any one faced this issue. No, but that sounds like one of the codepaths I put in - is this a Kerberos secure cluster? Try disabling the optimization and see if it works. set

Re: Sqoop Hcat Int partition error

Great! So what is the interim fix you are implementing Richa On Mar 1, 2016 4:06 PM, "Biswajit Nayak" wrote: > Thanks Richa. > > The issue was suppose to be fixed in Hive 0.12 version as per the jira > https://issues.apache.org/jira/browse/HIVE-7164. > > Even raised a ticket in sqoop jira [SQOO

Re: Sqoop Hcat Int partition error

Thanks Richa. The issue was suppose to be fixed in Hive 0.12 version as per the jira https://issues.apache.org/jira/browse/HIVE-7164. Even raised a ticket in sqoop jira [SQOOP-2840] for this . Thanks Biswa On Tue, Mar 1, 2016 at 9:56 AM, Richa Sharma wrote: > Hi, > > The values should sti

Hive Cli ORC table read error with limit option

Hi All, I am trying to run a simple query of select with limit option, it fails. Below are the details. Versions:- Hadoop :- 2.7.1 Hive :- 1.2.0 Sqoop :- 1.4.5 Query:- The table table_orc is partitioned based on year, month and day. And the table is ORC storage. hive> select date f

Fwd: Wrong column is picked in HIVE 2.0.0 + TEZ 0.8.2 left join

+ hive mail list, more likely hive issue. -- Forwarded message -- From: GAO Chi Date: Tue, Mar 1, 2016 at 12:24 PM Subject: Wrong column is picked in HIVE 2.0.0 + TEZ 0.8.2 left join To: u...@tez.apache.org Hi all, We encountered a strange behavior after upgrading to HIVE

Re: Sqoop Hcat Int partition error

Hi, The values should still persist if partition column data type in Hive is a string. I am checking HCatalog documentation for support of int data type in partition column. Cheers Richa On Tue, Mar 1, 2016 at 3:06 PM, Biswajit Nayak wrote: > Hi Richa, > > Thats a work around. But how to hand

Re: Sqoop Hcat Int partition error

Hi Richa, Thats a work around. But how to handle the columns with INT type. Changing the type will be the last option for me. Regards Biswa On Tue, Mar 1, 2016 at 9:31 AM, Richa Sharma wrote: > Hi Biswajit > > The answer is in the last line of the error message. Change the data type > of par

Re: Sqoop Hcat Int partition error

Hi Biswajit The answer is in the last line of the error message. Change the data type of partition column to string in hive and try again. Hope it helps ! Richa 16/02/12 08:04:12 ERROR tool.ExportTool: Encountered IOException running export job: java.io.IOException: The table provided default.e

Sqoop Hcat Int partition error

Hi All, I am trying to do a SQOOP export from hive( integer type partition) to mysql through HCAT and it fails with the following error. Versions:- Hadoop :- 2.7.1 Hive :- 1.2.0 Sqoop :- 1.4.5 Table in Hive :- hive> use default; OK Time taken: 0.028 seconds hive> describe emp_detail

Re: Hive-2.0.1 Release date

HPLSQL released with Hive in 2.0, but it hasn’t been integrated as in there isn’t a single parser that handles HPLSQL and Hive SQL. The work to integrate it is significant, and a new feature, so it definitely won’t be done in a bug fix release but in a feature bearing release (that is 2.x, not

Re: Hive-2.0.1 Release date

Thanks. I believe Alan Gate mentioned that HPLSQL is not yet integrated into Hive 2.0.May be later? Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw *

Re: Hive-2.0.1 Release date

HPLSQL is available as part of Hive 2.0. I am not sure to which extent the integration goes as I wasn’t involved in that work. As far as I understand HPLSQL and Hive on Spark are kind of orthogonal… Hive 2.0.1 is purely a bug fix release for Hive 2.0; Hive 2.1 will be the next feature release if

Re: Hive-2.0.1 Release date

Hi Sergey, Will HPLSQL be part of 2.0.1.release? I am using 2.0 and found Hive on Spark to be much more stable. Thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Re: Hive-2.0.1 Release date

Hi. It will be released when some critical mass of bugfixes is accumulated. We already found some issues that would be nice to fix, so it may be some time in March. Is there a particular fix that interests you? From: Oleksiy MapR mailto:osayankin.maprt...@gmail.com>> Reply-To: "user@hive.apache

Cannot convert column 2 from string to map error

When attempting to insert null value into a map column type, I run into this error: Cannot convert column 2 from string to map Here is my Avro schema and the table definition: "fields": [ {"name": "src", "type": ["null", "string"], "default": null}, {"name": "ui

Re: SARG predicate is ignored when query ORC table

Hi, Prasanth, Thanks for sharing the insight. "Before hive 0.14 the default stripe size of ORC was 256MB and hdfs block size is calculated based Math.min(2*stripe_size,1.5GB). So typically block size is 512MB. When the entire file is less than a block it is not beneficial to read the footer to e

RE: How to Query running in background in tez

There is also a “TezViewInstance” view for Ambari that will help you drill into Tez queries and see things like DAG counters, etc. It didn’t work out of the box for us – some permissions had to be tweaked manually. But it’s worth investigating. From: Riesland, Zack Sent: Monday, February 29, 20

RE: How to Query running in background in tez

1) Your cluster should have an application master UI, usually located at :8088/cluster This will list all the running queries/applications and allow you to drill in for statistics like mappers, reducers, etc. 2) You want to use the Yarn capacity scheduler. You can create queues and allocate a

[Error]: Spark 1.5.2 + HiveHbase Integration

Hi, I am trying to access hive table which been created using HbaseIntegration I am able to access data in Hive CLI But when I am trying to access the table using hivecontext of Spark getting following

Hive-2.0.1 Release date

Hi all! Are you planing to release Hive-2.0.1? If yes, when it probably may be? Thanks, Oleksiy.

Re: SARG predicate is ignored when query ORC table

Hi Prasanth. I am using Hive 2 and notice that the file elimination happens when the table is bucketed and SARG happens to be part of that bucket. In that case optimizer goes to the correct bucket. Otherwise it seems to be a full table scan meaning that every file of the table is checked. It wou