Thanks Prasanth for the update. I will test it and update it here the
outcome.
Thanks
Biswa
On Tue, Apr 19, 2016 at 6:26 AM, Prasanth Jayachandran <
pjayachand...@hortonworks.com> wrote:
> Hi Biswajit
>
> You might need patch from https://issues.apache.org/jira/browse/HIVE-11546
>
> Can you appl
Hi Biswajit
You might need patch from https://issues.apache.org/jira/browse/HIVE-11546
Can you apply this patch to your hive build and see if it solves the issue?
(recommended)
Alternatively, you can use “hive.exec.orc.split.strategy”=“BI” as workaround.
Its highly not recommended to use this c
Hi All,
I seriously need help on this aspect. Any reference or pointer to
troubleshoot or fix this, could be helpful.
Regards
Biswa
On Fri, Mar 25, 2016 at 11:24 PM, Biswajit Nayak
wrote:
> Prashanth,
>
> Apologies for the delay in response.
>
> Below is the orcfiledump of the empty orc file f
Prashanth,
Apologies for the delay in response.
Below is the orcfiledump of the empty orc file from a broken partition.
*$ hive --orcfiledump /hive/*testdb*.db/*table_orc
*/year=2016/month=1/day=29/00_0*
*Structure for /hive/*testdb*.db/*table_orc
*/year=2016/month=1/day=29/00_0*
*Fil
Alternatively you can send orcfiledump output for the empty orc file from
broken partition.
Thanks
Prasanth
On Mar 10, 2016, at 5:11 PM, Prasanth Jayachandran
mailto:pjayachand...@hortonworks.com>> wrote:
Could you attach the emtpy orc files from one of the broken partition
somewhere? I can ru
Could you attach the emtpy orc files from one of the broken partition
somewhere? I can run some tests on it to see why its happening.
Thanks
Prasanth
On Mar 8, 2016, at 12:02 AM, Biswajit Nayak
mailto:biswa...@altiscale.com>> wrote:
Both the parameters are set to false by default.
hive> set h
Both the parameters are set to false by default.
*hive> set hive.optimize.index.filter;*
*hive.optimize.index.filter=false*
*hive> set hive.orc.splits.include.file.footer;*
*hive.orc.splits.include.file.footer=false*
*hive> *
>>>I suspect this might be related to having 0 row files in the buc
> cvarchar(2)
...
> Num Buckets: 7
I suspect this might be related to having 0 row files in the buckets not
having any recorded schema.
You can also experiment with hive.optimize.index.filter=false, to see if
the zero row case is artificially produced via predi
Hi Gopal,
I had already pasted the table format in this thread. Will repeat it again.
*hive> desc formatted *testdb.table_orc*;*
*OK*
*# col_name data_typecomment *
*row_id bigint *
*a int
> Any one has any idea about this.. Really stuck with this.
...
> hive> select h from testdb.table_orc where year = 2016 and month =1 and
>day >29 limit 10;
Depends on whether any of those columns are paritition columns or not &
whether the table is marked transactional.
> Caused by: java.lang.I
Any one has any idea about this.. Really stuck with this.
On Tue, Mar 1, 2016 at 4:09 PM, Biswajit Nayak
wrote:
> Hi,
>
> It works for MR engine, while in TEZ it fails.
>
> *hive> set hive.execution.engine=tez;*
>
> *hive> set hive.fetch.task.conversion=none;*
>
> *hive> select h from test*db.ta
Hi,
It works for MR engine, while in TEZ it fails.
*hive> set hive.execution.engine=tez;*
*hive> set hive.fetch.task.conversion=none;*
*hive> select h from test*db.table_orc* where year = 2016 and month =1 and
day >29 limit 10;*
*Query ID = 26f9a510-c10c-475c-9988-081998b66b0c*
*Total jobs =
Gopal,
Any plan of provide the fix to Hive 1.x versions or to backport it?
Regards
Biswa
On Tue, Mar 1, 2016 at 11:44 AM, Biswajit Nayak
wrote:
> Thanks Gopal for the details .. happy to know it has been counted and
> fixed.
>
> Biswa
>
>
> On Tue, Mar 1, 2016 at 11:37 AM, Gopal Vijayaraghavan
Thanks Gopal for the details .. happy to know it has been counted and
fixed.
Biswa
On Tue, Mar 1, 2016 at 11:37 AM, Gopal Vijayaraghavan
wrote:
>
> > Yes it is kerberos cluster.
> ...
> > After disabling the optimization in hive cli, it works with limit
> >option.
>
> Alright, then it is fixed
> Yes it is kerberos cluster.
...
> After disabling the optimization in hive cli, it works with limit
>option.
Alright, then it is fixed in -
https://issues.apache.org/jira/browse/HIVE-13120
Cheers,
Gopal
Thanks Gopal for the response.
Yes it is kerberos cluster.
After disabling the optimization in hive cli, it works with limit option.
Below is the DESC details of the table that you asked for.
*hive> desc formatted *testdb.table_orc*;*
*OK*
*# col_namedata_type comment
> Failed with exception java.io.IOException:java.lang.RuntimeException:
>serious problem
> Time taken: 0.32 seconds
...
> Any one faced this issue.
No, but that sounds like one of the codepaths I put in - is this a
Kerberos secure cluster?
Try disabling the optimization and see if it works.
set
Hi All,
I am trying to run a simple query of select with limit option, it fails.
Below are the details.
Versions:-
Hadoop :- 2.7.1
Hive :- 1.2.0
Sqoop :- 1.4.5
Query:-
The table table_orc is partitioned based on year, month and day. And the
table is ORC storage.
hive> select date f
18 matches
Mail list logo
