If you are using one of the latest hive releases, then we orcfiledump have an
option for recovering such files. It backtrack the files for intermediate
footers.
https://cwiki.apache.org/confluence/display/Hive/LanguageManual+ORC
// Hive version 1.3.0 and later:
hive --orcfiledump [-j] [-p] [-d] [
The file has trailing data. If you want to recover the data, you can use:
% strings -3 -t d ~/Downloads/bucket_0 | grep ORC
will print the offsets where ORC occurs with in the file:
0 ORC
4559 ORC
That means that there is one intermediate footer within the file. If you
slice the file at the
Unfortunately, I сan't provide more information, this file I got from our
tester and he already droped table.
On Thu, Aug 4, 2016 at 9:16 PM, Prasanth Jayachandran <
pjayachand...@hortonworks.com> wrote:
> Hi
>
> In case of streaming, when a transaction is open orc file is not closed
> and hence
Hi
In case of streaming, when a transaction is open orc file is not closed and
hence may not be flushed completely. Did the transaction commit successfully?
Or was there any exception thrown during writes/commit?
Thanks
Prasanth
On Aug 3, 2016, at 6:09 AM, Igor Kuzmenko
mailto:f1she...@gmail.
he.org>"
mailto:user@hive.apache.org>>
Cc: "Bhavana Kamichetty (bkamiche)"
mailto:bkami...@cisco.com>>
Subject: Re: Malformed Orc file Invalid postscript length 0
I sent a link to you.
File system is hdfs.
Versions:
hdp HDP-2.2.4.2-2
hdfs 2.6.0.2.2
MapReduce2 2.6.0.2
o:user@hive.apache.org>>
Date: Friday, May 22, 2015 at 12:51 PM
To: "user@hive.apache.org<mailto:user@hive.apache.org>"
mailto:user@hive.apache.org>>
Cc: "Bhavana Kamichetty (bkamiche)"
mailto:bkami...@cisco.com>>
Subject: Re: Malformed Orc file I
Bhavana,
Could you send me (omal...@apache.org) the incorrect ORC file? Which
file system were you using? hdfs? Which version of Hadoop and Hive?
Thanks,
Owen
On Fri, May 22, 2015 at 9:37 AM, Grant Overby (groverby) wrote:
> I’m getting the following exception when Hive executes a query
