Re: Interpretation of transactional table base file format

2015-03-30 Thread Elliot West
Ok, so both the source and Javadoc for org.apache.hadoop.hive.ql.io.orc.OrcInputFormat answer most of these questions. Apologies for the spam. Thanks - Elliot. On 30 March 2015 at 11:52, Elliot West wrote: > I've been looking at the structure of the ORCFiles that back transaction > tables in H

Interpretation of transactional table base file format

2015-03-30 Thread Elliot West
I've been looking at the structure of the ORCFiles that back transaction tables in Hive. After a compaction I was surprised to find that the base file structure is identical to the delta structure: struct< operation:int, originalTransaction:bigint, bucket:int, rowId:bigint, c