Re: ORC: duplicate record - rowid meaning ?

2019-11-19 Thread David Morin
tid":3,"rowid":0} | *5218* | | {"transactionid":11365,"bucketid":3,"rowid":1} | *5216* | | {"transactionid":11369,"bucketid":3,"rowid":1} | *5216* | | {"transactionid":11369,"bucketid":

ORC: duplicate record - rowid meaning ?

2019-11-18 Thread David Morin
Hello, I'm trying to understand the purpose of the rowid column inside ORC delta file {"transactionid":11359,"bucketid":5,"*rowid*":0} Orc view: {"operation":0,"originalTransaction":11359,"bucket":5,"*rowId* ":0,"currentTransaction":11359,"row":...} I use HDP 2.6 => Hive 2 If I want to be idempot