Does this feature work with TextInputFormat?
hive> set hive.exec.rowoffset=true;
hive> SELECT INPUT__FILE__NAME, BLOCK__OFFSET__INSIDE__FILE,
ROW__OFFSET__INSIDE__BLOCK FROM hive_text WHERE line LIKE '%hive%'
limit 2;
OK
file:/user/hive/warehouse/hive_text/folder=docs/README.txt 22430
fil
>From VirtualColumn.java:
public static VirtualColumn ROWOFFSET = new
VirtualColumn("ROW__OFFSET__INSIDE__BLOCK",
(PrimitiveTypeInfo)TypeInfoFactory.longTypeInfo);
Cheers
On Sun, Mar 25, 2012 at 2:30 PM, Edward Capriolo wrote:
>
> hive.exec.rowoffset
> false
> Whether to provide the row of
hive.exec.rowoffset
false
Whether to provide the row offset virtual column
I know the others are INPUT__FILE__NAME and BLOCK_OFFSET Does
anyone know what this third columns is?
Edward
Quick q,
This is a pretty simple patch, but wondering what the thinking was of
adding this.
https://issues.apache.org/jira/browse/HIVE-1020
Why add another speculative reducer setting? Why not just use the hadoop ones?
Thanks,
Edward
