Krisztian Kasa created HIVE-25406:
-------------------------------------

             Summary: Fetch writeId from insert-only tables
                 Key: HIVE-25406
                 URL: https://issues.apache.org/jira/browse/HIVE-25406
             Project: Hive
          Issue Type: Improvement
          Components: ORC, Parquet, Reader, Vectorization
            Reporter: Krisztian Kasa
            Assignee: Krisztian Kasa


When generating plan for incremental materialized view rebuild a filter 
operator is inserted on top of each source table scans. The predicates contain 
a filter for writeId since we want to get all the rows inserted/deleted from 
the source tables since the last rebuild only.

WriteId is part of the ROW_ID virtual column and only available for fully-ACID 
ORC tables.

The goal of this jira is to populate a writeId when fetching from insert-only 
transactional tables.
{code:java}
create table t1(a int, b int) clustered by (a) into 2 buckets stored as orc 
TBLPROPERTIES ('transactional'='true', 
'transactional_properties'='insert_only');

...

SELECT t1.ROW__ID.writeId, a, b FROM t1;
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to