[
https://issues.apache.org/jira/browse/IMPALA-14328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Fang-Yu Rao updated IMPALA-14328:
---------------------------------
Summary: Calcite Planner: Produce column lineage graph when Calcite is the
planner (was: Calcite Produce column lineage graph when Calcite is the planner)
> Calcite Planner: Produce column lineage graph when Calcite is the planner
> -------------------------------------------------------------------------
>
> Key: IMPALA-14328
> URL: https://issues.apache.org/jira/browse/IMPALA-14328
> Project: IMPALA
> Issue Type: Sub-task
> Components: Frontend
> Reporter: Fang-Yu Rao
> Assignee: Fang-Yu Rao
> Priority: Major
>
> We found that Impala could not produce a structurally same column lineage
> graph when Calcite is the planner. For instance, consider the following query
> in
> [lineage.test|https://github.com/apache/impala/blob/master/testdata/workloads/functional-query/queries/QueryTest/lineage.test].
> {code:java}
> select * from (
> select tinyint_col + int_col x from functional.alltypes
> union all
> select sum(bigint_col) y from (select bigint_col from functional.alltypes)
> v1) v2
> {code}
> We expect Impala to produce a graph with 4 vertices and 1 edge. However, we
> only get one vertice when Calcite is the planner.
> {code}
> {
> "edges": [
> {
> "edgeType": "PROJECTION",
> "sources": [],
> "targets": [
> 0
> ]
> }
> ],
> "endTime": 1755630445,
> "hash": "3968bd65781e9e856eaca799f4501513",
> "queryId": "fb443702ac817ecc:c432854600000000",
> "queryText": "select * from ( select tinyint_col + int_col x from
> functional.alltypes union all select sum(bigint_col) y from (select
> bigint_col from functional.alltypes)
> "timestamp": 1755630437,
> "user": "fangyurao",
> "vertices": [
> {
> "id": 0,
> "vertexId": "X",
> "vertexType": "COLUMN"
> }
> ]
> }
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
