gamblewin opened a new issue, #8855:
URL: https://github.com/apache/hudi/issues/8855

   **Problem**
   
   I attempted to insert the join result of two Hudi tables into another Hudi 
table by using Flink SQL, the task executes normally and there are no errors 
reported on Flink Web UI, but there are no join results in wide table.
   
   After checking Flink Web UI, i find something wrong with [stream_write] 
phase, it received join result but can not send to downstream operator.
   <img width="1377" alt="image" 
src="https://github.com/apache/hudi/assets/39117591/a386f549-0906-4973-a78f-dfbc44501248";>
   
   
   
   
   **To Reproduce**
   
   Steps to reproduce the behavior:
   
   
   ```sql
   # create two source tables and insert some data into them
   CREATE TABLE source_t1 (
   id BIGINT PRIMARY KEY NOT ENFORCED,
   name varchar(10),
   t2_id BIGINT,
   ts timestamp(3)
   ) WITH (
   'connector' = 'hudi',
   'path' = '/hudi/source_t1',
   'table.type' = 'MERGE_ON_READ',
   'hoodie.datasource.write.recordkey.field'='id',
   'hoodie.datasource.write.operation'='insert',
   'table.type'='MERGE_ON_READ',
   'write.bucket_assign.tasks'='1',
   'write.tasks' = '1',
   'read.streaming.enabled' = 'true'
   );
   
   CREATE TABLE source_t2 (
   id BIGINT PRIMARY KEY NOT ENFORCED,
   name varchar(10),
   ts timestamp(3)
   ) WITH (
   'connector' = 'hudi',
   'path' = '/hudi/source_t2',
   'table.type' = 'MERGE_ON_READ',
   'hoodie.datasource.write.recordkey.field'='id',
   'hoodie.datasource.write.operation'='insert',
   'table.type'='MERGE_ON_READ',
   'write.bucket_assign.tasks'='1',
   'write.tasks' = '1',
   'read.streaming.enabled' = 'true'
   );
   
   # create wide table
   create table inner_table (
   id BIGINT PRIMARY KEY NOT ENFORCED,
   name varchar(10),
   name2 varchar(10),
   ts timestamp(3)
   ) WITH (
   'connector' = 'hudi',
   'path' = '/hudi/inner_table',
   'table.type' = 'MERGE_ON_READ',
   'hoodie.datasource.write.recordkey.field'='id',
   'hoodie.datasource.write.operation'='insert',
   'table.type'='MERGE_ON_READ',
   'write.bucket_assign.tasks'='1',
   'write.tasks' = '1'
   );
   
   # insert join result into inner_table
   insert into inner_table
   select
        a.id as id,
        a.name as name,
        b.name as name2,
        LOCALTIMESTAMP as ts
   from
   source_t1 a JOIN source_t2 b
   ON a.id = b.id;
   ```
   
   **Environment Description**
   
   * Hudi version : 1.13.0
   
   * Hadoop version : 3.1.3
   
   * Flink version: 1.16.2
   
   * Running on Docker? (yes/no) : yes
   
   
   **Additional context**
   Insert data into hudi table by using `insert into table_name values (...)` 
works fine, but insert join result into hudi table failed. I don't know this is 
something wrong with Hudi or Flink.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to