gamblewin commented on issue #8855:
URL: https://github.com/apache/hudi/issues/8855#issuecomment-1573413451

   > Intreasting, can you share us the flink checkpoint configuration params?
   
   ah oh, your concern about checkpoint is right.
   Originally, i don't have any customized settings for checkpoints, so it 
looks like this in `flink-conf.yml`, everything uses default value.
   
![image](https://github.com/apache/hudi/assets/39117591/c252f037-5e7a-450a-8fd1-ef27930cd9e9)
   
   Then because of your reminder, i add some configurations to checkpoints, and 
join result can be successfully inserted into  wide table. 
   ```sql
   set execution.checkpointing.interval=1000;
   set state.checkpoints.dir=hdfs:///ckp/;
   set 
execution.checkpointing.externalized-checkpoint-retention=RETAIN_ON_CANCELLATION;
   ```
   
   Really thx for your reminder, but i still wonder why under default 
checkpoint configuration, join result can not be inserted into wide table, 
however data can be inserted one by one.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to