chacha.tang created HUDI-3887: --------------------------------- Summary: Spark query can not read the data changes which written by flink after the spark query connection created Key: HUDI-3887 URL: https://issues.apache.org/jira/browse/HUDI-3887 Project: Apache Hudi Issue Type: Bug Components: spark Reporter: chacha.tang
Enviroment: hudi version: 0.10.1 flink version: 13.2 spark version: 3.1.2 Spark query can not read the data changes which written by flink after the spark query connection created。 For example: step1: use flink hudi job write table INSERT INTO t1 VALUES ('id1','Danny',20,TIMESTAMP '1970-01-01 00:00:01','par1'); step2: create the spark jdbc connection to query the data,in this time data can be query correctly step3: change the age property to write the data again。 INSERT INTO t1 VALUES ('id1','Danny',27,TIMESTAMP '1970-01-01 00:00:01','par1'); step4: use the spark jdbc connection which created in step2 to query data,and found there is no change happened。 step5:create a new spark jdbc connection to query the data, then the result is correct -- This message was sent by Atlassian Jira (v8.20.1#820001)