ad1happy2go opened a new issue, #20199: URL: https://github.com/apache/hudi/issues/20199
For a \`ComplexKeyGenerator\` with one record key field, \`_hoodie_record_key\` is \`field:value\` when written by 0.14.0 and older and the bare \`value\` when written by 0.14.1, 0.15.0 and 1.0.0 to 1.0.2 (HUDI-7001). On \`branch-0.x\` the writer cannot tell which one a table stores: a validation guard refuses every write to such a table by default, and with the guard disabled the writer keys records with \`hoodie.write.complex.keygen.new.encoding\` (default \`field:value\`), so every upsert into a table written by 0.14.1 inserts duplicates. Proposal: port #19304 to \`branch-0.x\`, recording the table's encoding as \`hoodie.table.complex.keygenerator.encoding\` and keying every write with it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
