Asthenia0412 opened a new pull request, #12705:
URL: https://github.com/apache/seatunnel/pull/12705

   ## Overview
   
   Composite keys are currently joined with a delimiter, so distinct key tuples 
can produce the same Elasticsearch `_id` and overwrite documents. This adds an 
opt-in `LENGTH_PREFIXED` encoding that frames each formatted key value by its 
length, while retaining `LEGACY` as the default.
   
   ## Compatibility and migration
   
   The default keeps existing IDs unchanged. Switching an existing index to 
`LENGTH_PREFIXED` changes document IDs; reindex or migrate existing documents 
before switching to avoid creating a second set of documents. The Elasticsearch 
connector uses the same serializer for Elasticsearch and OpenSearch-compatible 
clusters.
   
   ## Verification
   
   The Elasticsearch serializer and factory tests pass (10 tests), Spotless 
passes, and the connector module builds with `verify -DskipTests`. The full 
module test suite has 10 unrelated Mockito failures on Java 21 because its Byte 
Buddy version supports only through Java 20.
   
   Fixes #12704.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to