lokeshj1703 commented on PR #18222:
URL: https://github.com/apache/hudi/pull/18222#issuecomment-4044437814
@nsivabalan These PRs are all related to Zookeeper and DynamodDB LP.
So commit message can be:
Add support for DynamodDB and Zookeeper based Lock provider.
Detailed commit message
Option 1:
These changes improve lock provider implementations including:
- Removing table name from lock keys to fix table rename issues
- New DynamoDB lock provider with hash-based partition keys
- New ZooKeeper lock provider with auto-derived partition keys
- Also fixes bugs related to serialization, NPE and DynamoDB protocol
endpoint configuration issue
Option 2:
Bug Fixes:
- [HUDI-8490] Fix concurrency issue when table is renamed by removing
table name from lock keys in DDB and ZooKeeper lock providers
- [HUDI-7258] Fix DynamoDB protocol endpoint configuration issue
- [HUDI-7782] Fix NotSerializableException in DynamoDBBasedLockProvider
and HiveMetastoreBasedLockProvider during clean action
- [HUDI-8043] Fix DynamoDB lock provider bug
Improvements:
- [HUDI-8005] Add new DynamoDB lock provider with hash-based partition keys
- [HUDI-8090] Add new ZooKeeper lock provider with auto-derived partition
keys
- [#13039] Use ConfigUtils to handle defaults for ZooKeeper lock provider
configs
- [#17780] Refactor DynamoDbBasedLockConfig to remove misapplied builder
pattern
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
