clintropolis opened a new pull request, #19377:
URL: https://github.com/apache/druid/pull/19377
### Description
Druid has carried both ZooKeeper- and HTTP-based paths for segment
announcement and inventory for several releases. The ZK paths have been
`@Deprecated` for years, off by default (druid.serverview.type=http is the
default), and segment-publishing path, the ZK-based inventory view, and the
now-orphaned `ZkCoordinator` / `DataSegmentServerAnnouncer` /
`CuratorDataSegmentServerAnnouncer`.
After this change, ZooKeeper's responsibilities in Druid are limited to:
1. Coordinator and Overlord leader election
2. Service (node) announcement and discovery
3. Overlord / MiddleManager task management (out of scope for this PR; but
will look to remove this too in a follow-up)
`BatchDataSegmentAnnouncer` seems a lot nicer now since it only has to track
change history for the lister resource, to something better in a follow-up,
but skipped for now.
#### Release note
#### ZooKeeper-based segment announcement and discovery removed
The ZooKeeper-based segment announcement and inventory view, which have been
deprecated and off by default for several releases, have been removed. The
HTTP-based path (the default for `druid.serverview.type=http`) is now the only
supported option.
If your configuration sets `druid.serverview.type` to anything other than
`http`, startup will now fail with a clear error message. Remove the property
(or set it to `http`, which is the default) to proceed.
The following configuration properties are no longer recognized and should
be removed from `common.runtime.properties`:
- `druid.announcer.segmentsPerNode`
- `druid.announcer.maxBytesPerNode`
- `druid.announcer.skipLoadSpec`
- `druid.announcer.skipDimensionsAndMetrics`
- `druid.announcer.skipSegmentAnnouncementOnZk`
- `druid.zk.paths.liveSegmentsPath`
- `druid.zk.paths.propertiesPath`
- `druid.zk.paths.connectorPath`
ZooKeeper is still used for leader election, service (node) announcement and
discovery, and Overlord-to-MiddleManager task management.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
