[ https://issues.apache.org/jira/browse/SOLR-17065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17885476#comment-17885476 ]
ASF subversion and git services commented on SOLR-17065: -------------------------------------------------------- Commit 94a744746dc5d10d8900f30cac7cba9ce3743432 in solr's branch refs/heads/branch_9x from Houston Putman [ https://gitbox.apache.org/repos/asf?p=solr.git;h=94a744746dc ] SOLR-17065: Absorb the Cross DC project (#2062) * Migrate Cross DC code into Solr - The Cross DC Producer + Cross DC Common -> solr/modules/cross-dc - The Cross DC Consumer -> solr/cross-dc-manager * Upgrade kafka libraries to 3.7.1 Co-authored-by: Houston Putman <hous...@apache.org> Co-authored-by: Mark Robert Miller <markrmil...@apache.org> (cherry picked from commit 8188bf5e0f37ca929e4cebce9e73e50d5d07d86d) > Migrate Sandbox CrossDC functionality into Solr > ----------------------------------------------- > > Key: SOLR-17065 > URL: https://issues.apache.org/jira/browse/SOLR-17065 > Project: Solr > Issue Type: Task > Components: CrossDC, module - crossDC > Reporter: Houston Putman > Assignee: Houston Putman > Priority: Major > Labels: pull-request-available > Time Spent: 0.5h > Remaining Estimate: 0h > > As a part of [SIP-13: Cross Data Center > Replication|https://cwiki.apache.org/confluence/display/SOLR/SIP-13%3A+Cross+Data+Center+Replication], > the [solr-sandbox|https://github.com/apache/solr-sandbox] repository was > created and a new Cross DC implementation has been developed. > This CrossDC implementation relies on Kafka (for now, maybe other queues in > the future), and has two parts. > * A producer, which is a Solr plugin (An updateRequestProcessor), that sends > documents to kafka after successfully indexing them. > * A consumer, which is a standalone application, that reads documents for > kafka and sends them to the mirrored SolrClouds. > This has been in development for a year now and is used at multiple companies > (even in production). > We believe that the project has reached a level of maturity that it can be > "graduated" from the sandbox module and be included in future Solr releases. > > As a part of the move I propose the following: > * The Producer will be branded as the "cross-dc" Solr module, and be > available just as any other module is. > * The Consumer will be branded as the "cross-dc-manager" and be packaged > just as the prometheus-exporter is, a standalone application that comes with > Solr and uses many of the same Jars. The reason for the name change is that > we might expand the role of this application to something beyond just > "consuming" from the Kafka queue. In that case its much easier to rename it > now than later. > > We will let this bake in the main branch for a while before backporting to > 9.x. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@solr.apache.org For additional commands, e-mail: issues-h...@solr.apache.org