maksaska commented on code in PR #11497: URL: https://github.com/apache/ignite/pull/11497#discussion_r1981911363
########## docs/_docs/extensions-and-integrations/change-data-capture-extensions.adoc: ########## @@ -90,19 +130,76 @@ image:../../assets/images/integrations/CDC-ignite2ignite.svg[] | `MappingsCount` | Count of mappings events applied to destination cluster |=== +=== Configuration example + +Add link:https://github.com/apache/ignite-extensions/blob/master/modules/cdc-ext/src/main/java/org/apache/ignite/cdc/IgniteToIgniteCdcStreamer.java[Ignite2IgniteCdcStreamer] bean configuration to the source ignite configuration. + +```xml +<!--IgniteToIgniteCdcStreamer--> +<bean id="cdc.streamer" class="org.apache.ignite.cdc.IgniteToIgniteCdcStreamer"> + <property name="destinationIgniteConfiguration"> + <bean class="org.apache.ignite.configuration.IgniteConfiguration"> + <property name="igniteInstanceName" value="cluster-cdc-client" /> + <property name="clientMode" value="true" /> + <property name="localHost" value="127.0.0.1" /> + <property name="discoverySpi" ref="destination.TcpDiscoverySpi"/> + </bean> + </property> + + <property name="caches"> + <list> + <value>cache1</value> + <value>cache2</value> + </list> + </property> + + <property name="onlyPrimary" value="false"/> + <property name="maxBatchSize" value="1024"/> +</bean> + +<!--Destination TcpDiscoverySpi for CDC streamer--> +<bean id="destination.TcpDiscoverySpi" class="org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi"> + <property name="ipFinder"> + <bean class="org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder"> + <property name="addresses" value="127.0.0.1:47600..47610" /> + </bean> + </property> + + <property name="localPort" value="47601" /> + <property name="joinTimeout" value="10000" /> +</bean> +``` + +NOTE: Use the resulting configuation with `ignite-cdc.sh` to start CDC client on the source Ignite instance. Review Comment: Fixed ########## docs/_docs/extensions-and-integrations/change-data-capture-extensions.adoc: ########## @@ -90,19 +130,76 @@ image:../../assets/images/integrations/CDC-ignite2ignite.svg[] | `MappingsCount` | Count of mappings events applied to destination cluster |=== +=== Configuration example + +Add link:https://github.com/apache/ignite-extensions/blob/master/modules/cdc-ext/src/main/java/org/apache/ignite/cdc/IgniteToIgniteCdcStreamer.java[Ignite2IgniteCdcStreamer] bean configuration to the source ignite configuration. + +```xml +<!--IgniteToIgniteCdcStreamer--> +<bean id="cdc.streamer" class="org.apache.ignite.cdc.IgniteToIgniteCdcStreamer"> + <property name="destinationIgniteConfiguration"> + <bean class="org.apache.ignite.configuration.IgniteConfiguration"> + <property name="igniteInstanceName" value="cluster-cdc-client" /> + <property name="clientMode" value="true" /> + <property name="localHost" value="127.0.0.1" /> + <property name="discoverySpi" ref="destination.TcpDiscoverySpi"/> + </bean> + </property> + + <property name="caches"> + <list> + <value>cache1</value> + <value>cache2</value> + </list> + </property> + + <property name="onlyPrimary" value="false"/> + <property name="maxBatchSize" value="1024"/> +</bean> + +<!--Destination TcpDiscoverySpi for CDC streamer--> +<bean id="destination.TcpDiscoverySpi" class="org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi"> + <property name="ipFinder"> + <bean class="org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder"> + <property name="addresses" value="127.0.0.1:47600..47610" /> + </bean> + </property> + + <property name="localPort" value="47601" /> + <property name="joinTimeout" value="10000" /> +</bean> +``` + +NOTE: Use the resulting configuation with `ignite-cdc.sh` to start CDC client on the source Ignite instance. + +NOTE: Make sure both source and destination clusters are up. Review Comment: Redundant. Removed ########## docs/_docs/extensions-and-integrations/change-data-capture-extensions.adoc: ########## @@ -90,19 +130,76 @@ image:../../assets/images/integrations/CDC-ignite2ignite.svg[] | `MappingsCount` | Count of mappings events applied to destination cluster |=== +=== Configuration example + +Add link:https://github.com/apache/ignite-extensions/blob/master/modules/cdc-ext/src/main/java/org/apache/ignite/cdc/IgniteToIgniteCdcStreamer.java[Ignite2IgniteCdcStreamer] bean configuration to the source ignite configuration. + +```xml +<!--IgniteToIgniteCdcStreamer--> +<bean id="cdc.streamer" class="org.apache.ignite.cdc.IgniteToIgniteCdcStreamer"> + <property name="destinationIgniteConfiguration"> + <bean class="org.apache.ignite.configuration.IgniteConfiguration"> + <property name="igniteInstanceName" value="cluster-cdc-client" /> + <property name="clientMode" value="true" /> + <property name="localHost" value="127.0.0.1" /> + <property name="discoverySpi" ref="destination.TcpDiscoverySpi"/> + </bean> + </property> + + <property name="caches"> + <list> + <value>cache1</value> + <value>cache2</value> + </list> + </property> + + <property name="onlyPrimary" value="false"/> + <property name="maxBatchSize" value="1024"/> +</bean> + +<!--Destination TcpDiscoverySpi for CDC streamer--> +<bean id="destination.TcpDiscoverySpi" class="org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi"> + <property name="ipFinder"> + <bean class="org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder"> + <property name="addresses" value="127.0.0.1:47600..47610" /> + </bean> + </property> + + <property name="localPort" value="47601" /> + <property name="joinTimeout" value="10000" /> +</bean> +``` + +NOTE: Use the resulting configuation with `ignite-cdc.sh` to start CDC client on the source Ignite instance. + +NOTE: Make sure both source and destination clusters are up. + == CDC replication using Kafka This way to replicate changes between clusters requires setting up two applications: . `ignite-cdc.sh` with `org.apache.ignite.cdc.kafka.IgniteToKafkaCdcStreamer` that will capture changes from source cluster and write it to Kafka topic. . `kafka-to-ignite.sh` that will read changes from Kafka topic and then write them to destination cluster. +NOTE: Please, enable `ignite-cdc-ext` to be able to run `kafka-to-ignite.sh`. + NOTE: Instances of `ignite-cdc.sh` with configured streamer should be started on each server node of source cluster to capture all changes. IMPORTANT: CDC trough Kafka requires _metadata topic with the only one partition_ for sequential ordering guarantees. image:../../assets/images/integrations/CDC-ignite2kafka.svg[] +==== Kafka Installation Review Comment: Done! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@ignite.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
