lhotari commented on issue #24695: URL: https://github.com/apache/pulsar/issues/24695#issuecomment-3249319070
With `dispatcherMaxReadBatchSize=1000`, consuming is able to keep up. ``` ==> consume.1756906641.txt <== 2025-09-03T13:37:33,088+0000 [main] INFO org.apache.pulsar.testclient.PerformanceConsumer - Throughput received: 2745126 msg --- 274418.424 msg/s --- 267.987 Mbit/s --- Latency: mean: 74.885 ms - med: 70 - 95pct: 101 - 99pct: 186 - 99.9pct: 214 - 99.99pct: 221 - Max: 222 2025-09-03T13:37:43,227+0000 [main] INFO org.apache.pulsar.testclient.PerformanceConsumer - Throughput received: 6176301 msg --- 339658.686 msg/s --- 331.698 Mbit/s --- Latency: mean: 66.355 ms - med: 66 - 95pct: 77 - 99pct: 89 - 99.9pct: 127 - 99.99pct: 131 - Max: 131 2025-09-03T13:37:53,420+0000 [main] INFO org.apache.pulsar.testclient.PerformanceConsumer - Throughput received: 9502693 msg --- 325858.234 msg/s --- 318.221 Mbit/s --- Latency: mean: 71.439 ms - med: 67 - 95pct: 90 - 99pct: 209 - 99.9pct: 253 - 99.99pct: 257 - Max: 258 2025-09-03T13:38:03,584+0000 [main] INFO org.apache.pulsar.testclient.PerformanceConsumer - Throughput received: 12533030 msg --- 298182.342 msg/s --- 291.194 Mbit/s --- Latency: mean: 74.275 ms - med: 68 - 95pct: 109 - 99pct: 268 - 99.9pct: 341 - 99.99pct: 348 - Max: 349 2025-09-03T13:38:13,779+0000 [main] INFO org.apache.pulsar.testclient.PerformanceConsumer - Throughput received: 15785498 msg --- 319568.627 msg/s --- 312.079 Mbit/s --- Latency: mean: 70.165 ms - med: 68 - 95pct: 89 - 99pct: 130 - 99.9pct: 143 - 99.99pct: 154 - Max: 155 2025-09-03T13:38:23,953+0000 [main] INFO org.apache.pulsar.testclient.PerformanceConsumer - Throughput received: 19036026 msg --- 319576.032 msg/s --- 312.086 Mbit/s --- Latency: mean: 69.524 ms - med: 67 - 95pct: 95 - 99pct: 127 - 99.9pct: 167 - 99.99pct: 174 - Max: 175 2025-09-03T13:38:34,122+0000 [main] INFO org.apache.pulsar.testclient.PerformanceConsumer - Throughput received: 21573453 msg --- 249040.310 msg/s --- 243.203 Mbit/s --- Latency: mean: 87.490 ms - med: 82 - 95pct: 121 - 99pct: 165 - 99.9pct: 314 - 99.99pct: 317 - Max: 317 2025-09-03T13:38:44,310+0000 [main] INFO org.apache.pulsar.testclient.PerformanceConsumer - Throughput received: 24410600 msg --- 278940.036 msg/s --- 272.402 Mbit/s --- Latency: mean: 78.566 ms - med: 76 - 95pct: 105 - 99pct: 133 - 99.9pct: 144 - 99.99pct: 149 - Max: 149 2025-09-03T13:38:54,493+0000 [main] INFO org.apache.pulsar.testclient.PerformanceConsumer - Throughput received: 27058899 msg --- 259684.194 msg/s --- 253.598 Mbit/s --- Latency: mean: 84.472 ms - med: 83 - 95pct: 102 - 99pct: 115 - 99.9pct: 134 - 99.99pct: 139 - Max: 139 2025-09-03T13:39:04,675+0000 [main] INFO org.apache.pulsar.testclient.PerformanceConsumer - Throughput received: 29615641 msg --- 251573.251 msg/s --- 245.677 Mbit/s --- Latency: mean: 86.414 ms - med: 84 - 95pct: 112 - 99pct: 132 - 99.9pct: 141 - 99.99pct: 144 - Max: 145 ==> produce.1756906642.txt <== 2025-09-03T13:37:33,440+0000 [main] INFO org.apache.pulsar.testclient.PerformanceProducer - Throughput produced: 2821633 msg --- 281981.2 msg/s --- 275.4 Mbit/s --- failure 0.0 msg/s --- Latency: mean: 64.284 ms - med: 61.892 - 95pct: 84.115 - 99pct: 97.687 - 99.9pct: 128.139 - 99.99pct: 130.591 - Max: 130.920 2025-09-03T13:37:43,742+0000 [main] INFO org.apache.pulsar.testclient.PerformanceProducer - Throughput produced: 6338814 msg --- 341086.6 msg/s --- 333.1 Mbit/s --- failure 0.0 msg/s --- Latency: mean: 58.444 ms - med: 57.741 - 95pct: 67.893 - 99pct: 82.207 - 99.9pct: 87.760 - 99.99pct: 88.387 - Max: 88.506 2025-09-03T13:37:54,047+0000 [main] INFO org.apache.pulsar.testclient.PerformanceProducer - Throughput produced: 9681441 msg --- 323553.7 msg/s --- 316.0 Mbit/s --- failure 0.0 msg/s --- Latency: mean: 61.693 ms - med: 59.132 - 95pct: 82.565 - 99pct: 103.645 - 99.9pct: 129.098 - 99.99pct: 131.207 - Max: 131.346 2025-09-03T13:38:04,360+0000 [main] INFO org.apache.pulsar.testclient.PerformanceProducer - Throughput produced: 12719767 msg --- 294966.3 msg/s --- 288.1 Mbit/s --- failure 0.0 msg/s --- Latency: mean: 67.764 ms - med: 60.242 - 95pct: 103.736 - 99pct: 264.611 - 99.9pct: 323.267 - 99.99pct: 328.375 - Max: 330.369 2025-09-03T13:38:14,631+0000 [main] INFO org.apache.pulsar.testclient.PerformanceProducer - Throughput produced: 15985131 msg --- 317436.9 msg/s --- 310.0 Mbit/s --- failure 0.0 msg/s --- Latency: mean: 62.256 ms - med: 60.206 - 95pct: 80.621 - 99pct: 119.492 - 99.9pct: 131.500 - 99.99pct: 137.701 - Max: 138.530 2025-09-03T13:38:24,915+0000 [main] INFO org.apache.pulsar.testclient.PerformanceProducer - Throughput produced: 19228283 msg --- 316197.3 msg/s --- 308.8 Mbit/s --- failure 0.0 msg/s --- Latency: mean: 63.158 ms - med: 59.091 - 95pct: 83.304 - 99pct: 148.024 - 99.9pct: 305.139 - 99.99pct: 307.847 - Max: 308.375 2025-09-03T13:38:35,225+0000 [main] INFO org.apache.pulsar.testclient.PerformanceProducer - Throughput produced: 21876285 msg --- 256696.3 msg/s --- 250.7 Mbit/s --- failure 0.0 msg/s --- Latency: mean: 77.904 ms - med: 74.623 - 95pct: 110.860 - 99pct: 127.916 - 99.9pct: 160.067 - 99.99pct: 162.222 - Max: 163.047 2025-09-03T13:38:45,518+0000 [main] INFO org.apache.pulsar.testclient.PerformanceProducer - Throughput produced: 24725830 msg --- 276930.0 msg/s --- 270.4 Mbit/s --- failure 0.0 msg/s --- Latency: mean: 71.977 ms - med: 69.348 - 95pct: 94.323 - 99pct: 124.832 - 99.9pct: 135.739 - 99.99pct: 137.425 - Max: 137.660 2025-09-03T13:38:55,795+0000 [main] INFO org.apache.pulsar.testclient.PerformanceProducer - Throughput produced: 27415989 msg --- 261118.6 msg/s --- 255.0 Mbit/s --- failure 0.0 msg/s --- Latency: mean: 76.484 ms - med: 75.604 - 95pct: 92.618 - 99pct: 103.173 - 99.9pct: 113.024 - 99.99pct: 118.638 - Max: 119.452 2025-09-03T13:39:06,077+0000 [main] INFO org.apache.pulsar.testclient.PerformanceProducer - Throughput produced: 29979710 msg --- 250047.8 msg/s --- 244.2 Mbit/s --- failure 0.0 msg/s --- Latency: mean: 79.731 ms - med: 77.239 - 95pct: 103.463 - 99pct: 123.482 - 99.9pct: 132.509 - 99.99pct: 133.734 - Max: 136.183 ``` it seems that `dispatcherMaxReadBatchSize` needs to be close to `maxPendingPublishRequestsPerConnection` value. This is also a sign that some queues are shared between producing and consuming, although there should only be a need when actual BK reads are made and the entries aren't found in the cache. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
