GGraziadei commented on PR #2261: URL: https://github.com/apache/stormcrawler/pull/2261#issuecomment-6396344639
Hi @GitMehdi-sys, thanks for bringing this feature to StormCrawler! I’d suggest narrowing the scope of this PR to improving the documentation rather than enabling the feature by default. Let me explain my reasoning: there’s no magic number that works for every setup, as the optimal configuration depends on the cluster resources, parallelism, and topology itself. I’d prefer to let users tune the settings according to their specific environments. One useful approach would be to run the `StatusUpdaterBenchmark` with different cluster configurations x parameter values, then include the results directly in the documentation. This would give users a practical reference to help them find the optimal configuration for their setup. What do you think? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
