Need Help Benchmarking Druid

2021-12-03 Thread Abdelouahab Khelifati
Hello, I am Abdel, a researcher of Computer Science and I am working on a benchmarking paper on time series database systems. I am interested in your Druid system a lot and I would like to include it in the set of time series database systems that we will benchmark (test and evaluate). I would

Re: Need help in understanding real-time ingestion task pause behavior during checkpointing

2021-12-03 Thread Jason Koch
Hi Gian > Jason, also interesting findings! I took a crack at rebasing your patch on > master and adding a scale test for the TaskQueue with 1000 simulated tasks: > https://github.com/apache/druid/compare/master...gianm:tq-scale-test

Re: Need help in understanding real-time ingestion task pause behavior during checkpointing

2021-12-03 Thread Jason Koch
Gian, I've submitted a PR to gianm/tq-scale-test that provides a concurrent test, (and fixes a concurrency bug I found along the way). The change uses an 8millis response time for shutdown acknowledgment, and a 2 second time for shutdown completion/notification. Based on this test, - serial TaskQ

[CRON] Broken: apache/druid#34419 (master - 76d281d)

2021-12-03 Thread Travis CI
Build Update for apache/druid - Build: #34419 Status: Broken Duration: 9 mins and 58 secs Commit: 76d281d (master) Author: Gian Merlino Message: Enable allocating segments at ALL granularity. (#12003) * Enable allocating segments at ALL granularity. The main