Re: SEDA, queues, and a second lower-priority queue set

2019-01-16 Thread Rahul Singh
I understand the goal. Thinking in this direction , multiple queues make sense if there is enough processing power / multiple cores and memory. There is some over head involved to determine priority and send to the proper queue / routing. I would say that having the ability to addition queues m

Re: SEDA, queues, and a second lower-priority queue set

2019-01-16 Thread Carl Mueller
additionally, a certain number of the threads in each stage could be restricted from serving the low-priority queues at all, say 8/32 or 16/32 threads, to further ensure processing availability to the higher-priority tasks. On Wed, Jan 16, 2019 at 3:04 PM Carl Mueller wrote: > At a theoretical l

SEDA, queues, and a second lower-priority queue set

2019-01-16 Thread Carl Mueller
At a theoretical level assuming it could be implemented with a magic wand, would there be value to having a dual set of queues/threadpools at each of the SEDA stages inside cassandra for a two-tier of priority? Such that you could mark queries that return pages and pages of data as lower-priority w