[backfilling some messages]
GaryG wrote: > > > On 2/5/07, Givental, Gary wrote: >> Ah yes, I should have clarified that :) >> >> The nature of the applications makes that impossible. We need to >> ensure that A) all the tasks are processed in sequential order, B) >> each work task is tied to a specific business entity. If 2 tasks need >> to be done for the same business entity, they *must* be processed in >> time-sequential order, and be processed by the Worker. >> >> These two requirements do not allow us to use a Queue for all the >> worker tasks, since that would mean they they might be processed out >> of order, and even worse, 2 tasks for the same business entity might >> be processed out of time-sequence. > > > > Aha. Looks like you need to use Message Groups. Using the business entity > as the JMSXGroupID value - then you get load balancing across your > business entities and workers - yet each business entity's messages are > processed in time-sequential order > > http://activemq.apache.org/message-groups.html > > If you need to preserve the order of all messages across all business > entities (i.e. process all messages essentially single threaded), then you > could use Exclusive Consumers > > http://activemq.apache.org/exclusive-consumer.html > > in either case, the broker does the hard work of tracking workers and load > balancing etc > -- > James > In response to this, James, does it effect performance negatively to have thousands of message groups? on the order of 10,000? Also, it sounds like Message Groups are Topics (publish/subscribe) is that correct? What about the use case (building on the Stock Symbols example on the activemq site) where perhaps all the Stock Symbols (MSFT, IBM, etc) are unique Message Groups, but we also want to group all the stock that are for Internet Companies, and a group for all the automotive industry companies, etc...is there sub-grouping in other words? I'm also concerned about memory requirements and performance of the broker itself -- View this message in context: http://www.nabble.com/Queue-question-tf3157001.html#a8814454 Sent from the ActiveMQ - User mailing list archive at Nabble.com.
