Fwd: Consumer service that supports retry with exponential backoff

2017-10-09 Thread John Walker
I have a pair of services. One dispatches commands to the other for processing. My consumer sometimes fails to execute commands as a result of transient errors. To deal with this, commands are retried after an exponentially increasing delay up to a maximum of 4 times. (Delays: 1hr, 2hr, 4hr, 8h

Bundling already-serialized messages

2018-08-19 Thread John Walker
I want to do something crazy. Someone talk me off the ledge: record Bundle { string key; array msgs; } Producers individually serialize a bunch of messages that share a key, then serialize a bundle and post to a topic. A generic Flattener service is configured by startup parameters to liste