Can you present on Postgres + Kafka?

2018-11-19 Thread Joshua D. Drake
Howdy, I am one of the organizers of Silicon Valley Postgres (and others) as well as PostgresConf, we are looking for speakers to present on integrating Kafka with Postgres. Do we have any community members in Silicon Valley and/or NYCish that would be interested in presenting on this topic?

Re: Producer throughput with varying acks=0,1,-1

2018-11-19 Thread Matthias J. Sax
The producer has a config `max.in.flight.requests.per.connection` and because of `ack=all`, even if you don't check the `Future`, a request will be in-flight longer, because the leader needs to wait for the followers to replicate the data before it can send the ack back. Thus, I assume that you ar

Re: Kafka in multi-dc deployment

2018-11-19 Thread Ryanne Dolan
Igor, currently the best available disaster recovery strategy looks something like this: - Use MirrorMaker to replicate data from a source cluster to a target cluster. MM should be co-located with the target cluster to minimize producer lag. If you have multiple active data centers, each would nee

Kafka in multi-dc deployment

2018-11-19 Thread igor polyakov
What is the best way for Kafka multi-dc deployments to pick up processing at another location if a primary location fails? What features of Kafka are the most relevant for continuous processing? Sincerely, Igor Check these out ! [Ad Placement 1]