Kafka Connect JDBC source can pick up changes based on primary keys and mod time columns. Debezium consumes the DBs change log directly.
Both would work for your purpose. Have a look at the documentation for the Kafka Connect S3 sink to see if it fits your needs on the other end. Cheers, Liam Clarke On Fri, 15 Feb. 2019, 7:03 am John Ziebro <jzie...@mbsicorp.com wrote: > Hi, > > We are planning on implementing Kafka to stream changes from a MariaDB as > well as a MS SQL Server database into an S3 bucket and would like to stay > with opensource solutions as much as possible. To simplify this process it > looks like we might need to use something that leverages Kafka like > Debezium<https://debezium.io/>. > > What are your suggestions for handling this scenario? > > Thank you, > John Z > >
