On Wed, 2022-03-16 at 22:53 +0530, Ambrose Jr wrote: > Hello All, > > I'm new to CDC implementation and we are in plan to do POC for data > replication from mainframe to distributed side. We planned a setup like > *VSAM->CDC(infosphere)->Kafka->mongoDB*. I have more concern with Kafka to > mongodb connectivity and bit worried with connection functionality though > lot of connectors are available in market,
It's a no-brainer. If you are even contemplating using Kafka in production for CDC replication of production data you should work with Confluence and use their supported Kafka Connect MongoDB connector. My colleague and I had a meeting with Confluence solution advisors and their support is top notch, as are their platforms and products. On-prem support will not break the bank either. Confluence's biggest customer base is the financial services sector. CDC (change data capture) is becoming the norm for mainframe financial services companies. Disruptive technologies like mobile banking apps have caused their transaction workloads to dramatically increase along with their software bills. I was speaking to an architect from a local bank and he told me that 75% of their transactions are reads. They have split the reads from the writes and use Oracle Golden Gate CDC on z/OS and Kafka to stream to Apache Cassandra running on their hybrid cloud, which they can scale out in a matter of seconds using k8s. There is a great video where the architects from the Nationwide Building Society in the UK present their architecture using IBM DB2 CDC, Kafka and MongoDB to create a speed layerfor caching reads. Once the data is being streamed to Kafka topics they started to build other services such as machine learning, fraud detection, anomaly detection, push requests etc and the beauty of using Kafka as the central nervous system is that everything is loosely coupled as opposed to the old monolithic architectures of old. The other plus is that their online services will still operate when the mainframe is down for scheduled maintenance or an application is unavailable due to overnight or weekly batch processing. https://youtu.be/x_rYEpRrdrA Good luck on your journey > .Incase if someone one done this setup before please share the doc or link > . Also let me know if you know any other easy or alternate way to implement > this setup. Appreciate your help !!. > > Regards, > ---------------------------------------------------------------------- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [email protected] with the message: INFO IBM-MAIN
