Re: CDC from Oracle database reading directly logs - integration with OpenLogReplicator

2023-01-09 Thread Adam Leszczyński
Hi Martijn, This is not reasonable to merge Flink and OpenLogReplicator code. A simple network connection is enough and leave the projects separate. They can remain distinct. You can have client/SDK code for OpenLogReplicator (like StreamClient.cpp in the code) which would be licensed with Apac

Re: CDC from Oracle database reading directly logs - integration with OpenLogReplicator

2023-01-09 Thread Martijn Visser
Hi Adam, Just a side note, since your code is licensed under GPL, I believe it can't be included with Flink since GPL licenses are considered category X and can't be included with Apache-licensed projects [1]. Best regards, Martijn [1] https://www.apache.org/legal/resolved.html#category-x On M

Re: CDC from Oracle database reading directly logs - integration with OpenLogReplicator

2023-01-08 Thread Adam Leszczyński
Hi Gunnar, Thank you very much for help. I really appreciate it. I believe you might be right. But still Flink has it’s own connector to Oracle which does not require Debezium. I’m not an expert and don’t have a wider view how most customer sites work. My intention was just to clearly shot what

Re: CDC from Oracle database reading directly logs - integration with OpenLogReplicator

2023-01-06 Thread Gunnar Morling
Hey Adam, all, Just came across this thread, still remembering the good conversations we had around this while I was working on Debezium full-time :) Personally, I still believe the best way forward with this would be to add support to the Debezium connector for Oracle so it can ingest changes fr

Re: CDC from Oracle database reading directly logs - integration with OpenLogReplicator

2023-01-05 Thread Adam Leszczyński
Thanks Leonard, Jark, I will just reply on the dev list for this topic as this is more related with development. Sorry, I have sent on 2 lists - I don’t want to add more chaos here. The answer to your question is not straight, so I will start from a broader picture. Maybe first I will describ

Re: CDC from Oracle database reading directly logs - integration with OpenLogReplicator

2023-01-04 Thread Jark Wu
Hi Adam, Thanks for sharing this interesting project. I think it definitely is valuable for users for better speed. I am one of the maintainers of flink-cdc-connector project. The project offers a “oracle-cdc” connector which uses Debezium (depends on LogMiner) as the CDC library. From the pe

Re: CDC from Oracle database reading directly logs - integration with OpenLogReplicator

2023-01-04 Thread Adam Leszczyński
H Márton, Thank you very much for your answer. The point with Kafka makes sense. It offers huge bag of potential connectors that could be used. But … not everybody wants or needs Kafka. This brings additional architectural complication and delays, which might not be acceptable by everybody. Tha