Hi Jay, Thanks for your response. So in the future if there is a change in the commit-log (CommitLogDescriptor.java <https://github.com/apache/cassandra/blob/06209037ea56b5a2a49615a99f1542d6ea1b2947/src/java/org/apache/cassandra/db/commitlog/CommitLogDescriptor.java#L69>) structure, will CommitLogReader be updated to read the new changes as well ?
Thanks Sreeni On Sat, Feb 9, 2019 at 5:13 AM jay.zhu...@yahoo.com.INVALID <jay.zhu...@yahoo.com.invalid> wrote: > Hi, > Yes, the commit-log format may change, here is the current version of > commit-log: > https://github.com/apache/cassandra/blob/06209037ea56b5a2a49615a99f1542d6ea1b2947/src/java/org/apache/cassandra/db/commitlog/CommitLogDescriptor.java#L69 > You > need to look into git log to find out the changes. > But if you use Cassandra lib to read the files, CommitLogReader is able to > read the current and previous version of commit-logs: > https://github.com/apache/cassandra/blob/06209037ea56b5a2a49615a99f1542d6ea1b2947/src/java/org/apache/cassandra/db/commitlog/CommitLogReader.java#L168 > If > you implement that by yourself (maybe in other languages), you should do > the similar thing. > Thanks,Jay > On Thursday, February 7, 2019, 11:34:35 PM PST, Sreenivasulu Nallapati > <sreeni.nallap...@gmail.com> wrote: > > Hello folks, > > I am exploring the CDC option to move data from cassandra to Hive on > periodic basis. > While exploring this option, I overheard saying that the internal > commit-log structure will change form version to version. Is this correct? > > As per this link > < > http://cassandra.apache.org/doc/latest/architecture/storage_engine.html#sstable-versions > >, > sstables have changed in multiple times in multiple versions. > I want to understand about the commit-log internal structure as well. Is > there any change in the commit-log file structure in different cassandra > versions? If so, can someone please redirect me to the docs/change log? > > Please help me to understand more on this. Thanks in advance > > Thanks > Sreeni >
