[DISCUSS] CEP-18: Improving Modularity

2021-10-22 Thread Jeremiah Jordan
Hi All, As has been seen with the work already started in CEP-10, increasing the modularity of our subsystems can improve their testability, and also the ability to try new implementations without breaking things. Our team has been working on doing this and CEP-18 has been created to propose addin

Re: Permission to create a CEP for pluggable SSTable formats

2021-10-22 Thread Patrick McFadin
And this looks like it was done for anyone that finds this later. On Fri, Oct 22, 2021 at 12:41 AM Erick Ramirez wrote: > Noting here that I responded on the #cassandra-dev channel so someone could > grant Jacek edit access to the cwiki. Cheers! >

Re: [DISCUSS] CEP-17: SSTable format API (CASSANDRA-17056)

2021-10-22 Thread Jeremiah Jordan
Hi Stefan, That idea is not related to this CEP which is about the file formats of the sstables, not file system access. But you should take a look at the work recently committed in https://issues.apache.org/jira/browse/CASSANDRA-16926 to switch to using java.nio.file.Path for file access. This s

Re: [DISCUSS] CEP-17: SSTable format API (CASSANDRA-17056)

2021-10-22 Thread Stefan Miklosovic
One point I would like to add to this; I was already looking into how to extend this but what I saw in SSTableReader was that it is very much "file system oriented". There was not any possibility to actually hook something like that there. I think what importing does is that it will use SSTableRead

Re: [DISCUSS] CEP-17: SSTable format API (CASSANDRA-17056)

2021-10-22 Thread Stefan Miklosovic
Hi Jacek, Thanks for taking the lead on this. There was importing of SSTables introduced in 4.0 via StorageService#importNewSSTables. The "problem" with this is that SSTables need to be physically located at disk so Cassandra can read them. If a backup is taken and SSTables are uploaded to, for e

[DISCUSS] CEP-17: SSTable format API (CASSANDRA-17056)

2021-10-22 Thread Jacek Lewandowski
I'd like to start a discussion about SSTable format API proposal (CEP-17) Jira: https://issues.apache.org/jira/browse/CASSANDRA-17056 CEP: https://cwiki.apache.org/confluence/display/CASSANDRA/CEP-17%3A+SSTable+format+API Thanks, Jacek ---

Re: Permission to create a CEP for pluggable SSTable formats

2021-10-22 Thread Erick Ramirez
Noting here that I responded on the #cassandra-dev channel so someone could grant Jacek edit access to the cwiki. Cheers!

Permission to create a CEP for pluggable SSTable formats

2021-10-22 Thread Jacek Lewandowski
I'd like to add a CEP for pluggable SSTable format but I don't have permission to create one - could anybody help me with that? Jacek - To unsubscribe, e-mail: dev-unsubscr...@cassandra.apache.org For additional commands, e-mai

Re: Paging in bytes (CASSANDRA-11745)

2021-10-22 Thread Oleksandr Petrov
I personally think this change should be small enough to just be done via jira without introducing a CEP. But since paging generally has seen some problems, it'd be good to understand the design before flushing it out in code. One of the ways where we probably should be considerate is the paging s

Paging in bytes (CASSANDRA-11745)

2021-10-22 Thread Jacek Lewandowski
Hi I wanted to start working on extending the paging mechanism to support memory based limits. My question is whether such a change requires a CEP or discussion in Jira is enough? Thanks, - - -- --- - - Jacek Lewandowski