ent it and allow for our users to
enable it. This derisks the project in case there is an inadvertent change in
behavior.
Dinesh
On Oct 15, 2023, at 11:34 PM, Pawar, Amit
mailto:amit.pa...@amd.com>> wrote:
[Public]
Hi,
CommitLog uses mmap (memory mapped ) segments by default. Dire
M, guo Maxwell
mailto:cclive1...@gmail.com>> wrote:
-1
I still think we should keep it as it is until the direct io for commitlog
(read and write) is ready and relatively stable. And then we may change the
default value to direct io from mmap in a future version, such as 5.2, or 6.0.
if the commit log eventually does not use it.
>
> > On 16 Oct 2023, at 17:00, Jon Haddad
> > mailto:rustyrazorbl...@apache.org>> wrote:
> >
> > I haven't looked at the patch, but at a high level, defaulting to direct
> > I/O for commit logs makes a lot o
[Public]
Hi,
CommitLog uses mmap (memory mapped ) segments by default. Direct-IO feature is
proposed through new PR[1] to improve the CommitLog IO speed. Enabling this by
default could be useful feature to address IO bottleneck seen during peak load.
Need your input regarding changing this def
. Use proper caution
when opening attachments, clicking links, or responding.
This sounds awesome. Could you share the fio configuration you used to
benchmark and what hardware you used?
On 2023/04/18 18:10:24 "Pawar, Amit" wrote:
> [Public]
>
> Hi,
>
> I shared my inv
want to have some lower level discussions there when we find you a
reviewer.
On Tue, Apr 18, 2023, at 2:10 PM, Pawar, Amit wrote:
[Public]
Hi,
I shared my investigation about Commitlog I/O issue on large core count system
in my previous email dated July-22 and link to the thread is given below
[Public]
Hi,
I shared my investigation about Commitlog I/O issue on large core count system
in my previous email dated July-22 and link to the thread is given below.
https://lists.apache.org/thread/xc5ocog2qz2v2gnj4xlw5hbthfqytx2n
Basically, two solutions looked possible to improve the CommitLo
2022 12:41, Pawar, Amit wrote:
[Public]
Hi Bowen,
Thanks for the reply and it helped to identify the failure point. Tested
compaction throughput with different values and threads active in compaction
reports "java.lang.OutOfMemoryError: Map failed" error with 1024 MB/s earlier
comp
)
a larger number of compactions involving smaller SSTable data files.
Regards,
Bowen
On 22/07/2022 11:19, Pawar, Amit wrote:
[Public]
Thank you Bowen for your reply. Took some time to respond due to testing issue.
I tested again multi-threaded feature with number of records from 260 million
to 2
patch is a result from an
extended tlp-stress run that includes both the live write path as well as the
deferred compaction of data written.
- Scott
On Jul 22, 2022, at 9:14 AM, Pawar, Amit
mailto:amit.pa...@amd.com>> wrote:
[AMD Official Use Only - General]
Hi Benedict,
The whole
bottlenecks is still a good thing if the additional
complexity is not severe - and this is still an unfortunately common way that
we benchmark changes today, anyway.
On 22 Jul 2022, at 11:20, Pawar, Amit
mailto:amit.pa...@amd.com>> wrote:
[Public]
Thank you Bowen for your reply. Too
action, not commit log. You initially may see commit log as the
>bottleneck when the table size is relatively small, but as the table size
>increases, compaction will likely take its place and become the new bottleneck.
On 20/07/2022 11:11, Pawar, Amit wrote:
[Public]
Hi all,
(My previous
[Public]
Hi all,
(My previous mail is not appearing in mailing list and resending again after 2
days)
Myself Amit and working at AMD Bangalore, India. I am new to Cassandra and need
to do Cassandra testing on large core systems. Usually should test on
multi-nodes Cassandra but started with Si
[AMD Official Use Only - General]
Hi Erick,
I am planning for a contribution and already initiated a discussion thread. Not
sure why that thread is not appearing and will send it again.
Thanks,
Amit
From: Erick Ramirez
Sent: Wednesday, July 20, 2022 1:18 PM
To: dev@cassandra.apache.org
Subjec
[Public]
Hi ,
I would like to join slack channel but need invitation. Could someone please
invite ?
Email:amit.pa...@amd.com
Thanks,
Amit
15 matches
Mail list logo
