From: Andrey Zhadchenko
as we already got all info from ploop_bat_entries() earlier.
https://virtuozzo.atlassian.net/browse/VSTOR-91817
Signed-off-by: Andrey Zhadchenko
---
drivers/md/dm-ploop-map.c | 8
1 file changed, 4 insertions(+), 4 deletions(-)
diff --git a/drivers/md/dm-ploop
On 1/23/25 12:24, Pavel Tikhomirov wrote:
On 1/23/25 18:47, Andrey Zhadchenko wrote:
On 1/23/25 10:53, Pavel Tikhomirov wrote:
On 1/23/25 17:21, Andrey Zhadchenko wrote:
On 1/23/25 09:15, Pavel Tikhomirov wrote:
On 1/20/25 16:34, Andrey Zhadchenko wrote:
so user can query the lis
https://virtuozzo.atlassian.net/browse/VSTOR-91820
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-map.c| 21 +
drivers/md/dm-ploop-target.c | 3 ++-
drivers/md/dm-ploop.h| 2 +-
3 files changed, 16 insertions(+), 10 deletions(-)
diff --git a/drivers/m
Prepare to reduce locking by using atomic 32 bit access to the fields.
To ensure this we need to use the _ONCE macros.
https://virtuozzo.atlassian.net/browse/VSTOR-91659
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-bat.c | 20 ++--
drivers/md/dm-ploop-cmd.c | 28
Convert to lockless lists - intermix with regular list due to
that next pointer in both list_head and llist_head is the first
field, and prev is not used. Do this so we can make babysteps
forward.
https://virtuozzo.atlassian.net/browse/VSTOR-91820
Signed-off-by: Alexander Atanasov
---
drivers/md
Use llist and remove deferred_lock around pio dispatching.
https://virtuozzo.atlassian.net/browse/VSTOR-91820
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-map.c| 123 +--
drivers/md/dm-ploop-target.c | 6 +-
drivers/md/dm-ploop.h| 4 +-
Ploop processes requsts in a different threads in parallel
where possible which results in significant improvement in
performance and makes further optimistations possible.
v1:
- addressed feedback, i've left a few requests to merge changes
into bigger patches out, as to keep changes in smal
When running out of space pios are delayed and retried
from a timer. This timer is the only thing that runs in
interrupt context and brings requirement to use _irqsave
variants, since a complete request processing can be started
from the timer. To avoid this set a flag from the timer
and process de
From: Andrey Zhadchenko
Do not bother with locked clusters. For llseek we can ignore all
concurrent operations.
Do not call ploop_bat_entries() on every cluster as this is slow.
Just remember md and read it directly.
Return EINVAL if it fails to find md page.
https://virtuozzo.atlassian.net/bro
unify how MD_WRITEBACK bit is set across the code -
one of the files is using a wrapper the rest of the code
directly sets the bit. To avoid confusion remove the wrapper.
Remove the lock and rely on atmoic bitops to make a further
lock reorganization easier.
https://virtuozzo.atlassian.net/browse/
From: Andrey Zhadchenko
Currently we have single bat_rwlock for the whole ploop. However,
runtime locking granularity can be reduced to single metadata page.
In this patch, add rwlock to metadata structure, use it when
accessing md->levels and md->page at the sime time to protect
readers against
lock bitmap in grow update header and disable delayed writeback
https://virtuozzo.atlassian.net/browse/VSTOR-91821
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-cmd.c | 8
1 file changed, 8 insertions(+)
diff --git a/drivers/md/dm-ploop-cmd.c b/drivers/md/dm-ploop-cmd.c
ind
Fix direct bitops to use set_bit/clear_bit which
are atomic - this is required since there are
some places in code that do not use locking when
operating on that bits. this is also a preparation
to relax locking.
https://virtuozzo.atlassian.net/browse/VSTOR-91820
Signed-off-by: Alexander Atanasov
Currently there are two workers one to handle pios,
one to handle flush (via vfs_fsync). This workers are
created unbound which means they are run whenever there is a free
CPU. When ploop sends pios (via ploop_dispatch_pios) it checks
if there are data and if there are flush pios. If both are
prese
md_page is always present in memory. In that case
md_page->page could be always be mapped and we would not need to perform
kmap_atomic/kunmap_atomic during each lookup
Convert bat updates to use kmap_local_page/kunmap_local.
https://virtuozzo.atlassian.net/browse/VSTOR-91659
Suggested-by: Denis V
nr_bat_entries are updated while resizing, some places
read it without holding the bat_lock, to ensure a good
value is read use READ_ONCE and WRITE_ONCE when updating.
During grow/resize and shrink pios are suspended and
code waits for all active inflight pios to complete.
https://virtuozzo.atlass
From: Andrey Zhadchenko
Revert llist conversion for metadata writeback.
Create new list for priority metadata updates, which are triggered
by FUA requests.
Write metadata for all other requests in batch after some delay.
Add new parameter to specify delay time.
Always submit COW and discard io to
Currently data pios and fluses are separated into different lists before
handled to workqueue. This can lead to executing of flushes before relevant
data pios and it is not possible to get that dependency in the worker.
So put both data and flush pios into prepare list. This way worker can
get sing
From: Andrey Zhadchenko
Drop ploop_cluster_is_in_top_delta(), because
- it internally searches md on every call
- it takes read lock every time
https://virtuozzo.atlassian.net/browse/VSTOR-91817
Signed-off-by: Andrey Zhadchenko
---
drivers/md/dm-ploop-map.c | 15 +++
1 file chang
From: Andrey Zhadchenko
as all it's users are gone or reworked
https://virtuozzo.atlassian.net/browse/VSTOR-91817
Signed-off-by: Andrey Zhadchenko
---
drivers/md/dm-ploop.h | 14 --
1 file changed, 14 deletions(-)
diff --git a/drivers/md/dm-ploop.h b/drivers/md/dm-ploop.h
index 8e
Move to multithreaded model and remove work queue.
https://virtuozzo.atlassian.net/browse/VSTOR-91821
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-map.c| 54 +++
drivers/md/dm-ploop-target.c | 62 +---
drivers/md/dm-plo
There are some requirements listed in the comment inside
ploop_bat_write_complete:
* Success: now update local BAT copy. We could do this
* from our delayed work, but we want to publish new
* mapping in the fastest way. This must be done before
* data bios completion
Do not advance pio past bio end - this should not happen
but try to catch and log it as an error.
https://virtuozzo.atlassian.net/browse/VSTOR-91821
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-map.c | 11 ++-
1 file changed, 10 insertions(+), 1 deletion(-)
diff --git a/dri
The difference between hlist_unhashed_lockless and hlist_unhashed
is that _lockless version uses READ_ONCE to do the check.
Since it is used without locks we must switch to the _lockless variant.
Also make locking clusters and adding to inflight_pios return result
so we can track if they failed an
Send all pios attached to sync operation to runners
to call endio.
https://virtuozzo.atlassian.net/browse/VSTOR-91821
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-map.c| 18 --
drivers/md/dm-ploop-target.c | 1 +
drivers/md/dm-ploop.h| 2 ++
3 files cha
From: Andrey Zhadchenko
We are planning to delay metadata writeback, so we want to
immediately apply metadata changes to BAT page.
Make all request that trigger PIWB_TYPE_ALLOC apply metadata
changes immediately.
https://virtuozzo.atlassian.net/browse/VSTOR-91817
Signed-off-by: Andrey Zhadchenko
Prepare for threads. When preparing bat updates there are two important
things to protect - md->status MD_DIRTY bit and holes bitmap.
Use bat_lock to protect them.
https://virtuozzo.atlassian.net/browse/VSTOR-91821
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-cmd.c | 2 +
drivers
Do not bulk write all dirtied bat pages in a common timeout.
Instead mark dirty time for each page and delay for each page
by the timeout. If page is tried to be redirtied - update the
dirty time so for hot page try to accumulate more changes before
writeout.
https://virtuozzo.atlassian.net/browse
These locks are used in both interrupt and user context so we must
preserve interrupts state.
https://virtuozzo.atlassian.net/browse/VSTOR-98471
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-map.c | 10 ++
1 file changed, 6 insertions(+), 4 deletions(-)
diff --git a/drivers/
From: Andrey Zhadchenko
On every flush request we should submit all accumulated metadata
changes, wait for their completion and only then do the flush.
https://virtuozzo.atlassian.net/browse/VSTOR-91817
Signed-off-by: Andrey Zhadchenko
---
drivers/md/dm-ploop-map.c | 42 +++
Fast path results in rcu lockups and hangs.
The reason is that we got called from fs,
then we try to re-enter the fs but fs is not ready for this.
There is an idea to investigate - try to skip dispatcher thread
and directly execute in a runner thread.
Signed-off-by: Alexander Atanasov
---
drive
convert bool high prio to status bit - reduce size and gain atomicity
https://virtuozzo.atlassian.net/browse/VSTOR-91817
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-bat.c | 1 -
drivers/md/dm-ploop-map.c | 10 +-
drivers/md/dm-ploop.h | 3 +--
3 files changed, 6 inser
From: Andrey Zhadchenko
https://virtuozzo.atlassian.net/browse/VSTOR-91817
Signed-off-by: Andrey Zhadchenko
---
drivers/md/dm-ploop-map.c | 5 +++--
1 file changed, 3 insertions(+), 2 deletions(-)
diff --git a/drivers/md/dm-ploop-map.c b/drivers/md/dm-ploop-map.c
index 5d2bcc8446d5..c6e39cec11
direct IO write result ENOTBLK or 0(in ext4 case) means
retry IO in buffered mode. We wrongly assumed that it is
a short write and handled it incorrectly
Since we can not retry in buffered mode, code is not ready
for it. Take a different route. This error happens if
page invalidation fails, which
improve how and when we wait for pios to complete
before proceeding with next pios.
force writing of pending md pages in case we have a sync pios.
remove now unused functions.
https://virtuozzo.atlassian.net/browse/VSTOR-91821
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-map.c | 33
Create threads to execute pios in parallel - call them pio runners.
Use number of CPUs to determine the number of threads started.
>From worker each pio is sent to a thread in round-robin fashion
thru work_llist. Maintain the number of pios sent so we can wait
for them to be processed - NB we only
Prepare pios earlier in preparation to try to execute them earlier.
Convert more places to use lock less lists.
https://virtuozzo.atlassian.net/browse/VSTOR-91820
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-cmd.c | 13 +
drivers/md/dm-ploop-map.c | 101 ++--
If we see a bio with REQ_FUA set we need to request a sync.
https://virtuozzo.atlassian.net/browse/VSTOR-91816
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-map.c | 8
1 file changed, 8 insertions(+)
diff --git a/drivers/md/dm-ploop-map.c b/drivers/md/dm-ploop-map.c
index f
After a pio is split and prepared try to execute if immediately
without going to the worker thread.
https://virtuozzo.atlassian.net/browse/VSTOR-91820
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-map.c | 96 ---
1 file changed, 70 insertions(+), 2
ploop_advance_local_after_bat_wb is handling only one
md page, so it is possible do simplify discard completion
done in ploop_piwb_discard_completed.
initialization overlaps and there is an extra md page
lookup which can be avoided.
remove the function and integrate it into
ploop_advance_local_aft
From: Andrey Zhadchenko
Flushed should be explicitly called by the writer if he really
wants it.
Drop ploop_md_write_endio() and ploop_md_fsync_endio().
https://virtuozzo.atlassian.net/browse/VSTOR-91817
Signed-off-by: Andrey Zhadchenko
---
drivers/md/dm-ploop-map.c | 31 +++---
Process pios in runner threads while preserving order.
Metadata writeback requries all prios pios to be processed,
since they can generate updates, so we have to wait before
processing writeback. Fsync is yet sequential too.
Both can be improved in a next iterration.
https://virtuozzo.atlassian.n
Encode device minor number into thread name.
If we use dm-ploop as prefix since name gets
truncated so shorten it to ploop.
https://virtuozzo.atlassian.net/browse/VSTOR-91821
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-target.c | 6 +++---
1 file changed, 3 insertions(+), 3 deletio
For some reason this fixed xfs issues .
I do not know why yet.
To be investigated. And probably reverted.
https://virtuozzo.atlassian.net/browse/VSTOR-91821
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-bat.c| 15 -
drivers/md/dm-ploop-cmd.c| 6 --
drivers/md
Move file space allocation into a separate thread, try to
preallocate space in advance.
On each cluster allocation check if next allocation will possibly
require file space allocation and trigger the allocator thread to
perform it in background.
In case we try to allocate cluster and no space is
We need to wait for write back to complete to issue pending flushes.
To know if we have to wait return numer of pios submitted.
Check if we have pending pios blocked by md update.
https://virtuozzo.atlassian.net/browse/VSTOR-91821
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-map.c |
reduce locking for cow pios chained to bat updates
https://virtuozzo.atlassian.net/browse/VSTOR-91821
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-map.c | 19 ++-
drivers/md/dm-ploop.h | 2 +-
2 files changed, 11 insertions(+), 10 deletions(-)
diff --git a/driv
remove the wb_batch_list_prio, use only wb_batch_list and
use the md high_prio flag for immediate submission.
https://virtuozzo.atlassian.net/browse/VSTOR-91817
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-map.c| 70 +++-
drivers/md/dm-ploop-targe
Prepare locking for threads. Some operations require to lock bat data
(see next patch) and in some cases we need to lock md page while hodling
bat spin lock but we can not take sleeping lock while holding a spin lock.
To address this use a spin lock for md pages instead of rwlock.
https://virtuoz
From: Andrey Zhadchenko
When mapping request, save all flags, rather then only operation
type. Use it later to check if the request is FUA or not.
Unfortunately there is no REQ_FUA equivalent on IOCB layer, but
IOCB_DSYNC is usually translated to it, as can be seen in
__iomap_dio_rw().
https://v
On suspended or stopped sync delta.
Enable use of per cpu pool cache for bio allocated from kaio.
https://virtuozzo.atlassian.net/browse/VSTOR-91821
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-target.c | 21 +++--
1 file changed, 19 insertions(+), 2 deletions(-)
d
reduce locking for data ready pios chained to bat updates
https://virtuozzo.atlassian.net/browse/VSTOR-91821
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-map.c | 15 ---
drivers/md/dm-ploop.h | 2 +-
2 files changed, 9 insertions(+), 8 deletions(-)
diff --git a/dri
- no point to sync before write
- no point to reverse the list order since it is resubmit and
order is lost already
https://virtuozzo.atlassian.net/browse/VSTOR-91821
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-cmd.c | 5 -
1 file changed, 5 deletions(-)
diff --git a/drivers/
GFP_NOIO can sleep so we can not use it while we
are called from block layer and device mapper in
interrupt context. It is also invalid under rcu_nesting
which happens too.
(traces in the issue)
https://virtuozzo.atlassian.net/browse/VSTOR-98291
Signed-off-by: Alexander Atanasov
---
drivers/md/d
From: Andrey Zhadchenko
Create new flush pio when we see REQ_PREFLUSH flag. Call original
pio after the flush is done.
https://virtuozzo.atlassian.net/browse/VSTOR-91817
Signed-off-by: Andrey Zhadchenko
---
drivers/md/dm-ploop-map.c | 39 ++-
1 file changed,
Merging required to back this change, so do it again.
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-map.c| 53 ++--
drivers/md/dm-ploop-target.c | 1 -
drivers/md/dm-ploop.h| 1 -
3 files changed, 27 insertions(+), 28 deletions(-)
diff -
Add specific list ids for writeback and flush pios, and process them
inside the runners.
https://virtuozzo.atlassian.net/browse/VSTOR-91821
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-map.c | 4
drivers/md/dm-ploop.h | 3 +++
2 files changed, 7 insertions(+)
diff --git a/
Split ploop_process_delta_cow in two - list iterator and processing
functions, unify handling with other pio types.
We need this to be able to call pio by pio from threads.
https://virtuozzo.atlassian.net/browse/VSTOR-91821
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-map.c | 52 +++
Add conditions that prevent writeback delay:
- if we have a pending pios
- if doing utility operations we do not want to delay writeout too
Add interface to disable delay.
Hook it into suspend/resuming of sending pios. Which is done before
ops that require it.
https://virtuozzo.atlassian.net/brow
Delayed metadata writeback results in a hang, disable
it until it is fixed. Pios end in the waiting list of
md and get stuck there never to complete.
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-map.c | 22 ++
1 file changed, 18 insertions(+), 4 deletions(-)
dif
currently threads do
old_flags = current->flags;
current->flags |= ploop flags;
...
current->flags = old_flags;
this can break process flags
To fix this use current_restore_flags(..) macro which only removes
our flags and it preserves any other flags.
https://virtuozzo.atlassian.net/browse/VST
a pio may complete after md page update, in that case we
must not complete the update but wait for the last data pio
and only then complete them all.
https://virtuozzo.atlassian.net/browse/VSTOR-91821
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-map.c | 105 -
Prepare for threads. Convert rwlock to spin lock.
This patch converts existing rwlocks only.
In the next one lock is used where required.
https://virtuozzo.atlassian.net/browse/VSTOR-91821
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-cmd.c| 8
drivers/md/dm-ploop-map.c
https://virtuozzo.atlassian.net/browse/VSTOR-91820
Signed-off-by: Alexander Atanasov
---
drivers/md/dm-ploop-cmd.c| 14 --
drivers/md/dm-ploop-map.c| 2 +-
drivers/md/dm-ploop-target.c | 2 +-
drivers/md/dm-ploop.h| 2 +-
4 files changed, 15 insertions(+), 5 deletio
From: Andrey Zhadchenko
Drop extra ploop_cluster_is_in_top_delta() as we are planning to
access BAT anyway
https://virtuozzo.atlassian.net/browse/VSTOR-91817
Signed-off-by: Andrey Zhadchenko
---
drivers/md/dm-ploop-map.c | 28
1 file changed, 12 insertions(+), 16 d
65 matches
Mail list logo
