Re: [RFC PATCH 00/30] Code tagging framework and applications

2022-08-31 Thread Kent Overstreet
On Wed, Aug 31, 2022 at 09:38:27AM +0200, Peter Zijlstra wrote: > On Tue, Aug 30, 2022 at 02:48:49PM -0700, Suren Baghdasaryan wrote: > > === > > Code tagging framework > > === > > Code tag is a structure identifying a specific location in the source

Re: [RFC PATCH 00/30] Code tagging framework and applications

2022-08-31 Thread Kent Overstreet
On Wed, Aug 31, 2022 at 11:19:48AM +0100, Mel Gorman wrote: > On Wed, Aug 31, 2022 at 04:42:30AM -0400, Kent Overstreet wrote: > > On Wed, Aug 31, 2022 at 09:38:27AM +0200, Peter Zijlstra wrote: > > > On Tue, Aug 30, 2022 at 02:48:49PM -0700, Suren

Re: [RFC PATCH 03/30] Lazy percpu counters

2022-08-31 Thread Kent Overstreet
On Wed, Aug 31, 2022 at 11:02:49AM +0100, Mel Gorman wrote: > On Tue, Aug 30, 2022 at 02:48:52PM -0700, Suren Baghdasaryan wrote: > > From: Kent Overstreet > > > > This patch adds lib/lazy-percpu-counter.c, which implements counters > > that start out as atomics, but l

Re: [RFC PATCH 22/30] Code tagging based fault injection

2022-08-31 Thread Kent Overstreet
On Wed, Aug 31, 2022 at 12:37:14PM +0200, Dmitry Vyukov wrote: > On Tue, 30 Aug 2022 at 23:50, Suren Baghdasaryan wrote: > > > > From: Kent Overstreet > > > > This adds a new fault injection capability, based on code tagging. > > > > To us

Re: [RFC PATCH 10/30] mm: enable page allocation tagging for __get_free_pages and alloc_pages

2022-08-31 Thread Kent Overstreet
On Wed, Aug 31, 2022 at 11:11:03AM +0100, Mel Gorman wrote: > On Tue, Aug 30, 2022 at 02:48:59PM -0700, Suren Baghdasaryan wrote: > > Redefine alloc_pages, __get_free_pages to record allocations done by > > these functions. Instrument deallocation hooks to record object freeing. > > > > Signed-off

Re: [RFC PATCH 00/30] Code tagging framework and applications

2022-08-31 Thread Kent Overstreet
On Wed, Aug 31, 2022 at 12:47:32PM +0200, Michal Hocko wrote: > On Wed 31-08-22 11:19:48, Mel Gorman wrote: > > Whatever asking for an explanation as to why equivalent functionality > > cannot not be created from ftrace/kprobe/eBPF/whatever is reasonable. > > Fully agreed and this is especially tr

Re: [RFC PATCH 00/30] Code tagging framework and applications

2022-09-01 Thread Kent Overstreet
On Thu, Sep 01, 2022 at 10:05:03AM +0200, David Hildenbrand wrote: > On 31.08.22 21:01, Kent Overstreet wrote: > > On Wed, Aug 31, 2022 at 12:47:32PM +0200, Michal Hocko wrote: > >> On Wed 31-08-22 11:19:48, Mel Gorman wrote: > >>> Whatever asking for an ex

Re: [RFC PATCH 00/30] Code tagging framework and applications

2022-09-01 Thread Kent Overstreet
On Thu, Sep 01, 2022 at 09:00:17AM +0200, Peter Zijlstra wrote: > On Wed, Aug 31, 2022 at 11:19:48AM +0100, Mel Gorman wrote: > > > It's also unclear *who* would enable this. It looks like it would mostly > > have value during the development stage of an embedded platform to track > > kernel memor

Re: [RFC PATCH 03/30] Lazy percpu counters

2022-09-01 Thread Kent Overstreet
On Thu, Sep 01, 2022 at 08:51:31AM +0200, Peter Zijlstra wrote: > On Tue, Aug 30, 2022 at 02:48:52PM -0700, Suren Baghdasaryan wrote: > > +static void lazy_percpu_counter_switch_to_pcpu(struct > > raw_lazy_percpu_counter *c) > > +{ > > + u64 __percpu *pcpu_v = alloc_percpu_gfp(u64, GFP_ATOMIC|__

Re: [RFC PATCH 27/30] Code tagging based latency tracking

2022-09-01 Thread Kent Overstreet
On Thu, Sep 01, 2022 at 09:11:17AM +0200, Peter Zijlstra wrote: > On Tue, Aug 30, 2022 at 02:49:16PM -0700, Suren Baghdasaryan wrote: > > From: Kent Overstreet > > > > This adds the ability to easily instrument code for measuring latency. > > To use, add the followin

Re: [RFC PATCH 03/30] Lazy percpu counters

2022-09-01 Thread Kent Overstreet
On Thu, Sep 01, 2022 at 10:48:39AM -0400, Steven Rostedt wrote: > On Thu, 1 Sep 2022 10:32:19 -0400 > Kent Overstreet wrote: > > > On Thu, Sep 01, 2022 at 08:51:31AM +0200, Peter Zijlstra wrote: > > > On Tue, Aug 30, 2022 at 02:48:52PM -0700, Suren Baghdasaryan wrote

Re: [RFC PATCH 00/30] Code tagging framework and applications

2022-09-01 Thread Kent Overstreet
On Thu, Sep 01, 2022 at 05:07:06PM +0200, David Hildenbrand wrote: > Skimming over the patches (that I was CCed on) and skimming over the > cover letter, I got the impression that everything after patch 7 is > introducing something new instead of refactoring something out. You skimmed over the dyn

Re: [RFC PATCH 00/30] Code tagging framework and applications

2022-09-01 Thread Kent Overstreet
On Thu, Sep 01, 2022 at 12:05:01PM +0100, Mel Gorman wrote: > As pointed out elsewhere, attaching to the tracepoint and recording relevant > state is an option other than trying to parse a raw ftrace feed. For memory > leaks, there are already tracepoints for page allocation and free that could > b

Re: [RFC PATCH 00/30] Code tagging framework and applications

2022-09-01 Thread Kent Overstreet
On Thu, Sep 01, 2022 at 12:39:11PM -0700, Suren Baghdasaryan wrote: > kmemleak is known to be slow and it's even documented [1], so I hope I > can skip that part. For page_owner to provide the comparable > information we would have to capture the call stacks for all page > allocations unlike our pr

Re: [RFC PATCH 27/30] Code tagging based latency tracking

2022-09-01 Thread Kent Overstreet
On Thu, Sep 01, 2022 at 05:38:44PM -0400, Steven Rostedt wrote: > On Tue, 30 Aug 2022 14:49:16 -0700 > Suren Baghdasaryan wrote: > > > From: Kent Overstreet > > > > This adds the ability to easily instrument code for measuring latency. > > To use, add the fo

Re: [RFC PATCH 00/30] Code tagging framework and applications

2022-09-01 Thread Kent Overstreet
On Thu, Sep 01, 2022 at 03:27:27PM -0700, Roman Gushchin wrote: > On Wed, Aug 31, 2022 at 01:56:08PM -0700, Yosry Ahmed wrote: > > This is very interesting work! Do you have any data about the overhead > > this introduces, especially in a production environment? I am > > especially interested in me

Re: [RFC PATCH 27/30] Code tagging based latency tracking

2022-09-01 Thread Kent Overstreet
On Thu, Sep 01, 2022 at 06:34:30PM -0400, Steven Rostedt wrote: > On Thu, 1 Sep 2022 17:54:38 -0400 > Kent Overstreet wrote: > > > > So this looks like it's gotten better since I last looked, but it's still > > not > > there yet. > > > > Pa

Re: [RFC PATCH 28/30] Improved symbolic error names

2022-09-01 Thread Kent Overstreet
On Thu, Sep 01, 2022 at 04:19:35PM -0700, Joe Perches wrote: > On Tue, 2022-08-30 at 14:49 -0700, Suren Baghdasaryan wrote: > > From: Kent Overstreet > > > > This patch adds per-error-site error codes, with error strings that > > include their file and line number. &

Re: [RFC PATCH 00/30] Code tagging framework and applications

2022-09-01 Thread Kent Overstreet
On Thu, Sep 01, 2022 at 03:53:57PM -0700, Roman Gushchin wrote: > I'd suggest to run something like iperf on a fast hardware. And maybe some > io_uring stuff too. These are two places which were historically most > sensitive > to the (kernel) memory accounting speed. I'm getting wildly inconsiste

Re: [RFC PATCH 00/30] Code tagging framework and applications

2022-09-01 Thread Kent Overstreet
On Thu, Sep 01, 2022 at 06:04:46PM -0700, Roman Gushchin wrote: > On Thu, Sep 01, 2022 at 08:17:47PM -0400, Kent Overstreet wrote: > > On Thu, Sep 01, 2022 at 03:53:57PM -0700, Roman Gushchin wrote: > > > I'd suggest to run something like iperf on a fast hardware. And ma

Re: [RFC PATCH 27/30] Code tagging based latency tracking

2022-09-01 Thread Kent Overstreet
On Thu, Sep 01, 2022 at 08:23:11PM -0400, Steven Rostedt wrote: > If ftrace, perf, bpf can't do what you want, take a harder look to see if > you can modify them to do so. Maybe we can use this exchange to make both of our tools better. I like your histograms - the quantiles algorithm I've had for

Re: [RFC PATCH 00/30] Code tagging framework and applications

2022-09-02 Thread Kent Overstreet
On Fri, Sep 02, 2022 at 06:02:12AM -0600, Jens Axboe wrote: > On 9/1/22 7:04 PM, Roman Gushchin wrote: > > On Thu, Sep 01, 2022 at 08:17:47PM -0400, Kent Overstreet wrote: > >> On Thu, Sep 01, 2022 at 03:53:57PM -0700, Roman Gushchin wrote: > >>> I'd suggest to

Re: [RFC PATCH 00/30] Code tagging framework and applications

2022-09-02 Thread Kent Overstreet
On Fri, Sep 02, 2022 at 01:53:53PM -0600, Jens Axboe wrote: > I've complained about memcg accounting before, the slowness of it is why > io_uring works around it by caching. Anything we account we try NOT do > in the fast path because of it, the slowdown is considerable. I'm with you on that, it d

Re: [RFC PATCH 00/30] Code tagging framework and applications

2022-09-05 Thread Kent Overstreet
On Mon, Sep 05, 2022 at 11:08:21AM -0700, Suren Baghdasaryan wrote: > On Mon, Sep 5, 2022 at 8:06 AM Steven Rostedt wrote: > > > > On Sun, 4 Sep 2022 18:32:58 -0700 > > Suren Baghdasaryan wrote: > > > > > Page allocations (overheads are compared to get_free_pages() duration): > > > 6.8% Codetag c

Re: [RFC PATCH 00/30] Code tagging framework and applications

2022-09-05 Thread Kent Overstreet
On Mon, Sep 05, 2022 at 10:49:38AM +0200, Michal Hocko wrote: > This is really my main concern about this whole work. Not only it adds a > considerable maintenance burden to the core MM because [citation needed] > it adds on top of > our existing allocator layers complexity but it would need to s

Re: [RFC PATCH 00/30] Code tagging framework and applications

2022-09-05 Thread Kent Overstreet
On Mon, Sep 05, 2022 at 06:16:50PM -0400, Steven Rostedt wrote: > On Mon, 5 Sep 2022 16:42:29 -0400 > Kent Overstreet wrote: > > > > Haven't tried that yet but will do. Thanks for the reference code! > > > > Is it really worth the effort of benchmarking trac

Re: [RFC PATCH 00/30] Code tagging framework and applications

2022-09-06 Thread Kent Overstreet
On Tue, Sep 06, 2022 at 09:23:31AM +0200, Michal Hocko wrote: > On Mon 05-09-22 19:46:49, Kent Overstreet wrote: > > On Mon, Sep 05, 2022 at 10:49:38AM +0200, Michal Hocko wrote: > > > This is really my main concern about this whole work. Not only it adds a > > > conside

Re: [RFC PATCH 00/30] Code tagging framework and applications

2022-09-07 Thread Kent Overstreet
On Wed, Sep 07, 2022 at 01:00:09PM +0200, Michal Hocko wrote: > Hmm, it seems that further discussion doesn't really make much sense > here. I know how to use my time better. Just a thought, but I generally find it more productive to propose ideas than to just be disparaging. Cheers, Kent

Re: [RFC PATCH 00/30] Code tagging framework and applications

2022-09-07 Thread Kent Overstreet
On Wed, Sep 07, 2022 at 09:45:18AM -0400, Steven Rostedt wrote: > On Wed, 7 Sep 2022 09:04:28 -0400 > Kent Overstreet wrote: > > > On Wed, Sep 07, 2022 at 01:00:09PM +0200, Michal Hocko wrote: > > > Hmm, it seems that further discussion doesn't really make much se

Re: [RFC PATCH 00/30] Code tagging framework and applications

2022-09-08 Thread Kent Overstreet
On Wed, Sep 07, 2022 at 11:49:37PM -0700, Suren Baghdasaryan wrote: > I would really appreciate if everyone could please stick to the > technical side of the conversation. That way we can get some > constructive feedback. Everything else is not helpful and at best is a > distraction. > Maintenance

Re: [RFC PATCH 00/30] Code tagging framework and applications

2022-09-08 Thread Kent Overstreet
On Thu, Sep 08, 2022 at 09:12:45AM +0200, Michal Hocko wrote: > Then you have probably missed a huge part of my emails. Please > re-read. If those arguments are not clear, feel free to ask for > clarification. Reducing the whole my reasoning and objections to the > sentence above and calling that v

Re: [PATCH RFC v3 for-6.8/block 07/17] bcachefs: remove dead function bdev_sectors()

2024-04-11 Thread Kent Overstreet
On Thu, Dec 21, 2023 at 04:57:02PM +0800, Yu Kuai wrote: > From: Yu Kuai > > bdev_sectors() is not used hence remove it. > > Signed-off-by: Yu Kuai Acked-by: Kent Overstreet > --- > fs/bcachefs/util.h | 5 - > 1 file changed, 5 deletions(-) > > diff -

Re: [PATCH block/for-next v2 07/16] bcachefs: use new helper to get inode from block_device

2023-11-26 Thread Kent Overstreet
On Mon, Nov 27, 2023 at 02:21:07PM +0800, Yu Kuai wrote: > From: Yu Kuai > > Which is more efficiency, and also prepare to remove the field > 'bd_inode' from block_device. > > Signed-off-by: Yu Kuai Acked-by: Kent Overstreet > --- > fs/bcachefs/util.h | 2

Re: [PATCH block/for-next v2 07/16] bcachefs: use new helper to get inode from block_device

2023-11-26 Thread Kent Overstreet
On Mon, Nov 27, 2023 at 04:09:47PM +0900, Damien Le Moal wrote: > On 11/27/23 15:21, Yu Kuai wrote: > > From: Yu Kuai > > > > Which is more efficiency, and also prepare to remove the field > > 'bd_inode' from block_device. > > > > Signed-off-by: Yu Kuai > > --- > > fs/bcachefs/util.h | 2 +- >

Re: [PATCH RFC v3 for-6.8/block 09/17] btrfs: use bdev apis

2023-12-23 Thread Kent Overstreet
On Sat, Dec 23, 2023 at 05:31:55PM +, Matthew Wilcox wrote: > On Thu, Dec 21, 2023 at 04:57:04PM +0800, Yu Kuai wrote: > > @@ -3674,16 +3670,17 @@ struct btrfs_super_block > > *btrfs_read_dev_one_super(struct block_device *bdev, > > * Drop the page of the primary superblock, so la