Re: -fno-inline-functions vs glibc's initfini

2012-02-01 Thread Richard Guenther
On Wed, Feb 1, 2012 at 3:30 AM, Alexandre Oliva wrote: > On Jan 31, 2012, Richard Guenther wrote: > >> What's probably confusing you is the "Don't pay attention to the >> @code{inline} keyword" sentence. > > What really set me down the wrong patch were the comments in > gcc/common.opt, that got m

RE: ICE building compiler

2012-02-01 Thread Henderson, Stuart
>Whilst investigating an ICE with the Blackfin compiler, I bumped in to a >bit of code which seems questionable: > >in reload1.c:reload() we call select_reload_regs() and then check if >failure was set. However, looking at find_reload_regs() (called via >select_reload_regs()), the only time we set

Memory corruption due to word sharing

2012-02-01 Thread Jan Kara
Hello, we've spotted the following mismatch between what kernel folks expect from a compiler and what GCC really does, resulting in memory corruption on some architectures. Consider the following structure: struct x { long a; unsigned int b1; unsigned int b2:1; }; We have two proc

Re: Memory corruption due to word sharing

2012-02-01 Thread Markus Trippelsdorf
On 2012.02.01 at 16:19 +0100, Jan Kara wrote: > we've spotted the following mismatch between what kernel folks expect > from a compiler and what GCC really does, resulting in memory corruption on > some architectures. Consider the following structure: > struct x { > long a; > unsigned int

Re: Memory corruption due to word sharing

2012-02-01 Thread Colin Walters
On Wed, 2012-02-01 at 16:19 +0100, Jan Kara wrote: > I've raised the issue with our GCC guys and they said to me that: "C does > not provide such guarantee, nor can you reliably lock different > structure fields with different locks if they share naturally aligned > word-size memory regions. The

Re: Memory corruption due to word sharing

2012-02-01 Thread Linus Torvalds
On Wed, Feb 1, 2012 at 7:19 AM, Jan Kara wrote: > >  we've spotted the following mismatch between what kernel folks expect > from a compiler and what GCC really does, resulting in memory corruption on > some architectures. This is sad. We've had something like this before due to architectural re

Re: Memory corruption due to word sharing

2012-02-01 Thread Linus Torvalds
On Wed, Feb 1, 2012 at 8:37 AM, Colin Walters wrote: > > 1) Use the same lock for a given bitfield That's not the problem. All the *bitfield* fields are all accessed under the same word already. > 2) Split up the bitfield into different words Again, it's not the bitfield that is the problem. T

Re: Memory corruption due to word sharing

2012-02-01 Thread Torvald Riegel
On Wed, 2012-02-01 at 16:19 +0100, Jan Kara wrote: > I've raised the issue with our GCC guys and they said to me that: "C does > not provide such guarantee, nor can you reliably lock different > structure fields with different locks if they share naturally aligned > word-size memory regions. The C

Re: Memory corruption due to word sharing

2012-02-01 Thread Jiri Kosina
On Wed, 1 Feb 2012, Linus Torvalds wrote: > But the compiler turns the access to the bitfield (in a 32-bit aligned > word) into a 64-bit access that accesses the word *next* to it. > > That word next to it might *be* the lock, for example. > > So we could literally have this kind of situation: >

Re: -fno-inline-functions vs glibc's initfini

2012-02-01 Thread Roland McGrath
> Want me to prepare a s/-fno-inline-functions/-fno-inline/ patch? My reading was that actually we would want both of those switches (the first to avoid inlining as an implicit optimization, the second to avoid inlining of functions declared inline). But whatever the exact detail, yes, please sen

Re: Memory corruption due to word sharing

2012-02-01 Thread Linus Torvalds
On Wed, Feb 1, 2012 at 9:08 AM, Torvald Riegel wrote: > > What do the kernel folks think about the C11 memory model?  If you can > spot any issues in there, the GCC community would certainly like to > know. I don't think this is about memory models except very tangentially. Gcc currently accesse

Re: Memory corruption due to word sharing

2012-02-01 Thread Linus Torvalds
On Wed, Feb 1, 2012 at 9:11 AM, Jiri Kosina wrote: > On Wed, 1 Feb 2012, Linus Torvalds wrote: >> >> And I suspect it really is a generic bug that can be shown even with >> the above trivial example. > > I have actually tried exactly this earlier today (because while looking at > this, I had an id

Re: Memory corruption due to word sharing

2012-02-01 Thread Michael Matz
Hi, On Wed, 1 Feb 2012, Jiri Kosina wrote: > # cat x.c > struct x { > long a; > volatile unsigned int lock; > unsigned int full:1; > }; > > void > wrong(struct x *ptr) > { > ptr->full = 1; > } > > In my opinion, this is a clear bug Even that depends (sadly) on who you ask.

Re: Memory corruption due to word sharing

2012-02-01 Thread Dennis Clarke
> I have actually tried exactly this earlier today (because while looking at > this, I had an idea that putting volatile in place could be a workaround, > causing gcc to generate a saner code), but it doesn't work either: > > # cat x.c > struct x { > long a; > volatile unsigned int lock; >

Documentation error for cbranch4

2012-02-01 Thread Paulo J. Matos
Hi, The docs state: `cbranchmode4' Conditional branch instruction combined with a compare instruction. Operand 0 is a comparison operator. Operand 1 and operand 2 are the first and second operands of the comparison, respectively. Operand 3 is a label_ref that refers to the label to jump to

Re: Memory corruption due to word sharing

2012-02-01 Thread David Miller
From: Michael Matz Date: Wed, 1 Feb 2012 18:41:05 +0100 (CET) > One problem is that it's not a new problem, GCC emitted similar code since > about forever, and still they turned up only now (well, probably because > ia64 is dead, but sparc64 should have similar problems). Indeed, on sparc64 i

Re: Memory corruption due to word sharing

2012-02-01 Thread Jeff Law
On 02/01/2012 11:09 AM, David Miller wrote: From: Michael Matz Date: Wed, 1 Feb 2012 18:41:05 +0100 (CET) One problem is that it's not a new problem, GCC emitted similar code since about forever, and still they turned up only now (well, probably because ia64 is dead, but sparc64 should have sim

Re: Memory corruption due to word sharing

2012-02-01 Thread Linus Torvalds
On Wed, Feb 1, 2012 at 9:41 AM, Michael Matz wrote: > > One problem is that it's not a new problem, GCC emitted similar code since > about forever, and still they turned up only now (well, probably because > ia64 is dead, but sparc64 should have similar problems).  The bitfield > handling code is

Re: Memory corruption due to word sharing

2012-02-01 Thread Linus Torvalds
On Wed, Feb 1, 2012 at 10:09 AM, David Miller wrote: > > Personally I've avoided C bitfields like the plague in any code I've > written. I do agree with that. The kernel largely tries to avoid bitfields, usually because we have some really strict rules about different bitfields, but also because

Re: Memory corruption due to word sharing

2012-02-01 Thread Peter Bergner
On Wed, 2012-02-01 at 13:09 -0500, David Miller wrote: > From: Michael Matz > Date: Wed, 1 Feb 2012 18:41:05 +0100 (CET) > > > One problem is that it's not a new problem, GCC emitted similar code since > > about forever, and still they turned up only now (well, probably because > > ia64 is dead

Re: Memory corruption due to word sharing

2012-02-01 Thread Linus Torvalds
On Wed, Feb 1, 2012 at 10:45 AM, Jeff Law wrote: > > Torvald Riegel & I were told that was kernel policy when we brought up the > upcoming bitfield semantic changes with some of the linux kernel folks last > year. Btw, one reason this is true is that the bitfield ordering/packing is so unspecifie

Re: Memory corruption due to word sharing

2012-02-01 Thread Torvald Riegel
On Wed, 2012-02-01 at 08:41 -0800, Linus Torvalds wrote: > If the gcc people aren't willing to agree that this is actually a flaw > in the standard (one that is being addressed, no less) It has been addressed in the standards. > and try to fix > it, Again, this is being worked on, see http://gcc

Re: Memory corruption due to word sharing

2012-02-01 Thread Jakub Jelinek
On Wed, Feb 01, 2012 at 06:42:54PM +0100, Torvald Riegel wrote: > We need a proper memory model. No vague assumptions with lots of > hand-waving. If you think that this is simple stuff and can > sufficiently described by "don't do anything stupid", then please have a > look at the issues that the

RE: Memory corruption due to word sharing

2012-02-01 Thread Boehm, Hans
I'm clearly with Torvald here. The original set of problems here is very clearly addressed by the C+11/C11 memory model. It clearly implies, among other things: - Updating a bit-field may interfere (create a data race with) other updates to that same contiguous sequence of bit-fields, but not

Re: Memory corruption due to word sharing

2012-02-01 Thread Linus Torvalds
On Wed, Feb 1, 2012 at 9:42 AM, Torvald Riegel wrote: > > We need a proper memory model. Not really. The fact is, the kernel will happily take the memory model of the underlying hardware. Trying to impose some compiler description of the memory model is actually horribly bad, because it automati

Re: Memory corruption due to word sharing

2012-02-01 Thread Jeff Law
On 02/01/2012 12:44 PM, Boehm, Hans wrote: C11 is a published standard. Last I checked, gcc did not follow many of the above rules. It looks like major changes were recently merged into the gcc trunk, and I haven't had a chance to test those, so it may well be fixed. But more importantly,

Re: Memory corruption due to word sharing

2012-02-01 Thread Alan Cox
> So here's basically what the kernel needs: > > - if we don't touch a field, the compiler doesn't touch it. > >This is the rule that gcc now violates with bitfields. > >This is a gcc bug. End of story. The "volatile" example proves it - > anybody who argues otherwise is simply wrong, a

Re: Memory corruption due to word sharing

2012-02-01 Thread Linus Torvalds
On Wed, Feb 1, 2012 at 11:40 AM, Jakub Jelinek wrote: > > Well, the C++11/C11 model doesn't allow to use the underlying type > for accesses, consider e.g. > > struct S { long s1; unsigned int s2 : 5; unsigned int s3 : 19; unsigned char > s4; unsigned int s5; }; > struct T { long s1 : 16; unsigned

Re: Memory corruption due to word sharing

2012-02-01 Thread Jakub Jelinek
On Wed, Feb 01, 2012 at 12:01:46PM -0800, Linus Torvalds wrote: > On Wed, Feb 1, 2012 at 11:40 AM, Jakub Jelinek wrote: > > struct S { long s1; unsigned int s2 : 5; unsigned int s3 : 19; unsigned > > char s4; unsigned int s5; }; > > struct T { long t1 : 16; unsigned int t2; }; > > > > on e.g. x86

Re: Memory corruption due to word sharing

2012-02-01 Thread Linus Torvalds
On Wed, Feb 1, 2012 at 12:01 PM, Linus Torvalds wrote: > >  - However, while using the *smallest* possible access may generate > correct code, it often generates really *crappy* code. Which is > exactly the bug that I reported in > >   http://gcc.gnu.org/bugzilla/show_bug.cgi?id=48696 Btw, as I a

Re: Memory corruption due to word sharing

2012-02-01 Thread Torvald Riegel
On Wed, 2012-02-01 at 11:47 -0800, Linus Torvalds wrote: > On Wed, Feb 1, 2012 at 9:42 AM, Torvald Riegel wrote: > > > > We need a proper memory model. > > Not really. > > The fact is, the kernel will happily take the memory model of the > underlying hardware. You do rely on the compiler to do

Re: Memory corruption due to word sharing

2012-02-01 Thread Linus Torvalds
On Wed, Feb 1, 2012 at 12:16 PM, Jakub Jelinek wrote: >> >> So the kernel really doesn't care what you do to things *within* the >> bitfield. > > But what is *within* the bitfield?  Do you consider s4 or t2 fields > (non-bitfield fields that just the ABI wants to pack together with > the bitfield

Re: Memory corruption due to word sharing

2012-02-01 Thread Torvald Riegel
On Wed, 2012-02-01 at 09:29 -0800, Linus Torvalds wrote: > On Wed, Feb 1, 2012 at 9:08 AM, Torvald Riegel wrote: > > > > What do the kernel folks think about the C11 memory model? If you can > > spot any issues in there, the GCC community would certainly like to > > know. > > I don't think this

Re: Memory corruption due to word sharing

2012-02-01 Thread Linus Torvalds
On Wed, Feb 1, 2012 at 12:41 PM, Torvald Riegel wrote: > > You do rely on the compiler to do common transformations I suppose: > hoist loads out of loops, CSE, etc.  How do you expect the compiler to > know whether they are allowed for a particular piece of code or not? We have barriers. Compile

RE: Memory corruption due to word sharing

2012-02-01 Thread Boehm, Hans
> From: Linus Torvalds > > > > We need a proper memory model. > > Not really. > > The fact is, the kernel will happily take the memory model of the > underlying hardware. Trying to impose some compiler description of the > memory model is actually horribly bad, because it automatically also > inv

Re: Memory corruption due to word sharing

2012-02-01 Thread Linus Torvalds
On Wed, Feb 1, 2012 at 12:53 PM, Torvald Riegel wrote: > > For volatile, I agree. > > However, the original btrfs example was *without* a volatile, and that's > why I raised the memory model point.  This triggered an error in a > concurrent execution, so that's memory model land, at least in C > l

Re: Memory corruption due to word sharing

2012-02-01 Thread Torvald Riegel
On Wed, 2012-02-01 at 12:59 -0800, Linus Torvalds wrote: > On Wed, Feb 1, 2012 at 12:41 PM, Torvald Riegel wrote: > > > > You do rely on the compiler to do common transformations I suppose: > > hoist loads out of loops, CSE, etc. How do you expect the compiler to > > know whether they are allowed

RE: Memory corruption due to word sharing

2012-02-01 Thread Boehm, Hans
> From: Linus Torvalds > Don't try to make it anything more complicated. This has *nothing* to > do with threads or functions or anything else. > > If you do massive inlining, and you don't see any barriers or > conditionals or other reasons not to write to it, just write to it. > > Don't try to

Re: Memory corruption due to word sharing

2012-02-01 Thread Torvald Riegel
On Wed, 2012-02-01 at 13:20 -0800, Linus Torvalds wrote: > On Wed, Feb 1, 2012 at 12:53 PM, Torvald Riegel wrote: > > > > For volatile, I agree. > > > > However, the original btrfs example was *without* a volatile, and that's > > why I raised the memory model point. This triggered an error in a >

Re: Memory corruption due to word sharing

2012-02-01 Thread Linus Torvalds
On Wed, Feb 1, 2012 at 1:24 PM, Torvald Riegel wrote: >> It's not the only thing we do. We have cases where it's not that you >> can't hoist things outside of loops, it's that you have to read things >> exactly *once*, and then use that particular value (ie the compiler >> can't be allowed to relo

RE: Memory corruption due to word sharing

2012-02-01 Thread Boehm, Hans
> From: Torvald Riegel > > Oh, one of my favorite (NOT!) pieces of code in the kernel is the > > implementation of the > > > >smp_read_barrier_depends() > > > > macro, which on every single architecture except for one (alpha) is a > no-op. > > > > We have basically 30 or so empty definitions fo

Re: Memory corruption due to word sharing

2012-02-01 Thread Linus Torvalds
On Wed, Feb 1, 2012 at 1:25 PM, Boehm, Hans wrote: > > Here are some more interesting ones that illustrate the issues (all > declarations are non-local, unless stated otherwise): > > struct { char a; int b:9; int c:7; char d} x; > > Is x.b = 1 allowed to overwrite x.a?  C11 says no, essentially r

Re: Memory corruption due to word sharing

2012-02-01 Thread Paul E. McKenney
On Wed, Feb 01, 2012 at 12:59:24PM -0800, Linus Torvalds wrote: > On Wed, Feb 1, 2012 at 12:41 PM, Torvald Riegel wrote: > > > > You do rely on the compiler to do common transformations I suppose: > > hoist loads out of loops, CSE, etc.  How do you expect the compiler to > > know whether they are

Re: Memory corruption due to word sharing

2012-02-01 Thread Linus Torvalds
On Wed, Feb 1, 2012 at 2:45 PM, Paul E. McKenney wrote: > > My (perhaps forlorn and naive) hope is that C++11 memory_order_relaxed > will eventually allow ACCESS_ONCE() to be upgraded so that (for example) > access-once increments can generate a single increment-memory instruction > on x86. I don

Re: Access to source code from an analyser

2012-02-01 Thread Diego Novillo
On 12-01-19 05:06 , Alberto Lozano Alelu wrote: I need to have source text For that, you will need to read the file or get the line from libcpp's buffers. Accessing libcpp's buffer will not be trivial, since they are in libcpp's private structures. You're better off opening the file and r