The following tries to address that the vectorizer fails to have
precise knowledge of argument and return calling conventions and
views some accesses as loads and stores that are not.
This is mainly important when doing basic-block vectorization as
otherwise loop indexing would force such arguments to memory.

On x86 the reduction in the number of apparent loads and stores
often dominates cost analysis so the following tries to mitigate
this aggressively by adjusting only the scalar load and store
cost, reducing them to the cost of a simple scalar statement,
but not touching the vector access cost which would be much
harder to estimate.  Thereby we error on the side of not performing
basic-block vectorization.

Bootstrapped and tested on x86_64-unknown-linux-gnu.

Richard - we can of course do this adjustment in the backend as well
but it might be worthwhile in generic code.  Do you see similar
issues on arm?

        PR tree-optimization/116274
        * tree-vect-slp.cc (vect_bb_slp_scalar_cost): Cost scalar loads
        and stores as simple scalar stmts when they access a non-global,
        not address-taken variable that doesn't have BLKmode assigned.

        * gcc.target/i386/pr116274.c: New testcase.
---
 gcc/testsuite/gcc.target/i386/pr116274.c |  9 +++++++++
 gcc/tree-vect-slp.cc                     | 12 +++++++++++-
 2 files changed, 20 insertions(+), 1 deletion(-)
 create mode 100644 gcc/testsuite/gcc.target/i386/pr116274.c

diff --git a/gcc/testsuite/gcc.target/i386/pr116274.c 
b/gcc/testsuite/gcc.target/i386/pr116274.c
new file mode 100644
index 00000000000..d5811344b93
--- /dev/null
+++ b/gcc/testsuite/gcc.target/i386/pr116274.c
@@ -0,0 +1,9 @@
+/* { dg-do compile } */
+/* { dg-options "-O2 -fdump-tree-slp2-optimized" } */
+
+struct a { long x,y; };
+long test(struct a a) { return a.x+a.y; }
+
+/* { dg-final { scan-tree-dump-not "basic block part vectorized" "slp2" } } */
+/* { dg-final { scan-assembler-times "addl|leaq" 1 } } */
+/* { dg-final { scan-assembler-not "padd" } } */
diff --git a/gcc/tree-vect-slp.cc b/gcc/tree-vect-slp.cc
index 3464d0c0e23..e43ff721100 100644
--- a/gcc/tree-vect-slp.cc
+++ b/gcc/tree-vect-slp.cc
@@ -7807,7 +7807,17 @@ next_lane:
       vect_cost_for_stmt kind;
       if (STMT_VINFO_DATA_REF (orig_stmt_info))
        {
-         if (DR_IS_READ (STMT_VINFO_DATA_REF (orig_stmt_info)))
+         data_reference_p dr = STMT_VINFO_DATA_REF (orig_stmt_info);
+         tree base = get_base_address (DR_REF (dr));
+         /* When the scalar access is to a non-global not address-taken
+            decl that is not BLKmode assume we can access it with a single
+            non-load/store instruction.  */
+         if (DECL_P (base)
+             && !is_global_var (base)
+             && !TREE_ADDRESSABLE (base)
+             && DECL_MODE (base) != BLKmode)
+           kind = scalar_stmt;
+         else if (DR_IS_READ (STMT_VINFO_DATA_REF (orig_stmt_info)))
            kind = scalar_load;
          else
            kind = scalar_store;
-- 
2.43.0

Reply via email to