IBM: can someone check to see if this is a compiler error?

> On Apr 28, 2017, at 5:09 PM, Prentice Bisbal <pbis...@pppl.gov> wrote:
> 
> Update: removing the -fast switch caused this error to go away.
> 
> Prentice
> 
> On 04/27/2017 06:00 PM, Prentice Bisbal wrote:
>> I'm building Open MPI 2.1.0 with PGI 17.3, and now I'm getting 'illegal 
>> instruction' errors during 'make check':
>> 
>> ../../config/test-driver: line 107: 65169 Illegal instruction "$@" > 
>> $log_file 2>&1
>> FAIL: atomic_math
>>    - 1 threads: Passed
>> 
>> That's just one example of the error output. See all relevant error output 
>> below.
>> 
>> Usually, I see these errors when trying to run an executable on a processor 
>> that doesn't support the instruction set of the executable. I used to see 
>> this all the time when I supported an IBM Blue Gene/P system. I don't think 
>> I've ever seen it on an x86 system.
>> 
>> I'm passing the argument '-tp=x64' to pgcc to build a unified binary, so 
>> that might be part of the problem, but I've used this exact same process to 
>> build 2.1.0 with PGI 16.5 just a couple hours ago. I also built 1.10.3 with 
>> the same compiler flags with PGI 16.5 and 17.3 without this error.
>> 
>> Any ideas?
>> 
>> The relevant output from 'make check':
>> 
>> make  check-TESTS
>> make[3]: Entering directory `/local/pbisbal/openmpi-2.1.0/test/asm'
>> make[4]: Entering directory `/local/pbisbal/openmpi-2.1.0/test/asm'
>> basename: extra operand `--test-name'
>> Try `basename --help' for more information.
>> --> Testing
>> PASS: atomic_barrier
>>    - 1 threads: Passed
>> PASS: atomic_barrier
>>    - 2 threads: Passed
>> PASS: atomic_barrier
>>    - 4 threads: Passed
>> PASS: atomic_barrier
>>    - 5 threads: Passed
>> PASS: atomic_barrier
>>    - 8 threads: Passed
>> basename: extra operand `--test-name'
>> Try `basename --help' for more information.
>> --> Testing
>> PASS: atomic_barrier_noinline
>>    - 1 threads: Passed
>> PASS: atomic_barrier_noinline
>>    - 2 threads: Passed
>> PASS: atomic_barrier_noinline
>>    - 4 threads: Passed
>> PASS: atomic_barrier_noinline
>>    - 5 threads: Passed
>> PASS: atomic_barrier_noinline
>>    - 8 threads: Passed
>> basename: extra operand `--test-name'
>> Try `basename --help' for more information.
>> --> Testing
>> PASS: atomic_spinlock
>>    - 1 threads: Passed
>> PASS: atomic_spinlock
>>    - 2 threads: Passed
>> PASS: atomic_spinlock
>>    - 4 threads: Passed
>> PASS: atomic_spinlock
>>    - 5 threads: Passed
>> PASS: atomic_spinlock
>>    - 8 threads: Passed
>> basename: extra operand `--test-name'
>> Try `basename --help' for more information.
>> --> Testing
>> PASS: atomic_spinlock_noinline
>>    - 1 threads: Passed
>> PASS: atomic_spinlock_noinline
>>    - 2 threads: Passed
>> PASS: atomic_spinlock_noinline
>>    - 4 threads: Passed
>> PASS: atomic_spinlock_noinline
>>    - 5 threads: Passed
>> PASS: atomic_spinlock_noinline
>>    - 8 threads: Passed
>> basename: extra operand `--test-name'
>> Try `basename --help' for more information.
>> --> Testing
>> ../../config/test-driver: line 107: 65169 Illegal instruction "$@" > 
>> $log_file 2>&1
>> FAIL: atomic_math
>>    - 1 threads: Passed
>> ../../config/test-driver: line 107: 65172 Illegal instruction "$@" > 
>> $log_file 2>&1
>> FAIL: atomic_math
>>    - 2 threads: Passed
>> ../../config/test-driver: line 107: 65176 Illegal instruction "$@" > 
>> $log_file 2>&1
>> FAIL: atomic_math
>>    - 4 threads: Passed
>> ../../config/test-driver: line 107: 65180 Illegal instruction "$@" > 
>> $log_file 2>&1
>> FAIL: atomic_math
>>    - 5 threads: Passed
>> ../../config/test-driver: line 107: 65185 Illegal instruction "$@" > 
>> $log_file 2>&1
>> FAIL: atomic_math
>>    - 8 threads: Passed
>> basename: extra operand `--test-name'
>> Try `basename --help' for more information.
>> --> Testing
>> ../../config/test-driver: line 107: 65195 Illegal instruction "$@" > 
>> $log_file 2>&1
>> FAIL: atomic_math_noinline
>>    - 1 threads: Passed
>> ../../config/test-driver: line 107: 65198 Illegal instruction "$@" > 
>> $log_file 2>&1
>> FAIL: atomic_math_noinline
>>    - 2 threads: Passed
>> ../../config/test-driver: line 107: 65202 Illegal instruction "$@" > 
>> $log_file 2>&1
>> FAIL: atomic_math_noinline
>>    - 4 threads: Passed
>> ../../config/test-driver: line 107: 65206 Illegal instruction "$@" > 
>> $log_file 2>&1
>> FAIL: atomic_math_noinline
>>    - 5 threads: Passed
>> ../../config/test-driver: line 107: 65210 Illegal instruction "$@" > 
>> $log_file 2>&1
>> FAIL: atomic_math_noinline
>>    - 8 threads: Passed
>> basename: extra operand `--test-name'
>> Try `basename --help' for more information.
>> --> Testing
>> ../../config/test-driver: line 107: 65220 Illegal instruction "$@" > 
>> $log_file 2>&1
>> FAIL: atomic_cmpset
>>    - 1 threads: Passed
>> ../../config/test-driver: line 107: 65223 Illegal instruction "$@" > 
>> $log_file 2>&1
>> FAIL: atomic_cmpset
>>    - 2 threads: Passed
>> ../../config/test-driver: line 107: 65227 Illegal instruction "$@" > 
>> $log_file 2>&1
>> FAIL: atomic_cmpset
>>    - 4 threads: Passed
>> ../../config/test-driver: line 107: 65231 Illegal instruction "$@" > 
>> $log_file 2>&1
>> FAIL: atomic_cmpset
>>    - 5 threads: Passed
>> ../../config/test-driver: line 107: 65235 Illegal instruction "$@" > 
>> $log_file 2>&1
>> FAIL: atomic_cmpset
>>    - 8 threads: Passed
>> basename: extra operand `--test-name'
>> Try `basename --help' for more information.
>> --> Testing
>> ../../config/test-driver: line 107: 65245 Illegal instruction "$@" > 
>> $log_file 2>&1
>> FAIL: atomic_cmpset_noinline
>>    - 1 threads: Passed
>> ../../config/test-driver: line 107: 65248 Illegal instruction "$@" > 
>> $log_file 2>&1
>> FAIL: atomic_cmpset_noinline
>>    - 2 threads: Passed
>> ../../config/test-driver: line 107: 65252 Illegal instruction "$@" > 
>> $log_file 2>&1
>> FAIL: atomic_cmpset_noinline
>>    - 4 threads: Passed
>> ../../config/test-driver: line 107: 65256 Illegal instruction "$@" > 
>> $log_file 2>&1
>> FAIL: atomic_cmpset_noinline
>>    - 5 threads: Passed
>> ../../config/test-driver: line 107: 65260 Illegal instruction "$@" > 
>> $log_file 2>&1
>> FAIL: atomic_cmpset_noinline
>>    - 8 threads: Passed
>> ============================================================================ 
>> Testsuite summary for Open MPI 2.1.0
>> ============================================================================ 
>> # TOTAL: 8
>> # PASS:  4
>> # SKIP:  0
>> # XFAIL: 0
>> # FAIL:  4
>> # XPASS: 0
>> # ERROR: 0
>> ============================================================================ 
>> See test/asm/test-suite.log
>> Please report to http://www.open-mpi.org/community/help/
>> ============================================================================ 
>> make[4]: *** [test-suite.log] Error 1
>> make[4]: Leaving directory `/local/pbisbal/openmpi-2.1.0/test/asm'
>> make[3]: *** [check-TESTS] Error 2
>> make[3]: Leaving directory `/local/pbisbal/openmpi-2.1.0/test/asm'
>> make[2]: *** [check-am] Error 2
>> make[2]: Leaving directory `/local/pbisbal/openmpi-2.1.0/test/asm'
>> make[1]: *** [check-recursive] Error 1
>> make[1]: Leaving directory `/local/pbisbal/openmpi-2.1.0/test'
>> make: *** [check-recursive] Error 1
>> 
>> 
>> The contents of test/asm/test-suite.log:
>> 
>> $ cat test/asm/test-suite.log
>> =============================================
>>   Open MPI 2.1.0: test/asm/test-suite.log
>> =============================================
>> 
>> # TOTAL: 8
>> # PASS:  4
>> # SKIP:  0
>> # XFAIL: 0
>> # FAIL:  4
>> # XPASS: 0
>> # ERROR: 0
>> 
>> .. contents:: :depth: 2
>> 
>> FAIL: atomic_math
>> =================
>> 
>> FAIL atomic_math (exit status: 132)
>> 
>> FAIL: atomic_math_noinline
>> ==========================
>> 
>> FAIL atomic_math_noinline (exit status: 132)
>> 
>> FAIL: atomic_cmpset
>> ===================
>> 
>> FAIL atomic_cmpset (exit status: 132)
>> 
>> FAIL: atomic_cmpset_noinline
>> ============================
>> 
>> FAIL atomic_cmpset_noinline (exit status: 132)
>> 
>> 
>> And my configure command:
>> 
>> ./configure \
>>  --prefix=/usr/pppl/pgi/17.3-pkgs/openmpi-2.1.0 \
>>  --disable-silent-rules \
>>  --enable-mpi-fortran \
>>  --enable-mpi-cxx \
>>  --enable-shared \
>>  --enable-static \
>>  --enable-mpi-thread-multiple \
>>  --with-cuda=/usr/pppl/cuda/cudatoolkit/6.5.14 \
>>  --with-pmix \
>>  --with-verbs \
>>  --with-hwloc \
>>  --with-pmi=/usr/pppl/slurm/15.08.8 \
>>  --with-slurm \
>>  --with-psm \
>>  CPP=cpp \
>>  CC=pgcc \
>>  CFLAGS="-fpic -tp=x64 -fast" \
>>  CXX=pgc++ \
>>  CXXFLAGS="-fpic -tp=x64 -fast" \
>>  FC=pgfortran \
>>  FCFLAGS="-fpic -tp=x64 -fast" \
>>  2>&1 | tee configure.log
>> 
> 
> _______________________________________________
> users mailing list
> users@lists.open-mpi.org
> https://rfd.newmexicoconsortium.org/mailman/listinfo/users


-- 
Jeff Squyres
jsquy...@cisco.com

_______________________________________________
users mailing list
users@lists.open-mpi.org
https://rfd.newmexicoconsortium.org/mailman/listinfo/users

Reply via email to