I just constructed a test case to checkout how automake works and got the errors below. The tests worked correctly in that and fail is a FAIL, a skip a SKIP etc., so superficially there doesn't seem to be anything wrong.
As another (2) issues:
1: There seems be a lot of chatter when "make check" is executed. Any way of
reducing the unnecessary output?
2: There is no summary output except for the number of tests succeeded and
failed:
====================
2 of 3 tests failed
(1 test was not run)
====================
In parallel testing there is a (small) litany of summary data (PASS,
FAIL, XFAIL, XPASS, HARD, SKIP). Is this truncated output expected?
configure: WARNING: 'missing' script is too old or missing
make[2]: *** [check-TESTS] Error 1
make[1]: *** [check-am] Error 2
make: *** [check-recursive] Error 1
======================== configure.ac =======================
## -*- Autoconf -*-
## Process this file with autoconf to produce a configure script.
AC_PREREQ([2.69])
AC_INIT([test], [0.5],, test)
#AC_CONFIG_SRCDIR([src/main.cpp])
AC_CONFIG_HEADERS([config.h])
AC_REVISION([$Revision: 0.1 $])
AC_COPYRIGHT([GPL])
AC_SUBST([PACKAGE_COPYRIGHT_YEAR], [2014])
AC_DEFINE_UNQUOTED([PACKAGE_COPYRIGHT_YEAR], [$PACKAGE_COPYRIGHT_YEAR],
[The copyright year for this package])auto
# Checks for programs.
AC_PROG_CXX
AC_PROG_RANLIB
# Checks for header files.
AC_CHECK_HEADERS([stdlib.h])
AC_CONFIG_FILES([Makefile
src/Makefile])
# TAP test insertions
#AC_CONFIG_AUX_DIR([build-aux])
#AC_REQUIRE_AUX_FILE([tap-driver.sh])
#AC_PROG_AWK
# automake macro's - REQUIRED
AM_INIT_AUTOMAKE([foreign -Wall -Werror dist-xz])
AC_OUTPUT
======================= src/Makfile.am =======================
## Process this file with automake to produce Makefile.in
# select testing format
AUTOMAKE_OPTIONS = serial-tests
# Testing SLIP
check_SCRIPTS = test1.sh test2.sh test3.sh test4.sh
TESTS = $(check_SCRIPTS)
test1.sh:
echo '#!/bin/bash' > test1.sh
echo "echo 'PASS: 0'" >> test1.sh
echo "exit 0" >> test1.sh
test2.sh:
echo '#!/bin/bash' > test2.sh
echo "echo 'FAIL: 2'" >> test2.sh
echo "exit 2" >> test2.sh
test3.sh:
echo '#!/bin/bash' > test3.sh
echo "echo 'SKIP: 77'" >> test3.sh
echo "exit 77" >> test3.sh
test4.sh:
echo '#!/bin/bash' > test4.sh
echo "echo 'HARD: 99'" >> test4.sh
echo "exit 99 " >> test4.sh
chmod +x test1.sh test2.sh test3.sh test4.sh
CLEANFILES = $(test_SOURCES)
The failure of the past is the challenge of the present and the success of
the future.
testcase
Description: Binary data
