r21707: Finally merge my (long-living) perlselftest branch.
commita6e6dc7f1195c73dd43be90e5c51fe61e21523ff
authorJelmer Vernooij <jelmer@samba.org>
Mon, 5 Mar 2007 21:28:55 +0000 (5 21:28 +0000)
committerJelmer Vernooij <jelmer@samba.org>
Mon, 5 Mar 2007 21:28:55 +0000 (5 21:28 +0000)
tree138f73c8ea5b974bfb650e79de2a68c5ffbc2186
parent2437b04d11d45c68711fc8f559fab210d46e16c7
r21707: Finally merge my (long-living) perlselftest branch.

This changes the main selftest code to be in perl rather than in shell script.

The selftest script is now no longer a black box but a regular executable that takes
--help.

This adds the following features:

 * "make test TESTS=foo" will run only the tests that match the regex "foo"
 * ability to deal with expected failures. the suite will not warn about tests
   that fail and are known to fail, but will warn about other failing tests and
   tests that are succeeding tests but incorrectly marked as failing.
 * ability to print a summary with all failures at the end of the run

It also opens up the way to the following features, which I hope to implement later:
 * "environments", for example having a complete domains with DCs and domain members
 in a testenvironment
 * only set up smbd if necessary (not when running LOCAL tests, for example)
 * different mktestsetup scripts per target. except for the mktestsetup script, we can
   use the same infrastructure for samba 3 or windows.
26 files changed:
source/build/smb_build/makefile.pm
source/lib/socket_wrapper/config.m4
source/main.mk
source/samba4-knownfail
source/script/tests/Samba4.pm [new file with mode: 0644]
source/script/tests/SocketWrapper.pm [new file with mode: 0644]
source/script/tests/mk-fedora-ds.sh [changed mode: 0644->0755]
source/script/tests/mk-keyblobs.sh [changed mode: 0644->0755]
source/script/tests/mk-openldap.sh [changed mode: 0644->0755]
source/script/tests/mktestsetup.sh.share_ldb [changed mode: 0644->0755]
source/script/tests/selftest.pl
source/script/tests/selftest.sh [deleted file]
source/script/tests/test_ejs.sh
source/script/tests/test_ldap.sh
source/script/tests/test_nbt.sh
source/script/tests/testenv.pl [new file with mode: 0755]
source/script/tests/tests_net.sh [deleted file]
source/script/tests/tests_quick.sh
source/script/tests/tests_xterm.sh [changed mode: 0644->0755]
source/torture/basic/delaywrite.c
source/torture/raw/oplock.c
source/torture/smbtorture.c
source/torture/torture.c
source/torture/ui.c
source/torture/ui.h
testprogs/blackbox/test_ldb.sh