X-Git-Url: https://git.exim.org/users/jgh/exim.git/blobdiff_plain/1a2a87afff0f4e2bf8650fcb89166c5d7859e79a..762ca6f356174af684898457987e31a470a3a903:/test/README diff --git a/test/README b/test/README index bca4def7d..7e778eee7 100644 --- a/test/README +++ b/test/README @@ -237,6 +237,11 @@ is as follows: There are some options for the ./runtest script itself: + -CONTINUE This will allow the script to move past some failing tests. It will + write a simple failure line with the test number in a temporary + logfile test/failed-summary.log. Unexpected exit codes will still + stall the test execution and require interaction. + -DEBUG This option is for debugging the test script. It causes some tracing information to be output. @@ -421,6 +426,37 @@ OTHER ISSUES . Test 0142 tests open file descriptors; on some hosts the output may vary. +. Some tests may fail, for example 0022, because it says it uses cached data + when the expected output thinks it should not be in cache. Item #5 in the + Requirements section has: + "Exim must be built with its user and group specified at build time" + This means that you cannot use the "ref:username" in your Local/Makefile + when building the exim binary, in any of the following fields: + EXIM_USER EXIM_GROUP CONFIGURE_OWNER CONFIGURE_GROUP + +. If the runtest script warns that the hostname is not a Fully Qualified + Domain Name (FQDN), expect that some tests will fail, for example 0036, + with an extra log line saying the hostname doesn't resolve. You must use a + FQDN for the hostname for proper test functionality. + +. If you change your hostname to a FQDN, you must delete the test/dnszones + subdirectory. When you next run the runtest script, it will rebuild the + content to use the new hostname. + +. If your hostname has an uppercase characters in it, expect that some tests + will fail, for example, 0036, because some log lines will have the hostname + in all lowercase. The regex which extracts the hostname from the log lines + will not match the lowercased version. + +. Some tests may fail, for example 0015, with a cryptic error message: + Server return code 99 + Due to security concerns, some specific files MUST have the group write bit + off. For the purposes of the test suite, some test/aux-fixed/* files MUST + have the group write bit off, so it's easier to just remove the group write + bit for all of them. If your umask is set to 002, the group write bit will + be on by default and you'll see this problem, so make sure your umask is + 022 and re-checkout the test/ subdirectory. + OTHER SCRIPTS AND PROGRAMS -------------------------- @@ -688,6 +724,12 @@ This command causes the script to sleep for m milliseconds. Nothing is output to the screen. + munge + +This command requests custom munging of the test outputs. The munge names +used are coded in the runtest script. + + need_ipv4 This command must be at the head of a script. If no IPv4 interface has been