1 2009-06-14 Paul Smith <psmith@gnu.org>
3 * scripts/features/vpath: Verify we don't get bogus circular
4 dependency warnings if we choose a different file via vpath during
5 update. Savannah bug #13529.
7 2009-06-13 Paul Smith <psmith@gnu.org>
9 * scripts/variables/MAKEFILES: Verify that MAKEFILES included
10 files (and files included by them) don't set the default goal.
13 * scripts/functions/wildcard: Test that wildcards with
14 non-existent glob matchers return empty.
16 2009-06-09 Paul Smith <psmith@gnu.org>
18 * scripts/options/dash-B: Test the $? works correctly with -B.
21 * scripts/features/patternrules: Test that dependencies of
22 "also_make" targets are created properly. Savannah bug #19108.
24 * test_driver.pl (compare_output): Create a "run" file for failed
25 tests containing the command that was run.
26 (get_runfile): New function.
28 * run_make_tests.pl (valid_option): Enhanced support for valgrind:
29 allow memcheck and massif tools.
31 * scripts/features/patternrules: Have to comment out a line in the
32 first test due to backing out a change that broke the implicit
33 rule search algorithm. Savannah bug #17752.
34 * scripts/misc/general4: Remove a test that is redundant with
37 * scripts/features/parallelism: Add a test for re-exec with
38 jobserver master override. Savannah bug #18124.
40 2009-06-08 Paul Smith <psmith@gnu.org>
42 * scripts/features/targetvars: Add a test for continued target
43 vars after a semicolon. Savannah bug #17521.
45 2009-06-07 Paul Smith <psmith@gnu.org>
47 * scripts/features/se_explicit: Make sure we catch defining
48 prereqs during snap_deps(). Savannah bug #24622.
50 * scripts/variables/automatic: Check prereq ordering when the
51 target with the recipe has no prereqs. Savannah bug #21198.
53 * scripts/variables/LIBPATTERNS: Add a new set of test for
54 $(.LIBPATTERNS) (previously untested!)
56 2009-06-04 Paul Smith <psmith@gnu.org>
58 * scripts/variables/SHELL: The export target-specific SHELL test
59 has an incorrect known-good-value.
61 * scripts/misc/general4: Check for whitespace (ffeed, vtab, etc.)
63 * scripts/features/se_explicit: Add tests for Savannah bug #24588.
65 2009-05-31 Paul Smith <psmith@gnu.org>
67 * scripts/variables/DEFAULT_GOAL: Add tests for Savannah bug #25697.
69 * scripts/features/targetvars: Add tests of overrides for Savannah
71 * scripts/features/patspecific_vars: Ditto.
73 * scripts/features/patternrules: Add a test for Savannah bug #26593.
75 2009-05-30 Paul Smith <psmith@gnu.org>
77 * scripts/variables/flavors: Update with new variable flavor tests.
78 * scripts/variables/define: Create a new set of tests for
79 define/endef and move those aspects of the flavors suite here.
81 2009-05-25 Paul Smith <psmith@gnu.org>
83 * scripts/features/targetvars: Ditto.
85 * scripts/features/export: Test new variable parsing abilities.
87 2009-02-23 Ramon Garcia <ramon.garcia.f@gmail.com>
89 * scripts/variables/private: Create a new suite of tests for 'private'.
91 2007-11-04 Paul Smith <psmith@gnu.org>
93 * scripts/functions/eval: Update error message for command -> recipe.
95 * test_driver.pl (compare_output): Allow the answer to be a regex,
97 * scripts/misc/close_stdout: Use a regex for the answer, since
98 sometimes the error will have a description and sometimes it won't.
100 2007-09-10 Paul Smith <psmith@gnu.org>
102 * scripts/variables/special: Add tests for .RECIPEPREFIX variable.
104 2007-08-15 Paul Smith <psmith@gnu.org>
106 These test cases were contributed by
107 Icarus Sparry <savannah@icarus.freeuk.com> and J. David Bryan for
108 Savannah bugs #3330 and #15919.
110 * scripts/targets/SECONDARY: Add tests for Savannah bugs 3330 and
113 * scripts/features/parallelism: Add tests for wrong answer/hang
114 combining INTERMEDIATE, order-only prereqs, and parallelism.
115 See Savannah bugs 3330 and 15919.
117 2007-07-13 Paul Smith <psmith@gnu.org>
119 Install a timeout so tests can never loop infinitely.
120 Original idea and patch for a single-test version provided by
121 Icarus Sparry <savannah@icarus.freeuk.com>
123 * test_driver.pl (_run_command): New function: this is called by
124 other functions to actually run a command. Before we run it,
125 install a SIGALRM handler and set up a timer to go off in the
126 future (default is 5s; this can be overridden by individual tests).
127 (run_command): Call it.
128 (run_command_with_output): Call it.
130 * run_make_tests.pl (run_make_with_options): Override the default
131 timeout if the caller requests it.
132 (run_make_test): Pass any timeout override to run_make_with_options.
134 * scripts/features/parallelism: Increase the timeout for long tests.
135 * scripts/options/dash-l: Ditto.
137 2006-10-01 Paul Smith <psmith@paulandlesley.org>
139 * run_make_tests.pl (set_more_defaults): Remove setting of LANG in
140 ENV here. This doesn't always work.
141 * test_driver.pl (toplevel): Set LC_ALL to 'C' in the make
142 environment. Fixes Savannah bug #16698.
144 2006-09-30 Paul Smith <psmith@paulandlesley.org>
146 * scripts/variables/automatic: Add back the test for bug #8154.
148 2006-04-01 Paul D. Smith <psmith@gnu.org>
150 * scripts/functions/realpath: Don't run tests with multiple
151 initial slashes on Windows: those paths mean something different.
153 2006-03-19 Paul D. Smith <psmith@gnu.org>
155 * scripts/features/parallelism: Test that the jobserver is
156 properly managed when we have to re-exec the master instance of
159 2006-03-17 Boris Kolpackov <boris@kolpackov.net>
161 * scripts/features/statipattrules: Add tests for bug #16053.
163 2006-03-09 Paul Smith <psmith@gnu.org>
165 * scripts/features/escape: Use "pre:" not "p:" to avoid conflicts
166 with DOS drive letters. Fixes Savannah bug #15947.
168 * test_driver.pl (run_each_test): Set the status properly even
169 when a test fails to execute. Fixes Savannah bug #15942.
171 * scripts/functions/foreach: Use a different environment variable
172 other than PATH to avoid differences with Windows platforms.
173 Fixes Savannah bug #15938.
175 2006-03-05 Paul D. Smith <psmith@gnu.org>
177 * run_make_tests.pl (set_more_defaults): Add CYGWIN_NT as a port
178 type W32. Fixed Savannah bug #15937.
180 * scripts/features/default_names: Don't call error() when the test
181 fails. Fixes Savannah bug #15941.
183 2006-02-17 Paul D. Smith <psmith@gnu.org>
185 * scripts/features/targetvars: Test a complex construction which
186 guarantees that we have to merge variable lists of different
187 sizes. Tests for Savannah bug #15757.
189 2006-02-15 Paul D. Smith <psmith@gnu.org>
191 * scripts/functions/error: Make sure filename/lineno information
192 is related to where the error is expanded, not where it's set.
193 * scripts/functions/warning: Ditto.
194 * scripts/functions/foreach: Check for different error conditions.
195 * scripts/functions/word: Ditto.
196 * scripts/variables/negative: Test some variable reference failure
198 * scripts/options/warn-undefined-variables: Test the
199 --warn-undefined-variables flag.
201 2006-02-09 Paul D. Smith <psmith@gnu.org>
203 * run_make_tests.pl (set_more_defaults): Update valgrind support
205 * test_driver.pl (toplevel): Skip all hidden files/directories (ones
208 * scripts/functions/andor: Tests for $(and ..) and $(or ...)
211 2006-02-08 Boris Kolpackov <boris@kolpackov.net>
213 * scripts/features/parallelism: Add a test for bug #15641.
215 2006-02-06 Paul D. Smith <psmith@gnu.org>
217 * scripts/options/dash-W: Add a test for bug #15341.
219 2006-01-03 Paul D. Smith <psmith@gnu.org>
221 * scripts/variables/automatic: Add a test for bug #8154.
223 * README: Update to reflect the current state of the test suite.
225 2005-12-12 Paul D. Smith <psmith@gnu.org>
227 * scripts/features/parallelism, scripts/functions/wildcard,
228 scripts/targets/FORCE, scripts/targets/PHONY,
229 scripts/targets/SILENT: Use the default setting for
230 $delete_command. Fixes bug #15085.
232 * run_make_tests.pl (get_this_pwd) [VMS]: Use -no_ask with delete_file.
234 2005-12-11 Paul D. Smith <psmith@gnu.org>
236 * scripts/misc/general4: Test implicit rules with '$' in the
237 prereq list & prereq patterns.
238 * scripts/features/se_implicit: Add in .SECONDEXPANSION settings.
240 2005-12-09 Boris Kolpackov <boris@kolpackov.net>
242 * scripts/features/patternrules: Add a test for bug #13022.
244 2005-12-07 Boris Kolpackov <boris@kolpackov.net>
246 * scripts/features/double_colon: Add a test for bug #14334.
248 2005-11-17 Boris Kolpackov <boris@kolpackov.net>
250 * scripts/functions/flavor: Add a test for the flavor function.
252 2005-11-14 Boris Kolpackov <boris@kolpackov.net>
254 * scripts/variables/INCLUDE_DIRS: Add a test for the .INCLUDE_DIRS
257 2005-10-24 Paul D. Smith <psmith@gnu.org>
259 * scripts/misc/general4: Test '$$' in prerequisites list.
260 * scripts/features/statipattrules: Rewrite to use run_make_test().
261 Add various static pattern info.
262 * scripts/features/se_statpat: Enable .SECONDEXPANSION target.
263 * scripts/features/se_explicit: Add tests for handling '$$' in
264 prerequisite lists with and without setting .SECONDEXPANSION.
265 * scripts/features/order_only: Convert to run_make_test().
266 * run_make_tests.pl (set_more_defaults): If we can't get the value
267 of $(MAKE) from make, then fatal immediately.
269 2005-08-31 Paul D. Smith <psmith@gnu.org>
271 * run_make_tests.pl (get_this_pwd): Require the POSIX module (in
272 an eval to trap errors) and if it exists, use POSIX::getcwd to
273 find the working directory. If it doesn't exist, go back to the
274 previous methods. This tries to be more accurate on Windows
277 2005-08-29 Paul D. Smith <psmith@gnu.org>
279 * scripts/functions/abspath: Add some text to the error messages
280 to get a better idea of what's wrong. Make warnings instead of
283 * scripts/features/patspecific_vars: Don't use "test", which is
284 UNIX specific. Print the values and let the test script match
287 2005-08-25 Paul Smith <psmith@gnu.org>
289 * scripts/variables/SHELL: Use a /./ prefix instead of //: the
290 former works better with non-UNIX environments. Fixes Savannah
293 2005-08-13 Boris Kolpackov <boris@kolpackov.net>
295 * scripts/functions/wildcard: Wrap calls to $(wildcard ) with
296 $(sort) so that the resulting order is no longer filesystem-
299 2005-08-10 Boris Kolpackov <boris@kolpackov.net>
301 * scripts/features/statipattrules: Add a test for Savannah bug #13881.
303 2005-08-07 Paul D. Smith <psmith@gnu.org>
305 * scripts/features/parallelism: Add a test for a bug reported by
306 Michael Matz (matz@suse.de) in which make exits without waiting
307 for all its children in some situations during parallel builds.
309 2005-07-08 Paul D. Smith <psmith@gnu.org>
311 * test_driver.pl: Reset the environment to a clean value every
312 time before we invoke make. I'm suspicious that the environment
313 isn't handled the same way in Windows as it is in UNIX, and some
314 variables are leaking out beyond the tests they are intended for.
315 Create an %extraENV hash tests can set to add more env. vars.
316 * tests/scripts/features/export: Change to use %extraENV.
317 * tests/scripts/functions/eval: Ditto.
318 * tests/scripts/functions/origin: Ditto.
319 * tests/scripts/options/dash-e: Ditto.
320 * tests/scripts/variables/SHELL: Ditto.
322 2005-06-27 Paul D. Smith <psmith@gnu.org>
324 * scripts/options/dash-W: Use 'echo >>' instead of touch to update
326 * scripts/features/reinvoke: Rewrite to be safer on systems with
327 subsecond timestamps.
328 * scripts/features/patternrules: False exits with different error
329 codes on different systems (for example, Linux => 1, Solaris => 255).
331 * scripts/options/dash-W: Set the timestamp to foo.x in the future,
332 to be sure it will be considered updated when it's remade.
334 2005-06-26 Paul D. Smith <psmith@gnu.org>
336 * scripts/functions/shell: New test suite for the shell function.
338 2005-06-25 Paul D. Smith <psmith@gnu.org>
340 * scripts/features/include: Test include/-include/sinclude with no
341 arguments. Tests fix for Savannah bug #1761.
343 * scripts/misc/general3: Implement comprehensive testing of
344 backslash-newline behavior in command scripts: various types of
345 quoting, fast path / slow path, etc.
346 Tests fix for Savannah bug #1332.
348 * scripts/options/symlinks: Test symlinks to non-existent files.
349 Tests fix for Savannah bug #13280.
351 * scripts/misc/general3: Test semicolons in variable references.
352 Tests fix for Savannah bug #1454.
354 * scripts/variables/MAKE_RESTARTS: New file: test the
355 MAKE_RESTARTS variable.
356 * scripts/options/dash-B: Test re-exec doesn't loop infinitely.
357 Tests fix for Savannah bug #7566.
358 * scripts/options/dash-W: New file: test the -W flag, including
359 re-exec infinite looping.
361 2005-06-12 Paul D. Smith <psmith@gnu.org>
363 * scripts/misc/close_stdout: Add a test for Savannah bug #1328.
364 This test only works on systems that have /dev/full (e.g., Linux).
366 2005-06-09 Paul D. Smith <psmith@gnu.org>
368 * scripts/functions/foreach: Add a test for Savannah bug #11913.
370 2005-05-31 Boris Kolpackov <boris@kolpackov.net>
372 * scripts/features/include: Add a test for Savannah bug #13216.
373 * scripts/features/patternrules: Add a test for Savannah bug #13218.
375 2005-05-13 Paul D. Smith <psmith@gnu.org>
377 * scripts/features/conditionals: Add tests for the new if... else
380 2005-05-03 Paul D. Smith <psmith@gnu.org>
382 * scripts/variables/DEFAULT_GOAL: Rename DEFAULT_TARGET to
385 2005-05-02 Paul D. Smith <psmith@gnu.org>
387 * scripts/features/parallelism: Add a test for exporting recursive
388 variables containing $(shell ) calls. Rewrite this script to use
389 run_make_test() everywhere.
391 2005-04-07 Paul D. Smith <psmith@gnu.org>
393 * scripts/targets/SECONDARY: Add a test for Savannah bug #12331.
395 2005-03-15 Boris Kolpackov <boris@kolpackov.net>
397 * scripts/variables/automatic: Add a test for Savannah bug #12320.
399 2005-03-10 Boris Kolpackov <boris@kolpackov.net>
401 * scripts/features/patternrules: Add a test for Savannah bug #12267.
403 2005-03-09 Boris Kolpackov <boris@kolpackov.net>
405 * scripts/variables/DEFAULT_TARGET: Add a test for Savannah
408 2005-03-04 Boris Kolpackov <boris@kolpackov.net>
410 * scripts/features/patternrules: Add a test for Savannah bug #12202.
412 2005-03-03 Boris Kolpackov <boris@kolpackov.net>
414 * scripts/features/se_implicit: Add a test for stem
415 termination bug. Add a test for stem triple-expansion bug.
417 * scripts/features/se_statpat: Add a test for stem
418 triple-expansion bug.
420 * scripts/features/statipattrules: Change test #4 to reflect
421 new way empty prerequisite list is handled.
424 2005-03-01 Boris Kolpackov <boris@kolpackov.net>
426 * scripts/features/statipattrules: Add a test for
429 2005-02-28 Paul D. Smith <psmith@gnu.org>
431 * scripts/options/dash-q: Add a test for Savannah bug # 7144.
433 * scripts/options/symlinks: New file to test checking of symlink
434 timestamps. Can't use filename dash-L because it conflicts with
435 dash-l on case-insensitive filesystems.
437 * scripts/variables/MAKEFILE_LIST, scripts/variables/MFILE_LIST:
438 Rename MAKEFILE_LIST test to MFILE_LIST, for systems that need 8.3
441 2005-02-28 Boris Kolpackov <boris@kolpackov.net>
443 * scripts/variables/DEFAULT_TARGET: Test the .DEFAULT_TARGET
446 2005-02-27 Boris Kolpackov <boris@kolpackov.net>
448 * scripts/features/se_explicit: Test the second expansion in
450 * scripts/features/se_implicit: Test the second expansion in
452 * scripts/features/se_statpat: Test the second expansion in
453 static pattern rules.
454 * scripts/variables/automatic: Fix to work with the second
457 * scripts/misc/general4: Add a test for bug #12091.
459 2005-02-27 Paul D. Smith <psmith@gnu.org>
461 * scripts/functions/eval: Check that eval of targets within
462 command scripts fails. See Savannah bug # 12124.
464 2005-02-26 Paul D. Smith <psmith@gnu.org>
466 * test_driver.pl (compare_output): If a basic comparison of the
467 log and answer doesn't match, try harder: change all backslashes
468 to slashes and all CRLF to LF. This helps on DOS/Windows systems.
470 2005-02-09 Paul D. Smith <psmith@gnu.org>
472 * scripts/features/recursion: Test command line variable settings:
473 only one instance of a given variable should be provided.
475 2004-11-30 Boris Kolpackov <boris@kolpackov.net>
477 * tests/scripts/functions/abspath: New file: test `abspath'
480 * tests/scripts/functions/realpath: New file: test `realpath'
483 2004-11-28 Paul D. Smith <psmith@gnu.org>
485 * scripts/options/dash-C [WINDOWS32]: Add a test for bug #10252;
486 this doesn't really test anything useful in UNIX but...
488 * scripts/variables/SHELL: New file: test proper handling of SHELL
489 according to POSIX rules. Fixes bug #1276.
491 2004-10-21 Boris Kolpackov <boris@kolpackov.net>
493 * scripts/functions/word: Test $(firstword ) and $(lastword ).
495 2004-10-05 Boris Kolpackov <boris@kolpackov.net>
497 * scripts/features/patspecific_vars: Test simple/recursive
500 2004-09-28 Boris Kolpackov <boris@kolpackov.net>
502 * scripts/features/include: Test dontcare flag inheritance
503 when rebuilding makefiles.
505 2004-09-27 Boris Kolpackov <boris@kolpackov.net>
507 * scripts/features/patspecific_vars: Test exported variables.
509 2004-09-22 Paul D. Smith <psmith@gnu.org>
511 * run_make_tests.pl (run_make_test): Don't add newlines to the
512 makestring or answer if they are completely empty.
514 * scripts/features/patternrules: Rename from implicit_prereq_eval.
516 * scripts/test_template: Rework the template.
518 2004-09-21 Boris Kolpackov <boris@kolpackov.net>
520 * run_make_tests.pl: Change `#!/usr/local/bin/perl' to be
521 `#!/usr/bin/env perl'.
523 * scripts/features/implicit_prereq_eval: Test implicit rule
524 prerequisite evaluation code.
526 2004-09-21 Paul D. Smith <psmith@gnu.org>
528 * run_make_tests.pl (run_make_test): Enhance to allow the make
529 string to be undef: in that case it reuses the previous make
530 string. Allows multiple tests on the same makefile.
532 * scripts/variables/flavors: Add some tests for prefix characters
533 interacting with define/endef variables.
535 2004-09-20 Paul D. Smith <psmith@gnu.org>
537 * scripts/functions/substitution: Rewrite to use run_make_test()
538 interface, and add test for substitution failures reported by
539 Markus Mauhart <qwe123@chello.at>.
541 2004-03-22 Paul D. Smith <psmith@gnu.org>
543 * test_driver.pl (run_each_test, toplevel, compare_output): Change
544 to track both the testing categories _AND_ the number of
545 individual tests, and report both sets of numbers.
547 2004-02-21 Paul D. Smith <psmith@gnu.org>
549 * scripts/functions/origin: Set our own environment variable
550 rather than relying on $HOME.
552 2004-01-21 Paul D. Smith <psmith@gnu.org>
554 * scripts/features/conditionals: Test arguments to ifn?def which
555 contain whitespace (such as a function that is evaluated). Bug
558 2004-01-07 Paul D. Smith <psmith@gnu.org>
560 * scripts/features/order_only: Test order-only prerequisites in
561 pattern rules (patch #2349).
563 2003-11-02 Paul D. Smith <psmith@gnu.org>
565 * scripts/functions/if: Test if on conditionals with trailing
566 whitespace--bug #5798.
568 * scripts/functions/eval: Test eval in a non-file context--bug #6195.
570 2003-04-19 Paul D. Smith <psmith@gnu.org>
572 * scripts/features/patspecific_vars: Test multiple patterns
573 matching the same target--Bug #1405.
575 2003-04-09 Paul D. Smith <psmith@gnu.org>
577 * run_make_tests.pl (set_more_defaults): A new $port_type of
578 'OS/2' for (surprise!) OS/2. Also choose a wait time of 2 seconds
581 2003-03-28 Paul D. Smith <psmith@gnu.org>
583 * scripts/targets/SECONDARY: Test the "global" .SECONDARY (with
584 not prerequisites)--Bug #2515.
586 2003-01-30 Paul D. Smith <psmith@gnu.org>
588 * scripts/features/targetvars: Test very long target-specific
589 variable definition lines (longer than the default make buffer
590 length). Tests patch # 1022.
592 * scripts/functions/eval: Test very recursive $(eval ...) calls
593 with simple variable expansion (bug #2238).
595 * scripts/functions/word: Test error handling for word and
596 wordlist functions (bug #2407).
598 2003-01-22 Paul D. Smith <psmith@gnu.org>
600 * scripts/functions/call: Test recursive argument masking (bug
603 2002-10-25 Paul D. Smith <psmith@gnu.org>
605 * scripts/functions/eval: Test using $(eval ...) inside
606 conditionals (Bug #1516).
608 2002-10-14 Paul D. Smith <psmith@gnu.org>
610 * scripts/options/dash-t: Add a test for handling -t on targets
611 with no commands (Bug #1418).
613 2002-10-13 Paul D. Smith <psmith@gnu.org>
615 * scripts/features/targetvars: Add a test for exporting
616 target-specific vars (Bug #1391).
618 2002-10-05 Paul D. Smith <psmith@gnu.org>
620 * scripts/variables/automatic: Add tests for $$(@), $${@}, $${@D},
623 2002-09-23 Paul D. Smith <psmith@gnu.org>
625 * scripts/features/escape: Test handling of escaped comment
626 characters in targets and prerequisites.
628 2002-09-18 Paul D. Smith <psmith@gnu.org>
630 * scripts/features/export: Test export/unexport of multiple
631 variables in a single command.
633 2002-09-17 Paul D. Smith <psmith@gnu.org>
635 * scripts/features/targetvars: Tests for Bug #940: test
636 target-specific and pattern-specific variables in conjunction with
637 double-colon targets.
639 2002-09-10 Paul D. Smith <psmith@gnu.org>
641 * test_driver.pl (compare_output): Match the new format for time
644 * scripts/features/export: Created. Add tests for export/unexport
645 capabilities, including exporting/unexporting expanded variables.
647 * scripts/features/conditionals: Add a test for expanded variables
648 in ifdef conditionals.
650 2002-09-04 Paul D. Smith <psmith@gnu.org>
652 * scripts/features/reinvoke: Change touch/sleep combos to utouch
654 * scripts/features/vpathgpath: Ditto.
655 * scripts/features/vpathplus: Ditto.
656 * scripts/options/dash-n: Ditto.
657 * scripts/targets/INTERMEDIATE: Ditto.
658 * scripts/targets/SECONDARY: Ditto.
660 * scripts/options/dash-t: Added a test for the -t bug fixed by
661 Henning Makholm. This test was also contributed by Henning.
663 * scripts/misc/general4: Add a test suite for obscure algorithmic
664 features of make. First test: make sure creation subdirectories
665 as prerequisites of targets works properly.
667 * scripts/misc/version: Remove this bogus test.
669 2002-08-07 Paul D. Smith <psmith@gnu.org>
671 * scripts/misc/general3: Add a test for makefiles that don't end
674 * scripts/variables/special: Create tests for the special
675 variables (.VARIABLES and .TARGETS). Comment out .TARGETS test
676 for now as it's not yet supported.
678 2002-08-01 Paul D. Smith <psmith@gnu.org>
680 * scripts/options/dash-B: Add a test for the new -B option.
682 2002-07-11 Paul D. Smith <psmith@gnu.org>
684 * run_make_tests.pl (valid_option): Add support for Valgrind. Use
685 -valgrind option to the test suite.
686 (set_more_defaults): Set up the file descriptor to capture
687 Valgrind output. We have to unset its close-on-exec flag; we
688 hardcode the value for F_SETFD (2) rather than load it; hopefully
689 this will help us avoid breaking the Windows/DOS test suite.
691 2002-07-10 Paul D. Smith <psmith@gnu.org>
693 * scripts/variables/automatic: Add some tests for $$@, $$(@D), and
696 * test_driver.pl (utouch): Create a new function that creates a
697 file with a specific timestamp offset. Use of this function will
698 let us avoid lots of annoying sleep() invocations in the tests
699 just to get proper timestamping, which will make the tests run a
700 lot faster. So far it's only used in the automatic test suite.
702 2002-07-09 Paul D. Smith <psmith@gnu.org>
704 * scripts/variables/automatic: Create a test for automatic variables.
706 2002-07-08 Paul D. Smith <psmith@gnu.org>
708 * scripts/features/order_only: Test new order-only prerequisites.
710 2002-07-07 Paul D. Smith <psmith@gnu.org>
712 * scripts/functions/eval: Test new function.
713 * scripts/functions/value: Test new function.
714 * scripts/variables/MAKEFILE_LIST: Test new variable.
716 2002-04-28 Paul D. Smith <psmith@gnu.org>
718 * scripts/functions/call: New test: transitive closure
719 implementation using $(call ...) to test variable recursion.
721 2002-04-21 Paul D. Smith <psmith@gnu.org>
723 * test_driver.pl (compare_dir_tree): Ignore CVS and RCS
724 directories in the script directories.
726 2001-05-02 Paul D. Smith <psmith@gnu.org>
728 * scripts/variables/flavors: Test define/endef scripts where only
729 one of the command lines is quiet.
731 2000-06-22 Paul D. Smith <psmith@gnu.org>
733 * scripts/options/dash-q: New file; test the -q option. Includes
736 2000-06-21 Paul D. Smith <psmith@gnu.org>
738 * scripts/features/targetvars: Added a test for PR/1709: allowing
739 semicolons in target-specific variable values.
741 2000-06-19 Paul D. Smith <psmith@gnu.org>
743 * scripts/functions/addsuffix: Test for an empty final argument.
744 Actually this bug might have happened for any function, but this
747 2000-06-17 Eli Zaretskii <eliz@is.elta.co.il>
749 * scripts/options/general: If parallel jobs are not supported,
750 expect a warning message from Make.
752 2000-06-15 Eli Zaretskii <eliz@is.elta.co.il>
754 * scripts/options/general: Don't try -jN with N != 1 if parallel
755 jobs are not supported.
757 2000-05-24 Paul D. Smith <psmith@gnu.org>
759 * scripts/options/general: Test general option processing (PR/1716).
761 2000-04-11 Paul D. Smith <psmith@gnu.org>
763 * scripts/functions/strip: Test empty value to strip (PR/1689).
765 2000-04-08 Eli Zaretskii <eliz@is.elta.co.il>
767 * scripts/features/reinvoke: Sleep before updating the target
768 files in the first test, to ensure its time stamp really gets
769 newer; otherwise Make might re-exec more than once.
771 2000-04-07 Eli Zaretskii <eliz@is.elta.co.il>
773 * scripts/features/double_colon: Don't run the parallel tests if
774 parallel jobs aren't supported.
776 2000-04-04 Paul D. Smith <psmith@gnu.org>
778 * scripts/functions/word: wordlist doesn't swap arguments anymore.
780 2000-03-27 Paul D. Smith <psmith@gnu.org>
782 * scripts/features/statipattrules: Test that static pattern rules
783 whose prerequisite patterns resolve to empty strings throw an
784 error (instead of dumping core). Fixes PR/1670.
786 * scripts/features/reinvoke: Make more robust by touching "b"
787 first, to ensure it's not newer than "a".
788 Reported by Marco Franzen <Marco.Franzen@Thyron.com>.
789 * scripts/options/dash-n: Ditto.
791 * scripts/functions/call: Whoops. The fix to PR/1527 caused
792 recursive invocations of $(call ...) to break. I can't come up
793 with any way to get both working at the same time, so I backed out
794 the fix to 1527 and added a test case for recursive calls. This
795 also tests the fix for PR/1610.
797 * scripts/features/double_colon: Test that circular dependencies
798 in double-colon rule sets are detected correctly (PR/1671).
800 2000-03-26 Paul D. Smith <psmith@gnu.org>
802 * scripts/targets/INTERMEDIATE: Test that make doesn't remove
803 .INTERMEDIATE files when given on the command line (PR/1669).
805 2000-03-08 Paul D. Smith <psmith@gnu.org>
807 * scripts/options/dash-k: Add a test for error detection by
808 multiple targets depending on the same prerequisite with -k.
811 2000-02-07 Paul D. Smith <psmith@gnu.org>
813 * scripts/features/escape: Add a test for backslash-escaped spaces
814 in a target name (PR/1586).
816 2000-02-04 Paul D. Smith <psmith@gnu.org>
818 * scripts/features/patspecific_vars: Add a test for pattern-specific
819 target variables inherited from the parent target (PR/1407).
821 2000-02-02 Paul D. Smith <psmith@gnu.org>
823 * run_make_tests.pl (set_more_defaults): Hard-code the LANG to C
824 to make sure sorting order, etc. is predictable.
825 Reported by Andreas Jaeger <aj@suse.de>.
827 * run_make_tests.pl (set_more_defaults): Set the $wtime variable
828 depending on the OS. Eli Zaretskii <eliz@is.elta.co.il> reports
829 this seems to need to be *4* on DOS/Windows, not just 2. Keep it
831 * scripts/features/vpathplus (touchfiles): Use the $wtime value
832 instead of hardcoding 2.
833 * scripts/targets/SECONDARY: Ditto.
834 * scripts/targets/INTERMEDIATE: Ditto.
836 2000-01-27 Paul D. Smith <psmith@gnu.org>
838 * test_driver.pl (toplevel): Don't try to run test scripts which
839 are really directories.
841 2000-01-23 Paul D. Smith <psmith@gnu.org>
843 * scripts/features/include: Remove a check; the fix caused more
844 problems than the error, so I removed it and removed the test for
847 2000-01-11 Paul D. Smith <psmith@gnu.org>
849 * scripts/functions/call: Add a test for PR/1517 and PR/1527: make
850 sure $(call ...) doesn't eval its arguments and that you can
851 invoke foreach from it without looping forever.
853 1999-12-15 Paul D. Smith <psmith@gnu.org>
855 * scripts/targets/INTERMEDIATE: Add a test for PR/1423: make sure
856 .INTERMEDIATE settings on files don't disable them as implicit
857 intermediate possibilities.
859 1999-12-01 Paul D. Smith <psmith@gnu.org>
861 * scripts/features/double_colon: Add a test for PR/1476: Try
862 double-colon rules as non-goal targets and during parallel builds
863 to make sure they're handled serially.
865 1999-11-17 Paul D. Smith <psmith@gnu.org>
867 * scripts/functions/if: Add a test for PR/1429: put some text
868 after an if-statement to make sure it works.
870 * scripts/features/targetvars: Add a test for PR/1380: handling +=
871 in target-specific variable definitions correctly.
873 1999-10-15 Paul D. Smith <psmith@gnu.org>
875 * scripts/variables/MAKEFILES: This was really broken: it didn't
876 test anything at all, really. Rewrote it, plus added a test for
879 1999-10-13 Paul D. Smith <psmith@gnu.org>
881 * scripts/options/dash-n: Add a test for PR/1379: "-n doesn't
882 behave properly when used with recursive targets".
884 1999-10-08 Paul D. Smith <psmith@gnu.org>
886 * scripts/features/targetvars: Add a check for PR/1378:
887 "Target-specific vars don't inherit correctly"
889 1999-09-29 Paul D. Smith <psmith@gnu.org>
891 * test_driver.pl (get_osname): Change $fancy_file_names to
892 $short_filenames and reverse the logic.
893 (run_each_test): Change test of non-existent $port_host to use
894 $short_filenames--problem reported by Eli Zaretskii.
896 1999-09-23 Paul D. Smith <psmith@gnu.org>
898 * scripts/features/parallelism: Add a check to ensure that the
899 jobserver works when we re-invoke. Also cleaned up the tests a
900 little, reducing the number of rules we use so the test won't need
901 as many "sleep" commands.
903 1999-09-16 Paul D. Smith <psmith@gnu.org>
905 * scripts/features/reinvoke: Remove invocations of "touch" in
906 makefiles. See the comments on the touch function rewrite below.
907 Note that UNIX touch behaves the same way if the file already
908 exists: it sets the time to the _local_ time. We don't want
909 this. This is probably a good tip for makefile writers in
910 general, actually... where practical.
911 * scripts/options/dash-l: Ditto.
912 * scripts/options/dash-n: Ditto.
914 * test_driver.pl (run_each_test): In retrospect, I don't like the
915 .lN/.bN/.dN postfix required by DOS. So, for non-DOS systems I
916 changed it back to use .log, .base, and .diff.
918 * run_make_tests.pl (set_more_defaults): Move the check for the
919 make pathname to here from set_defaults (that's too early since it
920 happens before the command line processing).
921 Create a new variable $port_type, calculated from $osname, to
922 specify what kind of system we're running on. We should integrate
923 the VOS stuff here, too.
924 (valid_option): Comment out the workdir/-work stuff so people
925 won't be fooled into thinking it works... someone needs to fix
928 * scripts/functions/origin: Use $port_type instead of $osname.
929 * scripts/functions/foreach: Ditto.
930 * scripts/features/default_names: Ditto.
932 1999-09-15 Paul D. Smith <psmith@gnu.org>
934 * test_driver.pl (touch): Rewrite this function. Previously it
935 used to use utime() to hard-set the time based on the current
936 local clock, or, if the file didn't exist, it merely created it.
937 This mirrors exactly what real UNIX touch does, but it fails badly
938 on networked filesystems where the FS server clock is skewed from
939 the local clock: normally modifying a file causes it to get a mod
940 time based on the _server's_ clock. Hard-setting it based on the
941 _local_ clock causes gratuitous errors and makes the tests
942 unreliable except on local filesystems. The new function will
943 simply modify the file, allowing the filesystem to set the mod
946 * scripts/features/parallelism: The second test output could
947 change depending on how fast some scripts completed; use "sleep"
948 to force the order we want.
950 * test_driver.pl (toplevel): A bug in Perl 5.000 to Perl 5.004
951 means that "%ENV = ();" doesn't do the right thing. This worked
952 in Perl 4 and was fixed in Perl 5.004_01, but use a loop to delete
953 the environment rather than require specific versions.
955 * run_make_tests.pl (set_more_defaults): Don't use Perl 5 s///
956 modifier "s", so the tests will run with Perl 4.
957 (set_more_defaults): Set $pure_log to empty if there's no -logfile
958 option in PURIFYOPTIONS.
959 (setup_for_test): Don't remove any logs unless $pure_log is set.
961 1999-09-15 Eli Zaretskii <eliz@is.elta.co.il>
963 * scripts/features/reinvoke: Put the SHELL definition in the right
966 1999-09-15 Paul D. Smith <psmith@gnu.org>
968 ChangeLog file for the test suite created.
971 Copyright (C) 1992, 1993, 1994, 1995, 1996, 1997, 1998, 1999, 2000, 2001,
972 2002, 2003, 2004, 2005, 2006, 2007 Free Software Foundation, Inc.
973 This file is part of GNU Make.
975 GNU Make is free software; you can redistribute it and/or modify it under the
976 terms of the GNU General Public License as published by the Free Software
977 Foundation; either version 3 of the License, or (at your option) any later
980 GNU Make is distributed in the hope that it will be useful, but WITHOUT ANY
981 WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR
982 A PARTICULAR PURPOSE. See the GNU General Public License for more details.
984 You should have received a copy of the GNU General Public License along with
985 this program. If not, see <http://www.gnu.org/licenses/>.