1 GNU M4 NEWS - History of user-visible changes. -*- outline -*-
3 * Noteworthy changes in Version 1.9b (201x-??-??) [beta]
4 Released by ????, based on git version 1.9a-*
6 NOTE - there are still a number of FIXMEs to resolve before this can be
11 *** The build environment has been updated to modern GNU practices,
12 depending on newer features of Autoconf, Automake, Libtool, Gettext,
13 and Gnulib to be more portable to a wide variety of platforms.
15 ** New command line behavior
17 *** If the POSIXLY_CORRECT environment variable is set, it implies the
18 `-G' and `-Q' options, effectively giving a more fully POSIX-compliant
19 implementation with only compatible GNU extensions.
21 *** New `-b'/`--batch' command-line option to force non-interactive mode.
22 Also, in addition to `-e'/`--interactive' requesting interactive mode,
23 m4 now follows the lead of sh, and automatically enters interactive
24 mode when there are no files specified, and when both standard input
25 and standard error are terminals.
27 *** New `-B'/`--prepend-include' command-line option allows prepending to
28 the include path, rather than always searching `.' first.
30 *** New `--debuglen' command-line option matches the spelling of a new
31 macro, and the old spelling `--arglength' now issues a warning that it
32 might be withdrawn in the future.
34 *** The `-g'/`--gnu' command-line option is now required to allow all GNU
35 extensions when POSIXLY_CORRECT is set.
37 *** The `-H'/`--hashsize' command-line options, which were made no-ops in
38 a previous beta, now issue a deprecation warning.
40 *** The `-L'/`--nesting-limit' command-line option now performs argument
41 validation and accepts an optional multiplier suffix.
43 *** New `-p'/`--pushdef' and `--popdef' command-line options allow more
44 control over macro definitions from the command line between input
47 *** New `--posix' command-line option is a synonym for `-G'/`--traditional'.
49 *** New `-r'/`--regexp-syntax' command-line option changes the default
50 regular expression syntax used by M4. Without this option, M4
51 continues to use EMACS style expressions. A new section in the info
52 docs explains the differences between them, and what builtins are
55 *** New `--safer' command-line option cripples the potentially unsafe
56 builtins `debugfile', `esyscmd', `maketemp', `mkdtemp', `mkstemp', and
59 *** New `--syncoutput' command-line option matches the builtin added in a
60 previous beta, and provides more control over sync line generation
61 from the command line between input files. The previous options
62 `-s'/`--synclines' remain as aliases for `--syncoutput=1'.
64 *** New `--traceoff' command-line option, and new spelling `--traceon' for
65 `--trace', allow more control over macro tracing from the command line
68 *** New `--warnings' command-line option re-enables warnings, overriding
69 `-Q'/`--quiet'/`--silent', allowing warnings even when POSIXLY_CORRECT.
71 *** When GNU extensions are enabled, any command line arguments that wauld
72 have been interpreted as input file names with previous releases are
73 still searched for as before, but will first attempt to be loaded as
74 compiled modules before falling back on loading as m4 input. In
75 POSIXLY_CORRECT mode, only m4 input files in the current directory can
80 *** The `defn' builtin now allows any number of arguments, as POSIX requires.
81 - FIXME: This still doesn't work with concatenating builtins with text.
83 - FIXME: POSIX recommends using ${10} instead of $10 for the tenth
84 positional argument. We should deprecate $10.
88 *** The experimental `epatsubst' and `eregexp' builtins have been removed
89 in favor of a new `changeresyntax' builtin.
91 *** The `load' builtin, introduced in previous betas has been removed in
92 lieu of richer `include' and `sinclude' functionality.
96 *** New `changeresyntax' builtin allows programmatic setting of the default
97 regular expression flavor, to match `-r'/`--regexp-syntax' command-line
100 *** New `debuglen' builtin allows runtime setting of debug output length,
101 previously controlled only by the `-l' command line argument.
102 Additionally, whether using the new macro or the command line argument,
103 the length limitation now affects dumpdef output as well as trace
104 output, undergoes argument validation, and accepts an optional
106 - FIXME the multiplier suffix isn't reliable yet
108 *** New `mkdtemp' builtin parallels `mkstemp', but allows the creation of
109 temporary directories instead of files.
111 *** New `refcount' builtin allows tracking how many times a module has
113 - FIXME: consider making m4modules smarter for this purpose
115 *** New `renamesyms' builtin allows programmatic renaming of all symbols
116 according to a regular expression.
117 - FIXME: This feature can cause core dumps when renaming multiple
118 symbols to the same name.
120 *** New `__traditional__' builtin identifies when the traditional module
121 is loaded instead of the gnu module.
123 *** The `modules' and `symbols' builtins, introduced in previous betas,
124 have been renamed `m4modules' and `m4symbols', in order to minimize
125 problems when upgrading from 1.4.x and processing English text. To
126 prevent future problems, any future macro added as a GNU extension will
127 either be blind (ie. be unrecognized without arguments), or begin with
128 the prefix `m4' or `__'.
130 ** Changed behavior of builtins
132 *** The module identifier builtins, such as `__gnu__', `__m4_version__',
133 and `__unix__', now warn if given arguments.
135 *** The `builtin' builtin now has a special form, where if the first
136 argument is exactly the special token representing defn(`builtin'), the
137 expansion is the special token representing the builtin named in the
138 second argument. This allows regenerating a macro with a more
139 efficient mapping directly to a builtin function, rather than through
140 textual indirection through further expansions of `builtin'.
142 *** The `changesyntax' builtin has been improved, to make it easier to add
143 and remove characters from a syntax class without having to specify the
144 entire set of characters in that class. It also supports new syntax
145 categories, `$', `{' and `}', for extended argument handling in macro
146 definitions. See the manual for more examples.
148 *** New `m' flag to `-d'/`--debug' command-line option or `debugmode'
149 builtin traces actions related to module loading and unloading, and
150 affects `dumpdef' and trace output to show where builtins come from.
151 New `s' flag shows the entire stack of `pushdef' definitions during
152 `dumpdef'. The `c' flag has been updated to add information to the
153 first line to show the definition of the macro being expanded.
155 *** The `eval' and `mpeval' builtins now support the following new
156 operators: `>>>', `\', and `,'.
158 *** When GNU extensions are enabled, the `include' and `sinclude' builtins
159 continue to search directories one at a time, but will first attempt to
160 load arguments as compiled modules and then as m4 input before moving
161 to the next directory in the search path. In POSIXLY_CORRECT mode,
162 only m4 input in the current directory can be loaded.
164 *** The `maketemp' builtin now always warns that it is obsolete, even in GNU
165 mode where it uses the same secure algorithm as `mkstemp', because of
166 the recommendation of POSIX to obsolete `maketemp' as inherently
167 insecure when obeying POSIX.
169 *** The `m4symbols' builtin now warns if given a builtin token instead of
170 a macro name. It remains silent for undefined macros.
172 *** The `patsubst' and `regexp' builtins have a new optional 4th argument
173 to use a different regular expression syntax for the duration of that
176 *** The semantics of the `traceon' and `traceoff' builtins now match
177 traditional implementations: when called without arguments, they affect
178 global state rather than affecting only the macros defined at that
179 moment. The manual includes an example of how to recover 1.4.x
184 *** The syntax of frozen files format V2 has been improved to save
185 additional state. This includes the `R' directive for default regular
186 expression syntax, the `t' directive for traced macros, and the `d'
187 directive for debug mode. Existing directives with consecutive strings
188 now require an intermediate newline, for faster parsing. Also, a V2
189 file can now be represented completely in ASCII, thanks to escape
190 sequences. Unfortunately, files frozen by M4 1.4q cannot be read by
191 1.9b, but since 1.4q was not widely distributed, this is not expected
192 to be much of an issue, and comes with the territory of using a beta
194 - FIXME: format 2 still needs to catch more missing state; once 2.0 is
195 released, any further changes would introduce format 3.
197 *** Improvements made in the 1.4.x and 1.6 stable series have been
201 * Noteworthy changes in Version 1.6 (????-??-??) [stable]
202 Released by ????, based on git versions 1.4.10b.x-* and 1.5.*
204 ** Fix regression introduced in 1.4.4b where using `traceon' could delete
205 a macro. This was most noticeable with `traceon(`traceon')', but
206 would also happen in cases such as `foo(traceon(`foo'))'.
208 ** Fix regressions introduced in 1.4.10b:
209 *** Using `builtin' or `indir' to perform nested `shift' calls triggered
210 an assertion failure (not present in 1.4.11).
211 *** The command-line option -dV, as well as the builtin `debugmode(V)',
212 failed to enable `t' and `c' debug options (not present in 1.4.11).
213 *** Comments that contain unbalanced quotes were not rescanned correctly
214 when passed through $@ (not present in 1.4.11).
215 *** Using `defn' on a traced but undefined macro triggered an assertion
216 failure (also present in 1.4.11, but not 1.4.12).
218 ** Remove the undocumented command-line option '-N', as no one complained
219 about the assertion failure regression that it introduced in 1.4.7.
221 ** The `-o'/`--error-output' command-line options, which were replaced by
222 `--debugfile' in 1.4.7, now issue a deprecation warning. This warning
223 harmlessly triggers with versions of Autoconf 2.60 and earlier, but can
224 be silenced by applying this patch:
225 http://git.sv.gnu.org/gitweb/?p=autoconf.git;a=commitdiff;h=714eeee87
227 ** Fix the `m4wrap' builtin to accumulate wrapped text in FIFO order, as
228 required by POSIX. The manual mentions a way to restore the LIFO order
229 present in earlier GNU M4 versions. NOTE: this change exposes a bug
230 in Autoconf 2.59 and earlier (which was fixed in Autoconf 2.60).
232 If you want your package to work with pre-installed Autoconf without
233 requiring 2.60, then add these lines to your project's configure.ac,
234 prior to calling AC_INIT:
236 # As long as this project is not ready to upgrade to autoconf 2.60
237 # or newer, make sure that newer M4 will still use LIFO order:
238 m4_define([m4_wrap], [m4_ifdef([_$0_text],
239 [m4_define([_$0_text], [$1]m4_defn([_$0_text]))],
240 [m4_define([_$0_text], [$1])m4_builtin([m4wrap],
241 [m4_default(m4_defn([_$0_text])m4_undefine([_$0_text]))])])])
243 On the other hand, if you want to install Autoconf 2.59 or earlier,
244 then apply this patch:
245 http://git.sv.gnu.org/gitweb/?p=autoconf.git;a=commitdiff;h=56d42fa71
247 ** The `changecom' builtin semantics now match traditional
248 implementations; if the start-comment string resembles a macro name or
249 the start-quote string, comments are effectively disabled.
251 ** The `divert' builtin now accepts an optional second argument of text
252 that is immediately placed in the new diversion, regardless of whether
253 the current expansion is nested within argument collection of another
254 macro. It has also been optimized for faster performance.
256 ** The `substr' builtin now treats negative arguments as indices relative
257 to the end of the string, and accepts an optional fourth argument of
258 text to supply in place of the selected substring. The manual gives an
259 example of how to recover M4 1.4.x behavior, as well as an example of
260 simulating the new negative argument semantics with older M4.
262 ** The `index' builtin now takes an optional third argument as the index
263 to begin searching from, with a negative argument relative to the end of
266 ** The `-d'/`--debug' command-line option now understands `-' and `+'
267 modifiers, the way the builtin `debugmode' has always done; this allows
268 `-d-V' to disable prior debug settings from the command line, similar to
269 using the builtin `debugmode' without arguments. The option
270 `--debugmode' is added as an alias for `-d'. The new flag `d' is added
271 to control whether dereferencing an undefined macro causes a warning;
272 this flag is enabled by default if neither `-d' nor `-E' are specified.
273 The new flag `o' is added to control whether `dumpdef' outputs to stderr
274 or the current `debugfile' location. When the command line option is
275 given the empty string, the mode is treated as `+adeq' instead of `aeq'.
276 Also, the position of `-d' with respect to files on the command line is
279 ** A new predefined text macro, `__m4_version__', expands to the unquoted
280 version number of M4, if GNU extensions are enabled. While you should
281 generally favor feature tests over version number checks, this macro can
282 be used, via `defn', to determine whether the version of m4 processing
283 your file is adequate.
285 ** The `defn', `popdef', and `undefine' builtins gained a new warning when
286 operating on an undefined macro name, to match the warning already
287 present in `builtin', `indir', and `dumpdef'. For backwards
288 compatibility, the warning can be disabled by using `debugmode(`-d')'
289 (or the command line option `--debug=-d'). The flag is also cleared by
290 the command line option `-E'/`--fatal-warnings', so that scripts written
291 for 1.4.x do not cause the script to fail because of new warnings.
293 ** Enhance the `indir' builtin to trace indirect macros, where the trace
294 is requested via `traceon' or the command-line option `-t'. Previously,
295 it was impossible to trace macro names such as `foo-bar' which could
296 only be invoked indirectly, without relying on global tracing (such as
297 with `debugmode(`t')') or the experimental `changeword'.
299 ** Aspects of tracing output that were previously undocumented have been
300 slightly altered, and the effect of the builtin `debugmode' on trace
301 output is more fully documented. As POSIX does not specify trace output
302 format, parsing such output is inherently fragile in the first place.
303 The intent is that future M4 versions will not change documented trace
304 output without adding additional `debugmode' flags.
306 ** Enhance the `ifdef', `ifelse', and `shift' builtins, as well as all
307 user macros, to transparently handle builtin tokens generated by `defn'.
309 ** Allow the concatenation of builtin macros with arbitrary text in
310 several contexts, via the `defn' builtin or argument expansion, rather
311 than warning and converting the builtin token to an empty string.
312 However, it is still not possible to use a concatenated builtin when
315 ** Enhance the `defn', `dumpdef', `ifdef', `popdef', `traceon', `traceoff',
316 and `undefine' macros to warn when encountering a builtin token in the
317 context of a macro name, rather than acting on the empty string. This
318 was already done for `define', `pushdef', `builtin', and `indir'.
320 ** Enhance the `eval' builtin to understand the `?:' operator, and
321 downgrade a failed parse due to an unknown operator from an error to a
324 ** A number of portability improvements inherited from gnulib.
326 * Noteworthy changes in release 1.4.17 (2013-09-17) [stable]
328 ** Fix compilation with newer glibc headers.
330 ** Fix a failure with diverting large amounts of text on mingw (does
331 not affect platforms that can rename an open file).
333 ** A number of portability improvements inherited from gnulib.
336 * Noteworthy changes in release 1.4.16 (2011-03-01) [stable]
338 ** Fix regressions in the `index' builtin. On glibc platforms, this
339 avoids false positives from a strstr bug in glibc 2.9 through 2.12;
340 on many other platforms, it fixes two separate regressions, a false
341 positive introduced in 1.4.11 and a false negative in 1.4.15.
343 ** A number of portability improvements inherited from gnulib.
346 * Noteworthy changes in release 1.4.15 (2010-08-31) [stable]
348 ** Fix regression introduced in 1.4.9b where the `format' builtin could
349 crash on an invalid format string.
351 ** Fix compilation against newer glibc, and on AIX 7.1BETA.
353 ** A number of portability improvements inherited from gnulib.
355 * Noteworthy changes in Version 1.4.14 (2010-02-24) [stable]
356 Released by Eric Blake, based on git version 1.4.13.*
358 ** Fix regression introduced in 1.4.12 where executing with stdout closed
359 could crash m4 on exit on some platforms.
361 ** Fix regressions introduced in 1.4.13 in the `esyscmd' builtin, where
362 closed file descriptors could interfere with child execution, and where
363 a child status of 127 made m4 print a spurious message to stderr.
365 ** A number of portability improvements inherited from gnulib.
367 * Noteworthy changes in Version 1.4.13 (2009-04-01) [stable]
368 Released by Eric Blake, based on git version 1.4.12.*
370 ** The manual is now distributed under the terms of FDL 1.3.
372 ** The `divert' and `undivert' builtins have been made more efficient
373 when using temporary files for large diversions.
375 ** The `translit' builtin has been made more efficient when the second
378 ** The input engine has been optimized for faster processing.
380 ** The command line option `--debugfile', introduced in 1.4.7, now
381 treats its argument as optional, in order to allow setting the debug
382 output back to stderr when used without an argument; and order is now
383 significant with respect to command line files. You must therefore use
384 `m4 --debugfile=trace file', not `m4 file --debugfile trace'. This
385 change does not affect the deprecated `-o'/`--error-output' option.
387 ** The `syscmd' and `esyscmd' builtins can be configured to use an
388 alternate shell, via the new `configure' option `--with-syscmd-shell'.
390 ** A number of portability improvements inherited from gnulib.
392 * Noteworthy changes in Version 1.4.12 (2008-10-10) [stable]
393 Released by Eric Blake, based on git version 1.4.11.*
395 ** Fix regression introduced in 1.4.4b where using `traceon' could delete
396 a macro. This was most noticeable with `traceon(`traceon')', but
397 would also happen in cases such as `foo(traceon(`foo'))'.
399 ** Fix regression introduced in 1.4.7 where `m4 -N9' died with an assertion
402 ** Fix regression introduced in 1.4.11 where `defn' died with an assertion
403 failure on a traced but undefined macro.
405 ** New `-g'/`--gnu' command-line option overrides `-G'/`--traditional'.
406 For now, the environment variable POSIXLY_CORRECT has no effect on M4
407 behavior; but a future release of M4 will behave as though --traditional
408 is implied if POSIXLY_CORRECT is set (this future change is necessary,
409 because in the current release, there is no way to disable GNU
410 extensions that conflict with POSIX without the use of a non-POSIX
411 command-line argument). Clients of M4 that want to use GNU extensions,
412 even when POSIXLY_CORRECT is set, should start using the -g command-line
413 argument, even though it is currently a no-op if -G did not appear
414 earlier in the command line, so that the client will not break in the
415 face of an upgraded m4 and a POSIXLY_CORRECT execution environment.
417 ** The `-L'/`--nesting-limit' command-line option now defaults to 0 for
418 unlimited on platforms that can detect and deal with stack overflow. On
419 systems that lack alternate stack support, such as Cygwin, and on
420 systems that do not obey the POSIX semantics for distinguishing stack
421 overflow from other exceptions, such as Linux, you can optionally
422 install the libsigsegv library (version 2.6 or newer recommended) to
423 enhance m4's ability to accurately report stack overflow:
424 http://www.gnu.org/software/libsigsegv/
426 ** A number of portability improvements inherited from gnulib.
428 * Noteworthy changes in Version 1.4.11 (2008-04-02) [stable]
429 Released by Eric Blake, based on git version 1.4.10a
431 ** Security fixes for the -F option, for bugs present since -F was
432 introduced in 1.3: Avoid core dump with 'm4 -F file -t undefined', and
433 avoid arbitrary code execution with certain file names.
435 ** Fix regression introduced in 1.4.9b in the `divert' builtin when more
436 than 512 kibibytes are saved in diversions on platforms like NetBSD
437 or darwin where fopen(name,"a+") seeks to the end of the file.
439 ** The output of the `maketemp' and `mkstemp' builtins is now quoted if a
440 file was created. This is a minor security fix, because it was possible
441 (although rather unlikely) that an unquoted string could match an
442 existing macro name, such that use of the `mkstemp' output would trigger
443 inadvertent macro expansion and operate on the wrong file name.
445 ** Enhance the `defn' builtin to support concatenation of multiple text
446 arguments, as required by POSIX. However, at this time, it is not
447 possible to concatenate a builtin macro with anything else; a warning is
448 now issued if this is attempted, although a future version of M4 may
449 lift this restriction to match other implementations.
451 ** Enhance the `format' builtin to parse all C99 floating point numbers,
452 even on platforms where strtod(3) is buggy, although the replacement
453 function does have the known issue of rounding errors when parsing
454 some decimal floating point values. This fixes testsuite failures
455 introduced in 1.4.9b.
457 ** Enhance the `index' builtin to guarantee linear behavior, in spite of
458 the surprisingly large number of systems with a brain-dead quadratic
461 ** A number of portability improvements inherited from gnulib.
463 * Noteworthy changes in Version 1.4.10b (2008-02-25) [beta]
464 Released by Eric Blake, based on git version 1.4.10a
466 Note that M4 1.4.10b was released prior to 1.4.11, and includes all the
467 features of 1.4.11 except for C99 parsing in the `format' builtin. It also
468 contains the following beta features that were deemed worth deferring until
471 ** Further enhance the `index' builtin to often achieve sublinear results.
473 ** Enhance the `regexp' and `patsubst' builtins to cache frequently used
474 regular expressions, which speeds up typical Autoconf usage.
476 ** Enhance the `format' builtin to warn for more suspicious usages, such as
477 missing arguments or problems parsing according to the format string.
479 ** Enhance the `ifelse' and `shift' builtins so that tail-recursive
480 algorithms based on `$@' operate in linear, rather than quadratic, time
483 ** A number of portability improvements inherited from gnulib.
485 * Noteworthy changes in Version 1.4.10 (2007-07-09) [stable]
486 Released by Eric Blake, based on CVS version 1.4.9c
488 ** Upgrade from GPL version 2 to GPL version 3 or later.
490 ** A number of portability improvements inherited from gnulib.
492 ** Avoid undefined behavior introduced in 1.4.9b in the `format' builtin
493 when handling %c. However, this area of code has never been documented,
494 and currently does not match the POSIX behavior of printf(1), so it may
495 have further changes in the next version.
497 * Noteworthy changes in Version 1.4.9b (2007-05-29) [beta]
498 Released by Eric Blake, based on CVS version 1.4.9a
500 ** Fix regression introduced in 1.4.9 in the `eval' builtin when performing
503 ** Fix regression introduced in 1.4.8 in the `-F' option that made it
504 impossible to freeze more than 512 kibibytes of diverted text.
506 ** The synclines option `-s' no longer generates sync lines in the middle of
507 multiline comments or quoted strings.
509 ** Work around a number of corner-case POSIX compliance bugs in various
510 broken stdio libraries. In particular, the `syscmd' builtin behaves
511 more predictably when stdin is seekable.
513 ** The `format' builtin now understands formats such as %a, %A, and %'hhd,
514 and works around a number of platform printf bugs. Furthermore, the
515 sequence format(%*.*d,-1,-1,1) no longer outputs random data. However,
516 some non-compliant platforms such as mingw still have known bugs in
517 strtod that may cause testsuite failures.
519 ** The testsuite is improved to also run gnulib portability tests for the
520 features that M4 imports from gnulib.
522 * Noteworthy changes in Version 1.4.9 (2007-03-23) [stable]
523 Released by Eric Blake, based on CVS version 1.4.8c
525 ** Minor documentation and portability cleanups.
527 * Noteworthy changes in Version 1.4.8b (2007-02-24) [beta]
528 Released by Eric Blake, based on CVS version 1.4.8a
530 ** Fix a regression introduced in 1.4.8 that made m4 unable to process
531 files larger than 2GiB on some platforms.
533 ** Fix a regression introduced in 1.4.8 that made m4 dump core when
534 invoked as 'm4 -- file'.
536 ** The `eval' builtin now follows C precedence rules. Additionally, the
537 short-circuit operators correctly short-circuit division by zero. The
538 previously undocumented alias of '=' meaning '==' in eval now triggers a
539 deprecation warning, so that a future version of M4 can implement a form
540 of variable assignment as an extension.
542 ** The `include' builtin now affects exit status on failure, as required by
543 POSIX. Use `sinclude' if you need a successful exit status.
545 ** The `-E'/`--fatal-warnings' command-line option now has two levels. When
546 specified only once, warnings affect exit status, but execution
547 continues, so that you can see all warnings instead of fixing them one
548 at a time. To achieve 1.4.8 behavior, where the first warning
549 immediately exits, specify -E twice on the command line.
551 ** A new `--warn-macro-sequence' command-line option allows detection of
552 sequences in `define' and `pushdef' definitions that match an optional
553 regular expression. The default regular expression is
554 `\$\({[^}]*}\|[0-9][0-9]+\)', corresponding to the sequences that might
555 not behave correctly when upgrading to the eventual M4 2.0. By default,
556 M4 2.0 will follow the POSIX requirement that a macro definition
557 containing `$11' must expand to the first argument concatenated with 1,
558 rather than the eleventh argument; and will take advantage of the POSIX
559 wording that allows implementations to treat `${11}' as the eleventh
560 argument instead of literal text. Be aware that Autoconf 2.61 will not
561 work with this option enabled with the default regular expression; but
562 Autoconf 2.62 will be compatible with this option.
564 ** Improved portability to platforms such as BSD/OS and AIX.
566 * Noteworthy changes in Version 1.4.8 (2006-11-20) [stable]
567 Released by Eric Blake, based on CVS version 1.4.7a
569 ** The `divert' macro and `-H'/`--hashsize' command line option no longer
570 cause a core dump when handed extra large values. Also, `divert' now
571 uses memory proportional to the number of diversions in use, rather than
572 to the maximum diversion number encountered, so that large diversion
573 numbers are less likely to exhaust system memory; and is no longer
574 limited by the maximum number of file descriptors.
576 ** The `--help' and `--version' command line options now consistently
577 override all earlier options. For example, `m4 --debugfile=trace
578 --help' now no longer accidentally creates an empty file `trace'.
580 ** The `-L'/`--nesting-limit' command line option can now be set to 0
581 to remove the default limit of 1024. However, it is still possible that
582 heavily nested input can cause abrupt program termination due to stack
585 ** Problems encountered when writing to standard error, such as with the
586 `errprint' macro, now always cause a non-zero exit status.
588 ** Warnings and errors issued during macro expansion are now consistently
589 reported at the line where the macro name was detected, rather than
590 where the close parenthesis resides. Text wrapped by `m4wrap' now
591 remembers the location that was in effect when m4wrap was invoked,
592 rather than changing to line 0 and the empty string for a file. The
593 macros `__line__' and `__file__' now work correctly even as the last
594 token in an included file.
596 ** The `builtin' and `indir' macros now transparently handle builtin
597 tokens generated by `defn'.
599 ** When diversions created by the `divert' macro collect enough text that
600 M4 must use temporary files, the environment variable $TMPDIR is now
601 consulted, and a better effort is made to clean up those files in the
602 event of a fatal signal.
604 ** The `mkstemp' builtin is added with the same GNU semantics as `maketemp',
605 based on the recommendation of POSIX to deprecate the POSIX semantics of
606 `maketemp' as inherently insecure. In GNU mode (no -G supplied on the
607 command line), `maketemp' silently retains the secure GNU semantics, but
608 a future release of M4 will change this to emit a warning. In
609 traditional mode (m4 -G), `maketemp' now uses the POSIX-mandated
610 insecure semantics, and issues a warning that you should convert your
611 script to use `mkstemp' instead. Additionally, `mkstemp' and `maketemp'
612 are now well-defined even if the template argument does not end in six
615 ** The manual has been improved, including a new section on a composite
618 ** The `changecom' and `changequote' macros now treat an empty second
619 argument the same as if it were missing, rather than using the empty
620 string and making it impossible to end a comment or quote.
622 ** The `translit' macro now operates in linear instead of quadratic time,
623 and is now eight-bit clean.
625 ** The `-D', `-U', `-s', and `-t' command line options now take effect
626 after any files encountered earlier on the command line, rather than up
627 front, as is done in traditional implementations and required by POSIX.
629 * Noteworthy changes in Version 1.4.7 (2006-09-25) [stable]
630 Released by Eric Blake, based on CVS version 1.4.6a
632 ** Fix regression from 1.4.5 in handling a file that ends in a macro
633 expansion without arguments instead of a newline.
635 ** The define and pushdef macros now warn when the first argument is not
636 a string, rather than silently doing nothing.
638 ** Standard input can now be read more than once, as in 'm4 - file -', and
639 is not closed until all wrapped text is handled. This makes a
640 difference when stdin is not a regular file, and also fixes bugs when
641 using the syscmd or esyscmd macros from wrapped text.
643 ** When standard input is a seekable file, the m4exit, syscmd, and esyscmd
644 macros now restore the current position to the next unread byte rather
645 than discarding an arbitrary amount of buffered data.
647 ** SysV command-line compatibility is no longer a goal of GNU M4; the
648 focus will be instead on POSIX compatibility. This release continues to
649 support previous usage, but adds warnings in areas which will allow a
650 future version of GNU M4 to use its own extensions without being tied to
651 the SysV command line interface.
653 ** The no-op compatibility command line options -B, -N, -S, -T, and
654 --diversions may be withdrawn or assigned new meanings in future
655 releases, so they now issue a warning if used.
657 ** A new command line option -i replaces the compatibility -e as the
658 short spelling of --interactive, for consistency with other GNU tools; a
659 warning is issued if the old spelling is used, and it may be assigned
660 new meaning in future releases.
662 ** A new command line option --debugfile replaces the options -o and
663 --error-output as the preferred spelling. The old options were
664 misleading in their names and inconsistent with other GNU tools; they
665 are still silently accepted, but no longer documented in --help, and may
666 be assigned new meanings in future releases.
668 * Noteworthy changes in Version 1.4.6 (2006-08-25) [stable]
669 Released by Eric Blake, based on CVS version 1.4.5a
671 ** Fix buffer overruns in regexp and patsubst macros when handed a trailing
672 backslash in the replacement text, or when handling \n substitutions
673 beyond the number of \(\) groups.
675 ** Fix memory leak in regexp, patsubst, and changeword macros.
677 ** The format macro now understands %F, %g, and %G.
679 ** When loading frozen files, m4 now exits with status 63 if version
680 mismatch is detected.
682 ** Fix bugs that occurred when invoked with stdout or stderr closed,
683 and detect write failures to stdout or to the target of the debugfile
684 macro. In particular, the syscmd and esyscmd macros can no longer
685 interfere with the debug stream or diversions.
687 ** The m4exit macro now converts values outside the range 0-255 to 1.
689 ** It is now an error if a command-line input file ends in the middle of a
690 comment, matching the behavior of mid-string and mid-argument
693 ** The dnl macro now warns if end of file is encountered instead of a
696 ** The error message when end of file is encountered now uses the file and
697 line where the dangling construct started, rather than `NONE:0:'.
699 ** The debugmode and __file__ macros, and the -s/--synclines option, now
700 show what directory a file was found in when the -I/--include option or
701 M4PATH variable had an effect.
703 ** The changequote and changecom macros now work with 8-bit characters, and
704 quotes and comments that begin with `(' are properly recognized
707 ** The new macro __program__ is added, which allows the input file to issue
708 an error message that resembles messages from m4. Warning and error
709 messages have been reformatted to comply with GNU Coding Standards.
711 ** The errprint, m4wrap, and shift macros are now recognized only with
714 ** The index, substr, translit, regexp, and patsubst macros now produce
715 output when given only one argument, but still warn about a missing
718 ** The patsubst macro now reliably finds zero-length matches at the end
721 * Noteworthy changes in Version 1.4.5 (2006-07-15) [stable]
722 Released by Eric Blake, based on CVS version 1.4.4c
724 ** Fix sysval on BeOS, OS/2, and other systems that store exit status
725 in the low-order byte. Additionally, on Unix platforms, if syscmd was
726 terminated by a signal, sysval now displays the signal number shifted
727 left by eight bits, to match traditional m4 implementations.
729 ** The maketemp macro is no longer subject to platform limitations (such as
730 26 or 32 max files from a given template).
732 ** Frozen files now require that the first directive be V (version), to
733 better diagnose version mismatch. Additionally, if the F directive
734 (builtin function) names an unknown builtin that existed in the m4 that
735 froze the file but not in the current m4 (for example, changeword), the
736 warning is deferred until an attempt is made to actually use the
737 builtin. This allows downgrading from beta m4-1.4o to stable m4-1.4.5
738 without breaking autoconf.
740 ** The format and indir macros are now recognized only with arguments.
742 ** The eval macro no longer crashes on x86 architectures when dividing the
743 minimum integer by -1.
745 ** On systems with ecvt and fcvt, format no longer truncates trailing
746 zeroes on integers printed with %.0f. On systems without these
747 functions, format is no longer subject to a buffer overflow that
748 permitted arbitrary code execution.
750 ** On native Windows builds, the macro __windows__ is provided instead of
751 __unix__. Likewise, on OS/2 builds, the macro __os2__ is provided.
752 This allows input files to determine when syscmd might behave
755 ** Fix bug in 1.4.3 patch to use \n line-endings that did not work for
758 ** When given the empty string or 0, undivert is now documented as a no-op
759 rather than closing stdout, warning about a non-existent file, or trying
760 to read a directory as a file.
762 ** Many documentation improvements. Also, the manual is now distributed
763 under FDL 1.2, rather than a stricter verbatim-only license.
765 ** Raise the -L (--nesting-limit) command line option limit from 250 to
768 ** The decr, incr, divert, m4exit, and substr macros treat an empty number
769 as 0, issue a warning, and expand as normal; rather than issuing an
770 error and expanding to the empty string.
772 ** The eval macro now treats an empty radix argument as 10, handles radix 1,
773 and treats the width argument as number of digits excluding the sign,
774 for compatibility with other m4 implementations.
776 ** The ifdef, divert, m4exit, substr, and translit macros now correctly
777 ignore extra arguments.
779 ** The popdef and undefine macros now correctly accept multiple arguments.
781 ** Although changeword is on its last leg, if enabled, it now reverts to the
782 default (faster) regexp when passed the empty string.
784 ** The regexp and substr macros now warn and ignore a trailing backslash in
785 the replacement, and warn on \n for n larger than the number of
786 sub-expressions in the regexp.
788 * Noteworthy changes in Version 1.4.4b (2006-06-17) [beta]
789 Released by Eric Blake, based on CVS version 1.4.4a
791 ** Fix a recursive push_string crashing bug, which affected changequote of
792 three or more characters on some compilers.
794 ** Use automake to fix build portability issues.
796 ** Fix a recursive m4wrap crashing bug.
798 ** Fix a 1 in 2**32 hash crashing bug.
800 ** Tracing a macro by name is now persistent, even if the macro is
801 subsequently undefined or redefined. The traceon and traceoff macros no
802 longer warn about undefined symbols. This solves a crash when using
803 indir on an undefined macro traced with the -t option, as well as an
804 incorrect result of ifdef. Furthermore, tracing is no longer
805 transferred with builtins, solving the bug of "m4 -tm4_eval" failing to
806 give trace output on the input
807 "define(`m4_eval',defn(`eval'))m4_eval(1)".
809 ** Fix a crash when a macro is undefined while collecting its arguments, by
810 always using the definition that was in effect before argument
811 collection. This behavior matches the C pre-processor, and means that
812 the sequence "define(`f',`1')f(define(`f',`2'))f" is now documented to
813 result in "12", rather than the previously undocumented "22".
815 ** Update the regex engine to fix several bugs.
817 ** Fix a potential crash on machines where char is signed.
819 * Noteworthy changes in Version 1.4.4 (Oct 2005) [stable]
820 Released by Gary V. Vaughan
822 ** ./configure --infodir=/usr/share/info now works correctly.
824 ** When any file named on the command line is missing exit with status 1.
826 * Noteworthy changes in Version 1.4.3 (Mar 2005) [stable]
827 Released by Gary V. Vaughan
829 ** DESTDIR installs now work correctly.
831 ** Don't segfault with uncompilable regexps to changeword().
833 ** Always use \n line-endings for frozen files (fixes a Windows bug).
835 ** Portability fix for systems lacking mkstemp(3).
837 ** Approximately 20% speed up in the common case of usage with autoconf.
839 ** Supported on QNX 6.3.
841 * Noteworthy changes in Version 1.4.2 (Aug 2004) [stable]
842 Released by Paul Eggert
844 ** No user visible changes; portability bug fixes only.
846 * Noteworthy changes in Version 1.4.1 (Jun 2004) [stable]
847 Released by Paul Eggert
849 ** The 1.4.x series is intended to be stable; features added in 1.4[a-q]
850 were not backported to 1.4.x unless specifically mentioned above.
852 ** maketemp now creates an empty file with the given name, instead of merely
853 returning the name of a nonexistent file. This closes a security hole.
856 * Version beta 1.4q - August 2001, by Gary V. Vaughan
858 ** Support for the experimental `changeword' has been dropped.
860 ** `m4 --hashsize' and `-H' are still accepted, but have no effect. M4
861 will grow its internal symbol table if the symbol density is having an
862 effect on performance.
864 ** `configure --without-modules' will build an m4 binary with no preloaded
865 modules. At startup it will search for and load modules `m4' and either
866 `gnu' or `traditional'. This mode of operation can be used for
867 development and debugging of the base modules without the need to
868 recompile all of m4 with each modification.
870 ** `configure --with-modules="gnu m4 traditional load"', for example,
871 will build an m4 binary with the named modules preloaded, ready to be
872 activated (even on static lib only machines) with the `-m' option or
873 using the `load' builtin.
875 ** M4 has no builtins or macros in core, they are all loaded from modules
876 at startup. This means that modules are no longer optional, though the
877 standard build will statically link the modules `m4', `gnu' and
878 `traditional', so even on machines with no ltdl support, all of the
879 functionality from previous releases is available.
881 ** New builtin `load' to dynamically load modules which can define new
882 builtins and user macros.
884 ** New builtin `unload' to remove loaded modules (and the builtins and user
885 macros they define) from the running m4 interpreter.
887 ** New builtins `eregexp' and `epatsubst' to use Extended Regular
888 Expressions syntax in lieu of Basic Regular Expressions as used by
889 `regexp' and `patsubst'.
891 ** The names of all currently loaded modules are returned by the new
892 builtin, ``modules''.
894 ** Loadable modules can define new builtin functions or text expansion
897 ** The module code has been rewritten to use libltdl, the libtool dynamic
898 loader, which means GNU m4 can now load (and unload) modules just about
899 anywhere which it can be built. This includes obscure hosts such as
900 cygwin and BeOS, and also on hosts which do not have shared libraries,
901 through preloading (see libtool manual) and GNU dld.
903 ** Modules can now be built without the m4 source being available using the
904 installed m4module.h header file (and some other headers that it
905 includes for you), and the installed libm4.la libtool library. All
906 symbols exported from libm4.la have a prefix of `m4_' or `M4_'. See the
907 modules directory for examples of usage.
909 ** A new V2 format for frozen files that saves module and syntax information.
911 * Version beta 1.4o - January 2000, by Rene' Seindal
913 ** Modules can be loaded from the command line with --load-module
915 ** Modules now use libtool's wrapper libltdl.
917 ** New builtin `symbols' allows dynamic queries of all currently defined
920 ** Various Bug fixes.
922 * Version beta 1.4n - November 1998, by Rene' Seindal
924 ** The module code has been reorganised yet again, and now compiles
925 correctly on GNU/Linux, HPUX 9 and 10, SunOS 5 and Solaris 5.
927 ** When configured --with-gmp a new builtin `mpeval' is now defined. The
928 builtin `eval' retains its normal behaviour.
930 ** m4 --version also shows which options were used for compilation, such as:
931 "GNU m4 1.4n (options: modules gmp changeword)"
933 ** New option --import-environment defines all environment variables as
934 macros. This is done before -D and -U are handled, so the macros can be
935 changed through these options.
937 ** Error messages now always print program name before input file name as
938 specified by GNU coding standards. Reported by Akim Demaille.
940 ** Bug fixed: "undivert(0)" could cause m4 to read standard output. A call
941 of "undivert(0)" is now silently ignored.
943 ** Bug fixed: when compiling --with-included-gettext, <libintl.h> wasn't
944 found in intl/ directory. Reported by Andrew Bettison.
946 * Version beta 1.4m - November 1998, by Rene' Seindal
948 ** Using libtool for compiling modules and for linking main app.
950 ** Reorganised the dynamic module code to encapsulate system dependencies
951 better. The code for HPUX shl_load() still needs testing and debugging.
952 A dld interface is also missing. Any volunteers?
954 ** The files from the GNU m4 web-site is now in examples/WWW as a more
955 complete example of what GNU m4 can do.
957 * Version beta 1.4l - November 1998, by Rene' Seindal
959 ** GNU m4 now has an escape syntax category. If a character is marked as
960 an escape, words are only recognised as macros if preceded by an escape
961 character. It is a bit like -P, but dynamic: it can be turned on and
962 off. The GNU m4 web-site on http://www.seindal.dk/rene/gnu/ is
963 maintained with this feature - the m4 source is available on the site.
965 ** The module interface is improved, thanks to "Brian J. Fox",
966 who has contributed some code from Meta-HTML. The modules now build
967 automatically and installs properly, by default in
968 /usr/local/libexec/m4. There is a preliminary, untested support for
971 ** There is now a __m4_version__ macro that expands to the current version
974 * Version beta 1.4k - November 1998, by Erick Branderhorst and Rene' Seindal
976 ** GNU m4 now uses gettext to support internationalization.
978 ** GNU m4 now uses automake to control Makefile.in generation. This
979 should make it more consistent with the GNU standards.
981 ** GNU m4 will use the gmp library for multiple precision integral and
982 rational arithmetic in `eval' if configured with `--with-gmp'. If
983 configured without `--with-gmp' or if gmp is not available, and the type
984 `long long int' is, GNU m4 will use that for `eval' arithmetic.
986 ** GNU m4 now parses the input according to a syntax table, that can be
987 modified through the new builtin `changesyntax'. It is a generalisation
988 of the existing builtins `changecom' and `changequote'. The changes are
989 completely backwards compatible (except for the existence of
992 ** Sync lines can be turned on and off with the `syncoutput' builtin. The
993 builtin `syncoutput' is a GNU extension.
995 ** New experimental feature: dynamically loadable modules. New builtin
996 `loadmodules' loads shared libraries, that can define new builtin
997 macros, ie, new macros can be written in C. Depends on the dlopen()
998 interface, and is currently only tested on Linux. Enabled at configure
999 time with `--with-modules'. Documentation is in src/module.c and
1002 ** Implement a GNU message catalog for French (Franc,ois Pinard).
1004 ** Filenames found through path searches are now correctly reflected in
1005 error and debug messages and through the `__file__' macro.
1009 *** All 8-bit characters can now be used for quotes.
1011 * Version 1.4 - October 1994, by Franc,ois Pinard
1013 ** (No user visible changes)
1015 * Version 1.3 - September 1994, by Franc,ois Pinard
1017 ** Diversions are created as needed. Option `-N' is still accepted, but
1018 otherwise ignored. Users should use only negative diversion numbers,
1019 instead of high positive numbers, for diverting to nowhere.
1021 ** Diversions should also work faster. No temporary files will be needed
1022 at all if all diversions taken altogether do not use more than 512K.
1024 ** Frozen state files may be produced with the `--freeze-state' (-F)
1025 option and later brought back through the `--reload-state' (-R) option.
1027 * Version 1.2 - July 1994, by Franc,ois Pinard
1029 ** In patsubst(STRING, REGEXP, REPLACEMENT), \& in REPLACEMENT has been
1030 changed to represent this part of STRING matched by the whole REGEXP,
1031 instead of the whole STRING as before. \0 does the same, but emits a
1032 diagnostic saying it will disappear in some subsequent release.
1034 ** eval(EXPR) emits a diagnostic if EXPR has suffixed crumb. The same for
1035 other numeric conversions in incr(), decr(), divert(), etc.
1037 ** `--fatal-warnings' (-E) stops execution at first warning.
1039 ** `--nesting-limit=LEVEL' (-L LEVEL) sets a limit to macro nesting.
1040 It is initially fixed at 250.
1042 ** `--word-regexp=REGEXP' (-W REGEXP) modifies macro name syntax, like
1043 does the new `changeword(REGEXP)' macro. This feature is experimental,
1044 tell me your opinions about it. You do need --enable-changeword at
1045 configure time to get these things. Do *not* depend on them yet.
1047 ** Trace output format is scannable by GNU Emacs' next-error function.
1049 ** Stack overflow is detected and diagnosed on some capable systems.
1051 ** Various bugs have been corrected, m4 should be more portable. See the
1052 ChangeLog for details.
1054 * Version 1.1 - November 1993, by Franc,ois Pinard
1056 ** Changes which might affect existing GNU m4 scripts:
1058 *** Option `-V' has been removed, use `--version' instead. `--version'
1059 writes on standard output instead of standard error, and inhibits any
1062 *** `--no-gnu-extensions' has been renamed `--traditional'.
1064 *** In `eval', `^' used to indicate exponentiation, use `**' instead.
1066 *** The automatic undiversion which takes place at end of all input is
1067 forced into the main output stream.
1069 ** Changes which are unlikely to affect existing scripts:
1071 *** `--help' prints an usage summary on standard output. Script execution
1074 *** `--prefix-builtins' (-P) prefixes all builtin macros by `m4_'.
1076 *** Most builtin macros for which arguments are mandatory, called without
1077 any arguments, are no more recognized as builtin macros: they are
1078 consequently copied verbatim to the output stream.
1080 *** `define' and `pushdef' are usable with only one argument, they give
1081 this argument an empty definition.
1083 *** `eval' new operators for binary representation handling: `^' for
1084 exclusive-or, `~' for the bitwise negation, `<<' and `>>' for shifts.
1086 *** `eval' recognizes the notation 0bDIGITS for binary numbers and the
1087 notation 0rRADIX:DIGITS for numbers in any radix from 1 to 36.
1089 * Version 1.0.3 - December 1992, by Franc,ois Pinard
1091 ** Changes for the user:
1093 *** `dnl' outputs a diagnostic if immediately followed by `('. Usually,
1094 `dnl' is followed by newline or whitespace.
1096 *** `ifelse' accepts without complaining the common idiom of having only
1097 one argument. This is useful for introducing long comments.
1099 *** `eval' always expresses values as signed, whatever the radix.
1101 *** M4OPTS environment variable is no longer obeyed.
1103 *** `--no-warnings' option is renamed `--silent'.
1105 *** Debug lines use a new format more compatible with GNU standards.
1107 *** Various bugs have been corrected. See the ChangeLog for details.
1109 ** Changes for the installer:
1111 *** GNU m4 now uses an Autoconf-generated configure script, and should be
1112 more easily portable in many ways. (Cray is not supported yet).
1114 *** `make check' has been made more portable, expect no errors.
1116 ** Changes for the programmer:
1118 *** Sources have been fully reindented to comply with GNU standards, and
1119 cleaned up in many ways.
1121 *** Sources have been protoized. Non-ANSI compilers are automatically
1122 detected, then sources are unprotoized on the fly before compilation.
1124 *** GNU m4 uses newer versions of obstack, regex, getopt, etc.
1126 * Version 1.0 - October 1991, by Rene' Seindal
1128 ** Uses GNU configure, taken from the gdb distribution.
1130 ** Uses GNU getopt(), with long option names.
1132 ** The -Q/+quiet option is added, which suppresses warnings about missing
1133 or superflous arguments to builtin macros.
1135 ** Added default options via the M4OPTS environment variable.
1137 ** Several minor bugs have been fixed.
1139 * Version 0.99 - July 1991, by Rene' Seindal
1141 ** The builtins `incr' and `decr' are now implemented without use of
1144 ** The builtin `indir' is added, to allow for indirect macro calls
1145 (allows use of "illegal" macro names).
1147 ** The debugging and tracing facilities has been enhanced considerably.
1148 See the manual for details.
1150 ** The -tMACRO option is added, marks MACRO for tracing as soon as it
1153 ** Builtins are traced after renaming iff they were before.
1155 ** Named files can now be undiverted.
1157 ** The -Nnum option can be used to increase the number of divertions
1160 ** Calling changecom without arguments now disables all comment handling.
1162 ** A bug in `dnl' is fixed.
1164 ** A bug in the multi-character quoting code is fixed.
1166 ** Several typos in the manual has been corrected. More probably persist.
1168 * Version 0.75 - November 1990, by Rene' Seindal
1170 ** Implemented search path for include files (-I option and M4PATH
1171 environment variable).
1173 ** Implemented builtin `format' for printf-like formatting.
1175 ** Implemented builtin `regexp' for searching for regular expressions.
1177 ** Implemented builtin `patsubst' for substitution with regular
1180 ** Implemented builtin `esyscmd', which expands to a shell commands output.
1182 ** Implemented `__file__' and `__line__' for use in error messages.
1184 ** Implemented character ranges in `translit'.
1186 ** Implemented control over debugging output.
1188 ** Implemented multi-character quotes.
1190 ** Implemented multi-character comment delimiters.
1192 ** Changed predefined macro `gnu' to `__gnu__'.
1194 ** Changed predefined macro `unix' to `__unix__', when the -G option is
1195 not used. With -G, `unix' is still defined.
1197 ** Added program name to error messages.
1199 ** Fixed two missing null bytes bugs.
1201 * Version 0.50 - January 1990, by Rene' Seindal
1203 * Initial beta release.
1205 ========================================================================
1211 Copyright (C) 1992-1994, 2004-2011, 2013-2014 Free Software Foundation,
1214 Permission is granted to copy, distribute and/or modify this document
1215 under the terms of the GNU Free Documentation License, Version 1.3 or
1216 any later version published by the Free Software Foundation; with no
1217 Invariant Sections, with no Front-Cover Texts, and with no Back-Cover
1218 Texts. A copy of the license is included in the ``GNU Free
1219 Documentation License'' file as part of this distribution.