2 This file is in the public domain.
4 ==============================================================
5 LuaTeX Release 0.95 for TeX Live 2016 was released 2016042515
6 ==============================================================
8 This is the official frozen TeXlive 2016 version.
9 - deleted 'beta' from the luatex_version_string
14 ==============================================================
15 LuaTeX Release 0.95 was released 2016040415
16 ==============================================================
18 This is a prerelease of the stable 1.0 version.
20 - glues now have gluespec merged in (idem math and insert)
21 - registers are still glue specs
22 - the spec field in glues are gone
23 - extra tex.setglue and tex.setmuglue
24 - obsolete dvi related dir fields removed
26 (if we are in time, it will be included in TeX Live 2016)
29 ==============================================================
30 LuaTeX Release 0.90.0 was released 2016032512
31 ==============================================================
33 This is the version that will go on TeX Live 2016
35 - mostly small bug fixes
36 - a few setters/getters added to the pdf namespace (were in the tex one before)
37 - a few patches to the lua interface macros
38 - a bit more control over protrusion edges
39 - no fundamental changes
43 ==============================================================
44 Luatex Release 0.89.4 was released 2016031100
45 ==============================================================
47 Intermediary release. Several bugs fixed.
51 ==============================================================
52 Luatex Release 0.89.2 was released 2016022700
53 ==============================================================
55 Intermediary release. Several bugs fixed.
58 ==============================================================
59 Luatex Release 0.89.0 was released 2016020500
60 ==============================================================
62 No fundamental changes, just some fixes / improvements (and of course new bugglets).
65 \pdfvariable pkfixeddpi = integer % > 0 : use only default dpi (so one can do with one high res instance)
66 \pdfvariable ignoreunknownimages = integer % > 0 : ignore missing and inject something empty (to be used with care)
68 \edef\foo{\pdfvariable foo}
70 \ifx\foo\oof don't fool me\fi
71 (side effect of no longer aborting on missing, so one implement a catch)
76 ==============================================================
77 Luatex Release 0.88.0 was released 2016011500
78 ==============================================================
80 This is a next step upto 0.90 and it has the following changes:
82 - mostly small bug fixes
84 - a few setters/getters added to the pdf namespace (were in the tex one before)
86 - The current libraries under libs are now:
100 ==============================================================
101 Luatex beta-0.87.0 was released 2015121700
102 ==============================================================
106 This is a next step upto 0.90 and it has the following changes:
108 - image data is no longer stored in the format (it was fragile anyway)
110 - pdf backend data generated when in ini mode is no longer stored in the format
112 - (incomplete) \mag support removed from pdf backend (this functionality is
115 - there are a couple of improvements that should make luatex run a little bit faster
116 (but of course that depends on the job at hand)
118 - some further pending issues / cleanup has been done (but this is not reflected in the
121 - there is a new primitive \nospace:
123 \nospace=1 do now not inject glue for spaces (not even zero glue)
124 \nospace=2 inject zero glue for spaces
126 - there are new primitives \hpack, \vpack and \tpack that are like \hbox, \vbox and
127 \vtop but they don't trigger callbacks
129 - we no longer keep track of older math character and delimiter definition states,
130 but this should normally go unnoticed
132 - from now on only ^^XX, ^^C, ^^^^XXXX and ^^^^^^XXXXXX are supported so no funny odd
133 values (three and five)
135 - texio.setescape(0) disables escaping to terminal (a matter of taste)
137 - the (current) lc codes are now saved with the (current) language when patterns are
138 loaded unless one hs used \hjcode instead of \lccode; overloading of \hjcodes is
139 possible (but of course goes ahead of hyphenation which is delayed till parbuilding or
142 - active characters can now be set with: \letcharcode123=\foo (experimental)
144 - there are some experimental new primitives but these will be described when they are
145 stable (currently being tested)
147 - there is more backend error reporting and all error messages adn warnings (the non-tex
148 ones) have been normalized
150 - of course there are the usual small fixes and additional setters and getters in libraries
154 ==============================================================
155 Luatex beta-0.85.0 was released 2015111400 (5550)
156 ==============================================================
159 The 0.85 release is has a lot of changes. It is the prelude to 0.90 which itself is
160 a prelude to the 0.95 that will go on texlive 2016. The 1.00 release will happen
161 around the 2016 context meeting. After that 2.* will become the next experimental
162 branch (leading to 3.*). The most important changes between 0.80 and 0.85 are mentioned
163 below. For more information consult the manual.
165 -- the backend commands
167 There is a better separation between front- and backend code. Some of the generic
168 \pdf* commands have been promoted to core primitives (with different names), some
169 have been removes like ximagecolordepth and ximagebbox have been removed and
170 all that are left have been organized differently. The backend is now more abstract
171 and provides three primitives only
173 \pdfextension <keyword> <optional spec>
174 \pdfvariable <keyword>
175 \pdffeedback <keyword>
177 The first replaces \pdfannot and alike, the second replaces the variables that can
178 be sused to control behaviour, and the third accesses the read only variables. See
179 luatex-pdf.tex in the context distribution for a plain definition file.
181 The big advantage of the separation (basically core (lua)tex + extensions) is that
182 changes in the backend don't have consequences for the frontend and it's easier to
183 locate possible issues in the code. We might split a bit more at the lua end too.
187 The boundary, dir and localpar whatsits are now normal nodes. The xforms and ximage
188 whatsits are now a special kind of rule nodes (subtypes 1 and 2) and known as box-
189 and image resources (see manual). Also, empty rules are now a valid subtype (subtype
190 3) with related commands \nohrule and \novrule.
192 At the lua end one can now access the fields of a spec subnode directly in the parent,
193 which has the benefit of more control and robust assignments (no need to check for
194 writeability) while we keep the concept of shared glue specs (tex internals). By
195 staying close to traditional TeX the Knuthian documentation still applies in most
198 The pdf action nodes are now pdf_action whatsit nodes (so no longer a pseudo core
201 You can get the node subtypes with the node.subtypes function which adds a layer
202 of abstraction (foo.subtype = "string" might be added in the future).
206 The hz optimization already only supported level 2 optimization, but now has a variant
207 3 that does only stretch glyphs and not kerns. Pending is a change where we go back to
208 percentages instead of fractions of em.
212 The old/new codepath has been checked and italic correction which is fundamental
213 different between the engines has been (partially) redone.
215 We now have \mathsurroundskip that replaces mathsurround when it's non zero.
217 The \mathtoptions (old 1) directive can be used for testing. This primitive is mostly for
218 ourselves and used for development.
220 The \Umathcharclass, \Umathcharfam and \Umathcharslot primitives can be used to fetch
221 properties of a math character.
223 The new \Uleft, \Uright and \Umiddle fence operators accept "height <dimen>", "depth
224 <dimen>" and the "noaxis" keyword as well the "exact" keyword for non-fitting ones. There
225 is also \Uvextension. Optionally one can specify a 'class'.
227 The \Udelimiter[under|over] and \U[under|over]delimiter primitives accept a width as well
228 as left, middle and right keywords (for non fitting ones). There is also \Uhextension.
230 The \abovewithdelimiter command accepts 'exact' as keyword (before the dimension) which nils
231 the excessive spacing. The normal vgaps still apply.
233 We have a new fraction primitive \Uskewed with a companion \Uskewedwithdelims. Optional
234 keywords are 'noaxis' and 'exact'.
236 There is a new directive \mathdisplayskipmode (esp for controlling the > 0 below skip check).
238 With \mathscriptsmode you can fix anchoring of scripts (as needed for chemistry).
240 The \Umathaccent commands accept a width and fraction argument.
244 The discretionary command now accept an optional "penalty <number>" specification
245 where the penalty will be stored with the node. Default is hyphenpenalty.
249 texio.write/write_nl now writes to file if the first argument is a (valid) number
250 reference to a file opened at the tex end; you can now open 128 files from the tex end
251 (0..127) and the system command is no longer executed with 18
255 The tex.<internal variable> is hopefully better now. The tex.get* also can handle
256 the built in registers. Especially prevdepth access should work out ok now.
260 As usual there are lots of small fixes, improvements, overhauls, small additions,
261 hopefully all mentioned in the manual.
265 This version is probably not compatible with the macro package that you use as some
266 engine specific initializations need to take place (\pdf commands) and some node types
267 have been changed. We now have separated pdf backend commands and the only left
268 primitive categories are: core, (tex), etex and luatex, so no more pdftex, omega and
269 umath (where the distinction became to fuzzy). Of course you can still prefix.
273 ==============================================================
274 Luatex beta-0.81.0 was released 2015100722 (5350)
275 ==============================================================
279 * A couple of primitives are removed, renamed and/or promoted to core (luatex) primitives.
280 Here's a summary. It might demand some adaption in the way macro packages initialize so we will mention them here explicitly in advance. As shown below, a simple way to get backward compatibility is to \let old ones to new ones. So,
282 Updating to this version also might demand an update in the
283 macro package that you use!
287 % removed, can be done with callbacks if needed, one can define dimen dummies, like
289 \newdimen\pdfeachlineheight
290 \newdimen\pdfeachlinedepth
291 \newdimen\pdflastlinedepth
292 \newdimen\pdffirstlineheight
293 \newdimen\pdfignoreddimen
295 % removed, were already obsolete, one can \let them
297 \let\pdftexversion \luatexversion
298 \let\pdftexrevision\luatexrevision
299 \let\pdftexbanner \luatexbanner
301 % promoted (from pdftex), so pdf prefix gone, one can \let them
303 \let\pdfnormaldeviate \normaldeviate
304 \let\pdfuniformdeviate\uniformdeviate
305 \let\pdfsetrandomseed \setrandomseed
306 \let\pdfrandomseed \randomseed
308 % promoted (from omega), so pdf prefix gone, one can \let them
310 \let\pdfpagewidth \pagewidth
311 \let\pdfpageheight\pageheight
313 % redundant (etex wins over omega), so \font-less ones gone, one can \let them
315 \let\chardp\fontchardp
316 \let\charht\fontcharht
317 \let\charit\fontcharit
318 \let\charwd\fontcharwd
320 % promoted (from aleph)
325 % promoted (from pdftex)
331 % removed (from pdftex), so *pdf* ones gone, one can \let them
333 \let\ifpdfabsnum \ifabsnum
334 \let\ifpdfabsdim \ifabsdim
335 \let\ifpdfprimitive\ifprimitive
336 \let\pdfprimitive \primitive
338 % promoted (from omega)
346 % promoted (from aleph)
350 % promoted (from pdftex)
361 % promoted (from pdftex), so *pdf* ones gone, one can \let them
363 \let\pdfprotrudechars\protrudechars
364 \let\pdfadjustspacing\adjustspacing
366 \let\pdfnoligatures \ignoreligaturesinfont
367 \let\pdffontexpand \expandglyphsinfont
369 % promoted (from pdftex), so *pdf* ones gone, one can \let them
371 \let\pdfsavepos \savepos
372 \let\pdflastxpos\lastxpos
373 \let\pdflastypos\lastypos
375 % on the todo list are:
377 \pdfoutput : \outputmode
378 \pdfmatrix : will get a normal syntax, no weird { } parsing
380 \pdfcolorstackinit : might become obsolete
381 \pdfcolorstack : might become obsolete
383 So, apart from a few, the \pdf* primitives now relate to the backend only.
385 % There is also a new primitive:
389 This one determines the minimum word length (per language).
390 At the same time we moved the (ex)hyphenpenalties
391 in the disc nodes so you can inject discretionaries with specific penalties.
393 There will also be an updated manual.
397 * new epdf.openMemStream(s,l,docid)
398 to create a pdf from a lightuserdata or string.
399 (experimental, do not use in production.)
401 * uniform random generator in mplib is now specific for each numbersystem;
403 * too_precise implemented for binary number system;
408 ==============================================================
409 Luatex beta-0.80.0 was released 20150319 (5195)
410 ==============================================================
412 * New library newtokenlib. It will replace the current token lib.
413 * Fixed a bug on the normal random generator for double/decimal/binary
415 * Several others bugs fixed.
418 ==============================================================
419 Luatex beta-0.79.3.1 was released 20150122 (5140)
420 ==============================================================
422 * Fixed a bug in mp.w with a wrong input that gives a seg. fault.
426 ==============================================================
427 Luatex beta-0.79.3 was released 20150121 (5130)
428 ==============================================================
431 * It's now possible with the MinGW compilers to build luatex and luajittex as DLL
432 for Windows 32bit/64bit. The files are:
433 libkpathsea-6.dll luajittex.exe luatex.exe texlua52.dll texluajit.dll
434 In the next release the build.sh script be updated; for the moment just add
435 "--enable-shared -disable-native-texlive-build " after --disable-all-pkgs
437 Building as DLL was tested only for Windows.
439 * When possibile symbols in the exe are now hidden:
440 this should avoid conflicts with the loading of dynamic shared object.
442 * several bugfixes and improvements. The patches for MetaPost
443 fix seg. faults occourred with wrong inputs.
445 mp_get_numeric_value, mp_get_string_value, mp_get_boolean_value
446 works if the value is a variable (i.e. not an internal variable,
447 a loop variable and a macro argument);
448 only mp_get_numeric_value now has support for loop variable
449 and internal variable (but still not for macro arguments).
452 ==============================================================
453 Luatex beta-0.79.2 was released 20141111 (5082)
454 ==============================================================
457 * WARNING: the structure of the format file is changed.
458 After the Web2C \TeX's magic constant: "W2TX" there is now
459 a FORMAT_ID, a 32bit field that cannot be between 0 and 256 (included)
460 so that there are no conflicts with the preexisting structure
462 The value can be seen with --debug-format and currently is
463 907 (the sum of the values of the bytes of the ASCII string "don knuth").
465 * There is a new set of lua functions for StructElement and Attribute,
466 convenient (even if not indispensable) for tagged pdf.
469 * several bugfixes and improvements.
472 ==============================================================
473 Luatex beta-0.79.0 was released 20140328 (4960)
474 ==============================================================
476 * The luafontloader now returns 'tsidebearing' glyph values
477 for OT/TT fonts, if applicable.
479 * new lua variables: stats.luatex_hashtype, stats.luatex_hashchars,
480 stats.lastluaerrorstring; the luajittex string hash method is now
481 lua 5.1 compliant which gives better results for similar strings
483 * new lua functions: tex.init_rand(), tex.uniform_rand(),
484 tex.normal_rand(), tex.lua_math_randomseed(), tex.lua_math_random(),
485 tex.show_context(); these helpers make luatex and luajittex compatible
487 * In the lua node interface, there were often issues with rubbish
488 in (especially) 'prev' fields because luatex itself never looks
489 at those values. This is now cleaned up to prevent weird stuff
490 happening inside lua node processing code.
492 * pdf.pageattributes, pdf.pagesattributes, pdf.info, pdf.catalog,
493 pdf.names and pdf.trailer now behave consistent and can be used
494 to add these properties at the lua end in addition to their \pdf*
495 counterparts atthe tex end; there are now pdf.get* and pdf.set*
496 commands for them too (in future versions the old ways can become
499 * new accessors pdf.geth, pdfgetv, pdfgetpos, getgetmatrix as well
500 as pdfhasmatrix helpers (in future versions the direct pdf.h and
501 pdf.v accessor can become obsolete)
503 * the pdf.pdf* variables have been removed (they were already
504 obsolete for some years)
506 * a new properties mechanism for associating lua tables with nodes
507 that get cleaned up when nodes a freed (see manual for details)
509 * several improvements to the way temporary (backend) data is stored
510 at the lua end (better protection, more consistent)
512 * a 'l' type for user nodes that holds a lua variable (can be set
515 * if a late lua node is set at the lua end the string value can be
516 a function as well which is then executed during serialization to
519 * Various small speedups
521 * Various smallish fixes to the node direct interface
523 * LPeg is now at version 0.12
525 * Some small fixes to the CFF (font) parsing
527 * Font file inclusion reporting messages on the terminal now
528 comply to the texconfig.trace_file_names setting
530 * Removed some of the additional luafontloader.info() return
531 information that was added in 0.78.2, but could not work
534 * new primitive \luafunction (see manual), with associated
535 lua.get_functions_table() function
537 * lua error message reporting has been altered a bit to make
538 the distinction between \directlua and other lua source code
541 * Additional pdf document data functionality in the 'pdf' table
542 has been cleaned up internally
544 * Additional pdf destination names can now be set via lua.
546 * New callbacks: finish_pdfpage, show_error_message,
547 show_lua_error_hook, start_file, stop_file
549 * Handling of \tracinglostchars is fixed
551 * Embedded metapost library version is now 1.900
553 * luajittex is now included in the distribution. One can use
554 buildjit.sh to build both luatex and luajittex, where
555 supported by the platform
557 * Synchronization with the TeXLive sources updated the following
559 * libpng is now 1.6.10
560 * poppler is now 0.25.2
562 ==============================================================
563 Luatex beta-0.78.2 was released 20140113 (4748)
564 ==============================================================
566 * Extended luafontloader's info() function to include data
567 from the 'pfminfo' and 'names' structure.
569 * Fixed a bug in the luafontloader library that made loading
570 some fonts extremely slow (LastResort.ttf)
572 * Removed a recent extension in the luafontloader library that
573 made loading fonts with lots of glyphs slow (ArialUnicoce.ttf).
574 Note: the extension made sure that there were no duplicate
575 glyph names in the font after loading.
577 * Restored --recorder output for lua files (dofile/loadfile/io.open)
579 * One-at-a-time pattern adding from lua used to require enormous
582 * luatex's fontloader.to_table() no longer reports 'altuni' table
583 information for alternates that are solely driven by the font
584 encoding. This fixes loading time issues for fonts that fill
585 encodings by copying a single glyph many times, like e.g.
586 LastResort.ttf from Apple.
588 * The datestamp no longer appears in any banners. The associated
589 \luatexdatestamp primitive is deprecated and will be removed
592 * Synchronization with the TeXLive sources updated the following
594 * cairo is now 1.12.16
595 * pixman is now 0.32.4
598 * poppler is now 0.25.0
600 * That same TL synchronization also fixes these issues:
601 * Always write "\nendstream" to the PDF for PDF/A-1b compliance.
602 * Large file support (>4GB) in Lua
603 * Big images could overflow on systems where sizeof(long)=4.
604 * In writing CID CFF fonts to the PDF, and end_dict() was missing.
605 * Unknown 'post' table versions (found in some broken ttf/otf
606 fonts) are now treated as-if they specified version 3.0.
607 * Fix crashes on 32-bit systems caused by bad C header inclusion
609 * Handle '--luac' and '--luaconly' properly
610 * luatex is now released under GPLv2+, not just GPLv2.
611 * luatex can now find .ofm metric files even if the extension
612 is not given explicitly.
614 * node.unset_attribute() was broken in 0.78.0
616 * The UTF-8 commandline patch from 0.78.0 for Win32 was removed
617 again (did not work properly)
619 ==============================================================
620 Luatex beta-0.78.0 was released 20131231
621 ==============================================================
623 * Instead of using expanded fonts, just calculate the expanded
624 width of glyphs where needed, and carry expand info in the
625 glyph nodes (all based on Hans' suggestions). All font expansion
626 functions are disabled and most are removed.
628 * New, faster (but limited) direct node access from lua, see
629 the manual for details
631 * Support for Apple Advanced Typography (AAT) information in
634 * Extended build script for mingw/msys (includes 64-bit support)
636 * Various patches from/via Akira Kakuta for better Win32
639 * Fixes for some bugs in de pdfscanner library (mostly related
642 * Maximum hyphenated word length is now 64Kb characters.
644 * Various patches from Khaled Hosny and Luigi Scarso for the
645 luafontloader subsystem
647 * Fix for a crash when re-dumping formats
649 * Fix for a Selene unicode library bug where some characters in
650 UTF-8 were incorrectly flagged as having the 'Space' property
654 ==============================================================
655 Luatex beta-0.76.0 was released 20130405
656 ==============================================================
660 * Small patches from TeXLive 2013, as well as an update to the
661 latest libraries (libpng, poppler, etc.)
663 * Speed up printing (of TeX strings) to the terminal and log.
665 * New lua function node.end_of_math().
667 * Fixed a memory leak in the lua function pdfscanner.scan().
669 ==============================================================
670 Luatex beta-0.75.0 was released 20130301
671 ==============================================================
675 * New expandable primitive \Uchar.
679 * New version of lnodelib.c with speedups by Hans and Luigi.
680 Also added some extra sanity checks to the Lua node field
683 * Support 'umath' in tex.extraprimitives(), so that formats can
684 make the \Umath* primitives unprefixed, now that they will be
685 provided by XeTeX as well.
687 * Removed a bunch of deprecated primitives
688 * \AlephVersion, \Alephrevision, \Alephversion, \Alephminorversion
689 * \OmegaVersion, \Omegarevision, \Omegaversion, \Omegaminorversion
690 * \omathcode, \odelcode, \omathchardef, \omathchar, \omathaccent,
691 \odelimiter, \oradical
692 * \Umathbotaccent, \Umathaccents
694 * Fix large file support.
696 * Fix Lua's loadfile().
698 * Removed the cidmap callbacks again (let that be done by user lua
699 code after the fact).
701 * Removed the fatal error on fonts where num_glyphs is too high,
702 as that problem is actually harmless.
704 * Some compilation issues under Win32 and Solaris resolved.
706 * Allow math extender objects to be zero width.
708 * The 'epdf' library has been extended to deal with finding and
709 saving embedded files (catalog:numEmbeddedFiles() and catalog:
710 embeddedFile, new EmbFile object).
712 ==============================================================
713 Luatex beta-0.74.0 was released 20121224
714 ==============================================================
719 There are no patches to the core Lua files; a future version
720 of luatex will switch to loading the regular lua 5.2 dynamic
721 library instead of depending on a statically compiled
724 * A bleeding-edge version of luasocket is included, as there
725 is no 5.2-compatible official release yet.
727 * A new lua extension is the two-argument version of
728 string.dump from Luajit:
730 string.dump(function f, [boolean strip])
734 * The implied existence of the following lua libraries is now
737 debug, unicode.*, luazip, lfs, lpeg, zlib, gzip, md5,
738 socket.*, profiler, epdf, fontloader, mplib, and
741 Future versions of luatex will load these modules on demand
742 from dynamic libraries.
744 Please update your sources to include a 'require' line for
745 each of the library modules mentioned.
747 * Two new callbacks: find_cidmap_file and load_cidmap_file
748 (used by the fontloader to discover .cidmaps)
750 ==============================================================
751 Luatex beta-0.72.0 was released 20121210
752 ==============================================================
756 * update various used libraries, including mplib 1.770,
757 poppler 0.21, libpng 1.5, and lpeg 0.10.2.
759 * new 'pdfscanner' lua library.
761 * various OpenType math fixes, including \Umathcharnumdef.
763 * improved placement of bottom accents.
765 * various other small fixes that have accumulated over the past
768 ==============================================================
769 Luatex beta-0.70.1 was released 20110519
770 ==============================================================
774 * fixed: recorder file location from TL (Akira).
776 * fixed: missing newline on 'No output' line.
778 * fixed: relative names in synctex file.
780 * fixed: 16bit png images in generated %!PDF-1.4.
782 * fixed: building with (installed) libpng < 1.5.0
784 * fixed: year in --version output.
786 * fixed: box output to synctex.
788 * fixed: FontDescriptor for non-embedded OpenType fonts has an
789 invalid FontFile3 entry (#654)
791 * fixed: crash on non-existent images.
793 * fixed: small memory leak in the ipc code.
795 * fixed: tex.print() and tex.sprint() don't recognize -2 as the
796 first argument (#659)
798 ==============================================================
799 Luatex beta-0.70.0 was released 20110506
800 ==============================================================
804 * fixed: various changes needed for libpng 1.5.2.
806 * fixed: node.fields() for nodes without subtype.
808 * fixed: non-argument use of os.execute().
810 * fixed: tex.[s|t|]print() with invalid catcode table arguments.
812 * fixed: recorder filename location with --output-directory.
814 * fixed: display alignment in TRT mode.
816 * luatex now uses the standard synctex files from Jérome Laurens.
819 ==============================================================
820 Luatex beta-0.66.0 was released 20110412
821 ==============================================================
825 * fixed: linebreak_filter doesn't do its default job when
826 tex.linebreak is used
828 * fixed: \escapechar ignored by \meaning
830 * fixed: wrong px default
832 * fixed: font kern attribute inheritance
834 * fixed: "nop" unrecognized in virtual fonts
836 * fixed: assertion failure in dviluatex when font ptmr8t used
838 * fixed: tex.settoks for with strings with embedded zeroes
840 * fixed: an indexing problem with nonexistent font glyphs
842 * fixed: some crashes and other bugs on the 'subtype' and 'prev'
843 fields (not all node types have those fields)
845 * fixed: crash on token.csname_id ("")
847 * fixed: initialize the statically allocated node's type ids
849 * fixed: fencepost error in math parameter counting
851 * fixed: math family numbers > 255 are allowed
853 * fixed: compilation failure on Hurd
855 * fixed: a small bug leading to displacements when reading
858 * fixed: \directlua followed by \pdfximage generates error if
861 * fixed: a problem with \vadjust pre in alignments
863 * fixed: a lua stack growing problem in the backend in 0.65.0,
864 resulting in an inability to create more than a few thousand
867 * fixed: inclusion of Scribus-generated pdfs
869 * adapt: the default form margin is now zero (was 1bp before)
871 * adapt: libpng 1.4.4, zzuplib 0.13.60, mplib 1.504
873 * adapt: small changes to the build system and new imports from
874 the texlive repository
876 * feature: new function node.currentattr() queries the current
877 active attribute list
879 * feature: Lua font loading; ignore unknown enumeration keys in
882 * feature: JPEG 2000 image support
884 * feature: continuing work on the 'epdf' library
886 * doc: the 'epdf' lua library is now documented
888 * doc: various other manual corrections
891 ==============================================================
892 Luatex beta-0.65.0 was released 20101213
893 ==============================================================
897 * The Aleph and Omega version primitives are deprecated.
899 * The Apple Snow Leopard Truetype font collections now work
902 * Libpng has been updated to 1.4.4, and zlib to 1.2.5.
904 * New lua functions node.next() and node.prev().
906 * The already deprecated for some time node.protrusion_skipable()
907 function has been removed.
909 * fontloader.apply_featurefile() and fontloader.apply_afmfile()
910 now return nil,<errortable> on failure.
912 * The various node list fields in the lua node interface have
913 been renamed from 'list' to 'head', e.g. tex.box[0].head,
914 and the 'list' name is deprecated. For now, the deprecation
915 is silent, as 'list' will stay for quite some time. Please
916 update your lua source as soon as possible, though.
918 * The call node.type(<node>) now returns "node". The existing
919 functionality is otherwise unchanged.
921 * Luafilesystem has been updated to 1.5.0. NOTE: there is an
922 incompatible change in the directory iterator method.
924 * The restriction on linebreak_filter has been eased: at least one
925 horizontal box should be returned, but that is not necessarily
926 the last node any more.
928 * Backward compatibility has been restored for \meaning\mathchar
930 * node.first_character() has been renamed to node.first_glyph()
931 to better match its actual functionality.
933 * The \Umathaccent primitive now supports both/bottom keywords,
934 and \Umathbotaccent / \Umathaccents are now deprecated.
936 * The \Umathaccent primitive now also supports the fixed keyword,
937 which supports non-growing math accents even if the font says
938 there are extensible variants.
940 * Ongoing work on the epdf library.
944 * Assignment to \dimen65535 was broken earlier.
946 * <box>.head.prev is now always initialized to null (0).
948 * luatex -lua=<script> '\relax' no longer exits immediately,
949 instead going into interactive mode as it should.
951 * The \jobname was initialized wrongly for input file names
952 with multiple dots in them.
954 * The synctex file is now written in the right place when
955 --output-directory is given.
957 * \letterspacefont could cause crashes, especially when combined
960 * Luatex would crash on linux32 systems if it was build in an
961 environment where LFS (>2GB files) was enabled by default.
963 * Node lists created by node.copy_list() could not be hyphenated
964 due to an assertion error.
966 * Synctex support was partially broken since 0.60.0.
968 * With OpenType math fonts, accents with multiple parts
969 (like the \vec arrow) forgot to include all parts if the
970 accentee was too narrow.
972 * With OpenType math fonts, accents over any class except 0 and 7
975 * kpse.lookup("plain", {all = true}) was broken in kpathsea
976 itself (no extension given as well as --all specified).
978 * A FontForge bug made Cambria Math accents look bad, and the
979 placement of math top accents did not allow a marker at the
980 origin (patches by Stefan Philipp)
982 * Cut&Paste from PDF was sometimes broken due to bad ToUnicode map.
984 * Many small manual improvements (thanks to Paul Isambert)
986 * An other bugfix to lpeg 0.9 (from Roberto Ierusalimsky)
988 * Some small fixes to writet1.w (from Han The Thanh)
990 * A build failure because of bad libz configuration on Win32
992 ==============================================================
993 Luatex beta-0.64.0 was released 20101112
994 ==============================================================
998 * New lua functions pdf.refobj(), pdf.maxobjnum() and pdf.objtype()
1000 * New lua function node.is_node()
1002 * The max_strings configuration variable's maximum value is
1003 raised to be identical to texlive's maximum (2097151), and
1004 same for param_size (32767).
1006 * The embedded mplib is now 1.503.
1008 * Minor cleanups in the output of fontloader.to_table():
1010 - removed out-of-range altuni's from the output
1011 - don't dump the extra encodings, just the actual font encoding
1012 - export the encoding's name also as 'enc_name' at one level up
1013 - no longer exporting unset macstyles, nor zero uniqueids
1014 - fix creationtime and modification time
1016 * Ongoing work on the epdf library
1020 * Fix a bug where an explicit hyphen prevented hyphenation for the
1021 whole rest of the paragraph
1023 * Internal font copying forgot to copy the last font dimen
1025 * os.selfdir() is now documented
1027 * patch quad (\fontdimen6) in \letterspacefont to be compatible
1030 * Multi-page pdf inclusion was very slow in 0.63.0
1032 * Some extra checks added to the handling of glue_spec node
1033 objects in lua code.
1035 * Some node.prev pointers have been corrected (but this is not
1038 * A small fix to lpeg 0.9.
1041 ==============================================================
1042 Luatex beta-0.63.0 was released 20100909
1043 ==============================================================
1047 * Drop tex.ht[], tex.wd[], tex.dp[].
1049 * Drop OCP support (and associated primitives).
1051 * Add tex.catcode[], tex.lccode[], tex.sfcode[], tex.uccode[],
1052 tex.mathcode[] and tex.delcode[] and associated functions.
1054 * Add CIDset tables to the output pdf where appropriate.
1056 * Added a 'string' field to late_lua nodes on the lua side. This
1057 field does not convert the assigned string to a tokenlist.
1059 * The result of fontloader.open() now has some virtual accessors
1060 (as well as fontloader.to_table).
1062 * There is now a `short reference' in the manual folder
1067 * Fix a crash on an empty font (bugreport #468).
1069 * Fix a crash for extremely long pattern arguments.
1071 * Fix a crash on bad virtual character arguments in lua.
1073 * Fix hyphenation exceptions.
1075 * Prevent linebreak between initial local_par paragraph whatsit
1076 and a following skip (bugreport #437).
1078 * Fix placement of scripts on textstyle big operators in MATH
1079 fonts (bugreport #466).
1081 * Fix a crash on the return value of MPlib's 'postscript'
1082 operation on images.
1084 * Fix a crash on \leftghost & \rightghost in math mode.
1086 ==============================================================
1087 Luatex beta-0.62.0 was released 20100823
1088 ==============================================================
1092 * LuaTeX now uses libpoppler (0.12.4) instead of xpdf.
1094 * All backend functions now report what file they were searching
1095 for whenever a file cannot be found.
1097 * Input-ed lua files are now mentioned in the fls file if
1098 the --recorder switch is specified on the command line.
1100 * Paragraph indentation hlist nodes and hlist and vlist nodes
1101 generated by alignment rows and cells now have a subtype
1102 (3 for indent box, 4 for rows/columns, 5 for cells).
1104 * The 'epdf' lib is in active development and still growing.
1106 * The 'fontforge' table is finally removed (was deprecated
1111 * A new mplib import fixes two bad bugs in mplib:
1112 - string equality test was wrong
1113 - type declarations could delete pre-existing variables
1115 * PNG images with transparency could create random size
1116 differences in the generated PDF.
1118 * In some special cases, font expansion could cause wrong
1119 spacing in the generated PDF.
1121 * \letterspacefont was broken since a very long time.
1123 * The node subtype of the \leftskip and \rightskip glues was
1126 * Some memory leaks have been removed.
1128 * Various manual fixes.
1130 ==============================================================
1131 Luatex beta-0.61.0 was released 20100728
1132 ==============================================================
1136 * New lua library 'epdf' for introspection of PDF inclusions,
1137 see the manual for details.
1139 * Mplib version 1.502 is now included (which is still beta,
1142 * new "finish_pdffile" and "pre_dump" callbacks.
1144 * new function pdf.pageref()
1146 * In the lua 'tex' library: assignment to internal glue
1147 parameters is now allowed.
1149 * New lua function tex.error().
1153 * Fix for crashes on fonts with bad Panose values.
1155 * Fix for a box placement bug that could sometimes cause text
1158 * Fix for a few small PDF/A1-a compatibility bugs.
1160 * Fix \letterspacefont.
1162 * Fix \Ustopdisplaymath in combination with aligned displays.
1164 * In math delimiters, the last of a chain of predefined sizes
1165 was always ignored if there were also extensible parts.
1167 ==============================================================
1168 Luatex beta-0.60.2 was released 20100701
1169 ==============================================================
1173 * Various small portability fixes, especially for non-gcc
1176 * Updated synctex from Jerome Laurens.
1178 * fix bug #406: \pdfliteral hinders hyphenation.
1180 * fix pdf overprinting bug (related to \pdfliteral).
1182 * patch from Akira Kakuto that ensures that only absolute commands
1183 that are inside the %PATH% will be executed in win32's restricted
1186 * fix a buffer overflow in luafontloader.
1188 * fix cross-platform share-ability of generated formats.
1190 * fix a few typos in the manual.
1192 * fix trashing of the null glue spec by attribute reference code.
1194 * documented the deprecated state and brokenness of otp processing.
1197 ==============================================================
1198 Luatex beta-0.60.1 was released 20100428
1199 ==============================================================
1203 * renamed node.skipable() to node.skippable().
1205 * More git discovery patches in getluatexsvnversion.sh.
1207 * Added --warnings=[no|min|yes|max|all] option to build.sh.
1209 * While cross-compiling, build.sh now adds an extra linker switch
1210 to allow win32 exes to use 3G instead of 2G of virtual memory.
1214 * os.exec() & os.spawn() handled the environment differently from
1215 os.execute() on Win32 (patch from Tomek)
1217 * Builds with --enable-ipc were broken.
1219 * Assigning and acquiring \fontdimen s from TeX code was broken.
1221 * An initial attempt at fixing bug #372 (\predisplaydirection).
1223 * An attempt to fix \eqno/\leqno placements in mixed direction
1226 * Our local xpdf patch is reverted, it is not needed any more.
1228 * The os.selfdir variable was not documented, as well as broken
1231 * Fix "\input tikz hello \bye" bug, plus fix one sign error.
1233 * Fix handling of lua script files with UNC names.
1235 ==============================================================
1236 Luatex beta-0.60.0 was released 20100404
1237 ==============================================================
1241 * os.name now knows about CYGWIN (from Elie Roux)
1243 * Internal handling of direction specifiers is faster now.
1245 * Each glyph node now has three new virtual read-only fields:
1246 width, height, and depth (values in scaled points, of course)
1248 * There are new functions node.protrusion_skipable() and
1249 tex.badness() (useful for paragraph breaking in lua)
1251 * Also new: tex.linebreak(). See the manual for details.
1253 * All lua errors now report file and line numbers to aid in
1256 * Import of metapost 1.211.
1258 * pdf.pdfcatalog will be replaced soon by the new pdf.catalog
1259 pdf.pdfinfo will be replaced soon by the new pdf.info
1260 pdf.pdfnames will be replaced soon by the new pdf.names
1261 pdf.pdftrailer will be replaced soon by the new pdf.trailer
1263 * pdf.pdfmapfile and pdf.pdfmapline are replaced by the new
1264 pdf.mapfile() and pdf.mapline() functions. (a function interface
1265 fits these parameters better because they never return anything).
1267 * New read-write lua variables: pdf.pageattributes, pdf.pageresources,
1270 * getluatexsvnversion.sh now correctly detects git-svn and still
1271 manages to find a valid SVN revision number (from Patrick Gundlach)
1273 * Many of the source files have been converted to CWEB.
1277 * GNU libtool is now used to solve the various technical issues with
1278 dynamic loading of lua modules.
1280 * Error detection in scan_integer_part was wrong due to missing
1281 initialization of OK_so_far (spotted by Javier Mugica)
1283 * Synctex was broken in 0.51-0.52.
1285 * \lastlinefit was broken since ... well, nearly forever.
1287 * Reading of binary files with length zero was broken.
1289 * Trapping of unitialized rules (this was for sloppily created
1290 rule nodes from lua)
1292 * pdf.immediateobj('streamfile') was broken on 64-bit platforms.
1294 * tex.linebreak did not take the given left and right skip, but
1295 instead used the current TeX-side values (bug #356).
1297 * the found 'MAKE' command in build.sh is now fed into configure to fix
1298 problems with that not finding GNU make even when it is actually
1301 * dofile(<nil>) and loadfile(<nil>) in batch mode now give an
1302 error and continue instead of pointlessly waiting for user input.
1304 * Reverted commit #3417 (the buildpage experiment) as it causes bad
1305 things to happen when items are waiting during page breaks.
1307 * Overrule loaders[4] in --safer mode, make require() behave
1308 closer to normal lua 5.1, and add some nicer error messages
1309 (based on an email and patches from Manuel Pegourie-Gonnard)
1311 * Added an extra sanity check for GDEF loading in luafontloader,
1312 based on a crash caused by Linux' AkaashNormal.ttf.
1315 ==============================================================
1316 Luatex beta-0.52.0 was released 20100316
1317 ==============================================================
1321 * Various small manual improvements.
1323 * A better version of getluatexsvnversion.sh, from Tomek.
1325 * node.copy_list() now allows the second (optional) argument to
1328 * An import of the current state of the texlive repository
1329 (kpathsea and build system).
1333 * An attempt fix for bug #345 (math kerning is not perfect): when the
1334 current math font is a new math font, check against \catcode <cur_c>
1335 == 11 to suppress the italic correction, instead of looking at
1336 the value of space(<cur_f>).
1338 * There is a new <tfmtable> key: 'units_per_em' (defaults to 0).
1339 This is part of a fix for bug #200 (Problem with CFF fonts having
1340 em-size other than 1000): there is a special correction to the
1341 embedded cff font itself and the font scale if the font to be output
1342 is opentype or type1 in unicode encoding and the 'units_per_em
1344 <tfmtable>.units_per_em has to be passed back to luatex from
1345 the lua font loading code for this to work.
1347 * A fix for bug #314 (problem with pk file).
1349 * lua code can no longer change the internal preallocated glue_spec
1350 nodes (as that resulted in weird spacing bugs). For this, glue_specs
1351 now have a new field: 'writable'. If that field is false, a copy
1352 has to be made of the glue_spec instead of doing an assignment
1355 * Setting of \textdir inside the output routine could trash output
1356 on following pages due to a lingering internal variable.
1358 * \pdfthread crashed because the arguments were handled in reverse
1361 ==============================================================
1362 Luatex beta-0.51.0 was released 20100312
1363 ==============================================================
1367 * Various small manual improvements.
1368 * The backend message "cannot open Type 1 font file for reading"
1369 now reports which Type1 font it was looking for.
1370 * Fontforge clears some font names at loading time that will be
1371 refilled in at font generation time, but the fontloader should not
1372 do that. Patch from Khaled Hosny.
1373 * New synctex code imported from TeXLive.
1374 * luamd5/md5.h is renamed to luamd5/luamd5.h to avoid confusion.
1375 * Embedded mplib is now 1.209.
1376 * Some experimental tweaking of buildpage_filter, see the manual
1378 * Luatex now detects kfreebsd (from Alan Braslau)
1379 * The new lua function tex.sp() converts a string to a number
1380 representing scaled points.
1381 * There is now support for revision numbers in the banner and stats
1383 * The command line help and manual documentation page is extended.
1384 * node.hpack() now also accepts "cal_expand_ratio" and "subst_ex_font"
1386 * node.hpack() and node.vpack() now give back the badness of the box
1387 as second return value.
1388 * node.copy_list() now allows a second (stop) argument, this stopper
1390 * new lua functions in lfs: lfs.readlink() and lfs.shortname().
1391 * new lua function tex.tprint() that can combine multiple catcode
1392 regime prints in one function call.
1393 * new lua sub-table: tex.nest[] (read/write access to the semantic
1395 * New lua functions in kpse: kpse.lookup() and kpse.version(). See
1396 the manual for more details.
1397 * New lua function tex.shipout().
1401 * There problems in the pdf output for Type3 (pk) fonts.
1402 * Fix a bug that allowed bad commandline quoting.
1403 * Fix a bug that sometimes caused crashes when \pdfprotrudechars.
1404 * The build script now exports CONFIG_SHELL to avoid problems with
1406 * The was a bug in the generated /Image /ProcSet.
1407 * status.font_bytes reported the wrong value.
1408 * Lots of compiler warnings are removed (thanks Javier Mugica).
1409 * Patch to fontloader.info() to accept filenames with embedded
1411 * Fix a \write error with docstrip package.
1412 * Fixed a crash on AdobeMyungjoStd-Medium.otf.
1413 * Fix coco stack overflows, needed for lpeg.
1414 * \pdfcompresslevel wasn't initialized for early immediate objects.
1415 * Fix for slanted fonts when HZ was on (slant angle was multiplied).
1416 * When concatenating content streams, put a space between them.
1417 * Allow pfb lines to end with \r as well as \n (for msam10.pfb).
1418 * Fix the internal string->scaled point conversion in the lua
1420 * Memory leaks in the fontloader removed, thanks to patches from
1422 * Fix a crash caused by the combination of coroutines and font.each().
1426 * Support for Type3 .pgc files (nobody used them).
1428 ==============================================================
1429 Luatex beta-0.50.0 was released 20091224
1430 ==============================================================
1434 * Fonts now listen also to the 'extend' key in the lua font
1435 metrics table, and the processing for this is done via de
1436 pdf text matrix instead of via the font matrix, which means
1437 it now works for all font types.
1439 * The embedded Metapost library is now at version 1.209.
1443 * It is no longer possible for fonts from embedded pdf files
1444 to be replaced by / merged with the document fonts of the
1445 enveloping pdf. This regression may be temporary, depending
1446 on how the rewritten font backend will look after beta 0.60.
1450 * Use of \middle confused the \mathstyle operation.
1452 * \pdfcolorstack handling was broken.
1454 * node.unset_attribute() had a bug whereby it inverted the
1455 requested result in some cases (the node on which the unset
1456 was called was sometimes the only node at the current level
1457 that *kept* the attribute).
1459 * During font expansion, the internal font copy had one character
1460 information object less than the original, resulting in the
1461 disappearance of a glyph in some fonts when font expansion
1464 * Placement of operator scripts of OT MATH fonts is adjusted
1465 to be conformant with Word's logic where the italic correction
1466 is only used to tuck in the subscript and for nothing else.
1468 * luafontloader.open() no longer writes directly to stderr in
1469 case of internal font errors.
1471 * Any <pdf_refobj_node>.objnum could not be assigned to.
1473 * The lua 'pdf' table could not be assigned to.
1475 * The lua 'md5' library was returning incorrect results on
1476 64-bit architectures.
1478 * Luatex now compiles on GNU Hurd systems.
1480 * Fix segfault when embedding stream file object (these
1481 backend segfaults were a side-effect of the string pool
1484 ==============================================================
1485 Luatex beta-0.47.0 was released 20091218
1486 ==============================================================
1490 * New read-write lua variables pdf.pdfcatalog, pdf.pdfnames,
1491 pdf.pdfinfo, pdf.pdftrailer
1493 * The horizontal mode nodes that are added to lines during line
1494 breaking now inherit the attributes from the first and last node
1495 inside the created line.
1497 * The new function pdf.registerannot(<number>) registers an
1498 annotation object number to be included in the current
1499 page's /Annots list.
1501 * The variables <metrics>.Mathconstants.FractionDelimiterSize
1502 and <metrics>.Mathconstants.FractionDelimiterDisplayStyleSize
1503 are added to the font table. This allows proper setting of the
1504 size parameters for TeX's ...withdelims math primitives.
1506 * The internal representation of the string pool is reorganized
1507 (the pool of string characters is now allocated dynamically),
1508 and as a side-effect the lua variable status.init_pool_ptr
1509 is deprecated and will be removed in a later version. Also,
1510 status.pool_ptr now simply returns the current number of bytes
1511 in use for string characters.
1513 * There are new lua variables pdf.pdfmapline and pdf.pdfmapfile
1514 (write-only strings that mimic \pdfmapline and \pdfmapfile).
1516 * \pdfobj data and attribute are now stored as C strings instead
1517 of as token lists (this should speed up cases with a lot of data).
1519 * Artificially slanted fonts now work via the pdf text matrix
1520 (instead of adjusting the actual font) so that it now also
1521 works for non-Type1 fonts. The lua <metrics>.slant font key is
1522 now obeyed in all cases.
1524 * The lua function font.id(<string>) returns the internal font id
1525 number belonging to a control sequence name.
1527 * Pdf image inclusion is optimized such that objects from an
1528 external pdf will now be included only once even if they are
1529 referenced from multiple inclusions.
1533 * Protrusion for non-TLT documents did not work properly for
1534 the hyphenation character.
1536 * \lastbox could not remove the paragraph indent box for non-TLT
1539 * Pdf images (\pdfximage) are no longer kept open during the
1540 whole run, but closed and reopened. An error is raised if
1541 the file has changed between \pdfximage and \pdfrefximage.
1542 This prevents the 'too many open files' error when lots of
1543 images are included.
1545 * On Win32 Pdf image files are locked during the time that it is
1546 open, to prevent unnoticed file changes by external sources.
1548 * Compilation now again works on FreeBSD.
1550 * Format sharing between 32-bit and 64-bit architectures was
1553 * Unsetting attributes from lua could sometimes result in
1554 the unset state persisting beyond the current group level.
1556 * If something went wrong in the scanning of pdf action items,
1557 the error message reported the current primitive name
1560 * Luatex would crash on non-existant pdfs that were referenced
1561 from map file entries.
1563 ==============================================================
1564 Luatex beta-0.46.0 was released 20091126
1565 ==============================================================
1569 * The build.sh script now has better support for new MacOSX-es
1572 * Luatex now has experimental support for dynamic loading of
1573 external compiled lua libraries. Building luatex and loading
1574 external .so/.dll files is reported to work on Windows,
1575 linux and osx, other platforms are still unknown.
1577 * pdf.obj{type="stream"} no longer converts its argument to and
1578 from a tokenlist. This allows the use of binary data in the
1579 "string" argument. Such data does still have to hidden from
1580 the normal file parser by putting the code in a dofile()
1581 or by using string.char(), though.
1585 * Luatex 0.45.0 was not able to find truetype nor opentype fonts
1586 if there were no callbacks defined (patch from Pawel).
1588 * 0.45.0 printed the user input instead of the full pathname
1589 for \input-ed tex files.
1591 * The TFM reader now rejects fonts with tfm names that are
1592 longer than 255 characters because such font names cannot
1593 be stored in a DVI file.
1595 * The combination of \immediate\pdfxform followed by a later
1596 \pdfrefxform could cause broken pdf output files because
1597 the box used for the form could have been freed and even
1598 reused already at that moment in time, sometimes resulting
1599 in an invalid transformation matrix.
1601 * The placement of super- and subscripts for displaystyle
1602 \int's in CambriaMath is now better than before. It still
1603 needs a tweak to the metrics though: in the current version,
1604 the italic correction has to be substracted from the width
1605 of the integral sign to get correct placement (context mkiv
1606 does this). to be continued ...
1608 ==============================================================
1609 Luatex beta-0.45.0 was released 20091118
1610 ==============================================================
1614 * Loading big OTF fonts via lua is now much faster than before,
1615 at the expense of a bit of precision loss in the calculated
1618 * Two new token lists are provided: \pdfxformresources and
1619 \pdfxformattr, as an alternative to \pdfxform keywords.
1621 * \input and \openin now accept braced filenames.
1623 * The \endlinechar can now be set to any value between 0 and 127.
1625 * Luatex can now optionally use kpathsea to find lua require()
1628 * The new primitives \aligntab and \alignmark are aliases for
1629 the use of & and # in alignments.
1631 * \pdfrefximage [width <dimen>] [height <dimen>] [depth <dimen>] <imageref>
1632 overrules settings from \pdfximage for this \pdfrefximage call only
1634 * The print precision for small numbers in lua code (tostring)
1637 * Akira Kakuto suppled a patch that restricts writing to files
1638 with names such as latex.bat etc. (on windows only)
1640 * (un-feature): from now on luatex now only handles 4 direction
1641 specifiers: TLT (latin), TRT (arabic), RTT (cjk), and LTL
1642 (mongolian). The other directions now generate an error.
1644 * (un-feature): xpdf's automatic lower- and uppercasing retry attempts
1645 for nonfound image pdf files has been removed.
1647 * The callbacks hpack_filter, vpack_filter and pre_output_filter
1648 pass on an extra string argument for the direction, when known
1649 (nil == use default).
1651 * The lua functions node.hpack(), node.vpack() and node.dimensions()
1652 now accept an optional direction argument (not given == use default).
1654 * \pdfrefxform [width <dimen>] [height <dimen>] [depth <dimen>] <formref>
1655 scales a form object; similar principle as with \pdfximage: depth alone
1656 doesn't scale, it shifts vertically.
1658 * A change to the relative ordering inside font name discovery for use
1659 by the backend: now it tries <f>.psname first, as that is much less
1660 likely to contain spaces.
1662 * For ttc fonts, now the used subfont name and its index id are printed
1663 to the terminal, and if the backend cannot find a ttc subfont, the
1668 * Prevent crashes for lua-loaded fonts without a (tfm) name.
1670 * Remove spurious newlines in the output pdf that could be the
1671 result of using \pdfximage for an included pdf figure too early.
1673 * Full font embedding for wide otf and ttf fonts now really
1674 works (older versions only pretended that it did work).
1676 * node.dimensions() sometimes continued past the 'stop' node.
1678 * Images inside virtual fonts were broken.
1680 * The processing of \language=-1 was wrong, resulting in
1681 hyphenation attempts even though there was no proper language
1684 * Fix for finding files in --output-directory.
1686 * Fix for handling of --file-line-error.
1688 * tex.box[] assingments are now checked to make sure the assigned
1689 node has the right id (hlist or vlist).
1691 * show_node_list (as in \showbox) produced spurious local_par
1692 whatsit prints in the output after direction nodes.
1694 * The handling of pdf literals has been sped up.
1696 ==============================================================
1697 Luatex beta-0.44.0 was released 20091027
1698 ==============================================================
1702 * libpng is now 1.2.40.
1704 * hlist nodes now have a subtype to distinguish hlists generated
1705 by the paragraph breaking, explicit \hbox commands, and other
1706 (as-yet-undefined) sources.
1708 * \pdfobj now has an extra optional keyword: 'uncompressed',
1709 which forces the object to be written to the PDF in plain
1710 text (see the manual for the exact details).
1712 * The lua file from the luamd5 library (which provides the
1713 md5.hexsuma() function) is now embedded in the executable.
1717 * \latelua now works in DVI mode again.
1719 * status.output_file_name could crash when used too soon.
1721 * In 0.43, rules were not output at all in DVI mode.
1723 * \leavevmode\penalty-10000\penalty-10000 crashed luatex.
1725 * the API of margin kern nodes to lua was using the wrong
1726 fields in the nodes.
1728 * A few fixes to the manual.
1730 * PDF Xref stream dicts were slightly non-conformant.
1732 * There was too much space between two consecutive math displays
1733 (this bug was inherited from Aleph)
1735 * Synctex was broken (thanks, Akira)
1737 * Font mark classes were handled incorrectly by the fontloader
1740 * There was a crash possible with certain types of named PDF
1743 * Math delimiters and large operators in new MATH fonts no
1744 longer apply the italic correction (this fixes placements
1745 of super- and subscripts on such items for those fonts).
1747 * The converter from lua strings to token lists (for the node
1748 interface) sometimes generated invalid tokens.
1750 * CFF (OpenType) fonts now listen to 'embedding="full"'. TTF
1753 * Font tables with 'embedding="no"' would cause luatex to crash.
1755 * \pdfobj file {} failed to find the file if there was no lua
1758 * An optimization in MS Mincho caused luatex to crash.
1760 ==============================================================
1761 Luatex beta-0.43.0 was released 20090819
1762 ==============================================================
1766 * There is a new allowed key in the table trhat is returned
1767 by lua-loaded fonts: <f>.psname. This value should be set
1768 to the original PostScript font name of the font. Fonts inside
1769 dfont and ttc collections are fetched using this field
1770 (if it is missing, <f>.fullname will be used instead).
1772 * It is now possible to use Apple dfont font files
1773 (those that contain at least one outline font).
1775 * \latelua is now allowed inside leaders.
1777 * There is a new callback: process_output_buffer, from Manuel
1778 Pégourié-Gonnard. This callback is called just before
1779 \write acts, so it can be used to alter the file encoding
1780 of text output files.
1782 * There is a new node.dimensions() function, which calculates
1783 the natural size of (part of) a list of nodes.
1785 * The new primitive \gleaders provides 'globally aligned'
1788 * The DVI and PDF backends now share much code internally.
1790 * The embedded MPlib is now 1.207.
1792 * libpng is now 1.2.39.
1796 * We fixed lots of anonymous bugs introduced in 0.42.0 (as expected)
1798 * fontloader.info() errors are no longer fatal, the function now
1799 just returns a nil,"error string" pair.
1801 * Automatically inserted kerns for \accents are now once again
1802 valid word ends, as in \TEX.
1804 * Fixed the placement of math displays in mixed direction
1807 * The \pdfcompresslevel is now dynamic again.
1809 ==============================================================
1810 Luatex beta-0.42.0 was released 20090717
1811 ==============================================================
1813 * There is a new node.tail() function
1815 * lua-loaded fonts now support a 'nomath' key to speed up
1816 loading the lua table.
1818 * A bugfix in the ttf reader for the inclusion backend, and
1819 (also in the backend) support for treating ttc files by
1820 pretending they are single ttf fonts (both patches from pdftex)
1822 * Add Khaled Hosny's man page to the repository
1824 * The \pdfcompresslevel is now effectively fixed as soon as
1825 output to the pdf file has occurred.
1827 * Patched status.filename so that it (nearly) always returns a
1830 * fix '\the\delcode' and disable '\the\odelcode', '\the\Udelcode',
1831 and '\the\Udelcodenum'
1833 * Handle jfifs where either xres or yres is 0 and the other
1834 res is != 0 (from pdftex)
1836 * The single-argument version of lang.hyphenate() was broken.
1838 * Get rid of the \directlua/\latelua number warning.
1840 * The Lua coroutine patch (coco) is now disabled on linux
1841 powerpc architectures (because it caused crashes)
1843 * Removed obsolete pdftex primitives:
1844 \pdfoptionalwaysusepdfpagebox
1845 \pdfoptionpdfinclusionerrorlevel
1849 * The loading speed of large fonts (especially ttf) via the
1850 fontloader library, and the inclusion speed for subsetting
1851 in the backend have both been improved.
1853 * The 'pdf' lua library has been enhanced with various new
1854 functions, see the manual for details.
1856 * BLT and BRT glyph position fixed.
1858 * Various fixes for synctex offsets.
1860 * Support for exotic font string encodings has been removed
1861 from the fontloader library.
1863 * The embedded MPlib is now 1.205.
1865 * libpng is now 1.2.38.
1867 ==============================================================
1868 Luatex beta-0.40.6 was released 20090625
1869 ==============================================================
1871 * Fix two string vs. toks bugs in the lua node interface:
1872 whatsit,annot and whatsit,startlink data assignments were
1873 made directly as strings instead of being converted to tokens.
1875 * Sometimes pdf.print() could be used before the proper structures
1878 * There was a bug in the type codes for the lua package filter
1879 callback: wrong extra info was passed to lua for the alignment
1882 * The math parameters \Umathlimitdownvgap, \Umathlimitdownbgap,
1883 and \Umathlimitdownkern have been renamed to \Umathlimitbelowbgap,
1884 \Umathlimitbelowvgap, and \Umathlimitbelowkern to be more
1885 consistent with the other parameter names.
1887 * The embedded MPlib is now 1.204.
1889 * Handling of UTF-8 hyphenation exceptions has been fixed.
1891 * There were a number of typos in the manual.
1893 ==============================================================
1894 Luatex beta-0.40.5 was released 20090610
1895 ==============================================================
1897 * One of the internal print functions accidentally encoded its
1898 argument string to UTF-8 even though it was already UTF-8.
1900 * Some of the log and terminal UTF-8 output was gibberish.
1902 ==============================================================
1903 Luatex beta-0.40.4 was released 20090609
1904 ==============================================================
1906 * \the\textfont0 returned a number instead of doing a font
1909 * The embedded MPlib is now 1.203.
1911 ==============================================================
1912 Luatex beta-0.40.3 was released 20090608
1913 ==============================================================
1915 * A set of portability fixes for the AIX compiler from Vladimir
1918 * A set of fixes to the synctex support.
1920 * A patch to the build script to prevent installed X11 headers
1921 from being required.
1923 * Some weave (web syntax) fixes from Manuel Pégourié-Gonnard.
1925 * A simplification in luatex.ch (it is now less verbose
1926 about the web2c-specific extensions) from Karl Berry.
1928 * A fix in the handling of UTF-8 (input) file names.
1930 * Hyphenation exceptions were case sensitive in 0.40.2.
1932 * libpng is now 1.2.37.
1934 ==============================================================
1935 Luatex beta-0.40.2 was released 20090603
1936 ==============================================================
1938 * Fix for a compilation warning under Cygwin.
1940 * A complicated bugfix by Hartmut for a rounding problem in the
1941 VF loading that resulted in 'character width mismatch in font
1942 XY.vf ignored' messages at large load sizes
1944 * The embedded MPlib is now 1.202.
1946 * The post_page_number callback was accidentally run when
1947 shipping out xforms as well as during actual pages.
1949 * When a math accent char doesn't have a bot_accent placer,
1950 luatex now uses the top_accent placer, if present.
1952 * A crash caused by \Uroot .. {<list>}{...} is fixed
1954 * A portability fix for solaris 8 sparc using sun studio
1955 compiler, and one for glibc > 2.9.90
1957 * luatex -ini now sets the \catcode of the BOM character to
1960 * Kpathsea is updated from TeXLive, giving four extra types of
1961 searchable files: 'font feature files','cid maps','mlbib',
1964 * libpng is now 1.2.36
1966 ==============================================================
1967 Luatex beta-0.40.1 was released 20090508
1968 ==============================================================
1970 * Vertical placement of root radicals and degrees is fixed.
1972 * The use of \pageleftoffset could deviate from \hoffset
1975 * LuaTeX now issues a warning if \pagedir !- \bodydir during
1978 * The previous crash in font.read_tfm() was still not quite
1981 * The Web2C version is now also printed in the --version
1982 and --credits output.
1985 * There is a new MPlib 1.200 release candidate with a few minor
1988 * The xpdf library is updated to patch level 3.
1990 * New imports to the build system, from texlive. In particular,
1991 there is now configure-level support for building with
1992 libpoppler and support for building under cygwin 1.7 is added.
1994 ==============================================================
1995 Luatex beta-0.40.0 was released 20090422
1996 ==============================================================
1998 * The embedded MPlib is updated to version 1.200.
2000 * Texlua would crash if run font.read_tfm() was used.
2002 * Luatex would crash on empty \patterns.
2004 * Lots of small C code cleanups.
2006 * \textdir inside a \hbox dir *** was wrong earlier.
2008 * 0.39.0 introduced a bug that would make luatex crash whenever
2009 font expansion was used.
2011 * Font tables returned by define_font can now have a key named
2012 'cache' that controls the internal lua font table caching.
2014 * There is no longer a need for an explicit --progname if there
2015 is no input file given.
2017 ==============================================================
2018 Luatex beta-0.39.0 was released 20090415
2019 ==============================================================
2021 * iniluatex will from now on start up with only the TeX82 primitives
2022 and \directlua, everything else has to be bootstrapped via
2023 tex.enableprimitives(). This change was planned for 0.40.0,
2024 but *now* is the time to test it.
2026 * A bugfix for \primitive in various expandable contexts,
2027 and \primitive now generates an error message when the
2028 argument is not actually a primitive's name.
2030 * There was a bug found in the math accent handling.
2032 * Large math operators are now treated like extensible characters
2033 in the sense that they can be composed of segments.
2035 * The extra assign- and restore tracing information from eTeX
2036 had a massive bug because of a dangling else in the pascal web.
2037 As a side-effect of fixing this bugs, all such potential errors
2038 in the pascal web have been fixed (for now).
2040 * The math parameters can now be set and queried from lua code
2041 via the new tex.setmath() and tex.getmath() functions.
2043 * Reflection in a \hbox was broken.
2045 * There was a leak of direction nodes in the paragraph builder.
2047 * The font backend now does a small peek to differentiate
2048 truetype and postscript style opentype fonts. This fixes
2049 the "Can't find CFF table" bug for otf's with truetype outlines.
2051 * Parameters and registers can now also be assinged to globally
2052 from lua (see the manual for details).
2054 * It is now possible to query the current math style while a
2055 formula is still being constructed by using the new read-only
2056 value \mathstyle. Associated is the new command \Ustack that
2057 is to be used as a prefix for {.. \over ..} and friends.
2058 See the manual for more information.
2060 * The embedded MPLib is brought up to date with the current
2061 metapost repository (version 1.110 and a few small patches).
2063 * Luatex can now handle two breakpoints inside a single ligature
2064 (like for the functional word of-f-ice). The solution is not
2065 perfect yet, but the chance of missed hyphenation points in
2066 actual documents should now be negligible.
2068 * Some speedups in the font loading code, and in the handling of
2069 pdf_literal nodes that are set from within Lua code.
2071 * Some source code and manual cleanup, as usual.
2073 ==============================================================
2074 Luatex beta-0.38.0 was released 20090410
2075 ==============================================================
2077 * tex.enableprimitives() had a bug were previously defined (but
2078 currently undefined) control sequences prevented the creation
2081 * The special calling format callback.register('name', false)
2082 not only disables the callback, but also the builtin code it
2083 is supposed to replace.
2085 * Empty \localleftbox and \localrightbox -es are now suppressed.
2087 * Support for <f>.MathConstants.SubscriptShiftDownWithSuperscript
2088 was added, to solve the lack of "sub2" in OpenType math.
2090 * Luatex now supports horizontal super- and subscript placement
2091 corrections via the OpenType MATH mathkern table. See the
2094 * node.write() no longer copies its argument node list before
2097 * There are six new primitives that are verbose forms
2098 of one and two byte special tokens:
2099 \Usuperscript \Usubscript
2100 \Ustartmath \Ustopmath
2101 \Ustartdisplaymath \Ustopdisplaymath
2103 * The attribute node leaks in math mode and alignmetns have been
2106 * The 11 simple math noads are now combined into a single "noad"
2109 * Static linking against libstdc++ is working once again.
2111 * There is a small fix in the keyword scanner to solve the
2112 problem of 'Runaway ... while scanning ???' that could happen
2113 for some primitives.
2115 * Lua now also has the "architecture independent bytecode"
2118 * Lua is updated to version 5.1.4 with coco patches 1.1.5, and
2121 * Some TRT/TLT backend bugs are fixed.
2123 * Various manual updates.
2125 ==============================================================
2126 Luatex beta-0.37.0 was released 20090331
2127 ==============================================================
2129 * Luatex now implements shell_escape = 'p', a new feature
2130 in web2c that intends to make \write18 more secure. As
2131 a side-effect, if luatex is used for typesetting, it will
2132 now also apply shell_escape = 'p' and shell_escape = 'f'
2133 to the lua functions io.popen(), os.execute(), os.exec(),
2135 Nothing has changed for the case where luatex is used as
2136 a script interpreter.
2138 * Attributes can now have negative values. The special value
2139 for 'unset' is lowered to -0x7FFFFFFF (it used to be -1).
2141 * The lua 'kpse' library now has an object-oriented interface
2142 as companion to the procedural interface. This is useful for
2143 e.g. controlling the discovery of mplib files.
2145 * The new internal integer parameter \outputbox allows setting
2146 of the output box number (default: 255, max: 65535)
2148 * The new primitives \Udelimiterunder and \Udelimiterover
2149 complete the set of 'StretchStacks' for OpenType Math.
2151 * Fixed a bug in font string conversions on the Macintosh that
2152 resulted in warnings about 'unaligned pointers being freed'.
2154 * Khaled Hosny spotted a bunch of manual errors.
2156 * There was bug in the width of math_accent objects when
2157 there were super- or subscripts attached to the accentee.
2159 * In PDF mode, TRT \leaders were bugged.
2161 * The source tree now uses the new texlive build system that
2162 Peter Breitenlohner created.
2164 * There is now a single build.sh instead of four separate
2165 ones. It has a few options:
2166 --make : only make, no make distclean; configure
2167 --parallel : make -j 2 -l 3.0
2168 --nostrip : do not strip binary
2169 --mingw : crosscompile for mingw32 from i386-linux
2170 --ppc : crosscompile for ppc osx on intel osx
2172 Note: --parallel still sometimes causes crashes due to
2173 timing errors, so use that option with care.
2175 * Many compiler warnings have been removed (but not all yet).
2177 ==============================================================
2178 Luatex beta-0.36.0 was released 20090323
2179 ==============================================================
2181 * The included fontforge code is stripped considerably, and
2182 the lua table to access the code is renamed to 'fontloader'.
2183 The old name ('fontforge') will remain present for a while,
2184 but will eventually go away.
2186 * New lua functions: tex.primitives(), tex.extraprimitives,
2187 tex.enableprimitives(). This is a prelude to a big change
2188 in the next beta: iniluatex will from now on start up with
2189 only the TeX82 primitives and \directlua, everything else
2190 has to be bootstrapped via tex.enableprimitives().
2191 See the manual for more details.
2193 * Support for multiple lua states has been removed, and at the
2194 same time support for adding name ids to lua chunks has been
2195 added. See the manual for more details.
2197 * More changes to the PDF backend to make it support non-latin
2198 directions (form and image placement, vertical typesetting,
2201 * The kpathsea library is updated. Highlights: cleaner build
2202 process (thanks to Peter Breitenlohner), cleaner mingw32
2203 (cross)compilation support, and a new reentrant API.
2205 * Some possible endless loops within extended delimiters in
2206 math mode are now trapped.
2208 * Movements inside VF font characters were considerably off
2209 due to a wrong conversion routine.
2211 * Error handling for \outer has been reinstated, but can be
2212 suppressed via the new primitive \suppressoutererror.
2214 * The new primitives: \suppresslongerror and \suppressifcsnameerror
2215 that can be used to suppress errors for \par in non-long macros
2216 and for non-expandable objects inside \ifcsname ... \endcsname,
2219 * New lua function: node.vpack() via a patch from Khaled Hosny
2220 that also improves error handling in node.hpack().
2222 * Fix the typo that caused \charic (instead of \charit)
2223 to be defined as a primitive.
2225 * Suppression of hyphenation via \hyphenchar\font=-1 now works
2228 * The lua functions tex.print(), tex.sprint(), tex.write() now
2229 accept an array of strings as well as vararg list of strings
2232 * A change to be build process: luatex.p is no longer split
2233 int smaller pieces before running the C compiler.
2235 * Melissa O'Neill contributed a bugfix to the Type1 font
2238 * A bunch of smaller bugfixes and cleanups (as usual).
2240 ==============================================================
2241 Luatex beta-0.35.0 was released 20090224
2242 ==============================================================
2244 * The math handling portions of LuaTeX are converted to C code,
2245 and extended to support Unicode math. There are a great many
2246 related changes, see the new Math chapter in the manual for
2249 * A nasty bug in the paragraph breaking routine was fixed.
2250 (All lines except the first one were believed to be wider then
2251 they really were. This affected which nodes were considered
2252 as active breakpoints)
2254 * Various changes to the PDF backend to make it support non-latin
2257 * Fixed the behaviour of the page offsets. Placement of the output
2258 on the physical page should now work correctly in all directions,
2259 both in DVI and PDF.
2260 There now are \pageleftoffset and \pagetopoffset primitives,
2263 * fontforge.apply_featurefile() was broken since 0.31.0
2265 * The lua profiler library is added.
2267 * The included lua filesystem library is now 1.4.1.
2269 * Reading of pk files fixed.
2271 * An optional space afer a <direction specifier> for \textdir c.s.
2272 is ignored from now on.
2274 * \bodydir and \pagedir can now be (re)set even after the first
2275 page has been output.
2277 * The new callback mlist_to_hlist can be used to intercept the
2278 normal conversion of math lists to horizontal lists.
2280 * The programs ttf2afm and pdftosrc are removed from the luatex
2281 distribution (these belong to pdftex).
2283 * fontforge.open() now uses much less memory when opening large
2286 * The included libpng is now 1.2.35.
2288 * Quite a lot of smaller bugfixes and cleanups (as usual).
2291 ==============================================================
2292 Luatex beta-0.31.3 was released 20081229
2293 ==============================================================
2295 This release has a bunch of updates from the development trunk
2296 (#1657-1670,1677,1678,1680,1685,1687).
2298 * Closing of files opened by \externalocp.
2300 * Fix for a locale-related bug that make PDF generation fail
2301 with a "Parsing CFF Dict failed" message when including
2304 * The included metapost is now version 1.102.
2306 * PDF rules in vertical modes in RL direction where output
2307 in the wrong direction
2309 * Fix for a crash on Apple fonts that contain a 'bsln' table.
2311 * The handling of the second argument to fontforge.open() was
2314 * The included libpng is now 1.2.34
2316 * Handling of ttc files on Windows was broken
2319 ==============================================================
2320 Luatex beta-0.31.2 was released 20081209
2321 ==============================================================
2323 Besides fixing building issues, this release has
2325 * A small fix for a crash that could happen when using
2328 * A fix in the format of fontforge.to_table output.
2329 (In 0.31.1 <font>.lookups was near-empty; the lookups
2330 were accidentally output as part of the gpos table).
2332 ==============================================================
2333 Luatex beta-0.31.1 was released 20081209
2334 ==============================================================
2336 fixed a bunch of compilation errors on various platforms, but
2337 with no other visible changes.
2340 ==============================================================
2341 Luatex beta-0.31.0 was released 20081205
2342 ==============================================================
2344 This is just an intermediate release so that some testing can be
2345 done on the updated fontforge embedding.
2347 * There are new fields being generated by fontforge.to_table(),
2348 and one or two old ones have been removed. These fields are /
2349 will be documented in the manual, but very briefly:
2351 - MATH table and associated information are now exported
2352 (the main reason for the new fontforge code)
2353 - Baseline data is now exported
2354 (perhaps usable in lua code)
2355 - Multiple Master / Glyph variation data is now exported
2356 (but useless, for now)
2357 - Mac Feature (AAT) information is now exported
2358 (perhaps usable in lua code)
2359 - If (lookup) names were saved via the PfED table, these
2360 will the exported instead of the default, generated names.
2361 (as requested by Yannis)
2363 * dfont is now treated as an archive format just like ttc
2364 when it comes to fontforge.info(). NOTE: that does not mean you
2365 can actually use them, because the backend doesn't know
2366 yet how to embed dfont fonts in the PDF, that is on the
2367 TODO list for the next big beta (0.40.0).
2369 * The executables are a lot larger than before. That is because
2370 much more of fontforge is included than before. Likely this
2371 will stay this way, because this makes upgrading the ff code
2372 much easier, and it means that luatex/FF potentially
2373 understands more font formats (after upgrading the backend,
2377 ==============================================================
2378 Luatex beta-0.30.3 was released 20081128
2379 ==============================================================
2381 This release fixes a really big bug, a few smaller ones,
2382 and has updates of png and mplib:
2384 * All hyphenation patterns that were anchored at the start or
2385 end of a word were ignored in luatex versions 0.25.X and 0.30.X
2386 (and possibly even earlier).
2388 * Repeated use of \language=-1 could result in "There is not room
2389 for another language".
2391 * The lua true coroutines patch (Coco) is now disabled on OpenBSD
2392 running on non-intel platforms.
2394 * The lua socket library is patched so that it will now compile on
2397 * Luatex now has libpng 1.2.33 and mplib 1.100
2399 ==============================================================
2400 Luatex beta-0.30.2 was released 20081020
2401 ==============================================================
2403 * The Lua coco change from 0.30.1 is reverted as it gave
2404 trouble on MacOSX. Lua coco on non-intel OpenBSD platforms
2405 is now explicitly turned off.
2407 * The lua file reading speedup in 0.30.1 broke reading of
2408 files larger than 100MB.
2410 * Reading of font-related files was broken when there was a find
2411 callback, but no read callback.
2413 * The texmf.cnf array size setup values were ignored whenever
2414 --lua was given on the commandline (instead of only when
2415 texconfig.kpse_init is set to false).
2417 * glyphs with negative widths resulted in incorrect horizontal
2418 placement (overlapping) of the string in the output PDF.
2420 * Using \latelua could sometimes result in an invalid output PDF,
2421 and the argument token list was expanded too early
2423 * There was a read buffer overrun in the mapfile parser
2425 * There are two new variables in the status table:
2426 status.callbacks and status.indirect_callbacks (execution counts).
2428 ==============================================================
2429 Luatex beta-0.30.1 was released 20081009
2430 ==============================================================
2432 * Invalid return values from the linebreak_filter callback
2433 are now handled gracefully (was crashing)
2434 * a preinstalled ctangle is no longer needed except when
2436 * In 0.30.0, the .notdef fix was incorrectly applied to
2437 truetype / opentype fonts.
2438 * A bunch of all memory leaks is fixed
2439 * In lua, f:read('*a') now uses signicantly less memory
2440 * The number of \catcodetables is now limited to 64KB
2442 * Luatex could crash if there were PDF images with and
2443 without page /Group included on the same page
2444 * Lua coco now always uses setjmp (for OpenBSD compatibility)
2445 * The embedded mplib is updated to the latest svn version
2446 * # marks (characters with catcode 6) are no longer doubled
2448 * Handling the nul character (U+0000) with catcode 13
2450 * Luatex could crash on win32 with an access violation
2451 because there was one predefined language too few
2452 (the one matching \language=-1)
2454 ==============================================================
2455 Luatex beta-0.30.0 was released 20080930
2456 ==============================================================
2460 * Readable \tex internal params that are counts, attrs, or dimens are
2461 now returned as numbers instead of strings, and skips as node objects.
2462 Read-write access to tex's skip registers added: tex.skip[0] etc.
2463 * new callback: 'linebreak_callback' to replace the internal paragraph
2465 * the tex table now supports more readable 'convert' values:
2466 tex.fontname, tex.pdffontname, tex.pdffontobjnum, tex.pdffontsize,
2467 tex.uniformdeviate, tex.number, tex.romannumeral, tex.pdfpageref,
2468 tex.pdfxformname (each takes a number as argument)
2469 * new readable parameter: tex.fontidentifier(number) returns the
2470 \csname associated with that font id
2471 * luatex now outputs \FONT<nr> instead of \^^@ in Overfull/Underfull
2472 messages if the font's id text is zero (like for expanded fonts) (#77)
2473 * luatex --version is split into --version and --credits
2474 * There is now (again) an svn revision number in luatex --version (#91)
2475 * Add support for more read-only internal access from lua:
2476 tex.lastpenalty, tex.lastkern, tex.lastskip, tex.lastnodetype,
2477 tex.inputlineno, tex.badness, tex.pdftexversion, tex.pdflastobj,
2478 tex.pdflastxform, tex.pdflastximage, tex.pdflastximagepages,
2479 tex.pdflastannot, tex.pdflastxpos, tex.pdflastypos, tex.pdfrandomseed,
2480 tex.pdflastlink, tex.luatexversion, tex.Alephversion,
2481 tex.Omegaversion, tex.Alephminorversion, tex.Omegaminorversion,
2482 tex.eTeXminorversion, tex.eTeXversion, tex.currentgrouplevel,
2483 tex.currentgrouptype, tex.currentiflevel, tex.currentiftype,
2484 tex.currentifbranch, tex.pdflastximagecolordepth (#81)
2485 * the old --src-specials are replaced by --synctex (#63)
2486 * the \expanded primitive is backported from pdftex 1.50 (#43)
2487 * luatex now comes with libpng 1.2.32
2488 * experimental: tex.definefont(string, number) associates a
2489 csname string with a font id number
2491 Bugs fixed compared to 0.29.0:
2493 * dashes were exported wrongly by MPlib
2494 * multi-item \discretionaries were broken in various ways (#78, mailinglist)
2495 * read_font_info was sometimes called recursively from lua-loaded
2497 * do_vf was sometimes called on lua-loaded fonts that where
2498 already known to be virtual
2499 * trailing junk in tfm files is now ignored (needed for ecrm fonts)
2500 * pdf_ignored_dimen was initialized too late, breaking \prevdepth
2501 handling and causing output lines to overlap eachother (#72)
2502 * pdf.immediateobj() had a printf-related bug
2503 * the fontname terminal logging is fixed for strange font file names
2504 * lua tex array assignments now listen to the globaldefs setting
2505 (tex.count[0] etc) (#92,partial)
2506 * \parshape was broken (#70)
2507 * there is no longer a ".tex" extension forced on very input file (#74)
2508 * eof() for mapfiles was true one byte too soon (#76)
2509 * out of range \lefthyphenmin and \righthyphenmin settings now actually
2510 disable hyphenation (#90)
2511 * tex.unset_attribute() looked too far ahead when a to-be-unset
2512 attribute id not only did not exist in the node, but was also
2513 higher than the highest set attribute on the node. (#65)
2514 * the parameters attr and page_name of read_image() were swapped
2515 (this broke \pdfimage with attributes)
2516 * tex filenames with spaces in them on the command line are now
2518 * sometimes pfb fonts were included multiple times without valid
2520 * some parts of the pdftex 1.40.9 PNG transparancy hack were still
2521 present and caused transparant png handling to fail
2522 * \localinterlinepenalty and \localbrokenpenalty were broken
2523 * special case catcode tables are now handled better (#23)
2524 * the handling of missing .notdef charstrings in old pfb fonts
2527 ==============================================================
2528 Luatex beta-0.29.0 was released 20080718
2529 ==============================================================
2534 * The embedded pdftex is now 1.40.9 (forthcoming) except for the
2536 - the png transparancy fix is skipped because it is in conflict
2537 with a macro-based solution offered by context mkiv.
2538 - LFS (PDF files > 2GiB) is not working yet.
2539 - Synctex is still missing
2541 * libpng, xpdf, and zlib are updated to their pdftex 1.0.9 levels
2543 * MPlib is updated to 1.090
2545 * The syntax of buildpage_filter is changed to avoid confusion
2546 (and crashes). See the manual for the new calling convention.
2548 Bugs fixed compared to 0.28.0:
2550 * The previous bugfix for \languages skipping numbers was wrong.
2552 * Various compile-time warnings are suppressed
2554 * \pdfsetmatrix was broken
2556 * \pdfsave and \pdfrestore were broken
2558 * Valid user_defined whatsits nevertheless were generating errors.
2561 ==============================================================
2562 Luatex beta-0.28.0 was released 20080630
2563 ==============================================================
2565 There is one new feature:
2567 There is now experimental support for non-trivial discretionaries
2568 following explicit hyphens. In analogy to \prehyphenchar and
2569 \posthyphenchar, there are two new parameters \preexhyphenchar en
2570 \postexhyphenchar. Both new parameters default to zero (nothing).
2571 When set to a nonzero value, the parameter is added to either the
2572 pre- or post- break text. Note that this is *in addition to* the
2573 hyphen already in the input. Testing and comments are very welcome.
2575 Here is a short example (no idea what is says):
2579 \postexhyphenchar=`-
2581 pudesse t\^e-lo mantido como amigo, mas por
2582 mais bem-intencionado que eu fosse, n\~ao
2588 Bugs fixed compared to 0.27.0:
2590 * Words that started off with a character with a zero \lccode
2591 were never hyphenated at all.
2593 * There was a bug in the new active characters code that prevented
2594 the latex format from being built (with Invalid character error).
2596 * There is a temporary fix for the sometimes appearing "Font has a
2597 bad FontBB" message from Acrobat.
2599 * \leaders did not actually stretch enough (the last bit of glue
2600 that has to line up the line endings was never output to the PDF).
2602 * Bad paragraph-related callbacks could result in luatex crashing.
2604 * The pre_linebreak and post_linebreak filters were never called
2605 when \output was active (this was a leftover of a superceded
2608 * 'skipping' language codes when setting up \patterns c.s. did not
2609 work (it used the next empty slot instead of the actual value of
2612 * Using multiple 'attr' keywords on box items could cause random
2615 * Calling lang.hyphenate() with one argument (without specifying a
2616 tail node) could crash.
2618 * The luatex pdf banner and version reporting is cleaned up a bit.
2620 * Conflicting patterns inside \patterns now give an error:
2621 ! Conflicting pattern ignored.
2622 (duplicate identical patterns are ignored without error).
2624 ==============================================================
2625 Luatex beta-0.27.0 was released 20080624
2626 ==============================================================
2628 Bugs fixed compared to 0.25.3:
2630 * Unicode reencoding support for non-standard (i.e. older)
2631 Type1 fonts is now somewhat less broken than it was (#25)
2633 * .vf fonts using specials crashed luatex
2635 * luatex would crash on --\par (#33)
2637 * An attempt is made to get a sane default value for StemV in
2638 the created pdf (#32)
2640 * We can now guarantee that %PDF-1.* header is printed before
2641 the first pdf.print() output
2643 * lang.hyphenate() was broken
2645 * insert_before(a,a,b) was broken (#37)
2647 * argv[0] is now cleaned up before being used as a default for
2648 mem_name and prog_name (#28).
2650 * luatex would crash on loading extended fonts (fonts loaded
2651 via lua callbacks) from a format file.
2653 * The fix for pdftex bug #799 is backported from pdftex 1.40.4.
2655 * slnunicode had a bug in the unicode.utf8.gmatch iterator.
2657 * Queries of nonexisting fontdimens could cause a crash.
2659 * luatex would crash on {\textdir TLT\pardir TLT x\break\par }
2661 * Fixed wrong placement of lines in mixed-direction paragraphs
2662 that could happen in some situations.
2665 * Luatex now includes luasocket (#35)
2666 See http://www.tecgraf.puc-rio.br/~diego/professional/luasocket/
2668 There is a new commandline option: --nosocket to disable this,
2669 and that is also implied by --safer.
2671 NOTE to the binary builders: there are some unfixed configure
2672 problems when you need to add a specific library to get socket
2673 support on your platform. You probably will have to edit the
2674 generated Makefile by hand (search for 'socketlib').
2676 * There is ongoing development to the 'img' and 'mplib' libraries.
2677 See the reference manual for details.
2679 * The 'character commands' in virtual fonts now support image
2680 inclusion. See the reference manual for details.
2682 * Lua error messages now include the call stack.
2684 * \directlua and \latelua have been extended to accept a 'name'
2685 keyword. The argument is a token list that is used as the lua
2686 name of this chunk in lua error messages and call stack prints.
2689 * The lua chunk names can be interfaced via a new virtual
2690 table called lua.instancename, the values in that function as
2691 defaults in the absence of 'name' keywords.
2693 * The 2-plane limit on active character range is removed (#12).
2695 * Subsetted TTF fonts in the PDF now retain the cmap table.
2697 * There is a new Lua variable os.selfdir. This contains the
2698 full absolute pathname of the directory that the executable
2699 resides in (with symlinks resolved)
2701 * There is a new function os.uname() this returns a lua
2702 table containing various platform information items.
2704 * The node library now uses text strings for direction specifiers
2705 instead of numbers. See the reference manual for details.
2707 * The 'E' (edit) as error response functionality is now a noop.
2709 * Adding luatex 0.25.3 to texlive resulted in a few minor backports,
2710 in particular: Support for mktexfmt is added, and luatangle now
2711 identifies itself as such (instead of calling itself otangle).
2713 * We fixed a whole series of portability problems (but
2714 we probably introduced new problems as well).
2716 * Most (all?) files now have a corrected Copyright header,
2717 and link in NEWS source/texk/web2c/luatexdir/NEWS into the object file.
2719 * Some unnecessary files were removed from the distribution.
2721 ==============================================================
2722 Luatex beta-0.25.3 was released 20080418
2723 ==============================================================
2726 * Pdftex bug no. 936 (sarovar) regarding vertical
2727 positioning of embedded PDF files if depth parameter is given.
2728 * Luatex gave bogus lua return values for the tex.wd/hd/dp
2729 values of void boxes
2730 * A few bugfixes in mplib (square pens caused hangs, elliptical
2731 pens caused confused output)
2732 * Hyphenation of uppercase words (\uchyph) was broken
2733 * Output image placements corrected for all 8 transform cases
2734 also when artbox etc. is used
2735 * There were missing maketexstring() calls in error messages
2736 * Math display contents were sometimes prematurely freed during
2737 the placement of the equation number
2738 * Setting \language=-1 could cause crashes due to an array
2739 index going out-of-bounds
2742 * build.sh.ppc is added to the source distribution. This is a
2743 script that crosscompiles osx ppc binaries from osx intel
2744 * tex.box[<chardef name>] is now supported (but still experimental)
2745 * a bunch of compiler warnings are removed
2746 * The fontforge library now dump AAT feature tags as and
2748 * The new function font.nextid() predicts the next assigned font id
2749 * Some source code changes are backported from texlive
2751 ==============================================================
2752 Luatex beta-0.25.2 was released 20080410
2753 ==============================================================
2755 * Updated to MPlib 0.40
2756 * Bugfixes and cleanup in the lua img table code
2757 * Fix \pdflastximagepages bug from pdftex
2758 * Fix for very large tex.print strings
2759 * Update to Lpeg 0.8.1
2760 * &D Bugfix for Type1 fonts when out-of-range characters
2761 are marked as 'used'
2763 ==============================================================
2764 Luatex beta-0.25.1 was released 20080321
2765 ==============================================================
2767 * Updated to MPlib 0.30 (that is now becoming usable)
2768 * The build requirement for a pre-installed ctangle is gone
2771 ==============================================================
2772 Luatex beta-0.25.0 was released 20080311
2773 ==============================================================
2778 This version features an embedded MP interpreter whose output
2779 can be directly accessed from lua code (mplib), without calls
2780 to an external "mpost" command. Of course it has bugs and
2781 limitations (makempx does not work, for example) but keep in
2782 mind that it is only an initial attempt.
2783 See the manual for more details.
2785 ** img.immediatewrite() is added
2786 ** images now accept a 'transform' key
2787 ** widths etc. can now be given as width="100mm"
2791 * \parshape handling was completely broken since 0.20.0+
2792 * when \pdfprotrudechars was in effect, an assertion failure
2793 could happen when embedded \hboxes in the paragraph appeared
2794 at the end of a line.
2795 * import of otf fonts with contextual lookups has been debugged,
2796 thanks to a patch by GW himself.
2797 * compiling with gcc 4.2.3 is now supported
2798 * if you want to build from source, you need a pre-installed ctangle.
2801 ==============================================================
2802 Luatex beta-0.22.1 was released 20080227
2803 ==============================================================
2805 * The macnames.c source file for building ttf2afm is restored.
2806 * "make depend" in luatexdir now works again
2807 * luatex sometimes crashed because it attempted to expand an
2808 already expanded font
2809 * luatex aborted when --progname was given but no format name.
2810 It now sets the format name to the given progname in that case
2811 * sometimes paragraphs with near-empty lines could cause a crash
2812 * img.supportedtypes() had a bug causing it to crash
2813 * img.supportedtypes() has been renamed to img.types for consistency
2814 * img.boxes() added, returns strings representing bounding boxes
2815 * img.node() added, returns a whatsit node cf. \pdfrefximage
2816 * node.write() now accepts multiple arguments
2817 * the program_name_set switch was not set automatically from C,
2818 causing errors unless lua code called kpse.set_program_name()
2820 * kpse.set_program_name() can now be called more than once
2822 * os.spawn{...} and os.exec{...} could cause crashes because of
2823 a memory allocation error
2825 ==============================================================
2826 Luatex beta-0.22.0 was released 20080215
2827 ==============================================================
2829 * We now have an official bug tracker: http://tracker.luatex.org
2830 * A new lua library (img) is added that allows a direct
2831 interface to the image handling of luatex. You can use this
2832 to include images from lua code instead of via the more
2833 traditional \pdfximage cs. See the manual.
2834 * An optional equal sign after \{pre,post}hyphenchar is now
2836 * os.exec() has been extended, and os.spawn() added. These
2837 functions have support for quoted strings, and they
2838 also accept a table with preseparated command arguments.
2839 * New string constants os.type and os.name are provided.
2840 * node.last_node() is added. This pops and returns the last
2841 node from luatex's 'current list'
2842 * node.write() is added. This appends a node to the end of
2843 luatex's 'current list' (experimental).
2844 * The strict check on unicode compliance in pattern files
2845 is dropped. Patterns files still have to be in proper UTF-8
2846 encoding, but the error for non-Unicode character values
2847 (like 0 - 31 and 127 - 159) is dropped.
2848 * \pdfadjustinterwordglue, \prependkern, \appendkern
2849 and associated \XXXXcode arrays are gone.
2850 * The rest of the pdftex font arrays are now merged into
2851 the new luatex font data structure. This means that you
2852 can now set up font expansion from lua code, and that a few
2853 font-related limits are gone.
2854 * The 'top_skip' field in 'insert' nodes is renamed to 'spec',
2855 for improved consistency.
2856 * kpse.show_path() added. This behaves just like
2857 $ kpsewhich --show-path
2858 * The unicode.utf8 functions now also accept values in the range
2859 1.114.112 - 1.114.367 that is used by LUATEX for raw byte output.
2863 * Better node memory (de)allocation error tracking and messages
2864 * Compilation on MacOSX 10.5 was broken
2865 * There was a bug in node.insert_after
2866 * Use of \{pre,post}hyphenchar was broken
2867 * lfs.permissions was leaking memory
2868 * Some warning and error messages are improved a bit
2869 * A set of bugs in character protrusion, this seems to be working
2871 * Also, a set of bugs in font expansion. This now works in most
2872 cases but is not quite bugfree yet (problematic files for testing
2874 * The functions in the kpse library would crash luatex if
2875 kpse.set_program_name() was not yet called. gives an error now.
2876 * Alignments with spanned columns could cause crashes
2877 * A patch is added for problems with filename parsing on the
2878 "first input line" (by Jonathan Kew)
2879 * The hpack_filter and vpack_filter were only called for lists longer
2881 * Luatex is now more forgiving about font subsets being smaller
2882 than their expected size (issues a warning instead of aborts now)
2883 * A "double-free ignored" error for paragraphs with lines starting
2884 with discarded items was fixed.
2886 ==============================================================
2887 Luatex beta-0.20.2 was released 20071217
2888 ==============================================================
2890 * some portability fixes to the build scripts
2891 * a fix for multi-\span in alignments causing unbreakable
2893 * manual improvements from Jonathan Sauer
2894 * fix for undefined csnames in \directlua if
2895 web2c's hash_extra is nonzero
2896 * fix for LR text inside of a RL document
2897 * fix for open_read_file callback not being called
2898 unless find_read_file was also registered
2899 * removed the ocp status message when \ocps are not
2901 * "unicodeenc" in the fontforge to_table renamed to
2902 "unicode" for improved consistency
2904 ==============================================================
2905 Luatex beta-0.20.1 was released 20071207
2906 ==============================================================
2908 * texlua was broken on Solaris because the some C header
2909 files were loaded in the wrong order.
2910 * os.tmpdir() now accepts an argument, making it easier
2911 to use. It now generates more unique filenames when
2912 it is called repeatedly in one run.
2913 * The --luaconly commandline switch is now documented
2915 * The new extended hyphenation exceptions were severely
2917 * \pdfprotrudechars could cause luatex to abort with an
2919 * There was a bug in the \span code that could cause endless
2921 * The simple forms of \leaders were messed up on windows
2922 because a variable was not properly initialized.
2923 * Non-grouped \textdir commands created invalid output.
2924 * e-TeX's pseudo files were not closed properly in ini mode.
2925 * The luatex.web now weaves properly again.
2926 * I made some small improvements to the manual.
2928 ==============================================================
2929 Luatex beta-0.20.0 was released 20071205
2930 ==============================================================
2932 News compared to the last beta (0.11.2) is as follows:
2934 * Completely overhauled hyphenation and ligkern application,
2935 including the addition of a new "lang" table in lua to
2936 interface to the language parameters, some extra functions
2937 in the "node" table, and a few extra callbacks ("hyphenate",
2938 "ligaturing", "kerning", "post_linebreak_filter").
2940 There is a new chapter in the manual to document all the
2941 changes to the hyphenation and line breaking algorithms,
2942 it is simply too much to list here.
2944 * the interface of the pre_linebreak_filter,hpack_filter,
2945 vpack_filter, and pre_output_filter has changed slightly.
2947 * boxes can now get explicit attributes different from the
2948 currently active set, using a syntax like
2950 \hbox attr2=12 attr3=-1 to 12pt {Hi!}
2952 * lpeg is now at version 0.7
2954 * a whole series of exotic bugs and compiler warnings are
2955 fixed, mostly thanks to the watchful eye of Fabrice.
2957 * texio.print now accepts multiple strings as arguments.
2959 * the lua functions os.sleep(), os.times(), os.gettimeofday()
2960 and os.tmpdir() have been added.
2962 * lua now comes with the coroutine (coco) patches from the
2963 luajit project applied.
2965 * the banner line no longer claims to be TeX.
2967 * a bunch of bugs reported on the mailing list have been
2968 fixed (I hope all of them).
2970 * (internal) we found lots of small ways to speed up lua
2973 * (internal) the node (de)allocation functions have been
2974 rewritten, so that absolutely all nodes now have a type,
2975 even the ones with variable sizes.
2978 ==============================================================
2979 Luatex snapshot-20071029 was released 20071029
2980 ==============================================================
2982 * Completely overhauled hyphenation and ligkern application.
2984 There is a new chapter in the manual to document all the
2985 changes to the hyphenation and line breaking algorithms,
2986 it is simply too much to list here.
2988 * the interface of the pre_linebreak_filter,hpack_filter,
2989 vpack_filter, and pre_output_filter has changed slightly.
2991 * lpeg is now at version 0.7
2993 * a whole series of exotic bugs and compiler warnings are
2994 fixed thanks to the watchful eye of Fabrice.
2996 * texio.print now accepts multiple strings as arguments.
2998 * The lua function os.sleep() is added
3000 ==============================================================
3001 Luatex beta-0.11.2 was released 20070918
3002 ==============================================================
3004 * Pdf inclusion and subsetting of CID-based opentype fonts
3005 now works as it should.
3007 ==============================================================
3008 Luatex beta-0.11.1 was released 20070918
3009 ==============================================================
3011 A quick list of what is new and fixed since beta 0.10.2:
3014 * pfb+afm fonts can now be used in 'wide' (encodingbytes=2) mode
3015 * searching in PDFS using 'wide' fonts now works reasonably well
3016 (based on the tounicode feature)
3017 * related to that, tounicode information can now be passed
3018 on inside the font metrics table
3019 * font subsetting is now supported for CID-based OpenType fonts
3020 (however, there is a known bug with KpozMinProVI-Regular.otf)
3021 * fontforge's warning and error messages are now intercepted
3022 and passed on to the lua code as a second return value of
3023 the fontforge.open() function
3024 * the new primitive \suppressfontnotfounderror can suppress
3025 the TeX error for "Font not found"
3026 * The lua function font.current can now be used to set TeX's
3030 * set_attribute(-1) is now the same as unset_attribute()
3031 * OpenType lookups with glyph classes would crash luatex
3032 * luazlib would not compile on debian (fix from Norbert)
3033 * CID-based fonts would crash luatex
3034 * Bare CFF should be read in binary mode (fix from Akira)
3035 * VF processing did not process packets containing zero bytes properly
3036 * the truetype collection (.ttc) handling is fixed, so that all
3037 of the fonts inside a collection can now be used reliably
3038 * application segfaults and stack overflows are intercepted
3039 so that luatex can quit a bit more gracefully
3040 * an assertion failuer on systems with signed chars (linux-powerpc)
3042 * a crash on AMD64 linux was fixed
3043 * the lua "pdf" table code was wrong
3044 * \ifcsname did not work properly for UTF-8 characters
3045 * Use of the math-related functions using make_fraction (like \atop)
3047 * \handling of \if\noexpand was wrong
3048 * applied a patch that cleans up XForm and page calculations
3049 * "autoconf" support from zziplib is stripped
3051 ==============================================================
3052 Luatex beta-0.10.2 was released 20070814
3053 ==============================================================
3057 * the primitive \span was completely broken
3058 * \pdfexpandfont (font expansion) misbehaved if it was used more
3060 * virtual fonts: sometimes they used the wrong internal font id,
3061 loading vf fonts via fonts.read_vf() was impossible, and sometimes
3062 virtual fonts created segfaults
3063 * while dumping formats, the last font parameter for each font was not
3065 * zziplib was always compiled with pre-installed zlib headers, instead
3066 of the ones in the build tree
3067 * lua 5.1.2 has trouble quoting ^Z characters etc, the tentative patch
3068 for lua 5.2 from Luiz fixes that, hopefully
3069 * fontforge.font('font.pfb') now properly parses AFM boundingboxes
3070 * non-existing files in the argument for fontforge.open() or
3071 fontforge.info() could cause segfaults, now it generates an error
3073 * fontforge.open() did not return character widths for vertical fonts
3075 * on Windows, fontforge believed that ttc files (TrueType Collections)
3076 were actually directories. ttc processing is still not 100% correct,
3077 but it is getting better
3078 * the build system used explicit 'make' sometimes
3079 * the auto-growing string pool was not used everywhere
3080 * there were some typos in the documentation parts of the pascal web
3081 * use of \parshape could easily exhaust all available memory
3086 * support for applying Adobe Feature files (.fea) and Adobe Font
3087 Metrics (.afm) is added to the fontforge library
3088 * fontforge.info() will now return an array of tables for the contents
3090 * support for a 'texluac' personality was added, to replace the 'luac'
3091 command from the official Lua distribution
3093 ==============================================================
3094 Luatex beta-0.10.1 was released 20070719
3095 ==============================================================
3097 This was a hotfix because beta-0.10.0 was completely broken.
3099 ==============================================================
3100 Luatex beta-0.10.0 was released 20070718
3101 ==============================================================
3103 The latest version of the manual is included in the package, and I
3104 am not going to repeat all of that. There were some minor changes
3105 compared to the previous snapshot, but mostly just bugfixes and
3106 documentation improvements.
3108 ==============================================================
3109 Luatex snapshot-20070626 was released 20070626
3110 ==============================================================
3112 * Integrated the lua library lzlib, this defines tables with
3113 bindings for zlib (including eazy-to-use gzip support)
3114 * Updated to slnunicode version 1.1
3115 * Some small cleanups in the sparse array handling
3116 * Moved the raw byte support out of the valid unicode range
3117 * Fixed a bug in the OFM font reader
3118 * Removed the pdftex snap nodes (and associated primitives)
3121 ==============================================================
3122 Luatex snapshot-20070622 was released 20070622
3123 ==============================================================
3125 Not a lot of news, but it fixes a few important bugs in the lua
3126 node processing. Also a few utility functions are added:
3129 rounds and bounds checks a lua number to make sure it is
3130 a valid tex integer.
3132 multiplies a number (or the numeric values in a table)
3133 with a fixed quantity, and calls tex.round() on the result.
3135 Test if a node has a specified field name
3137 removes a node from a nodelist, while keeping the list intact
3138 * node.insert_before()
3139 inserts a new node into a nodelist, just before a specified
3141 * node.insert_before()
3142 inserts a new node into a nodelist, just after a specified
3145 packages a nodelist into a hlist node
3148 ==============================================================
3149 Luatex snapshot-20070619 was released 20070619
3150 ==============================================================
3152 * The lua node processing interface is completely reworked.
3153 It is now completely based on userdata, and uses a new lua table
3154 called 'node' to hold the methods. More detailed information
3155 is in the manual (of course).
3157 * There is a fifth node processing callback:
3159 this is executed just before the packaging of \box 255.
3161 * The hpack_filter and pre_linebreak_filter callbacks now
3162 receive an extra argument indicating the number of top-level
3163 glyphs in the node list.
3165 * Virtual fonts can now contain a 'node' key in the glyph
3166 commands: the value should be a hlist node (i.e.: a horizontal
3167 box), and that will then be output for each character access
3170 * A new set of registers is added, called \attribute. These are
3171 values that will be automatically attached to nodes created in
3172 their scope. More information in the manual.
3174 * Direct read/write access to TeX's box registers is addded to
3175 the lua 'tex' table.
3177 * TeX's main memory now grows dynamically, and the (de)allocation
3178 routines have been rewritten completely.
3180 * The 'kpse' table is extended with extra interface functions, to
3181 allow texlua to be used as a scripting engine.
3183 * The \pdftexversion command now returns 200, not 140.
3185 * The displayed banner and --version screens are cleaned up.
3187 * The format file is now RLE compressed. Not as small as before,
3188 but unpacking is much faster.
3191 ==============================================================
3192 Luatex snapshot-20070426 was released 20070426
3193 ==============================================================
3195 This past month I have been busy with nodes and lists of nodes,
3196 so the big new feature in this release is that there are four
3197 callbacks that operate on node lists:
3200 pre_linebreak_filter
3204 The preliminary documentation for these is in the manual, but the basic
3205 idea is that you can filter a node list just before LuaTeX starts doing
3206 something with it (like line breaking). This functionality is not stable
3207 yet: the node presentation of the various node types is pretty much OK
3208 now, but keep in mind the following:
3210 * math noads and math typesetting are not handled at all (yet)
3211 * not all hpacks and vpacks are intercepted (yet)
3212 * the nested node list handling will probably change
3213 * A conversion tool for nodes to/from dictionaries is planned,
3216 The other changes in this snapshot are various bugfixes (for builds
3217 on various platforms as well as font issues) and speedups (in the
3218 execution of callbacks and the creation of lua font representations).
3221 ==============================================================
3222 Luatex snapshot-20070322 was released 20070322
3223 ==============================================================
3225 * I have changed the token_filter callback quite rigorously,
3226 mostly because of speed issues. The raw speed of trivial
3227 lua token handling is now only about 20 times slower than
3228 the native handling. Not bad at all, considering it has to move
3229 between interpreted and compiled code for each and every
3230 token. If you do not run the token filter inside \output,
3231 the effective run speed difference should not be much more
3234 Two big differences: you have to call token.get_next()
3235 yourself, and the token table is now a three-item array
3236 instead of a five-key hash. The minimal example changes to
3239 callback.register('token_filter', function ()
3240 return token.get_next()
3244 more details are in the manual.
3246 * I've fixed a few bugs in the handling of Opentype TTF, and added
3247 a new key in the font definition table:
3249 f.encodingbytes = (1|2)
3251 The default is 2 for opentype and truetype format, 1 otherwise.
3252 Later on, it will become possible to have a type1 font in 2-byte
3253 (CID) encoding or a truetype font in traditional encoding (1-byte),
3254 but I have not covered all cases yet.
3258 ==============================================================
3259 Luatex snapshot-20070309 was released 20070309
3260 ==============================================================
3262 * The OCP debug information is removed again.
3264 * There is a new callback that I am quite excited about myself:
3268 A bit of text from the reference manual:
3269 --------------------
3270 This callback allows you to change the modify any lexical token that
3271 enters the \type{main_control} function before \LUATEX\ executes the
3274 Note: not all tokens can be intercepted yet, only those that are `seen'
3275 by \LUATEX's main control function. Supplemental tokens like the bodies
3276 of macro definitions and the right-hand side of register assignments
3277 are not seen. For now, this is intentional.
3280 function (table <token>)
3281 return table <token>
3285 Calling convention for this callback is bit more complicated then for
3286 most other callbacks. Initially, lua function will be called with the
3287 next token from \type{get_next()} as argument, represented as a small
3288 lua table. The function should either return a lua table representing
3289 a valid to-be-processed token, or something else like nil or an empty
3292 If your lua function does not return a table representing a valid
3293 token, it will be immediately called again with yet another token
3294 from \type{get_next()} as argument, until it eventually does return
3297 But if the function does return a usable token, then that token will
3298 be processed by \LUATEX. Afterwards, the function will be called
3299 again, but now without an argument. This is repeated until it stops
3300 returning tokens. Then processing reverts back to the other branch.
3302 The point behind that roundabout calling convention is that it
3303 allows the lua function to buffer tokens for various uses. That in
3304 turn makes it possible to do some really advanced things like
3307 Now about that table. The table that the function will receive
3308 contains four fields:
3310 \starttabulate[|l|i|p|]
3311 \NC Key \NC type \NC Explanation \NC\FR
3312 \NC cmd \NC string \NC A representation of \LUATEX's internal
3314 \NC chr \NC number \NC The command code modifier\NC\NR
3315 \NC cs \NC string \NC If the token came from a csname, this
3316 is that csname\NC\NR
3317 \NC mod \NC character \NC A single character string representing
3318 the current processing mode. One of {\bf v}ertical, {\bf h}orizontal,
3319 display {\bf m}ath, {\bf n}o, internal {\bf V}ertical,
3320 restricted {\bf H}orizontal, or inline {\bf M}ath mode.\NC\LR
3323 If you modify the table before returning it, then it is wise to return
3324 either a (\type{cmd}, \type{chr}) pair, or a \type{cs} string. That is
3325 because if both options are present, the pair has precedence and the
3326 string is ignored. On the return table, {\bf mod} is ignored always.
3329 I have no long example code yet and it is not as complete as one
3330 would want it to be because it is not intercepting everything that
3331 comes in, only the bits that are triggered by the main control
3334 I decided to do a fast snapshot release for two reasons:
3336 * It is one of the easier extensions to get started with if you want
3337 to learn a bit about lua programming
3339 * I would welcome feedback on the token interface, because it will
3340 be needed in other places as well, soon. I am still not sure
3341 whether converting the command to/from strings is worth it, for
3342 example. And maybe it would be less confusing if you could return
3343 a list of tokens instead of being called repeatedly?
3345 Here is the trivial example to get you started:
3348 callback.register('token_filter', function (t) return t end)
3352 ==============================================================
3353 Luatex snapshot-20070307 was released 20070307
3354 ==============================================================
3357 * Non-CID PostScript-based Opentype fonts are now combined over
3358 the entire document, and properly subsetted. The code is
3359 borrowed from xdvipdfmx with some minor adjustments
3361 Adding support for CID-keyed OpenType fonts would not be hard
3362 but at the moment I lack example input (and incentive).
3364 * A small extension to the virtual fonts structure: you can use
3366 f.fonts[1] = { 'id' = 38}
3368 to do a backreference to a previously defined font. This saves quite
3371 * There was a bug in the handling of \leaders in the output whereby
3372 it's width was taken to be twice what it should be while writing
3373 to the PDF, fixed now.
3375 * The font inclusion code is cleaned up a bit by Hartmut.
3377 * Some compilation problems were fixed.
3379 * There is (quite a bit of) debugging information printed out when
3380 OTPs are in use, because I am tracking down a bug reported by Idris.
3382 The input of each and every OTP step is shown on the terminal in
3385 [57902][1568][58423][1568][58408][1568][58921]
3387 those are the decimal values of ocp i/o characters. If you don't
3388 need them, don't worry about it.
3390 ==============================================================
3391 Luatex snapshot-20070302 was released 20070302
3392 ==============================================================
3394 * The 'snapshot version' banner is now calculated dynamically
3395 at build time. This aids in figuring out what binary people
3396 are actually running, but it can possibly break the build on
3397 systems that do not have a `date` command.
3399 * The do_vf() function that checks for virtual font existance
3400 is now run immediately after the font definition instead of
3401 being postponed until characters are output.
3403 * The 'define_font' callback interface has changed a little.
3405 retval = function (name,size,fontid)
3407 where fontid is the internal font number of the font that
3408 is currently being defined, and retval can be either a table
3409 (as before) or a different, previously defined fontid. This is
3410 useful if a previous definition can be reused instead of
3411 creating a whole new font structure.
3413 * The internal font data structure has been redone. Glyph index
3414 inside a font is now handled by a sparse array, so that use
3415 of e.g. 0xFB01 (fi-ligature) no longer creates a 64000+ entries
3418 * The internal cache-ing of font metric information is turned
3419 off completely, because it was based on the assumption that
3420 name + size were a unique identifier for a font. This can no
3421 longer be guaranteed.
3423 * word boundary processing now works OK again, thanks to the
3424 introduction of two virtual characters in the font table
3425 definition. Besides the normal numeric entries in the
3426 f.characters table, there can now also be two string keys:
3427 "left_boundary" and "right_boundary". The ligatures and kerns
3428 of the 'left_boundary' character are used for the pre-word
3429 boundary processing, ligatures and kerns between characters
3430 and 'right_boundary' are used for the post-word processing.
3432 * Lua font table references are no longer cached by the
3433 executable ,in order to preserve memory. (the only downside
3434 is that font.fonts[] access is now slower because of the need
3435 to recreate the lua table).
3437 * There are other some small changes to the font table formats.
3438 Please see the manual for details.
3440 * A 'real' font can now still have virtual characters if they
3441 are loaded via lua. Just set the 'commands' section and/or
3442 the 'fonts' array to your liking, and it should work out.
3444 If you have created no 'fonts' array at all, then the default
3445 font (indentifier '1') is the current font, so that you
3446 can create virtual duplicates of already existing characters.
3448 Note: this does not work the other way. There can not be
3449 'real' characters in a virtual font!
3451 * Truetype-based opentype fonts no longer require Acrobat 7
3452 t(hey are now written out as if they are normal truetype).
3454 * A lua init script can now set 'texconfig.formatname' and/or
3455 'texconfig.jobname'. If ther is no file or format specified
3456 on the commandline, then, if, one of those keys is present,
3457 that key will be used instead of simply quitting with an
3460 * Placement of boxes and rules in right-to-left mode is debugged,
3461 and now seems to work ok.
3463 * Virtual font loading is debugged.
3465 * Some memory leaks are resolved
3467 * HZ font expansion should work ok again, but is not tested.
3469 * a few of the warning during opentype loading have been removed
3470 because the problems are rather harmless and turned out to be
3471 triggered by almost every font.
3474 ==============================================================
3475 Luatex snapshot-20070218 was released 20070218
3476 ==============================================================
3478 * The pdftex stuff is now updated to 1.40.3
3479 (and on top of that, it still has those extra patches announced in
3482 * The virtual font parser is debugged and now appears rather stable.
3484 * There is one extra virtual command:
3487 {"slot", 1, 97}, -- place character 97 'a' in local font 1.
3490 This is just a shortcut for {"font",1}, {"char", 97}
3492 * Some small memory leaks have been fixed. Luatex does not leak big
3493 time, but I'd like to get back to valgrind reporting '0 out of 0',
3494 instead of the current 800 bytes or so (that is a slow process).
3496 * You can read a truetype or opentype font from within lua code
3497 using font.read_ttf() or font.read_otf(), respectively.
3499 This feature uses a fair bit of the fontforge code, making the
3500 binary rather a bit larger than before. Just so you know.
3502 Apple (AAT, as well as encoding) support is still largely missing,
3503 and bitmap-only and old Multiple-Master truetype fonts are not
3504 supported at all (and never will be).
3506 The output format is (shadily) documented in the reference manual.
3507 At the moment, it very closely resembles the internal font stucture
3508 that is used by fontforge.
3510 * LuaTeX can now write wide OpenType fonts to the PDF file.
3512 There is no subsetting support yet, and a ToUnicode CMap is also
3513 still missing, but nevertheless it is already somewhat useful. The
3514 rule is very simple: if a font uses code points above 255, then it
3515 is considered to be a `wide' font, and it will be written out as
3516 a Type0 CID-keyed font to the PDF.
3518 Caveat: Getting suitable metrics into LuaTeX can be a bit of problem
3519 right now, because font.read_otf() does not produce anything that
3520 can be fed back into define_font without extra processing. Hans has
3521 some experimental Lua code for ConTeXt (of course :-)) and that is
3522 how I know it works. You can expect a nicer interface soon,
3523 hopefully next week, in the form of a simplistic table conversion
3526 * I have started work on supporting Aleph's bidi typesetting in PDF
3527 mode as well, simple text seems to be largely ok. More complicated
3528 documents will no doubt still show some bugs, but fixing those will
3529 be easy (once they are discovered). Exactly what happens with specials
3530 is not yet investigated.
3532 * Omega's (16-bit) wide virtual fonts now work OK in PDF mode. This
3533 means that many Aleph files can now be run in PDF mode directly.
3534 (the documents that use UTF-8 input encoding)
3537 ==============================================================
3538 Luatex snapshot-20070202 was released 20070202
3539 ==============================================================
3542 * The pdftex stuff is now updated to 1.40.2, and on top of that, it has
3544 - an extra patch from Han The Thanh that adds a primitive to control
3545 the merging of fonts from external pdf images (\pdfreplacefonts),
3546 and a bugfix for virtual font handling.
3548 - an extra patch by Hartmut Henkel that removes a number of malloc()s
3549 and free()s from the calls to the compression library, thereby
3550 making luatex run a bit faster.
3552 * luatex now happily accepts the following low-level syntax:
3554 \font\myfont = <general text> <at specifier>
3556 It feeds the <general text> to either kpathsea or a lua script for
3557 further processing after stripping the braces.
3559 In itself, this is not all that useful, but the reason for this
3560 syntax extension is that it paves the road for a macro package
3561 to do something like this:
3563 \font\myfont = {font="Times New Roman", color="\darkred",
3564 encoding="ec", features="liga", size=10bp}
3566 without having to resort to system-specific quoting mechanisms.
3567 Macro (and other) expansion takes inside the braced argument.
3569 (I am considering adding this extension to \input as well).
3571 * It is now possible to define a font into the font.fonts[]
3572 directly from lua, but becayse use is limited, I am only
3573 mentioning it to be complete.
3576 <number> id = font.define(<table> font)
3578 * There is a (not very reliable yet) virtual font parser accessible
3582 <table> vfdata = font.read_vf(<string> name, <number> size)
3584 The interpreter tries to give a reasonable representation of a
3585 virtual font file (the .vf file). Besides a few simple top-level
3588 designsize -- in scaled points
3590 name -- the file name
3591 checksum -- the vf checksum
3592 header -- the header comment (if any)
3594 it also has a top-level array 'fonts' wherein each item is a mini-
3595 array describing one of te mapped fonts. An example makes this
3598 "fonts" = { {"ptmr8a",655360}, {"psyr", 600000} }
3600 says that the first referenced font (index 1) in this virtual font
3601 is ptrmr8a.tfm loaded at 10pt, and the second is psyr.tfm loaded
3602 at a little over 9pt. These index numbers are used by the character
3603 command definitions that follow.
3605 At top level, there is a 'characters' array, just as for a normal
3606 font, except that each item has only two keys:
3608 "width" -- the tfm width (as stored in the .vf)
3609 "commands" -- an array of virtual font commands for a character.
3611 each of the items in the 'commands' array is itself a tiny hash.
3613 Each of those mini-hashes represents a single character packet
3614 command. Here is a 'commands' entry that contains every possible
3618 {"push"}, -- remember where we are
3619 {"right", 5000}, -- move right 0.08pt
3620 {"font", 1}, -- select the fonts[1] entry
3621 {"setchar", 97}, -- place character 97 'a'
3622 {"pop"}, -- go all the way back
3623 {"down", -200000}, -- move *up* about 3pt
3624 {"special", "pdf: 1 0 0 rg"} -- switch to red color
3625 {"rule", 500000, 20000} -- draw a bar
3626 {'special',"pdf: 0 g"} -- back to black
3630 * But the big news is that you can now define your own virtual fonts
3631 on the fly, by adding a few statements to the table returned to
3632 the 'define_font' callback.
3634 There are a few requirements:
3636 - The table has to have a top-level key 'type', and it's value
3639 The presence of this key with the specific value 'virtual'
3640 will trigger handling of the rest of the special virtual font
3641 fields in the table, but the mere existance of 'type' is
3642 enough to prevent luatex from looking for a virtual font
3645 Therefore, this also works 'in reverse': if you are absolutely
3646 certain that a font is not a virtual font, assigning the value
3647 'base' or 'real' to 'type' will inhibit tex from looking for a
3648 virtual font file, thereby saving you a disk search.
3650 - There must be a top-level 'fonts' array, as explained above.
3651 Any fonts that are not yet known to luatex at that moment,
3652 will be loaded automatically (Warning: do not ever use a font
3653 in 'fonts' with the same name you will return in the table you
3654 are defining right now!).
3656 - Each and every character in the fonts needs to have a 'commands'
3657 key, as explained above.
3659 The main point behind these restrictions is that a font is
3660 *either* a base font *or* a virtual font. It cannot be both
3664 ==============================================================
3665 Luatex snapshot-20070126 was released 20070126
3666 ==============================================================
3669 * Underscores in pascal identifiers are now retained.
3671 This took quite a bit of work. The web2c conversion tools
3672 needed only small adjustments, but most of the existing C
3673 code depended on the removal of the underscores. I had to
3674 go through changing many lines. 99% of all identifiers are
3675 now written the same on the pascal side as on the C side.
3676 This makes writing interface code quite a bit less confusing.
3678 Not everything is completely clean yet, because I did
3679 not want to change the web2c-specific C files. I often
3680 took the other approach and removed the underscores
3681 from the web2c options (like 'parsefirstlinep') in the
3682 change file instead. Ugly, but predictable.
3684 There is about a dozen or so of #defines left, that map
3685 memoryword -> memory_word
3689 * The virtual font parsing and interpreting is now done in C.
3690 (this is because it needs to be interfaced with the lua-based
3693 * I am in the process of merging: the VF stuff; the TFM stuff;
3694 the lua font loading; and the pdftex font backend into one
3695 interface, so there were some smallish changes relating to
3696 that as well. Nothing worth mentioning just yet except that
3697 luatex now will read "ovf" files as well as "vf" files.
3699 * There are a few really small bugfixes for bug reports I received
3700 on this list and by email.
3702 ==============================================================
3703 Luatex snapshot-20070119 was released 20070119
3704 ==============================================================
3706 The largest new bit is the existence of a font.fonts array, that you
3707 can use to query/adjust the internal defined tex fonts. See the manual
3710 Two small new lua extensions are added as well:
3712 * os.setenv() -- to change the environment
3713 * os.exec() -- a non-returning os.execute()
3715 And a bit of cleanup in the commandline processing.
3718 ==============================================================
3719 Luatex snapshot-20070117 was released 20070117
3720 ==============================================================
3722 * the pdftex core is updated to 1.40.1, and web2c to 7.5.6
3724 * the pdftex-specific documentation is removed
3726 * lua lpeg library updated to 0.4
3727 ( http://www.inf.puc-rio.br/~roberto/lpeg.html )
3729 * the C part of the lua md5 library is added to the binary
3730 ( http://www.inf.puc-rio.br/~roberto/md5/md5-5/md5.html )
3732 * --luaonly now puts the script itself at arg[0], and
3733 preceding commandline items in the negative indices
3734 (instead of starting the count at zero).
3735 This new approach is compatible with the standalone lua
3739 ==============================================================
3740 Luatex snapshot-20070107 was released 20070107
3741 ==============================================================
3743 Hot on the heels of 20070105, a new snapshot. It turns out
3744 that using the callback to define a font broke all ligatures.
3745 This snapshot fixes that, and it has a few minor updates to
3746 the manual. Next shapshot will be after the inclusion of
3749 ==============================================================
3750 Luatex snapshot-20070105 was released 20070105
3751 ==============================================================
3753 * the calculations that converted lua strings into tex units
3754 were horrendously wrong, this was discovered by Pawel.
3756 * io.lines() was still using the old, line ending sensitive,
3757 code from the lua core distribution
3759 * The main font memory is allocated as needed^(1) instead of
3760 statically pre-allocated.
3762 * ligatures and kerns are separated completely from each other,
3763 so use of \noligatures no longer inhibits kerning as well
3765 * Metrics can be loaded using a callback: 'define_font'.
3766 The value returned should be a lua table representing a tfm
3769 * there is a new lua table: font. It has one function:
3770 font.read_tfm() that returns a table reprentation of the tfm
3771 contents, for use with the above mentioned callback
3773 * I dropped suppport for "Level 1" OFM files. I would like
3774 to have a try at those extended font files, but I lack
3775 examples (fonts nor documents). I am not even sure such
3776 fonts have ever existed in the 'real world'.
3780 ==============================================================
3781 Luatex snapshot-20061208 was released 20061208
3782 ==============================================================
3784 * There is a new switch: --safer. This disables a number of lua
3785 functions that are more or less dangerous (a detailed list is
3788 * Two longstanding bugs have been fixed: \latelua works once
3789 again (patch by Hartmut) and a bug that caused mysterious crashes
3790 turned out to be a problem inside the paragraph builder
3791 (reconstitution of ligatures)
3793 * Six new string iterators have been added to the string library:
3794 string.characters (one 1-letter string)
3795 string.bytes (one byte)
3796 string.characterpairs (two 1-letter strings)
3797 string.bytepairs (two bytes)
3798 string.utfcharacters (a one-character utf-8 string)
3799 string.utfvalues (a unicode code point number)
3801 * The top 256 values of the unicode range (starting at hex
3802 value "10FF00) are now reserved for byte output. Characters
3803 in that range will be written by luatex after substracting
3804 that offset. The net result is that \char"10FFA9 is written
3805 as byte value hex A9 = decimal 169 = copyright sign in latin1
3807 This trick allows byte-oriented output to \pdfliterals and
3808 \specials, but should be considered very experimental.
3810 * There is a new callback called 'process_input_buffer' that can
3811 be used to mutate the line buffer just before LuaTeX actually
3812 starts looking at it.
3814 * The statistics table now has readable items
3816 statistics.lasterrorstring
3817 that represent TeX's current input id and the last error string
3819 * The show_error_hook callback no longer receives any arguments
3820 * There is a new switch: --safer. This disables a number of lua
3821 functions that are more or less dangerous (a detailed list is
3824 * Two longstanding bugs have been fixed: \latelua works once
3825 again (patch by Hartmut) and a bug that caused mysterious crashes
3826 turned out to be a problem inside the paragraph builder
3827 (reconstitution of ligatures)
3829 * Six new string iterators have been added to the string library:
3830 string.characters (one 1-letter string)
3831 string.bytes (one byte)
3832 string.characterpairs (two 1-letter strings)
3833 string.bytepairs (two bytes)
3834 string.utfcharacters (a one-character utf-8 string)
3835 string.utfvalues (a unicode code point number)
3837 * The top 256 values of the unicode range (starting at hex
3838 value "10FF00) are now reserved for byte output. Characters
3839 in that range will be written by luatex after substracting
3840 that offset. The net result is that \char"10FFA9 is written
3841 as byte value hex A9 = decimal 169 = copyright sign in latin1
3843 This trick allows byte-oriented output to \pdfliterals and
3844 \specials, but should be considered very experimental.
3846 * There is a new callback called 'process_input_buffer' that can
3847 be used to mutate the line buffer just before LuaTeX actually
3848 starts looking at it.
3850 * The statistics table now has readable items
3852 statistics.lasterrorstring
3853 that represent TeX's current input id and the last error string
3855 * The show_error_hook callback no longer receives any arguments
3857 * The statistics table now has readable items
3858 statistics.luabytecodes
3859 statistics.luastates
3860 statistics.luabytecode_bytes
3861 statistics.luastate_bytes
3862 for memory statistics reporting
3865 * The statistics table now has readable items
3866 statistics.luabytecodes
3867 statistics.luastates
3868 statistics.luabytecode_bytes
3869 statistics.luastate_bytes
3870 for memory statistics reporting
3873 ==============================================================
3874 Luatex snapshot-20061204 was released 20061204
3875 ==============================================================
3877 * The LuaTeX interpreter can now be run as a standalone lua script
3878 processor, by using a commandline like this:
3880 luatex --luaonly=luatools.lua
3882 * Luafilesystem (http://www.keplerproject.org/luafilesystem/ ) is
3885 * There are a total of eight new file discovery callbacks:
3894 this enhances the orthogonality of the callback system, nothing
3895 fundamental is changed.
3897 * There is a new callback called 'process_input_buffer' that can
3898 be used to mutate the line buffer just before LuaTeX actually
3899 starts looking at it.
3901 * The 'reader' and 'close' functions from 'open_read_file' now
3902 receive the table they are defined in as a function argument,
3903 that can be used as a per file localized data store.
3905 * Updated the Lua to the latest 5.1.1, with all known bug patches
3906 from the website applied as well
3908 * Runtime autoloading of lua .so files is now off on all platforms.
3910 * The statistics table now has readable items
3912 statistics.linenumber
3913 that represent TeX's current file name and line number
3915 * The support for user-defined type3 font .pgc files and the
3916 associated 'read_miscfonts_file' callback has been removed.
3917 (nobody used it anyway)
3919 * General cleanups to the source tree and build process.
3921 ==============================================================
3922 Luatex snapshot-20061023 was released 20061023
3923 ==============================================================
3925 * there was a missing callback: find_font_file
3926 * program_invocation_name was not set
3927 * buf_size could not be more that 300k
3930 ==============================================================
3931 Luatex snapshot-20061013 was released 20061013
3932 ==============================================================
3934 Last friday I uploaded a new snapshot and today I finally
3935 finished updating the manual to go with it. The changes all
3936 relate to startup, file i/o, and callbacks. The main achievement
3937 is: you can now run luatex without it *ever* initializing kpathsea.
3939 Because I am lazy, I have checked in the pdf of the manual
3940 as well, so that I can say: Please look at
3942 https://foundry.supelec.fr/plugins/scmsvn/viewcvs.php/manual/
3943 /luatexref-t.pdf?root=luatex&rev=148&view=log
3945 for all the details. :-)
3947 ==============================================================
3948 Luatex snapshot-20061002 was released 20061002
3949 ==============================================================
3952 * Some infrastructure changes:
3954 libs/slnunicode-0.9.1/ renamed to libs/slnunicode/
3958 (zziplib is using a different version of autofoo. I know I have
3959 messed up something in the build process, but the bit we need
3960 compiles ok so I've postponed attempting to fix it)
3962 * The callback logic has changed quite a bit.
3964 - all callbacks are now only possible in lua state 0.
3966 - The callback 'input_line' has disappeared, and is replaced by
3967 'open_read_file'. One of the return values of that callback
3968 is a table that defines a 'reader' function for line reading.
3970 See the manual for further information on this.
3972 - There are some new callbacks for the reading of various binary
3973 files. The current ones are:
3975 "read_ocp_file", "read_vf_file", "read_data_file", "read_font_file",
3978 The rest of the file types will follow soon (fonts, enc files, and
3981 - There are also some new callbacks that 'find' a file's pathname:
3983 "find_truetype_file", "find_type1_file", "find_image_file"
3985 here too, more will follow later.
3987 - the functions from io. that were copied to texio have been removed
3988 again. The new callbacks do not pass file pointers around, so
3989 they ere not longer needed
3991 - the 'open_write_file' is temporarily unavailable
3993 * startup.lua is now always loaded into lua state 0
3995 * The luazip library from kepler is linked in, so there the table 'zip'
3996 is accessible from all lua states.
3998 ==============================================================
3999 Luatex snapshot-20060922 was released 20060922
4000 ==============================================================
4002 * The texio table has gained a new function:
4004 tex_file = texio.open(filename)
4006 returns a file handle of a type that luatex can use
4007 internally (the return of io.open is unusable in callbacks
4008 because it will be garbage-collected at a random time)
4011 * In related news, there are two new callbacks you can define:
4013 callback.register('open_read_file', f)
4014 callback.register('open_write_file', f)
4016 where your function should have the following conventions:
4018 function f (number id_number, string asked_name)
4019 return boolean success, string actual_name, tex_file filep
4022 id_number: zero for the log or \input files or TeX's \read
4023 number incremented by one (\read0 becomes 1).
4024 asked_name: the user-supplied filename
4026 success: return false for error, true otherwise.
4028 The remaining two items are only looked at if you return true:
4030 actual_name: the true filename used (with extension!)
4031 filep: a file object opened though texio.open()
4034 * The tex.print function has an extra optional parameter:
4036 tex.print(ctt_id n, strings ...)
4038 This prints the strings using the catcode regime defined by
4039 \catcodetable n (assuming n is valid, see below)
4041 * The new function tex.sprint has the same lua conventions as
4042 tex.print, but behaces slightly different on the tex side:
4044 ** tex does not switch to the 'new_line' state (this implies
4045 that leading spaces are not ignored)
4046 ** no \endlinechars are inserted
4047 ** trailing spaces are not removed from the argument
4049 * Catcode tables are a completely new feature, that allows
4050 you to switch the current catcode regime in one simple
4053 \catcodetable <count>
4055 Switches to the use of a different set of catcodes (table),
4056 that is stored under the number <count>. Such a table has to
4057 be previously created using one of the two command below, or
4058 the number 0 (which is pre-inititialized)
4060 This command obeys normal grouping rules.
4062 \initcatcodetable <count>
4064 creates a new, global, independent catcode table with catcodes
4065 matching the code that are predefined by initex (tex -ini).
4067 This allocation is global
4069 \savecatcodetable <count>
4071 copies the current set of catcodes to a new, global, table
4072 with id number <count>. The definitions in this new table
4073 are all treated as if they were made in the outermost level.
4075 This allocation is global
4077 At the end of each grouping level, items within all existing
4078 catcodetables are restored, regardless of which one is the
4079 currently active table.
4081 Catcode table numbers cannot be larger than 0xFFFFFFF (228-1)
4083 * There is a new lua table: lua. It contains three read-only
4086 lua.id -- the id number of the instance
4087 lua.version -- a luatex version identifier string
4088 lua.startupfile -- the full filename (+path) of startup.lua
4090 and it also contains a read/write array:
4092 lua.bytecode[] -- lua executable bytecode
4094 This array can be used to save and restore lua functions
4095 across lua states. The accepted values are for assignments
4096 are functions and nil. Likewise, the retrieved value is
4097 either a function or nil.
4099 The contents of the lua.bytecode array is stored inside the
4100 format file, so it can also be used to preload lua code.
4103 * The format files are quire a bit smaller than before
4106 ==============================================================
4107 Luatex snapshot-20060915 was released 20060915
4108 ==============================================================
4110 * There is a new TEX primitive: \formatname. It is similar
4111 to \jobname (read-only). In initex, the expansion is empty,
4112 otherwise the expansion is the same as the \jobname from
4115 * the lua "tex" table has been expanded with a few of the 'convert'
4116 codes (read-only). The supported ones at this moment are:
4123 tex.pdfnormaldeviate
4130 This list looks haphazard, but it really is not. These are
4131 all the cases of the 'convert' internal command that do not
4132 require an argument.
4134 * The metatables of the subtables like tex.dimen[] etc. are now
4135 adjustable from lua (not that I recommend doing that;-)).
4137 * On the lua side, there is a new global value: "luaid"
4138 It holds the internal id number of this \directlua instance.
4140 * There is a new lua table, "callback", that has the single function
4141 "callback.register", used to register callbacks. This replaces
4142 the previous concoction (see my message about snapshot 20060901).
4145 callback.register(<callback name>,function (f) ... end)
4147 where the <callback name> is for the moment, either "input_line"
4148 or "show_error_hook".
4150 This function internalizes the callback function in such a way
4151 that you no longer have to worry about \luacallback (which has
4152 been removed), nor does it matter if you redefine a function
4155 The internal testing for callback presence is also quite a bit
4156 faster, thanks to this change. Callback assignments are global
4157 and the "input_line" always takes effect starting on the next
4158 input line to be read from an actual file.
4161 * \detokenizedlua has been removed. It is functionally replaced by
4162 the new function call tex.write("").
4164 Each argument to each call of tex.write () counts as an input
4166 ** all catcodes on that line are either 'space' (for " ") or
4167 'character' for all others.
4168 ** there is no \newlinechar appended.
4170 * The implementation of tex.print() has changed as well:
4172 ** the very last tex.print() line from a \directlua
4173 will no longer have a trailing \newlinechar
4174 (this is very convenient when \directlua is used
4176 ** tex.print() is quite a lot faster than before, and the total amount
4177 of returnable text from a \directlua is now only limited by
4178 available system RAM. However, each separate tex.print ()
4179 argument has to fit in TeX's input buffer.
4181 * The new primitive \luastartup can be set inside the format file
4182 to specify the lua instance number in which a possible runtime
4183 startup.lua script is executed (initex always uses 0)
4185 * There is a new primitive \scantextokens. Differences with
4186 eTeX's \scantokens are:
4188 ** the last line (usually only) from \scantextokens
4189 does not have a \newlinechar
4191 ** \scantextokens never raises an eof error.
4193 This means things like
4196 {\scantextokens{\ifnum1=1 true}\else false\fi}
4198 are legal input (but potentially dangerous!).
4201 local d = tex.dimen["unknowndimen"]
4202 'd' will now become "nil" instead of raising an error
4205 tex.dimen["unknowndimen"] = d
4206 is still (and probably will remain) illegal
4208 ==============================================================
4209 Luatex snapshot-20060908 was released 20060908
4210 ==============================================================
4212 * BIG CHANGE: \directlua now runs \scantokens internally.
4214 There is no longer a need to call scantokens yourself, the
4215 tex.print() output is now fed straight into a pseudo file.
4216 This is quite a bit faster as well as easier to use, but
4217 just in case you want it, the old behaviour is still present,
4223 * The texio library now has its own (partial) set of I/O commands,
4224 so that the standard lua io library is back to the distributed
4225 state (no more patched garbage collector)
4227 Note: This is really a very small change (it should not have any
4228 impact on wellbehaved input files), but I attempt to be complete
4229 in these notes, since there is no official documentation yet.
4232 * There is a new standard library available: kpse
4234 The most important function in that library is find_file:
4236 string = kpse.find_file(string filename
4238 [,boolean mustexist])
4240 both "type" and "mustexist" are optional, so the function
4241 has from one upto three arguments.
4243 "type" is like the '-format' argument of kpsewhich. You can
4244 run 'kpsewich -h' for a list. The default type is "tex".
4246 "mustexist" is like '-must-exist', and the default is false.
4247 If you specify "true" (or a nonzero integer), then the kpse
4248 library will search the disk as well as the ls-R databases
4250 The new library also has three other functions that map
4251 straight to kpsewhich commandline options:
4253 string = kpse.expand_path(string)
4254 string = kpse.expand_var(string)
4255 string = kpse.expand_braces(string)
4257 * There is a second callback possibility:
4259 texio.show_error_hook(string message,
4260 string|number indicator,
4263 This command is run from inside the TeX error function, and the
4264 idea is to allow you to do some extra reporting on top of what
4265 TeX already does (none of the normal actions are removed).
4267 "message" is the formal error message tex has given to the
4268 user (the line after the "! ")
4269 "indicator" is either a filename (when it is a string) or a
4270 location indicator (a number) that can means lots of different
4271 things like a token list id or a \read number.
4272 "lineno" is the current line number
4274 This is an investigative item only, comments are welcome but do
4275 not take the syntax seriously.
4277 The final goal IMO is the total replacement of TeX's error
4278 handling routines, but that needs lots of adjustments
4279 in the web source because TeX deals with errors in a somewhat
4280 haphazard fashion (it needs unification first). The current
4281 hook is only for 'testing the water'.
4283 * It is now possible to use named items in the
4289 subtables, so you can have
4291 tex.count.scratchcounter = 0
4292 local enormous = tex.dimen["maxdimen"]
4294 Luatex looks up the value for you on the fly. You have to use a
4295 valid \countdef (or \dimendef, or \toksdef), anything else will
4298 In a normal TeX file, you don't do \dimen\maxdimen, but the
4299 lua syntax seems to be a bit cleaner to me. The intention is
4300 to evntually also allow \chardefs and macros that expand
4301 into a number (todo)
4304 * The tex table has also been extended with a large list of internal
4305 parameters (partially read/write). It is possible to access
4306 about every primitive that you can use after \the *and* is a
4307 single token. So there is
4309 integer = tex.tracingcommands (\the\tracingcommands)
4310 integer = tex.prevgraf (\the\prevgraf)
4311 string = tex.output (\the\output)
4313 etc. for all of the internal parameters, but not the items
4314 that need extra arguments (like \the\scriptfont )
4316 The subset comprising simple integer and dimension registers
4317 are writable as well as readable (stuff like \tracingcommands
4320 The fact that both lists are still quite limited is a result of
4321 the very different types of things that can occur after \the and
4322 also on the LHS of an assignment. The remaining primitives will
4323 be filled in when there is a real need or implementation becomes
4324 simple, whichever comes first.
4328 ==============================================================
4329 Luatex snapshot-20060901 was released 20060901
4330 ==============================================================
4332 All changes are related to lua this time, and most are quite unstable
4333 / experimental. But first the things that are stabel/fixed bugs:
4335 * A VF loading bug that turned up in some of Hans' fonts
4338 * A small series of bounds checking fixes to \ocplist has been
4339 added to prevent the system from crashing due to array indexes
4340 running out of bounds.
4342 * The Lua file searching paths are now fixed. The search path for lua
4343 script files now contains the following items (tried in order)
4344 1. the local directory:
4346 (for document-specific files)
4347 2. the items from the expansion of kpathsea's $TEXMFSCRIPTS variable,
4348 but only the parts containing 'lua' as a subpath:
4349 $TEXMFSCRIPTS<lua>/?.lua
4350 $TEXMFSCRIPTS<lua>/?/init.lua
4351 (for format-specific files)
4352 3. the $SELFAUTOPARENT sibling directory named 'lib'.
4353 $SELFAUTOPARENT/lib/lua/5.1/?.lua
4354 $SELFAUTOPARENT/lib/lua/5.1/?/init.lua
4355 (for files that are not related to tex)
4357 The search path for dynamic libraries has only
4358 1. the local directory:
4360 (for document-specific files)
4361 2. and the $SELFAUTOPARENT sibling directory named 'lib'.
4362 $SELFAUTOPARENT/lib/lua/5.1/?.so
4364 (of course the extension is .dll on windows, but .dlls do not
4365 work at the moment so it will not do you much good)
4367 * There are two functions available within a new table called
4369 texio.write (luastring)
4370 texio.write_nl (luastring)
4371 both write the luastring to the same location(s) TeX writes
4372 its stuff. So if \batchmode is on, it writes only to the
4373 log, inside a \write, it prints to the current write file,
4376 A read|write interface to TeX's "file selector" will
4379 * At startup, luatex searches for a script named
4381 in the path list I explained above. If such a file exists, it is
4384 This happens right before the first input file needs to be opened
4385 (that is after format loading, but before any \everyjob tokens).
4387 From within the script, you can check the value of
4391 that is the 'format identification' as used by TEX. When the variable
4392 is equal to nil, luatex in in 'initex' mode, otherwise it will be
4393 something like: " (format=plain 2006.9.1)"
4396 Now for the experimental portion: callbacks. Here is what I have done
4399 * The main reason for wanting startup.lua is file (input) re-encoding.
4400 For this purpose, it is now possible to set up a callback for
4403 If you attach a Lua function to
4407 then from the next input line onwards, luatex will run that
4408 function whenever it needs a new input line from a text file.
4410 Your function will receive a file handle as argument, and
4411 should return either a string or nil (with nil signalling that
4412 the end of file has occurred).
4414 The trivial case is simply this:
4419 texio.input_line = reader
4422 Warning: The implementation is not totally finished yet. For the
4423 moment the file handle ("f" in the example) is a normal lua file,
4424 with a simple but important restriction: you cannot alter its value.
4425 You cannot f:close() it, or assign it a different value. luatex
4426 will eventually close the file itself.
4428 The restriction is a side-effect of a synchronisation problem with
4429 the lua garbage collector. Because of this, it also was necessary
4430 to turn off the automatic file closing code for normal lua io
4431 files (In other words: you have to close yourself all the files
4432 you opened yourself, and you should not close any files you did
4435 In the near future, "f" will become a special 'texio' file object
4436 and the needed functionality from the normal io library will be
4437 reimplemented. Along with that change, there will also be a callback
4438 to open (i.e. find) files, and a simple interface to the compiled-in
4439 kpathsea to use within that callback.
4442 ==============================================================
4443 Luatex snapshot-20060825 was released 20060825
4444 ==============================================================
4446 The main change in this snapshot is that it uses far less memory.
4447 luatex -ini on my linux machine went from 326Mb (last week) to
4448 93Mb (now), and "texexec luatex" now ends at 184Mb instead of
4451 This is achieved by two big changes:
4453 * The \mathcode, \delcode, \catcode, \sfcode, \lccode and \uccode
4454 tables are now sparse arrays that are implemented in C. They
4455 are no longer part of the TeX "equivalence table" and because
4456 each had 1.1 million entries with a few memory words each, this
4457 makes a major difference.
4459 See mathcodes.c and textcodes.c if you are interested in the
4460 gory details, but be warned: the code is still extremely
4461 rough and ugly. In particular, the dump and undump routines
4462 are far from optimal, resulting in somewhat larger format files
4463 than before (approx 1.3Mb larger with unicode-letters loaded,
4464 10k without); and the assignments do not show up when using
4465 the etex tracing routines \tracingassigns and \tracingrestores
4466 (code simply not written yet)
4468 * Single-character commands are no longer "special" internally,
4469 they are stored in the hash just like the multiletter csnames.
4472 ==============================================================
4473 Luatex snapshot-20060818 was released 20060818
4474 ==============================================================
4476 The snapshot is up to par with Aleph-RC4 (from texlive devel)
4477 and the latest pdftex beta (even newer than 20060811). However,
4478 there are some differences, to summarize:
4480 * There is no pool file (all strings are embedded)
4482 * -8bit and -translate-file are silently ignored
4484 * There is no mltex nor enctex (conflicts with aleph)
4486 * The tex functionality is always present and enabled
4487 (but see below about TeXXeT), so the asterisk or
4488 -etex switch for initex is not needed
4490 * "plus 1 filllllllll" does not generate any errors from TeX
4492 * TeXXeT (from eTeX) is not present, so the primives
4500 * The experimental pdftex regex match operations are removed,
4501 because that feature does not make much sense when lua is
4502 available so the primitives
4507 * The input translations from Aleph are not implemented, the
4508 16 related primitives are all missing
4514 \noDefaultOutputMode
4517 \DefaultInputTranslation
4518 \noDefaultInputTranslation
4521 \DefaultOutputTranslation
4522 \noDefaultOutputTranslation
4523 \noOutputTranslation
4525 All file IO assumes UTF-8, except that all the low-ascii
4526 controls except TAB, CR en LF are written to the terminal
4527 using ^^ notation (even these are binary in the log file).
4529 * Input characters can use the full range of Unicode,
4530 but it probably only makes sense to use values above
4531 the base plane for \mathcode and \catcode assignments,
4532 since the fonts as well as the hyphenation patterns
4533 are strictly 16-bit still.
4536 \pdfpagewidth and \pagewidth,
4537 \pdfpageheight and \pageheight,
4538 \fontcharwd and \charwd,
4539 \fontcharht and \charht,
4540 \fontchardp and \chardp,
4541 \fontcharic and \charic,
4542 are all aliases of eachother.
4546 clears a marks class completely.
4548 * The experimental pdftex primitives
4553 and provided without the extra 'pdf' prefix, so they are
4561 * I probably forgot to mention some things :-)