parser: Add support for multi-byte characters
commit6c44f4ee0c2b4e96745d83752c64402eaa360a1c
authorHerbert Xu <herbert@gondor.apana.org.au>
Sun, 2 Jun 2024 01:29:06 +0000 (2 09:29 +0800)
committerHerbert Xu <herbert@gondor.apana.org.au>
Sat, 8 Jun 2024 03:43:51 +0000 (8 11:43 +0800)
tree7bfa96a07ca4b48c411478682ca5d475420f922c
parentd6df48c626fbf3bf0c3197927f2ec740d7a8b7ac
parser: Add support for multi-byte characters

Add the requisite markers for multi-byte characters so that the
expansion code can recognise them.  Also allow wide blank characters
to terminate words.

Signed-off-by: Herbert Xu <herbert@gondor.apana.org.au>
src/expand.c
src/mktokens
src/parser.c