Handle weird cases of token pasting
commit9bb46df4b716c5d8c483e66d39d2edb3ceb161f0
authorH. Peter Anvin <hpa@zytor.com>
Wed, 8 Apr 2009 04:59:24 +0000 (7 21:59 -0700)
committerH. Peter Anvin <hpa@zytor.com>
Wed, 8 Apr 2009 04:59:24 +0000 (7 21:59 -0700)
tree3692eb5836c0b99b78954aec41c9811d754cc22d
parent1582d52863ee6f857c1c76e2abe9a413f278e648
Handle weird cases of token pasting

Especially when token pasting involves floating-point numbers, we can
have some really strange effects from token pasting: for example,
pasting the two tokens "xyzzy" and "1e+10" ends up with *three*
tokens: "xyzzy1e" "+" "10".  The easiest way to deal with this is to
explicitly combine the string and then run tokenize() on it.

Signed-off-by: H. Peter Anvin <hpa@zytor.com>
preproc.c
test/weirdpaste.asm [new file with mode: 0644]