simplify the lexers
commit8ddc28ca9bb2897db563df8ea1527994fd78a1d4
authorGeorgi Kirilov <>
Sat, 31 Oct 2020 09:50:49 +0000 (31 11:50 +0200)
committerGeorgi Kirilov <>
Fri, 19 May 2023 15:22:54 +0000 (19 18:22 +0300)
tree02ee8b16e11aa5502599110477408880eb5c837c
parentedba420daa0c556afedc1c5001af61aa4850db72
simplify the lexers

The old implementation had some features that did depend on being
able to tell token types apart, but I've given up on these features.

The CPU usage was almost halved after this change.
parser/_lexer.lua [deleted file]
parser/clojure/init.lua
parser/fennel/init.lua
parser/init.lua
parser/lisp/init.lua
parser/scheme/init.lua