Add code to render pseudo-tokens, and correct the 'start' position
commit6bb913a0cdedf6abd8d119b00522cf812c603527
authorcrawley <crawley@407389f7-7c16-0410-9eee-ad85acb55d7f>
Sun, 31 May 2009 05:56:03 +0000 (31 05:56 +0000)
committercrawley <crawley@407389f7-7c16-0410-9eee-ad85acb55d7f>
Sun, 31 May 2009 05:56:03 +0000 (31 05:56 +0000)
tree5deb9553825d32e8a8657412abcdfeaeb2c85d65
parent90c814a3390dc8275de430ff15c27ef6aea9135e
Add code to render pseudo-tokens, and correct the 'start' position
recorded for an 'end of stream' token.

git-svn-id: https://jnode.svn.sourceforge.net/svnroot/jnode/trunk@5534 407389f7-7c16-0410-9eee-ad85acb55d7f
shell/src/shell/org/jnode/shell/bjorne/BjorneToken.java
shell/src/shell/org/jnode/shell/bjorne/BjorneTokenizer.java