use floor division and add a test that exercises the tabsize codepath
commitda4fe58131fad40d633c90a5b8a5323cde67784a
authorbenjamin.peterson <benjamin.peterson@6015fed2-1504-0410-9fe1-9d1591cc4771>
Thu, 15 Oct 2009 01:49:37 +0000 (15 01:49 +0000)
committerbenjamin.peterson <benjamin.peterson@6015fed2-1504-0410-9fe1-9d1591cc4771>
Thu, 15 Oct 2009 01:49:37 +0000 (15 01:49 +0000)
treee1b5f8d565d4b3c0d42088eb1bc13a2db33bcb2d
parent157fa98c73871037522cde4f8323a51adbb36fa0
use floor division and add a test that exercises the tabsize codepath

git-svn-id: http://svn.python.org/projects/python/trunk@75430 6015fed2-1504-0410-9fe1-9d1591cc4771
Lib/test/test_tokenize.py
Lib/tokenize.py