Bug#1006278: ITP: tokenize-rt -- A wrapper around the stdlib `tokenize` which roundtrips.

[Jelmer Vernooij <jelmer@debian.org>]

Package: wnpp
Severity: wishlist
Owner: Jelmer Vernooij <jelmer@debian.org>

* Package name    : python-tokenize-rt
  Version         : 2.1.0
  Upstream Author : Anthony Sottile <asotille@umich.edu>
* URL             : https://github.com/asottile/tokenize-rt
* License         : MIT
  Programming Lang: Python
  Description     : A wrapper around the stdlib `tokenize` which roundtrips.

Python's stdlib tokenize module does not properly roundtrip. This wrapper
around the stdlib provides two additional tokens ESCAPED_NL and UNIMPORTANT_WS,
and a Token data type. Use src_to_tokens and tokens_to_src to roundtrip.

This library is useful for writing a refactoring tool based on the python
tokenization.