Bug#1002547: RFP: tokenize-rt -- Wrapper around the stdlib tokenize which roundtrips

[Bastian Germann <bage@debian.org>]

Package: wnpp
Severity: wishlist
Control: block 988658 by -1

* Package name    : tokenize-rt
  Upstream Author : Anthony Sottile
* URL             : https://github.com/asottile/tokenize-rt
* License         : Expat
  Programming Lang: Python
  Description     : Wrapper around the stdlib tokenize which roundtrips

The stdlib tokenize module does not properly roundtrip. This wrapper around the stdlib provides two 
additional tokens ESCAPED_NL and UNIMPORTANT_WS, and a Token data type.

This library is useful if you're writing a refactoring tool based on the python tokenization.
E.g., it is needed as a pyupgrade dependency.