Installation

Stable release

To install Tokenize UK, run this command in your terminal:

$ pip install tokenize_uk

If you don’t have pip installed, this Python installation guide can guide you through the process.

From sources

The sources for Tokenize UK can be downloaded from the Github repo.

You can either clone the public repository:

$ git clone git://github.com/lang-uk/tokenize-uk

Or download the tarball:

$ curl  -OL https://github.com/lang-uk/tokenize-uk/tarball/master

Once you have a copy of the source, you can install it with:

$ python setup.py install