Metadata-Version: 1.1
Name: tokenizer_tools
Version: 0.16.0
Summary: Tools for tokenizer develope and evaluation
Home-page: https://github.com/howlandersonn/tokenizer_tools
Author: Xiaoquan Kong
Author-email: u1mail2me@gmail.com
License: MIT license
Description: ===============
        Tokenizer Tools
        ===============
        
        
        .. image:: https://img.shields.io/pypi/v/tokenizer_tools.svg
                :target: https://pypi.python.org/pypi/tokenizer_tools
        
        .. image:: https://travis-ci.com/howl-anderson/tokenizer_tools.svg?branch=master
                :target: https://travis-ci.com/howl-anderson/tokenizer_tools
        
        .. image:: https://readthedocs.org/projects/tokenizer-tools/badge/?version=latest
                :target: https://tokenizer-tools.readthedocs.io/en/latest/?badge=latest
                :alt: Documentation Status
        
        
        .. image:: https://pyup.io/repos/github/howlandersonn/tokenizer_tools/shield.svg
             :target: https://pyup.io/repos/github/howlandersonn/tokenizer_tools/
             :alt: Updates
        
        
        
        Tools/Utils for NLP (including dataset reading, tagset encoding & decoding, metrics computing) | NLP 工具集（包含数据集读取、tagset 编码和解码、指标的计算等）
        
        
        * Free software: MIT license
        * Documentation: https://tokenizer-tools.readthedocs.io.
        
        
        Features
        --------
        
        * 常见数据集格式的读取
        * 多种 Tagset 的编码和解码
        * 指标的计算
        
        TODO
        -----
        
        * 改变项目的名字，tokenizer_tools 已经无法正确描述现在项目的功能
        
        Credits
        -------
        
        This package was created with Cookiecutter_ and the `audreyr/cookiecutter-pypackage`_ project template.
        
        .. _Cookiecutter: https://github.com/audreyr/cookiecutter
        .. _`audreyr/cookiecutter-pypackage`: https://github.com/audreyr/cookiecutter-pypackage
        
        
        =======
        History
        =======
        
        0.1.0 (2018-09-05)
        ------------------
        
        * First release on PyPI.
        
Keywords: tokenizer_tools
Platform: UNKNOWN
Classifier: Development Status :: 2 - Pre-Alpha
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: MIT License
Classifier: Natural Language :: English
Classifier: Programming Language :: Python :: 2
Classifier: Programming Language :: Python :: 2.7
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.5
Classifier: Programming Language :: Python :: 3.6
Classifier: Programming Language :: Python :: 3.7
