Metadata-Version: 1.0
Name: tokenizers
Version: 0.0.2
Summary: Fast and Customizable Tokenizers
Home-page: https://github.com/huggingface/tokenizers
Author: Anthony MOI
Author-email: anthony@huggingface.co
License: Apache License 2.0
Description: UNKNOWN
Platform: UNKNOWN
