Metadata-Version: 2.1
Name: iar-tokenizer
Version: 1.0.2
Summary: A tokenizer focused on Spanish language.
Home-page: https://github.com/ivansiiito/iar_tokenizer
Author: Ivan Arias Rodriguez
Author-email: ivansiiito@gmail.com
License: UNKNOWN
Description: # IAR Tokenizer
        
        The IAR (IvÃ¡n Arias RodrÃ­guez) Tokenizer is a tokenizer developed mainly for Spanish. It is able to divide a text in paragraphs, those in 
        sentences, and each sentence in a list of tokens.
        
        More information to be added in the future...
Platform: UNKNOWN
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Description-Content-Type: text/markdown
