Metadata-Version: 2.1
Name: docassemble-textstat
Version: 0.7.0
Summary: Calculate statistical features from text
Home-page: https://github.com/shivam5992/textstat
Author: Shivam Bansal, Chaitanya Aggarwal
Author-email: shivam5992@gmail.com
License: MIT
Description: # Textstat
        
        **Modified from the original by Jonathan Pyle to remove the Pyphen
        dependency because it is a GPL library and textstat is MIT licensed.**
        
        [![PyPI](https://img.shields.io/pypi/v/textstat.svg)](https://pypi.org/project/textstat/)
        [![Build Status](https://travis-ci.com/shivam5992/textstat.svg?branch=master)](https://travis-ci.com/shivam5992/textstat)
        [![Downloads](https://img.shields.io/badge/dynamic/json.svg?url=https://pypistats.org/api/packages/textstat/recent?mirrors=false&label=downloads&query=$.data.last_month&suffix=/month)](https://pypistats.org/packages/textstat)
        
        **Textstat is an easy to use library to calculate statistics from text. It helps determine readability, complexity, and grade level.**
        
        <p align="center">
          <img width="100%" src="https://images.unsplash.com/photo-1457369804613-52c61a468e7d?ixlib=rb-1.2.1&auto=format&fit=crop&w=1350&h=400&q=80">
        </p>
        <p align="right">
          <sup>Photo by <a href="https://unsplash.com/@impatrickt">Patrick Tomasso</a>
          on <a href="https://unsplash.com/images/things/book">Unsplash</a></sup>
        </p>
        
        ## Usage
        
        ```python
        >>> import textstat
        
        >>> test_data = (
            "Playing games has always been thought to be important to "
            "the development of well-balanced and creative children; "
            "however, what part, if any, they should play in the lives "
            "of adults has never been researched that deeply. I believe "
            "that playing games is every bit as important for adults "
            "as for children. Not only is taking time out to play games "
            "with our children and other adults valuable to building "
            "interpersonal relationships but is also a wonderful way "
            "to release built up tension."
        )
        
        >>> textstat.flesch_reading_ease(test_data)
        >>> textstat.smog_index(test_data)
        >>> textstat.flesch_kincaid_grade(test_data)
        >>> textstat.coleman_liau_index(test_data)
        >>> textstat.automated_readability_index(test_data)
        >>> textstat.dale_chall_readability_score(test_data)
        >>> textstat.difficult_words(test_data)
        >>> textstat.linsear_write_formula(test_data)
        >>> textstat.gunning_fog(test_data)
        >>> textstat.text_standard(test_data)
        >>> textstat.fernandez_huerta(test_data)
        >>> textstat.szigriszt_pazos(test_data)
        >>> textstat.gutierrez_polini(test_data)
        >>> textstat.crawford(test_data)
        ```
        
        The argument (text) for all the defined functions remains the same -
        i.e the text for which statistics need to be calculated.
        
        ## Install
        
        You can install textstat either via the Python Package Index (PyPI) or from source.
        
        #### Install using pip
        
        ```shell
        pip install textstat
        ```
        
        #### Install using easy_install
        
        ```shell
        easy_install textstat
        ```
        
        #### Install latest version from GitHub
        
        ```shell
        git clone https://github.com/shivam5992/textstat.git
        cd textstat
        pip install .
        ```
        
        #### Install from PyPI
        
        Download the latest version of textstat from http://pypi.python.org/pypi/textstat/
        
        You can install it by doing the following:
        
        ```shell
        tar xfz textstat-*.tar.gz
        cd textstat-*/
        python setup.py build
        python setup.py install # as root
        ```
        
        ## Language support
        By default functions implement algorithms for english language. 
        To change language, use:
        
        ```python
        textstat.set_lang(lang)
        ``` 
        
        The language will be used for syllable calculation and to choose 
        variant of the formula.
        
        ### Language variants
        All functions implement `en_US` language. Some of them has also variants 
        for other languages listed below. 
        
        |  Function                   | en | de | es | fr | it | nl | pl | ru |
        |-----------------------------|----|----|----|----|----|----|----|----|
        | flesch_reading_ease         | ✔  | ✔  | ✔  | ✔  | ✔  | ✔  |    | ✔  |
        | gunning_fog                 | ✔  |    |    |    |    |    | ✔  |    |
        
        #### Spanish-specific tests
        The following functions are specifically designed for spanish language.
        They can be used on non-spanish texts, even though that use case is not recommended.
        
        ```python
        >>> textstat.fernandez_huerta(test_data)
        >>> textstat.szigriszt_pazos(test_data)
        >>> textstat.gutierrez_polini(test_data)
        >>> textstat.crawford(test_data)
        ```
        
        Additional information on the formula they implement can be found in their respective docstrings.
        
        ## List of Functions
        
        ### Syllable Count
        
        ```python
        textstat.syllable_count(text)
        ```
        
        Returns the number of syllables present in the given text.
        
        Uses the Python module [Pyphen](https://github.com/Kozea/Pyphen)
        for syllable calculation.
        
        ### Lexicon Count
        
        ```python
        textstat.lexicon_count(text, removepunct=True)
        ```
        
        Calculates the number of words present in the text.
        Optional `removepunct` specifies whether we need to take
        punctuation symbols into account while counting lexicons.
        Default value is `True`, which removes the punctuation
        before counting lexicon items.
        
        ### Sentence Count
        
        ```python
        textstat.sentence_count(text)
        ```
        
        Returns the number of sentences present in the given text.
        
        
        ### The Flesch Reading Ease formula
        
        ```python
        textstat.flesch_reading_ease(text)
        ```
        
        Returns the Flesch Reading Ease Score.
        
        The following table can be helpful to assess the ease of
        readability in a document.
        
        The table is an _example_ of values. While the
        maximum score is 121.22, there is no limit on how low
        the score can be. A negative score is valid.
        
        | Score |    Difficulty     |
        |-------|-------------------|
        |90-100 | Very Easy         |
        | 80-89 | Easy              |
        | 70-79 | Fairly Easy       |
        | 60-69 | Standard          |
        | 50-59 | Fairly Difficult  |
        | 30-49 | Difficult         |
        | 0-29  | Very Confusing    |
        
        > Further reading on
        [Wikipedia](https://en.wikipedia.org/wiki/Flesch%E2%80%93Kincaid_readability_tests#Flesch_reading_ease)
        
        ### The Flesch-Kincaid Grade Level
        
        ```python
        textstat.flesch_kincaid_grade(text)
        ```
        
        Returns the Flesch-Kincaid Grade of the given text. This is a grade
        formula in that a score of 9.3 means that a ninth grader would be able to
        read the document.
        
        > Further reading on
        [Wikipedia](https://en.wikipedia.org/wiki/Flesch%E2%80%93Kincaid_readability_tests#Flesch%E2%80%93Kincaid_grade_level)
        
        ### The Fog Scale (Gunning FOG Formula)
        
        ```python
        textstat.gunning_fog(text)
        ```
        
        Returns the FOG index of the given text. This is a grade formula in that
        a score of 9.3 means that a ninth grader would be able to read the document.
        
        > Further reading on
        [Wikipedia](https://en.wikipedia.org/wiki/Gunning_fog_index)
        
        ### The SMOG Index
        
        ```python
        textstat.smog_index(text)
        ```
        
        Returns the SMOG index of the given text. This is a grade formula in that
        a score of 9.3 means that a ninth grader would be able to read the document.
        
        Texts of fewer than 30 sentences are statistically invalid, because
        the SMOG formula was normed on 30-sentence samples. textstat requires at
        least 3 sentences for a result.
        
        > Further reading on
        [Wikipedia](https://en.wikipedia.org/wiki/SMOG)
        
        ### Automated Readability Index
        
        ```python
        textstat.automated_readability_index(text)
        ```
        
        Returns the ARI (Automated Readability Index) which outputs
        a number that approximates the grade level needed to
        comprehend the text.
        
        For example if the ARI is 6.5, then the grade level to comprehend
        the text is 6th to 7th grade.
        
        > Further reading on
        [Wikipedia](https://en.wikipedia.org/wiki/Automated_readability_index)
        
        ### The Coleman-Liau Index
        
        ```python
        textstat.coleman_liau_index(text)
        ```
        
        Returns the grade level of the text using the Coleman-Liau Formula. This is
        a grade formula in that a score of 9.3 means that a ninth grader would be
        able to read the document.
        
        > Further reading on
        [Wikipedia](https://en.wikipedia.org/wiki/Coleman%E2%80%93Liau_index)
        
        ### Linsear Write Formula
        
        ```python
        textstat.linsear_write_formula(text)
        ```
        
        Returns the grade level using the Linsear Write Formula. This is
        a grade formula in that a score of 9.3 means that a ninth grader would be
        able to read the document.
        
        > Further reading on
        [Wikipedia](https://en.wikipedia.org/wiki/Linsear_Write)
        
        ### Dale-Chall Readability Score
        
        ```python
        textstat.dale_chall_readability_score(text)
        ```
        
        Different from other tests, since it uses a lookup table
        of the most commonly used 3000 English words. Thus it returns
        the grade level using the New Dale-Chall Formula.
        
        | Score       |  Understood by                                |
        |-------------|-----------------------------------------------|
        |4.9 or lower | average 4th-grade student or lower            |
        |  5.0–5.9    | average 5th or 6th-grade student              |
        |  6.0–6.9    | average 7th or 8th-grade student              |
        |  7.0–7.9    | average 9th or 10th-grade student             |
        |  8.0–8.9    | average 11th or 12th-grade student            |
        |  9.0–9.9    | average 13th to 15th-grade (college) student  |
        
        > Further reading on
        [Wikipedia](https://en.wikipedia.org/wiki/Dale%E2%80%93Chall_readability_formula)
        
        ### Readability Consensus based upon all the above tests
        
        ```python
        textstat.text_standard(text, float_output=False)
        ```
        
        Based upon all the above tests, returns the estimated school
        grade level required to understand the text.
        
        Optional `float_output` allows the score to be returned as a
        `float`. Defaults to `False`.
        
        ### Spanish-specific tests 
        #### Índice de lecturabilidad Fernandez-Huerta  
        ```python
        textstat.fernandez_huerta(text)
        ```
        
        Reformulation of the Flesch Reading Ease Formula specifically for spanish.
        The results can be interpreted similarly
        
        > Further reading on
        [This blog post](https://legible.es/blog/lecturabilidad-fernandez-huerta/)
        
        ### Índice de perspicuidad de Szigriszt-Pazos
        ```python
        textstat.szigriszt_pazos(text)
        ```
        Adaptation of Flesch Reading Ease formula for spanish-based texts.
        Attempts to quantify how understandable a text is.
        
        > Further reading on
        [This blog post](https://legible.es/blog/perspicuidad-szigriszt-pazos/)
        
        ### Fórmula de comprensibilidad de Gutiérrez de Polini
        ```python
        textstat.gutierrez_polini(text)
        ```
        
        Returns the Guttiérrez de Polini understandability index.
        
        Specifically designed for the texts in spanish, not an adaptation.
        Conceived for grade-school level texts.
        Scores for more complex text are not reliable.
        
        > Further reading on
        [This blog post](https://legible.es/blog/comprensibilidad-gutierrez-de-polini/)
        
        ### Fórmula de Crawford
        ```python
        textstat.crawford(text)
        ```
        
        Returns the Crawford score for the text
        
        Returns an estimate of the years of schooling required to understand the text.
        The text is only valid for elementary school level texts.
        
        > Further reading on
        [This blog post](https://legible.es/blog/formula-de-crawford/)
        
        ## Contributing
        
        If you find any problems, you should open an
        [issue](https://github.com/shivam5992/textstat/issues).
        
        If you can fix an issue you've found, or another issue, you should open
        a [pull request](https://github.com/shivam5992/textstat/pulls).
        
        1. Fork this repository on GitHub to start making your changes to the master
        branch (or branch off of it).
        2. Write a test which shows that the bug was fixed or that the feature works as expected.
        3. Send a pull request!
        
        ### Development setup
        
        > It is recommended you use a [virtual environment](
        https://docs.python.org/3/tutorial/venv.html), or [Pipenv](
        https://docs.pipenv.org/) to keep your development work isolated from your
        systems Python installation.
        
        ```bash
        $ git clone https://github.com/<yourname>/textstat.git  # Clone the repo from your fork
        $ cd textstat
        $ pip install -r requirements.txt  # Install all dependencies
        
        $ # Make changes
        
        $ python -m pytest test.py  # Run tests
        ```
        
        
Platform: UNKNOWN
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.6
Classifier: Programming Language :: Python :: 3.7
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3 :: Only
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Education
Classifier: Intended Audience :: Science/Research
Classifier: Topic :: Text Processing
Requires-Python: >=3.6
Description-Content-Type: text/markdown
