Metadata-Version: 2.1
Name: keywordsai-eval
Version: 0.1.9
Summary: An evaluation package for LLM input output
License: MIT
Author: Keywords AI Team
Author-email: team@keywordsai.co
Requires-Python: >=3.9,<4.0
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Dist: aiohappyeyeballs (==2.4.0)
Requires-Dist: aiohttp (==3.10.5)
Requires-Dist: aiosignal (==1.3.1)
Requires-Dist: annotated-types (==0.7.0)
Requires-Dist: anyio (==4.4.0)
Requires-Dist: attrs (==24.2.0)
Requires-Dist: certifi (==2024.8.30)
Requires-Dist: charset-normalizer (==3.3.2)
Requires-Dist: click (==8.1.7)
Requires-Dist: distro (==1.9.0)
Requires-Dist: filelock (==3.16.0)
Requires-Dist: frozenlist (==1.4.1)
Requires-Dist: fsspec (==2024.9.0)
Requires-Dist: h11 (==0.14.0)
Requires-Dist: httpcore (==1.0.5)
Requires-Dist: httpx (==0.27.2)
Requires-Dist: huggingface-hub (==0.24.6)
Requires-Dist: idna (==3.8)
Requires-Dist: importlib-metadata (==8.4.0)
Requires-Dist: iniconfig (==2.0.0)
Requires-Dist: jinja2 (==3.1.4)
Requires-Dist: jiter (==0.5.0)
Requires-Dist: jsonpatch (==1.33)
Requires-Dist: jsonpointer (==3.0.0)
Requires-Dist: jsonschema (==4.23.0)
Requires-Dist: jsonschema-specifications (==2023.12.1)
Requires-Dist: langchain (==0.2.16)
Requires-Dist: langchain-core (==0.2.38)
Requires-Dist: langchain-text-splitters (==0.2.4)
Requires-Dist: langsmith (==0.1.116)
Requires-Dist: litellm (==1.44.22)
Requires-Dist: markupsafe (==2.1.5)
Requires-Dist: multidict (==6.0.5)
Requires-Dist: munch (>=4.0.0,<5.0.0)
Requires-Dist: numpy (==1.26.4)
Requires-Dist: openai (==1.44.0)
Requires-Dist: orjson (==3.10.7)
Requires-Dist: packaging (==24.1)
Requires-Dist: pluggy (==1.5.0)
Requires-Dist: pydantic (==2.9.0)
Requires-Dist: pydantic-core (==2.23.2)
Requires-Dist: pytest (==8.3.2)
Requires-Dist: python-dotenv (==1.0.1)
Requires-Dist: pyyaml (==6.0.2)
Requires-Dist: redis (==5.0.8)
Requires-Dist: referencing (==0.35.1)
Requires-Dist: regex (==2024.7.24)
Requires-Dist: requests (==2.32.3)
Requires-Dist: rpds-py (==0.20.0)
Requires-Dist: sniffio (==1.3.1)
Requires-Dist: sqlalchemy (==2.0.34)
Requires-Dist: tenacity (==8.5.0)
Requires-Dist: tiktoken (==0.7.0)
Requires-Dist: tokenizers (==0.20.0)
Requires-Dist: tqdm (==4.66.5)
Requires-Dist: typing-extensions (==4.12.2)
Requires-Dist: tzdata (==2024.1)
Requires-Dist: urllib3 (==2.2.2)
Requires-Dist: yarl (==1.10.0)
Requires-Dist: zipp (==3.20.1)
Description-Content-Type: text/markdown

# Keywords AI Eval
Keywords AI eval is an open-sourced evaluation package for classification


## Get started
Installation
```
pip install keywordsai-eval
```

# Sample questions
What are the main features of Keywords AI, and how do they benefit developers?

Can you walk me through the process of setting up Keywords AI in a Python project using the OpenAI SDK?

How does Keywords AI's unified LLM API work, and what advantages does it offer over using individual APIs for different models?

What kind of monitoring and observability features does Keywords AI provide for LLM applications?

What kind of monitoring and observability features does Keywords AI provide for LLM applications?k
