Metadata-Version: 2.1
Name: leaf-eval-tools
Version: 0.1.1
Summary: A project that provides eval tools for leaf-playground based projects
Author: The LEAF team (past and future) with the help of all our contributors
Author-email: leaf@shanda.com
Requires-Python: >=3.9,<4.0
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Provides-Extra: ragas
Requires-Dist: datasets (>=2.15.0,<3.0.0)
Requires-Dist: jinja2 (>=3.1.2,<4.0.0)
Requires-Dist: leaf_ai_backends (>=0.1.0,<0.2.0)
Requires-Dist: ragas (>=0.1.1,<0.2.0) ; extra == "ragas"
Description-Content-Type: text/markdown

# <center> leaf-eval-tools </center>


## Introduction

A project that provides eval tools that can be used by [leaf-playground](https://github.com/LLM-Evaluation-s-Always-Fatiguing/leaf-playground) based projects.

## Tools Introduction
- `leaf_eval_tools.oai_eval_worker.OaiEvalWorker`: using openai client to evaluate
- `leaf_eval_tools.ragas_eval_worker.RagasEvalWorker`: a wrapper to `ragas.evaluate`
- `leaf_eval_tools.regex_answer_extractor.RegexAnswerExtractor`: a helper to extract answers that match the specified patterns from text

## Installation

`pip install leaf-eval-toos`

## Usage
TBD;

## Maintainers

[@PanQiWei](https://github.com/panqiwei); [@Pandazki](https://github.com/pandazki).

## Roadmap
TBD;
