Metadata-Version: 2.1
Name: datapools
Version: 1.0.100
Summary: Awesome datapools created by openlicenseai
Home-page: https://github.com/openlicenseai/datapools/
Author: openlicenseai
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: pydantic ==2.6.1
Requires-Dist: pydantic-settings ==2.2.1
Requires-Dist: email-validator
Requires-Dist: websockets
Requires-Dist: pytube
Requires-Dist: click ==8.1.7
Requires-Dist: redis
Requires-Dist: types-redis
Requires-Dist: html2text
Requires-Dist: boto3
Requires-Dist: filetype
Requires-Dist: google-api-python-client
Requires-Dist: google-auth-httplib2
Requires-Dist: azure-identity
Requires-Dist: msgraph-sdk
Requires-Dist: aioftp
Requires-Dist: aio-pika
Requires-Dist: dnspython
Requires-Dist: pillow
Requires-Dist: types-python-dateutil
Requires-Dist: pytest-playwright
Requires-Dist: bs4
Requires-Dist: python-magic
Provides-Extra: test
Requires-Dist: pytest ; extra == 'test'
Requires-Dist: coverage ; extra == 'test'
Requires-Dist: flake8 ; extra == 'test'
Requires-Dist: black ; extra == 'test'
Requires-Dist: isort ; extra == 'test'
Requires-Dist: pytest-cov ; extra == 'test'
Requires-Dist: mypy ; extra == 'test'
Requires-Dist: gitchangelog ; extra == 'test'
Requires-Dist: mkdocs ; extra == 'test'
Requires-Dist: mkdocs-material ; extra == 'test'

# datapools

[![codecov](https://codecov.io/gh/openlicenseai/datapools/branch/main/graph/badge.svg?token=datapools_token_here)](https://codecov.io/gh/openlicenseai/datapools)
[![CI](https://github.com/openlicenseai/datapools/actions/workflows/main.yml/badge.svg)](https://github.com/openlicenseai/datapools/actions/workflows/main.yml)

Awesome datapools created by openlicenseai

## Install it from PyPI

```bash
pip install datapools
```

## Usage

```python
from datapools import crawl
...
await crawl(datapool_id=1)
```

```bash
$ python3 -m datapools --id=1
#or
$ datapools
```

## Documentation
Documentation is available at [docs.openlicense.ai](https://docs.openlicense.ai)
 

## Development

Read the [CONTRIBUTING.md](https://github.com/openlicenseai/datapools/blob/master/CONTRIBUTING.md) file.
