Metadata-Version: 2.1
Name: tiny-web-crawler
Version: 0.1
Summary: A simple web crawler.
Home-page: http://github.com/indrajithi/tiny-web-crawler
Author: Indrajith Indraprastham
Author-email: indr4jith@gmail.com
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: GNU General Public License v3 (GPLv3)
Classifier: Operating System :: OS Independent
Requires-Python: >=3.6
Description-Content-Type: text/markdown
Requires-Dist: validators
Requires-Dist: beautifulsoup4
Requires-Dist: lxml
Requires-Dist: colorama
Requires-Dist: requests
Provides-Extra: dev
Requires-Dist: mypy ; extra == 'dev'
Requires-Dist: pytest ; extra == 'dev'
Requires-Dist: responses ; extra == 'dev'

# A Tiny Web Crawler
A web crawler written in python.

# Install Requirements
`pip install validators beautifulsoup4 lxml`

### Python version: Python 3.6.3 :: Anaconda, Inc.

# Run
`python crawler.py`

Starts crawling from `root_url` until `max_link` urls are crawled. Saves the output to `out.json`.
