Metadata-Version: 2.1
Name: pycrawl
Version: 1.0.0
Summary: UNKNOWN
Home-page: https://github.com/AjxLab/PyCrawl
Author: Tatsuya Abe
Author-email: abe12@mccc.jp
License: MIT
Keywords: crawling crawler scraping
Platform: UNKNOWN
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 3.7
Description-Content-Type: text/markdown
Requires-Dist: mechanize
Requires-Dist: lxml

PyCrawl
=======

Script for crawling in Python.

## Description

This project enables site crawling and data extraction with xpath and css selectors.
You can also send forms such as text data, files, and checkboxes.


## Requirement

- Python3
- mechanize
- lxml


## Usage
### Simple Example
```python
import pycrawl

url = 'http://www.example.com/'
doc = pycrawl.PyCrawl(url)

# Search for nodes by css
doc.css('div')
doc.css('.main-text')
doc.css('#tadjs')

# Search for nodes by xpath
doc.xpath('//*[@id="top"]/div[1]')

# Others
doc.css('div').css('a')[2].attr('href')
doc.css('p').innerText()
doc.tables  # -> Table Tag to Dict

# You do not need to specify "[]" to access the first index
```

