Metadata-Version: 1.1
Name: solidscraper
Version: 0.7.7
Summary: This package lets your script scrape web sites. JQuery-Like API.
Home-page: https://github.com/sergioburdisso/solidscraper
Author: Sergio Burdisso
Author-email: sergio.burdisso@gmail.com
License: MIT
Download-URL: https://github.com/sergioburdisso/solidscraper/tarball/v0.7.7
Description: Solid Scraper
        =============
        
        Easy to use JQuery-Like API for Web Scraping/Crawling. It also supports
        Cookies and custom User Agents. Solidscraper is compatible with **Python
        2 and 3**.
        
        2. “Hello World” Examples
        -------------------------
        
        Getting all url of all links:
        
        .. code:: python
        
           import solidscraper as ss
        
           doc = ss.load("https://www.example.com/the/path")
        
           # print the list of urls from all <a> elements
           print(doc.select("a").getAttribute("href"))
        
        Getting all url of all links inside <div>s whose class id is ‘links’:
        
        .. code:: python
        
           import solidscraper as ss
        
           doc = ss.load("https://www.example.com/the/path")
        
           # print the list of urls from all <a> elements inside <div id="links">
           print(doc.select("div #links").then("a").getAttribute("href"))
        
        Getting the text of all <span> elements inside <p> whose class are
        ‘info’:
        
        .. code:: python
        
           import solidscraper as ss
        
           doc = ss.load("https://www.example.com/the/path")
        
           # print the text of all <span> elements inside <p class="info">
           print(doc.select("p .info").then("span").text())
        
        **Note:** these examples use the python 3 print function, in case you
        want to run them with python 2, either replace the ``print()`` function
        with the python 2 ``print`` statement or add the following import line
        as the first statement of your code:
        ``from __future__ import print_function``.
        
        --------------
        
        3. “Real World” Examples
        ------------------------
        
        The ``examples`` `folder above`_ contains two fully functional examples:
        one to download tweets by hashtags and another to download complete
        users timeline (tweets and images). Both scripts were completely built
        using ``solidscraper``.
        
        .. _folder above: https://github.com/sergioburdisso/solidscraper/tree/master/examples/
Keywords: scrape,crawler,crawl,scraper
Platform: UNKNOWN
Classifier: Topic :: Internet :: WWW/HTTP
Classifier: Programming Language :: Python :: Implementation :: PyPy
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 2
Classifier: Programming Language :: Python :: 3
