Metadata-Version: 2.0
Name: netboy
Version: 2018.4.3
Summary: the boy for net
Home-page: https://github.com/pingf/netboy2.git
Author: Jesse MENG
Author-email: pingf0@gmail.com
License: BSD
Description-Content-Type: UNKNOWN
Platform: any
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: BSD License
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Requires-Dist: termcc
Requires-Dist: loader
Requires-Dist: aiohttp
Requires-Dist: aiofiles
Requires-Dist: websockets
Requires-Dist: pony
Requires-Dist: terminaltables
Requires-Dist: logcc
Requires-Dist: celery
Requires-Dist: inquirer
Requires-Dist: selenium
Requires-Dist: pycurl
Requires-Dist: worker
Requires-Dist: wrap
Requires-Dist: redis

=============================
netboy
=============================

super fast web crawler

**Note**: this package is still in beta. Use with caution !


Quickstart
----------

Install netboy::

    pip install netboy


Use netboy:

.. code-block:: python

    if __name__ == '__main__':
        setup_log('netboy')
        data = [ 'http://www.bing.com',]
        boy = NetBoy()
        boy.use_queue(
            'worker'
        ).use_spider(
            'pycurl'
        ).use_filter(
            ['url', 'title', 'code']
        ).use_workers().use_triggers([
            'test.functional.netboy.screen.print_screen'
        ])
        resp = boy.run(data)



