Skip to content

jmg/crawley3-toolbox

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Crawley3 Toolbox

Crawley Toolbox implementation for python3 using asyncio.

###Requirements

  • python >= 3.3
  • asyncio
  • aiohttp

###Example

from src.crawlers import BaseCrawler

class PyCrawler(BaseCrawler):

    start_urls = ["http://python.org"]

if __name__ == "__main__":
    crawler = PyCrawler(debug=True)
    crawler.start()

About

Crawley Toolbox for python3

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages