spiderman是什么意思网络用语（spider.py 0.5 : Python Package Index）
导读：spider.py 0.5 Multithreaded crawling, reporting, and mirroring for Web and FTP...
spider.py 0.5
Multithreaded crawling, reporting, and mirroring for Web and FTP
This module provides multithreaded crawling, reporting, and mirroring for Web
and FTP in one convenient library. Crawling depth, maximum number of URLs to
crawl, and maximum number of threads are user-configurable. Reports can be
generated on external URLS, internal redirects to outside URLs, unparsable HTML,
non-HTTP/FTP URLs, and broken links.创心域SEO版权声明：以上内容作者已申请原创保护，未经允许不得转载，侵权必究！授权事宜、对本内容有异议或投诉，敬请联系网站管理员，我们将尽快回复您，谢谢合作！