mini_spider:在调研过程中，经常需要对一些网站进行定向抓取。由于python包含各种强大的库，使用python做定向抓取比较简单。请使用python开发一个迷你定向抓取器mini_spider.py，实现对种子链接的广度优先抓取，并把URL长相符合特定pattern的网页保存到磁盘上-源码

[{"title":"（ 23 个子文件 14KB ） mini_spider:在调研过程中，经常需要对一些网站进行定向抓取。由于python包含各种强大的库，使用python做定向抓取比较简单。请使用python开发一个迷你定向抓取器mini_spider.py，实现对种子链接的广度优先抓取，并把URL长相符合特定pattern的网页保存到磁盘上-源码","children":[{"title":"mini_spider-master","children":[{"title":"mini_spider","children":[{"title":"spider.py <span style='color:#111;'> 1.43KB </span>","children":null,"spread":false},{"title":"test","children":[{"title":"spider_conf <span style='color:#111;'> 423B </span>","children":null,"spread":false},{"title":"__init__.py <span style='color:#111;'> 0B </span>","children":null,"spread":false},{"title":"spiderengine_test.py <span style='color:#111;'> 1.17KB </span>","children":null,"spread":false},{"title":"UrlParse_test.py <span style='color:#111;'> 1.41KB </span>","children":null,"spread":false},{"title":"urls <span style='color:#111;'> 26B </span>","children":null,"spread":false}],"spread":true},{"title":"__main__.py <span style='color:#111;'> 1.43KB </span>","children":null,"spread":false},{"title":"spider_conf <span style='color:#111;'> 423B </span>","children":null,"spread":false},{"title":"__init__.py <span style='color:#111;'> 0B </span>","children":null,"spread":false},{"title":"engine","children":[{"title":"UrlParse.py <span style='color:#111;'> 4.09KB </span>","children":null,"spread":false},{"title":"__init__.py <span style='color:#111;'> 0B </span>","children":null,"spread":false},{"title":"spider_thread.py <span style='color:#111;'> 2.77KB </span>","children":null,"spread":false},{"title":"SpiderEngine.py <span style='color:#111;'> 5.09KB </span>","children":null,"spread":false}],"spread":true},{"title":"log.py <span style='color:#111;'> 2.58KB </span>","children":null,"spread":false},{"title":"urls <span style='color:#111;'> 26B </span>","children":null,"spread":false}],"spread":true},{"title":".idea","children":[{"title":"scopes","children":[{"title":"scope_settings.xml <span style='color:#111;'> 139B </span>","children":null,"spread":false}],"spread":true},{"title":"mini_spider.iml <span style='color:#111;'> 379B </span>","children":null,"spread":false},{"title":"misc.xml <span style='color:#111;'> 212B </span>","children":null,"spread":false},{"title":"vcs.xml <span style='color:#111;'> 180B </span>","children":null,"spread":false},{"title":".name <span style='color:#111;'> 11B </span>","children":null,"spread":false},{"title":"modules.xml <span style='color:#111;'> 274B </span>","children":null,"spread":false},{"title":"encodings.xml <span style='color:#111;'> 164B </span>","children":null,"spread":false}],"spread":true},{"title":"README.md <span style='color:#111;'> 1.63KB </span>","children":null,"spread":false}],"spread":true}],"spread":true}]