Python-新浪微博爬虫ScrapyRedis

上传者: 39840924 | 上传时间: 2021-03-29 10:52:40 | 文件大小: 56KB | 文件类型: ZIP
此项目和QQ空间爬虫类似,主要爬取新浪微博用户的个人信息、微博信息、粉丝和关注(详细见此)。

文件下载

资源详情

[{"title":"( 52 个子文件 56KB ) Python-新浪微博爬虫ScrapyRedis","children":[{"title":"SinaSpider-master","children":[{"title":".gitignore <span style='color:#111;'> 1.10KB </span>","children":null,"spread":false},{"title":"Sina_spider2","children":[{"title":"Sina_spider2","children":[{"title":"weiboID.py <span style='color:#111;'> 2.60KB </span>","children":null,"spread":false},{"title":"spiders","children":[{"title":"__init__.py <span style='color:#111;'> 161B </span>","children":null,"spread":false},{"title":"informationSpider.py <span style='color:#111;'> 4.35KB </span>","children":null,"spread":false},{"title":"tweetsSpider.py <span style='color:#111;'> 3.54KB </span>","children":null,"spread":false}],"spread":true},{"title":"__init__.py <span style='color:#111;'> 0B </span>","children":null,"spread":false},{"title":"pipelines.py <span style='color:#111;'> 841B </span>","children":null,"spread":false},{"title":"middleware.py <span style='color:#111;'> 465B </span>","children":null,"spread":false},{"title":"user_agents.py <span style='color:#111;'> 7.39KB </span>","children":null,"spread":false},{"title":"commands","children":[{"title":"__init__.py <span style='color:#111;'> 0B </span>","children":null,"spread":false},{"title":"crawlall.py <span style='color:#111;'> 1.44KB </span>","children":null,"spread":false}],"spread":true},{"title":"cookies.py <span style='color:#111;'> 1.68KB </span>","children":null,"spread":false},{"title":"settings.py <span style='color:#111;'> 758B </span>","children":null,"spread":false},{"title":"items.py <span style='color:#111;'> 964B </span>","children":null,"spread":false}],"spread":true},{"title":"scrapy.cfg <span style='color:#111;'> 268B </span>","children":null,"spread":false},{"title":"Begin.py <span style='color:#111;'> 71B </span>","children":null,"spread":false}],"spread":true},{"title":"pipelines.py <span style='color:#111;'> 6.81KB </span>","children":null,"spread":false},{"title":"README.md <span style='color:#111;'> 5.97KB </span>","children":null,"spread":false},{"title":"Sina_spider1","children":[{"title":"scrapy.cfg <span style='color:#111;'> 268B </span>","children":null,"spread":false},{"title":"Sina_spider1","children":[{"title":"spiders","children":[{"title":"__init__.py <span style='color:#111;'> 161B </span>","children":null,"spread":false},{"title":"spiders.py <span style='color:#111;'> 8.00KB </span>","children":null,"spread":false}],"spread":true},{"title":"__init__.py <span style='color:#111;'> 0B </span>","children":null,"spread":false},{"title":"pipelines.py <span style='color:#111;'> 1.48KB </span>","children":null,"spread":false},{"title":"middleware.py <span style='color:#111;'> 465B </span>","children":null,"spread":false},{"title":"user_agents.py <span style='color:#111;'> 7.37KB </span>","children":null,"spread":false},{"title":"cookies.py <span style='color:#111;'> 5.21KB </span>","children":null,"spread":false},{"title":"yumdama.py <span style='color:#111;'> 5.93KB </span>","children":null,"spread":false},{"title":"settings.py <span style='color:#111;'> 660B </span>","children":null,"spread":false},{"title":"items.py <span style='color:#111;'> 1.15KB </span>","children":null,"spread":false}],"spread":true},{"title":"Begin.py <span style='color:#111;'> 79B </span>","children":null,"spread":false}],"spread":true},{"title":"Sina_spider3","children":[{"title":"launch.py <span style='color:#111;'> 79B </span>","children":null,"spread":false},{"title":"scrapy.cfg <span style='color:#111;'> 268B </span>","children":null,"spread":false},{"title":"Sina_spider3","children":[{"title":"weiboID.py <span style='color:#111;'> 2.85KB </span>","children":null,"spread":false},{"title":"spiders","children":[{"title":"__init__.py <span style='color:#111;'> 161B </span>","children":null,"spread":false},{"title":"sinaSpider.py <span style='color:#111;'> 8.68KB </span>","children":null,"spread":false}],"spread":true},{"title":"__init__.py <span style='color:#111;'> 0B </span>","children":null,"spread":false},{"title":"pipelines.py <span style='color:#111;'> 6.80KB </span>","children":null,"spread":false},{"title":"middleware.py <span style='color:#111;'> 2.89KB </span>","children":null,"spread":false},{"title":"user_agents.py <span style='color:#111;'> 7.39KB </span>","children":null,"spread":false},{"title":"cookies.py <span style='color:#111;'> 6.52KB </span>","children":null,"spread":false},{"title":"scrapy_redis","children":[{"title":"scheduler.py <span style='color:#111;'> 3.35KB </span>","children":null,"spread":false},{"title":"__init__.py <span style='color:#111;'> 0B </span>","children":null,"spread":false},{"title":"spiders.py <span style='color:#111;'> 1.87KB </span>","children":null,"spread":false},{"title":"pipelines.py <span style='color:#111;'> 986B </span>","children":null,"spread":false},{"title":"connection.py <span style='color:#111;'> 869B </span>","children":null,"spread":false},{"title":"dupefilter.py <span style='color:#111;'> 1.36KB </span>","children":null,"spread":false},{"title":"queue.py <span style='color:#111;'> 4.63KB </span>","children":null,"spread":false},{"title":"tests.py <span style='color:#111;'> 8.26KB </span>","children":null,"spread":false}],"spread":false},{"title":"yumdama.py <span style='color:#111;'> 5.91KB </span>","children":null,"spread":false},{"title":"settings.py <span style='color:#111;'> 1.04KB </span>","children":null,"spread":false},{"title":"cleanRedis <span style='color:#111;'> 1.11KB </span>","children":null,"spread":false},{"title":"items.py <span style='color:#111;'> 1.34KB </span>","children":null,"spread":false}],"spread":false}],"spread":true}],"spread":true}],"spread":true}]

评论信息

免责申明

【只为小站】的资源来自网友分享,仅供学习研究,请务必在下载后24小时内给予删除,不得用于其他任何用途,否则后果自负。基于互联网的特殊性,【只为小站】 无法对用户传输的作品、信息、内容的权属或合法性、合规性、真实性、科学性、完整权、有效性等进行实质审查;无论 【只为小站】 经营者是否已进行审查,用户均应自行承担因其传输的作品、信息、内容而可能或已经产生的侵权或权属纠纷等法律责任。
本站所有资源不代表本站的观点或立场,基于网友分享,根据中国法律《信息网络传播权保护条例》第二十二条之规定,若资源存在侵权或相关问题请联系本站客服人员,zhiweidada#qq.com,请把#换成@,本站将给予最大的支持与配合,做到及时反馈和处理。关于更多版权及免责申明参见 版权及免责申明