scrapy抓取知乎话题回答

上传者: wxq714586001 | 上传时间: 2019-12-21 21:59:03 | 文件大小: 164KB | 文件类型: zip
实现功能:1、抓取知乎上关注人数超过2000人数的话题、相应连接、父子话题,并存入数据库。 2、抓取某一话题的回答,可以设置赞的最低数才会被抓取,并存入数据库。 3、将感兴趣的内容获取出来发送qq邮件。

文件下载

资源详情

[{"title":"( 38 个子文件 164KB ) scrapy抓取知乎话题回答","children":[{"title":"zhihu","children":[{"title":"zhihu","children":[{"title":"items.pyc <span style='color:#111;'> 502B </span>","children":null,"spread":false},{"title":"pipelines.pyc <span style='color:#111;'> 2.59KB </span>","children":null,"spread":false},{"title":"pipelines.py <span style='color:#111;'> 2.65KB </span>","children":null,"spread":false},{"title":"spiders","children":[{"title":"rotate_useragent.pyc <span style='color:#111;'> 3.18KB </span>","children":null,"spread":false},{"title":"zhihu_spider.py <span style='color:#111;'> 1.71KB </span>","children":null,"spread":false},{"title":"__init__.pyc <span style='color:#111;'> 143B </span>","children":null,"spread":false},{"title":"zhihu_spider.pyc <span style='color:#111;'> 2.06KB </span>","children":null,"spread":false},{"title":"__init__.py <span style='color:#111;'> 161B </span>","children":null,"spread":false},{"title":"rotate_useragent.py <span style='color:#111;'> 3.23KB </span>","children":null,"spread":false}],"spread":true},{"title":"__init__.pyc <span style='color:#111;'> 135B </span>","children":null,"spread":false},{"title":"getInteresting.py <span style='color:#111;'> 3.54KB </span>","children":null,"spread":false},{"title":"config.ini <span style='color:#111;'> 123B </span>","children":null,"spread":false},{"title":"util.py <span style='color:#111;'> 1.56KB </span>","children":null,"spread":false},{"title":"items.py <span style='color:#111;'> 486B </span>","children":null,"spread":false},{"title":"__init__.py <span style='color:#111;'> 0B </span>","children":null,"spread":false},{"title":"settings.py <span style='color:#111;'> 817B </span>","children":null,"spread":false},{"title":"getInteresting.pyc <span style='color:#111;'> 4.37KB </span>","children":null,"spread":false},{"title":"settings.pyc <span style='color:#111;'> 598B </span>","children":null,"spread":false},{"title":"互联网行业招聘.txt <span style='color:#111;'> 200B </span>","children":null,"spread":false},{"title":"util.pyc <span style='color:#111;'> 1.81KB </span>","children":null,"spread":false}],"spread":false},{"title":"scrapy.cfg <span style='color:#111;'> 252B </span>","children":null,"spread":false}],"spread":true},{"title":"zhihu_topic","children":[{"title":"scrapy.cfg <span style='color:#111;'> 264B </span>","children":null,"spread":false},{"title":"getInteresting.py <span style='color:#111;'> 1.05KB </span>","children":null,"spread":false},{"title":"topic.txt <span style='color:#111;'> 517.91KB </span>","children":null,"spread":false},{"title":"zhihu_topic","children":[{"title":"items.pyc <span style='color:#111;'> 544B </span>","children":null,"spread":false},{"title":"pipelines.pyc <span style='color:#111;'> 2.17KB </span>","children":null,"spread":false},{"title":"pipelines.py <span style='color:#111;'> 1.80KB </span>","children":null,"spread":false},{"title":"spiders","children":[{"title":"rotate_useragent.pyc <span style='color:#111;'> 3.23KB </span>","children":null,"spread":false},{"title":"__init__.pyc <span style='color:#111;'> 155B </span>","children":null,"spread":false},{"title":"__init__.py <span style='color:#111;'> 161B </span>","children":null,"spread":false},{"title":"zhihu_topic_spider.py <span style='color:#111;'> 1.24KB </span>","children":null,"spread":false},{"title":"zhihu_topic_spider.pyc <span style='color:#111;'> 1.86KB </span>","children":null,"spread":false},{"title":"rotate_useragent.py <span style='color:#111;'> 3.23KB </span>","children":null,"spread":false}],"spread":true},{"title":"__init__.pyc <span style='color:#111;'> 147B </span>","children":null,"spread":false},{"title":"items.py <span style='color:#111;'> 432B </span>","children":null,"spread":false},{"title":"__init__.py <span style='color:#111;'> 0B </span>","children":null,"spread":false},{"title":"settings.py <span style='color:#111;'> 864B </span>","children":null,"spread":false},{"title":"settings.pyc <span style='color:#111;'> 639B </span>","children":null,"spread":false}],"spread":true}],"spread":true}],"spread":true}]

评论信息

  • heydudesup :
    很棒很受用哦~
    2018-03-08
  • lyyl213 :
    不错,good,不错,good
    2017-04-10

免责申明

【只为小站】的资源来自网友分享,仅供学习研究,请务必在下载后24小时内给予删除,不得用于其他任何用途,否则后果自负。基于互联网的特殊性,【只为小站】 无法对用户传输的作品、信息、内容的权属或合法性、合规性、真实性、科学性、完整权、有效性等进行实质审查;无论 【只为小站】 经营者是否已进行审查,用户均应自行承担因其传输的作品、信息、内容而可能或已经产生的侵权或权属纠纷等法律责任。
本站所有资源不代表本站的观点或立场,基于网友分享,根据中国法律《信息网络传播权保护条例》第二十二条之规定,若资源存在侵权或相关问题请联系本站客服人员,zhiweidada#qq.com,请把#换成@,本站将给予最大的支持与配合,做到及时反馈和处理。关于更多版权及免责申明参见 版权及免责申明