WebCollector+Selenium+Phantomjs

上传者: osaymissyou0 | 上传时间: 2021-04-09 18:04:11 | 文件大小: 51KB | 文件类型: ZIP
爬虫简介: WebCollector是一个无须配置、便于二次开发的JAVA爬虫框架(内核),它提供精简的的API,只需少量代码即可实现一个功能强大的爬虫。 爬虫内核: WebCollector致力于维护一个稳定、可扩的爬虫内核,便于开发者进行灵活的二次开发。内核具有很强的扩展性,用户可以在内核基础上开发自己想要的爬虫。源码中集成了Jsoup,可进行精准的网页解析。2.x版本中集成了selenium,可以处理javascript生成的数据。

文件下载

资源详情

[{"title":"( 47 个子文件 51KB ) WebCollector+Selenium+Phantomjs","children":[{"title":"WebCollectorDemo","children":[{"title":".project <span style='color:#111;'> 1.68KB </span>","children":null,"spread":false},{"title":".mymetadata <span style='color:#111;'> 321B </span>","children":null,"spread":false},{"title":"src","children":[{"title":"test","children":[{"title":"resources","children":null,"spread":false},{"title":"java","children":null,"spread":false}],"spread":true},{"title":"main","children":[{"title":"resources","children":[{"title":"parser.js <span style='color:#111;'> 606B </span>","children":null,"spread":false},{"title":"log4j.properties <span style='color:#111;'> 600B </span>","children":null,"spread":false}],"spread":true},{"title":"java","children":[{"title":"com","children":[{"title":"zhao","children":[{"title":"crawler","children":[{"title":"ECCrawler.java <span style='color:#111;'> 3.45KB </span>","children":null,"spread":false},{"title":"demo","children":[{"title":"TutorialCrawler2.java <span style='color:#111;'> 4.73KB </span>","children":null,"spread":false},{"title":"DemoJSCrawler.java <span style='color:#111;'> 3.01KB </span>","children":null,"spread":false}],"spread":true},{"title":"util","children":[{"title":"Platform.java <span style='color:#111;'> 1009B </span>","children":null,"spread":false},{"title":"Tools.java <span style='color:#111;'> 1.36KB </span>","children":null,"spread":false},{"title":"PageUtils.java <span style='color:#111;'> 3.54KB </span>","children":null,"spread":false}],"spread":true},{"title":"GoodsList.java <span style='color:#111;'> 1.15KB </span>","children":null,"spread":false},{"title":"Goods.java <span style='color:#111;'> 1.79KB </span>","children":null,"spread":false},{"title":"jd","children":[{"title":"JDCrawler.java <span style='color:#111;'> 2.10KB </span>","children":null,"spread":false},{"title":"JDGoodsList.java <span style='color:#111;'> 2.78KB </span>","children":null,"spread":false}],"spread":false}],"spread":true}],"spread":true}],"spread":true}],"spread":true}],"spread":true}],"spread":true},{"title":"target","children":[{"title":"m2e-jee","children":[{"title":"web-resources","children":[{"title":"META-INF","children":[{"title":"MANIFEST.MF <span style='color:#111;'> 105B </span>","children":null,"spread":false},{"title":"maven","children":[{"title":"WebCollectorDemo","children":[{"title":"WebCollectorDemo","children":[{"title":"pom.properties <span style='color:#111;'> 241B </span>","children":null,"spread":false},{"title":"pom.xml <span style='color:#111;'> 2.38KB </span>","children":null,"spread":false}],"spread":true}],"spread":true}],"spread":true}],"spread":true}],"spread":true}],"spread":true},{"title":"test-classes","children":null,"spread":false}],"spread":true},{"title":"WebRoot","children":[{"title":"WEB-INF","children":[{"title":"classes","children":[{"title":"parser.js <span style='color:#111;'> 606B </span>","children":null,"spread":false},{"title":"com","children":[{"title":"zhao","children":[{"title":"crawler","children":[{"title":"ECCrawler.class <span style='color:#111;'> 3.80KB </span>","children":null,"spread":false},{"title":"Goods.class <span style='color:#111;'> 1.76KB </span>","children":null,"spread":false},{"title":"demo","children":[{"title":"DemoJSCrawler.class <span style='color:#111;'> 3.15KB </span>","children":null,"spread":false},{"title":"TutorialCrawler2.class <span style='color:#111;'> 1.91KB </span>","children":null,"spread":false}],"spread":false},{"title":"util","children":[{"title":"PageUtils.class <span style='color:#111;'> 3.25KB </span>","children":null,"spread":false},{"title":"Platform.class <span style='color:#111;'> 180B </span>","children":null,"spread":false},{"title":"Tools.class <span style='color:#111;'> 709B </span>","children":null,"spread":false}],"spread":false},{"title":"GoodsList.class <span style='color:#111;'> 490B </span>","children":null,"spread":false},{"title":"jd","children":[{"title":"JDGoodsList.class <span style='color:#111;'> 3.31KB </span>","children":null,"spread":false},{"title":"JDCrawler.class <span style='color:#111;'> 2.29KB </span>","children":null,"spread":false}],"spread":false}],"spread":true}],"spread":true}],"spread":true},{"title":"log4j.properties <span style='color:#111;'> 600B </span>","children":null,"spread":false},{"title":"main","children":[{"title":"resources","children":[{"title":"parser.js <span style='color:#111;'> 606B </span>","children":null,"spread":false},{"title":"log4j.properties <span style='color:#111;'> 600B </span>","children":null,"spread":false}],"spread":true}],"spread":true}],"spread":true},{"title":"lib","children":null,"spread":false},{"title":"web.xml <span style='color:#111;'> 404B </span>","children":null,"spread":false}],"spread":true},{"title":"index.jsp <span style='color:#111;'> 834B </span>","children":null,"spread":false},{"title":"META-INF","children":[{"title":"MANIFEST.MF <span style='color:#111;'> 36B </span>","children":null,"spread":false}],"spread":true}],"spread":true},{"title":".myeclipse","children":null,"spread":false},{"title":".settings","children":[{"title":"org.eclipse.wst.jsdt.ui.superType.container <span style='color:#111;'> 49B </span>","children":null,"spread":false},{"title":"org.eclipse.jdt.ui.prefs <span style='color:#111;'> 5.88KB </span>","children":null,"spread":false},{"title":"org.eclipse.wst.common.project.facet.core.xml <span style='color:#111;'> 252B </span>","children":null,"spread":false},{"title":"org.eclipse.m2e.core.prefs <span style='color:#111;'> 121B </span>","children":null,"spread":false},{"title":"org.eclipse.jdt.core.prefs <span style='color:#111;'> 461B </span>","children":null,"spread":false},{"title":"org.eclipse.wst.jsdt.ui.superType.name <span style='color:#111;'> 6B </span>","children":null,"spread":false},{"title":"com.genuitec.eclipse.j2eedt.core.prefs <span style='color:#111;'> 87B </span>","children":null,"spread":false},{"title":"org.eclipse.core.resources.prefs <span style='color:#111;'> 149B </span>","children":null,"spread":false},{"title":"org.eclipse.wst.common.component <span style='color:#111;'> 585B </span>","children":null,"spread":false},{"title":".jsdtscope <span style='color:#111;'> 500B </span>","children":null,"spread":false}],"spread":true},{"title":"phantomjsdriver.log <span style='color:#111;'> 45.32KB </span>","children":null,"spread":false},{"title":"pom.xml <span style='color:#111;'> 2.38KB </span>","children":null,"spread":false},{"title":".classpath <span style='color:#111;'> 712B </span>","children":null,"spread":false}],"spread":true}],"spread":true}]

评论信息

  • coding-now :
    分高了点,东西还可以
    2020-12-13
  • walk_ghost :
    很不错的例子,感谢分享
    2018-09-26
  • Yan-li :
    研究一下,刚开始看还不太懂
    2018-09-18
  • welee :
    研究研究,谢谢分享!
    2018-09-06
  • rockxt :
    很不错的例子,感谢分享
    2018-08-22
  • wtj917106 :
    可以用,挺好用的
    2018-07-03
  • lty806280241 :
    例子学习正好
    2018-05-09
  • qq_21405557 :
    我正在学习,很强大
    2018-01-29
  • zhuqlinglian :
    可以用,挺好用的
    2018-01-11
  • wangqz1027 :
    MD,下载没成功但提示我已经下载了。。。。
    2017-11-02

免责申明

【只为小站】的资源来自网友分享,仅供学习研究,请务必在下载后24小时内给予删除,不得用于其他任何用途,否则后果自负。基于互联网的特殊性,【只为小站】 无法对用户传输的作品、信息、内容的权属或合法性、合规性、真实性、科学性、完整权、有效性等进行实质审查;无论 【只为小站】 经营者是否已进行审查,用户均应自行承担因其传输的作品、信息、内容而可能或已经产生的侵权或权属纠纷等法律责任。
本站所有资源不代表本站的观点或立场,基于网友分享,根据中国法律《信息网络传播权保护条例》第二十二条之规定,若资源存在侵权或相关问题请联系本站客服人员,zhiweidada#qq.com,请把#换成@,本站将给予最大的支持与配合,做到及时反馈和处理。关于更多版权及免责申明参见 版权及免责申明