lianjia-spider:链家二手房爬虫,支持爬取指定城市,户型,价位二手仓库,并通过电子提供跨平台UI,可记录历史价格,售出仓库等信息

上传者: 42170064 | 上传时间: 2023-11-13 15:09:46 | 文件大小: 4.95MB | 文件类型: ZIP
链家二手房爬虫工具 本工具分为爬虫端与客户端,爬虫端用于爬取链家页面二手房数据并存储于数据库,客户端用于分析展示数据库数据。 实现功能 爬虫端(Python) 二手登山爬取,可指定城市,地区,户型以及价格范围。 每日数据存储,数据库为sqlite3,数据库文件为./lianjia.db 已售的记录记录,当某套房源不再能被抓取取到时,转换套房源从交换表迁移到售出表,保留售出前历史数据。 客户端(Nodejs) 数据可视化展示,使用电子实现跨平台,展示内容包括包括id,小区,户型,面积,朝向,偏移,年份,建筑类型,总价,单价。出。 历史价格展示,预先设定的预期高度后可进入历史价格页面,展示每次抓取获取到的价格,逐步价格的变化用箭头标出。 卖出上市展示,展示已售出上市及售出日期(最后一次抓取日期) 目录结构 . ├── README.md ├── config │   └── config.js

文件下载

资源详情

[{"title":"( 94 个子文件 4.95MB ) lianjia-spider:链家二手房爬虫,支持爬取指定城市,户型,价位二手仓库,并通过电子提供跨平台UI,可记录历史价格,售出仓库等信息","children":[{"title":"lianjia-spider-master","children":[{"title":"preload.js <span style='color:#111;'> 726B </span>","children":null,"spread":false},{"title":"python_scripts","children":[{"title":"main.py <span style='color:#111;'> 2.38KB </span>","children":null,"spread":false},{"title":"spider.py <span style='color:#111;'> 2.99KB </span>","children":null,"spread":false},{"title":"database.py <span style='color:#111;'> 3.87KB </span>","children":null,"spread":false}],"spread":true},{"title":"config","children":[{"title":"config.json <span style='color:#111;'> 131B </span>","children":null,"spread":false}],"spread":true},{"title":"img","children":[{"title":"sellout.png <span style='color:#111;'> 1.61MB </span>","children":null,"spread":false},{"title":"date.png <span style='color:#111;'> 577.99KB </span>","children":null,"spread":false},{"title":"index.png <span style='color:#111;'> 779.99KB </span>","children":null,"spread":false}],"spread":true},{"title":"package.json <span style='color:#111;'> 339B </span>","children":null,"spread":false},{"title":"db","children":[{"title":"lianjia.db <span style='color:#111;'> 60.00KB </span>","children":null,"spread":false}],"spread":true},{"title":"static","children":[{"title":"css","children":[{"title":"util.css <span style='color:#111;'> 84.77KB </span>","children":null,"spread":false},{"title":"main.css <span style='color:#111;'> 18.08KB </span>","children":null,"spread":false}],"spread":true},{"title":"vendor","children":[{"title":"bootstrap","children":[{"title":"css","children":[{"title":"bootstrap-grid.css.map <span style='color:#111;'> 72.02KB </span>","children":null,"spread":false},{"title":"bootstrap-reboot.min.css <span style='color:#111;'> 3.52KB </span>","children":null,"spread":false},{"title":"bootstrap.css.map <span style='color:#111;'> 370.25KB </span>","children":null,"spread":false},{"title":"bootstrap.min.css <span style='color:#111;'> 122.03KB </span>","children":null,"spread":false},{"title":"bootstrap-reboot.css <span style='color:#111;'> 4.38KB </span>","children":null,"spread":false},{"title":"bootstrap-grid.min.css <span style='color:#111;'> 21.27KB </span>","children":null,"spread":false},{"title":"bootstrap.css <span style='color:#111;'> 153.21KB </span>","children":null,"spread":false},{"title":"bootstrap-reboot.css.map <span style='color:#111;'> 49.83KB </span>","children":null,"spread":false},{"title":"bootstrap-reboot.min.css.map <span style='color:#111;'> 24.07KB </span>","children":null,"spread":false},{"title":"bootstrap.min.css.map <span style='color:#111;'> 490.66KB </span>","children":null,"spread":false},{"title":"bootstrap-grid.css <span style='color:#111;'> 28.46KB </span>","children":null,"spread":false},{"title":"bootstrap-grid.min.css.map <span style='color:#111;'> 51.44KB </span>","children":null,"spread":false}],"spread":false},{"title":"js","children":[{"title":"tooltip.js <span style='color:#111;'> 16.89KB </span>","children":null,"spread":false},{"title":"bootstrap.min.js <span style='color:#111;'> 49.94KB </span>","children":null,"spread":false},{"title":"popper.js <span style='color:#111;'> 79.76KB </span>","children":null,"spread":false},{"title":"bootstrap.js <span style='color:#111;'> 108.78KB </span>","children":null,"spread":false},{"title":"popper.min.js <span style='color:#111;'> 18.59KB </span>","children":null,"spread":false}],"spread":true}],"spread":true},{"title":"jquery","children":[{"title":"jquery-3.2.1.min.js <span style='color:#111;'> 84.63KB </span>","children":null,"spread":false}],"spread":true},{"title":"perfect-scrollbar","children":[{"title":"perfect-scrollbar.min.js <span style='color:#111;'> 17.46KB </span>","children":null,"spread":false},{"title":"perfect-scrollbar.css <span style='color:#111;'> 2.39KB </span>","children":null,"spread":false}],"spread":true},{"title":"select2","children":[{"title":"select2.min.css <span style='color:#111;'> 14.84KB </span>","children":null,"spread":false},{"title":"select2.css <span style='color:#111;'> 17.66KB </span>","children":null,"spread":false},{"title":"select2.min.js <span style='color:#111;'> 65.10KB </span>","children":null,"spread":false},{"title":"select2.js <span style='color:#111;'> 164.99KB </span>","children":null,"spread":false}],"spread":true},{"title":"animate","children":[{"title":"animate.css <span style='color:#111;'> 23.29KB </span>","children":null,"spread":false}],"spread":false}],"spread":true},{"title":"images","children":[{"title":"icons","children":[{"title":"favicon.ico <span style='color:#111;'> 31.29KB </span>","children":null,"spread":false}],"spread":true}],"spread":true},{"title":"fonts","children":[{"title":"font-awesome-4.7.0","children":[{"title":"css","children":[{"title":"font-awesome.min.css <span style='color:#111;'> 30.27KB </span>","children":null,"spread":false},{"title":"font-awesome.css <span style='color:#111;'> 36.54KB </span>","children":null,"spread":false}],"spread":true},{"title":"less","children":[{"title":"mixins.less <span style='color:#111;'> 1.57KB </span>","children":null,"spread":false},{"title":"variables.less <span style='color:#111;'> 22.03KB </span>","children":null,"spread":false},{"title":"path.less <span style='color:#111;'> 771B </span>","children":null,"spread":false},{"title":"rotated-flipped.less <span style='color:#111;'> 622B </span>","children":null,"spread":false},{"title":"stacked.less <span style='color:#111;'> 476B </span>","children":null,"spread":false},{"title":"list.less <span style='color:#111;'> 377B </span>","children":null,"spread":false},{"title":"screen-reader.less <span style='color:#111;'> 118B </span>","children":null,"spread":false},{"title":"larger.less <span style='color:#111;'> 370B </span>","children":null,"spread":false},{"title":"font-awesome.less <span style='color:#111;'> 495B </span>","children":null,"spread":false},{"title":"fixed-width.less <span style='color:#111;'> 119B </span>","children":null,"spread":false},{"title":"core.less <span style='color:#111;'> 452B </span>","children":null,"spread":false},{"title":"animated.less <span style='color:#111;'> 713B </span>","children":null,"spread":false},{"title":"bordered-pulled.less <span style='color:#111;'> 585B </span>","children":null,"spread":false},{"title":"icons.less <span style='color:#111;'> 48.55KB </span>","children":null,"spread":false}],"spread":false},{"title":"fonts","children":[{"title":"fontawesome-webfont.eot <span style='color:#111;'> 161.86KB </span>","children":null,"spread":false},{"title":"fontawesome-webfont.woff <span style='color:#111;'> 95.73KB </span>","children":null,"spread":false},{"title":"FontAwesome.otf <span style='color:#111;'> 131.65KB </span>","children":null,"spread":false},{"title":"fontawesome-webfont.svg <span style='color:#111;'> 433.96KB </span>","children":null,"spread":false},{"title":"fontawesome-webfont.woff2 <span style='color:#111;'> 75.35KB </span>","children":null,"spread":false},{"title":"fontawesome-webfont.ttf <span style='color:#111;'> 161.67KB </span>","children":null,"spread":false}],"spread":false},{"title":"scss","children":[{"title":"_bordered-pulled.scss <span style='color:#111;'> 592B </span>","children":null,"spread":false},{"title":"_stacked.scss <span style='color:#111;'> 482B </span>","children":null,"spread":false},{"title":"_screen-reader.scss <span style='color:#111;'> 134B </span>","children":null,"spread":false},{"title":"_rotated-flipped.scss <span style='color:#111;'> 672B </span>","children":null,"spread":false},{"title":"_mixins.scss <span style='color:#111;'> 1.60KB </span>","children":null,"spread":false},{"title":"_path.scss <span style='color:#111;'> 783B </span>","children":null,"spread":false},{"title":"_list.scss <span style='color:#111;'> 378B </span>","children":null,"spread":false},{"title":"_variables.scss <span style='color:#111;'> 22.11KB </span>","children":null,"spread":false},{"title":"_icons.scss <span style='color:#111;'> 49.31KB </span>","children":null,"spread":false},{"title":"_core.scss <span style='color:#111;'> 459B </span>","children":null,"spread":false},{"title":"_animated.scss <span style='color:#111;'> 715B </span>","children":null,"spread":false},{"title":"_fixed-width.scss <span style='color:#111;'> 120B </span>","children":null,"spread":false},{"title":"font-awesome.scss <span style='color:#111;'> 430B </span>","children":null,"spread":false},{"title":"_larger.scss <span style='color:#111;'> 375B </span>","children":null,"spread":false}],"spread":false},{"title":"HELP-US-OUT.txt <span style='color:#111;'> 323B </span>","children":null,"spread":false}],"spread":true},{"title":"OpenSans","children":[{"title":"OpenSans-SemiBoldItalic.ttf <span style='color:#111;'> 207.75KB </span>","children":null,"spread":false},{"title":"OpenSans-ExtraBoldItalic.ttf <span style='color:#111;'> 208.34KB </span>","children":null,"spread":false},{"title":"OpenSans-Italic.ttf <span style='color:#111;'> 207.77KB </span>","children":null,"spread":false},{"title":"OpenSans-BoldItalic.ttf <span style='color:#111;'> 208.17KB </span>","children":null,"spread":false},{"title":"OpenSans-SemiBold.ttf <span style='color:#111;'> 215.98KB </span>","children":null,"spread":false},{"title":"OpenSans-Regular.ttf <span style='color:#111;'> 212.18KB </span>","children":null,"spread":false},{"title":"OpenSans-Bold.ttf <span style='color:#111;'> 219.19KB </span>","children":null,"spread":false},{"title":"OpenSans-Light.ttf <span style='color:#111;'> 217.03KB </span>","children":null,"spread":false},{"title":"OpenSans-LightItalic.ttf <span style='color:#111;'> 208.03KB </span>","children":null,"spread":false},{"title":"OpenSans-ExtraBold.ttf <span style='color:#111;'> 217.21KB </span>","children":null,"spread":false},{"title":"OpenSans-Regular.otf <span style='color:#111;'> 149.11KB </span>","children":null,"spread":false}],"spread":false}],"spread":true},{"title":"js","children":[{"title":"sellout.js <span style='color:#111;'> 1.85KB </span>","children":null,"spread":false},{"title":"date.js <span style='color:#111;'> 1.39KB </span>","children":null,"spread":false},{"title":"main.js <span style='color:#111;'> 4.01KB </span>","children":null,"spread":false}],"spread":true}],"spread":true},{"title":"views","children":[{"title":"date.html <span style='color:#111;'> 1.93KB </span>","children":null,"spread":false},{"title":"index.html <span style='color:#111;'> 2.30KB </span>","children":null,"spread":false},{"title":"sellout.html <span style='color:#111;'> 2.17KB </span>","children":null,"spread":false}],"spread":true},{"title":"main.js <span style='color:#111;'> 2.65KB </span>","children":null,"spread":false},{"title":"README.md <span style='color:#111;'> 3.41KB </span>","children":null,"spread":false}],"spread":true}],"spread":true}]

评论信息

免责申明

【只为小站】的资源来自网友分享,仅供学习研究,请务必在下载后24小时内给予删除,不得用于其他任何用途,否则后果自负。基于互联网的特殊性,【只为小站】 无法对用户传输的作品、信息、内容的权属或合法性、合规性、真实性、科学性、完整权、有效性等进行实质审查;无论 【只为小站】 经营者是否已进行审查,用户均应自行承担因其传输的作品、信息、内容而可能或已经产生的侵权或权属纠纷等法律责任。
本站所有资源不代表本站的观点或立场,基于网友分享,根据中国法律《信息网络传播权保护条例》第二十二条之规定,若资源存在侵权或相关问题请联系本站客服人员,zhiweidada#qq.com,请把#换成@,本站将给予最大的支持与配合,做到及时反馈和处理。关于更多版权及免责申明参见 版权及免责申明