Python爬虫-scrapy-城市二手房数据爬取与保存

上传者: m0_54759841 | 上传时间: 2023-02-28 16:48:02 | 文件大小: 195KB | 文件类型: ZIP
基于scrapy编写的爬虫,能够爬取城市二手房的各种信息,比如房价、面积、所处位置等十分方便易用,并采用Beautifulsoup进行页面解析无视反爬机制

文件下载

资源详情

[{"title":"( 72 个子文件 195KB ) Python爬虫-scrapy-城市二手房数据爬取与保存","children":[{"title":"Scrapy","children":[{"title":"HousePrice","children":[{"title":"scrapy.cfg <span style='color:#111;'> 263B </span>","children":null,"spread":false},{"title":"HousePrice","children":[{"title":"__init__.py <span style='color:#111;'> 0B </span>","children":null,"spread":false},{"title":"pipelines.py <span style='color:#111;'> 1.20KB </span>","children":null,"spread":false},{"title":"spiders","children":[{"title":"__init__.py <span style='color:#111;'> 161B </span>","children":null,"spread":false},{"title":"items.py <span style='color:#111;'> 792B </span>","children":null,"spread":false},{"title":"__pycache__","children":[{"title":"items.cpython-39.pyc <span style='color:#111;'> 626B </span>","children":null,"spread":false},{"title":"__init__.cpython-39.pyc <span style='color:#111;'> 176B </span>","children":null,"spread":false},{"title":"spider.cpython-39.pyc <span style='color:#111;'> 2.41KB </span>","children":null,"spread":false}],"spread":true},{"title":"spider.py <span style='color:#111;'> 2.57KB </span>","children":null,"spread":false}],"spread":true},{"title":"data.csv <span style='color:#111;'> 321.91KB </span>","children":null,"spread":false},{"title":"items.py <span style='color:#111;'> 793B </span>","children":null,"spread":false},{"title":"settings.py <span style='color:#111;'> 4.11KB </span>","children":null,"spread":false},{"title":"__pycache__","children":[{"title":"middlewares.cpython-39.pyc <span style='color:#111;'> 3.02KB </span>","children":null,"spread":false},{"title":"__init__.cpython-39.pyc <span style='color:#111;'> 168B </span>","children":null,"spread":false},{"title":"settings.cpython-39.pyc <span style='color:#111;'> 1.39KB </span>","children":null,"spread":false},{"title":"pipelines.cpython-39.pyc <span style='color:#111;'> 1.40KB </span>","children":null,"spread":false}],"spread":true},{"title":"middlewares.py <span style='color:#111;'> 4.07KB </span>","children":null,"spread":false}],"spread":true}],"spread":true},{"title":".git","children":[{"title":"index <span style='color:#111;'> 1.74KB </span>","children":null,"spread":false},{"title":"HEAD <span style='color:#111;'> 23B </span>","children":null,"spread":false},{"title":"refs","children":[{"title":"heads","children":[{"title":"master <span style='color:#111;'> 41B </span>","children":null,"spread":false}],"spread":true},{"title":"tags","children":null,"spread":false},{"title":"remotes","children":[{"title":"origin","children":[{"title":"master <span style='color:#111;'> 41B </span>","children":null,"spread":false}],"spread":true}],"spread":true}],"spread":true},{"title":"COMMIT_EDITMSG <span style='color:#111;'> 15B </span>","children":null,"spread":false},{"title":"objects","children":[{"title":"a2","children":[{"title":"e0c2de46864016d4f6b0b8274439cecea42f44 <span style='color:#111;'> 119B </span>","children":null,"spread":false}],"spread":true},{"title":"40","children":[{"title":"d5d8373b68687684889c29dc2837c905d27794 <span style='color:#111;'> 81.65KB </span>","children":null,"spread":false}],"spread":true},{"title":"e6","children":[{"title":"9de29bb2d1d6434b8b29ae775ad8c2e48c5391 <span style='color:#111;'> 15B </span>","children":null,"spread":false}],"spread":true},{"title":"9d","children":[{"title":"e8bb7f472c8508f74936e3bd53426e6aabb39c <span style='color:#111;'> 569B </span>","children":null,"spread":false}],"spread":true},{"title":"eb","children":[{"title":"d689ac51d69c5e1dbbe80083c2b20a39f8bb79 <span style='color:#111;'> 134B </span>","children":null,"spread":false}],"spread":true},{"title":"10","children":[{"title":"5ce2da2d6447d11dfe32bfb846c3d5b199fc99 <span style='color:#111;'> 142B </span>","children":null,"spread":false}],"spread":true},{"title":"a4","children":[{"title":"598ea2ff33dd8bcbdc4999ec2f25f9a00c5812 <span style='color:#111;'> 138B </span>","children":null,"spread":false}],"spread":false},{"title":"3d","children":[{"title":"472e91c6942888aff586263348f22972a3f663 <span style='color:#111;'> 1.54KB </span>","children":null,"spread":false}],"spread":false},{"title":"11","children":[{"title":"0181416ae53df32c891a2e7fd55d64d998f68d <span style='color:#111;'> 1.18KB </span>","children":null,"spread":false}],"spread":false},{"title":"d0","children":[{"title":"876a78d06ac03b5d78c8dcdb95570281c6f1d6 <span style='color:#111;'> 210B </span>","children":null,"spread":false}],"spread":false},{"title":"35","children":[{"title":"410cacdc5e87f985c93a96520f5e11a5c822e4 <span style='color:#111;'> 182B </span>","children":null,"spread":false}],"spread":false},{"title":"8a","children":[{"title":"c2db9351989059a7440070aacc287ae37c6617 <span style='color:#111;'> 106B </span>","children":null,"spread":false}],"spread":false},{"title":"f1","children":[{"title":"e3230dc08958f5f5094548f950ece00ea3e76e <span style='color:#111;'> 1.36KB </span>","children":null,"spread":false}],"spread":false},{"title":"4b","children":[{"title":"107cc19a3468bbdde9d30048ee019fb91ef3f1 <span style='color:#111;'> 196B </span>","children":null,"spread":false}],"spread":false},{"title":"6b","children":[{"title":"63e269ef4ba773edc63d80dac3d014d3603eba <span style='color:#111;'> 196B </span>","children":null,"spread":false}],"spread":false},{"title":"pack","children":null,"spread":false},{"title":"c7","children":[{"title":"1e318e37f8f5d21c22cba8dac984b4320afb6f <span style='color:#111;'> 987B </span>","children":null,"spread":false}],"spread":false},{"title":"af","children":[{"title":"43530d5464e15bb6bbdb5e3b5bc89b3b79dd52 <span style='color:#111;'> 82B </span>","children":null,"spread":false}],"spread":false},{"title":"b4","children":[{"title":"7467817b9ce55ea09fdbda64ace142f3a7b101 <span style='color:#111;'> 186B </span>","children":null,"spread":false}],"spread":false},{"title":"info","children":null,"spread":false},{"title":"ba","children":[{"title":"9ca3973bd7849e59b3e203994acd978368d45a <span style='color:#111;'> 91B </span>","children":null,"spread":false}],"spread":false},{"title":"d5","children":[{"title":"6657add3eb3c246989284ec6e6a8475603cf1d <span style='color:#111;'> 147B </span>","children":null,"spread":false}],"spread":false},{"title":"31","children":[{"title":"e41a98fafd6dc5ba906e57a03e7557fcceb00f <span style='color:#111;'> 449B </span>","children":null,"spread":false}],"spread":false},{"title":"02","children":[{"title":"a1b2da95e31fc00967cf445e77e55f3e2e0d69 <span style='color:#111;'> 450B </span>","children":null,"spread":false}],"spread":false},{"title":"75","children":[{"title":"37705ade4dee3b6d8440c521511114a033a31f <span style='color:#111;'> 253B </span>","children":null,"spread":false}],"spread":false}],"spread":false},{"title":"description <span style='color:#111;'> 73B </span>","children":null,"spread":false},{"title":"info","children":[{"title":"exclude <span style='color:#111;'> 240B </span>","children":null,"spread":false}],"spread":true},{"title":"logs","children":[{"title":"HEAD <span style='color:#111;'> 162B </span>","children":null,"spread":false},{"title":"refs","children":[{"title":"heads","children":[{"title":"master <span style='color:#111;'> 162B </span>","children":null,"spread":false}],"spread":true},{"title":"remotes","children":[{"title":"origin","children":[{"title":"master <span style='color:#111;'> 144B </span>","children":null,"spread":false}],"spread":false}],"spread":true}],"spread":true}],"spread":true},{"title":"hooks","children":[{"title":"post-update.sample <span style='color:#111;'> 189B </span>","children":null,"spread":false},{"title":"prepare-commit-msg.sample <span style='color:#111;'> 1.46KB </span>","children":null,"spread":false},{"title":"commit-msg.sample <span style='color:#111;'> 896B </span>","children":null,"spread":false},{"title":"pre-receive.sample <span style='color:#111;'> 544B </span>","children":null,"spread":false},{"title":"update.sample <span style='color:#111;'> 3.56KB </span>","children":null,"spread":false},{"title":"pre-commit.sample <span style='color:#111;'> 1.60KB </span>","children":null,"spread":false},{"title":"pre-rebase.sample <span style='color:#111;'> 4.78KB </span>","children":null,"spread":false},{"title":"applypatch-msg.sample <span style='color:#111;'> 478B </span>","children":null,"spread":false},{"title":"fsmonitor-watchman.sample <span style='color:#111;'> 4.55KB </span>","children":null,"spread":false},{"title":"push-to-checkout.sample <span style='color:#111;'> 2.72KB </span>","children":null,"spread":false},{"title":"pre-applypatch.sample <span style='color:#111;'> 424B </span>","children":null,"spread":false},{"title":"pre-push.sample <span style='color:#111;'> 1.34KB </span>","children":null,"spread":false},{"title":"pre-merge-commit.sample <span style='color:#111;'> 416B </span>","children":null,"spread":false}],"spread":false},{"title":"config <span style='color:#111;'> 317B </span>","children":null,"spread":false}],"spread":true},{"title":".idea","children":[{"title":"vcs.xml <span style='color:#111;'> 185B </span>","children":null,"spread":false},{"title":"workspace.xml <span style='color:#111;'> 3.83KB </span>","children":null,"spread":false},{"title":"misc.xml <span style='color:#111;'> 188B </span>","children":null,"spread":false},{"title":"inspectionProfiles","children":[{"title":"Project_Default.xml <span style='color:#111;'> 6.38KB </span>","children":null,"spread":false},{"title":"profiles_settings.xml <span style='color:#111;'> 174B </span>","children":null,"spread":false}],"spread":true},{"title":"modules.xml <span style='color:#111;'> 271B </span>","children":null,"spread":false},{"title":".gitignore <span style='color:#111;'> 190B </span>","children":null,"spread":false},{"title":"Scrapy.iml <span style='color:#111;'> 291B </span>","children":null,"spread":false}],"spread":true}],"spread":true}],"spread":true}]

评论信息

免责申明

【只为小站】的资源来自网友分享,仅供学习研究,请务必在下载后24小时内给予删除,不得用于其他任何用途,否则后果自负。基于互联网的特殊性,【只为小站】 无法对用户传输的作品、信息、内容的权属或合法性、合规性、真实性、科学性、完整权、有效性等进行实质审查;无论 【只为小站】 经营者是否已进行审查,用户均应自行承担因其传输的作品、信息、内容而可能或已经产生的侵权或权属纠纷等法律责任。
本站所有资源不代表本站的观点或立场,基于网友分享,根据中国法律《信息网络传播权保护条例》第二十二条之规定,若资源存在侵权或相关问题请联系本站客服人员,zhiweidada#qq.com,请把#换成@,本站将给予最大的支持与配合,做到及时反馈和处理。关于更多版权及免责申明参见 版权及免责申明