基于python的二手房信息并进行数据处理与分析

上传者: QYgujingjing | 上传时间: 2023-03-01 17:49:08 | 文件大小: 1.28MB | 文件类型: ZIP
基于python的二手房数据分析 spider - 爬虫脚本,负责获取二手房数据 conf - 项目的全局配置, config.yaml 里定义获取过程中的 url 地址和自己的用户名密码 cities.py - 获取每个城市对应子域名 cas - cas模拟登录模块,二手房成交信息需要登录才能获取。其采用cas单点登录,密码使用 rsa2 和 rsa 加密隔天轮换 utils - 工具包,包含从 UA 池中获取随机 User-Agent 的方法,操作数据库的方法。 spider.py - 爬虫主文件,根据城市,地区爬取相应数据, 存入mysql UA.txt - UA 池,反反爬 sql/table.sql - 建表脚本 sh_house_backend - 系统后端 sh_house_frontend - 系统前端(可视化部分) static - 静态图片,资源和使用 pyecharts 动态绘制出的可视化图 template - 模板 app.py - app draw.py - 各种画图函数

文件下载

资源详情

[{"title":"( 93 个子文件 1.28MB ) 基于python的二手房信息并进行数据处理与分析","children":[{"title":"sh_house_analysis-main","children":[{"title":"spider","children":[{"title":"sql","children":[{"title":"table.sql <span style='color:#111;'> 847B </span>","children":null,"spread":false}],"spread":true},{"title":"utils","children":[{"title":"utils.py <span style='color:#111;'> 4.50KB </span>","children":null,"spread":false},{"title":"__init__.py <span style='color:#111;'> 44B </span>","children":null,"spread":false},{"title":"__pycache__","children":[{"title":"utils.cpython-38.pyc <span style='color:#111;'> 4.59KB </span>","children":null,"spread":false},{"title":"__init__.cpython-38.pyc <span style='color:#111;'> 224B </span>","children":null,"spread":false}],"spread":true}],"spread":true},{"title":"cas","children":[{"title":"cas_login.py <span style='color:#111;'> 4.09KB </span>","children":null,"spread":false},{"title":"__pycache__","children":[{"title":"cas_login.cpython-38.pyc <span style='color:#111;'> 3.70KB </span>","children":null,"spread":false}],"spread":true}],"spread":true},{"title":"UA.txt <span style='color:#111;'> 114B </span>","children":null,"spread":false},{"title":"test","children":[{"title":"test.py <span style='color:#111;'> 1.66KB </span>","children":null,"spread":false}],"spread":true},{"title":"spider.py <span style='color:#111;'> 11.25KB </span>","children":null,"spread":false},{"title":"conf","children":[{"title":"__init__.py <span style='color:#111;'> 274B </span>","children":null,"spread":false},{"title":"config.yaml <span style='color:#111;'> 403B </span>","children":null,"spread":false},{"title":"__pycache__","children":[{"title":"__init__.cpython-38.pyc <span style='color:#111;'> 646B </span>","children":null,"spread":false}],"spread":true},{"title":"config.yaml.example <span style='color:#111;'> 315B </span>","children":null,"spread":false}],"spread":true},{"title":"cities.py <span style='color:#111;'> 1005B </span>","children":null,"spread":false}],"spread":true},{"title":"sh_house_backend","children":[{"title":"pom.xml <span style='color:#111;'> 3.39KB </span>","children":null,"spread":false},{"title":"src","children":[{"title":"test","children":[{"title":"java","children":[{"title":"my","children":[{"title":"ShHouseBackendApplicationTests.java <span style='color:#111;'> 362B </span>","children":null,"spread":false}],"spread":true}],"spread":true}],"spread":true},{"title":"main","children":[{"title":"resources","children":[{"title":"application.yml <span style='color:#111;'> 657B </span>","children":null,"spread":false}],"spread":true},{"title":"java","children":[{"title":"my","children":[{"title":"controller","children":[{"title":"DataController.java <span style='color:#111;'> 2.05KB </span>","children":null,"spread":false}],"spread":true},{"title":"task","children":[{"title":"Spider.java <span style='color:#111;'> 639B </span>","children":null,"spread":false}],"spread":true},{"title":"dao","children":[{"title":"InfoMapper.java <span style='color:#111;'> 3.15KB </span>","children":null,"spread":false},{"title":"RegionMapper.java <span style='color:#111;'> 222B </span>","children":null,"spread":false},{"title":"CityMapper.java <span style='color:#111;'> 567B </span>","children":null,"spread":false}],"spread":true},{"title":"pojo","children":[{"title":"City.java <span style='color:#111;'> 341B </span>","children":null,"spread":false},{"title":"PriceAndDate.java <span style='color:#111;'> 316B </span>","children":null,"spread":false},{"title":"Info.java <span style='color:#111;'> 494B </span>","children":null,"spread":false},{"title":"Region.java <span style='color:#111;'> 368B </span>","children":null,"spread":false}],"spread":true},{"title":"service","children":[{"title":"DataService.java <span style='color:#111;'> 546B </span>","children":null,"spread":false},{"title":"Impl","children":[{"title":"DataServiceImpl.java <span style='color:#111;'> 10.85KB </span>","children":null,"spread":false}],"spread":false}],"spread":false},{"title":"ShHouseBackendApplication.java <span style='color:#111;'> 481B </span>","children":null,"spread":false},{"title":"predict","children":[{"title":"Predictor.java <span style='color:#111;'> 7.11KB </span>","children":null,"spread":false}],"spread":false},{"title":"dto","children":[{"title":"C3Data.java <span style='color:#111;'> 518B </span>","children":null,"spread":false},{"title":"C2Data.java <span style='color:#111;'> 636B </span>","children":null,"spread":false},{"title":"PredictData.java <span style='color:#111;'> 206B </span>","children":null,"spread":false},{"title":"C5Param.java <span style='color:#111;'> 264B </span>","children":null,"spread":false},{"title":"RawData.java <span style='color:#111;'> 251B </span>","children":null,"spread":false},{"title":"C1Data.java <span style='color:#111;'> 534B </span>","children":null,"spread":false},{"title":"C6Data.java <span style='color:#111;'> 277B </span>","children":null,"spread":false},{"title":"C7Data.java <span style='color:#111;'> 158B </span>","children":null,"spread":false},{"title":"RawParam.java <span style='color:#111;'> 330B </span>","children":null,"spread":false},{"title":"C4Data.java <span style='color:#111;'> 532B </span>","children":null,"spread":false}],"spread":false}],"spread":true},{"title":"META-INF","children":[{"title":"MANIFEST.MF <span style='color:#111;'> 64B </span>","children":null,"spread":false}],"spread":true}],"spread":true}],"spread":true}],"spread":true},{"title":".mvn","children":[{"title":"wrapper","children":[{"title":"maven-wrapper.properties <span style='color:#111;'> 218B </span>","children":null,"spread":false},{"title":"maven-wrapper.jar <span style='color:#111;'> 49.52KB </span>","children":null,"spread":false},{"title":"MavenWrapperDownloader.java <span style='color:#111;'> 4.83KB </span>","children":null,"spread":false}],"spread":true}],"spread":true},{"title":".gitignore <span style='color:#111;'> 333B </span>","children":null,"spread":false},{"title":"test.py <span style='color:#111;'> 96B </span>","children":null,"spread":false},{"title":"README.md <span style='color:#111;'> 32B </span>","children":null,"spread":false}],"spread":true},{"title":"README.md <span style='color:#111;'> 1.73KB </span>","children":null,"spread":false},{"title":"sh_house_frontend","children":[{"title":"draw.py <span style='color:#111;'> 7.33KB </span>","children":null,"spread":false},{"title":"app.py <span style='color:#111;'> 4.52KB </span>","children":null,"spread":false},{"title":"templates","children":[{"title":"analyse.html <span style='color:#111;'> 5.28KB </span>","children":null,"spread":false},{"title":"index.html <span style='color:#111;'> 5.89KB </span>","children":null,"spread":false},{"title":"about.html <span style='color:#111;'> 3.43KB </span>","children":null,"spread":false},{"title":"predict.html <span style='color:#111;'> 4.11KB </span>","children":null,"spread":false},{"title":"query.html <span style='color:#111;'> 6.41KB </span>","children":null,"spread":false}],"spread":true},{"title":".idea","children":[{"title":"frontend.iml <span style='color:#111;'> 890B </span>","children":null,"spread":false},{"title":"misc.xml <span style='color:#111;'> 185B </span>","children":null,"spread":false},{"title":"inspectionProfiles","children":[{"title":"Project_Default.xml <span style='color:#111;'> 3.82KB </span>","children":null,"spread":false},{"title":"profiles_settings.xml <span style='color:#111;'> 174B </span>","children":null,"spread":false}],"spread":true},{"title":"modules.xml <span style='color:#111;'> 268B </span>","children":null,"spread":false},{"title":".gitignore <span style='color:#111;'> 267B </span>","children":null,"spread":false}],"spread":true},{"title":"__pycache__","children":[{"title":"app.cpython-38.pyc <span style='color:#111;'> 3.90KB </span>","children":null,"spread":false},{"title":"draw.cpython-38.pyc <span style='color:#111;'> 5.74KB </span>","children":null,"spread":false}],"spread":true},{"title":"static","children":[{"title":"pic21.html <span style='color:#111;'> 4.10KB </span>","children":null,"spread":false},{"title":"js","children":[{"title":"lightbox-plus-jquery.min.js <span style='color:#111;'> 90.90KB </span>","children":null,"spread":false},{"title":"responsiveslides.min.js <span style='color:#111;'> 3.32KB </span>","children":null,"spread":false},{"title":"jquery.min.js <span style='color:#111;'> 94.12KB </span>","children":null,"spread":false}],"spread":true},{"title":"pic3.html <span style='color:#111;'> 5.52KB </span>","children":null,"spread":false},{"title":"pic1.html <span style='color:#111;'> 5.40KB </span>","children":null,"spread":false},{"title":"pic22.html <span style='color:#111;'> 4.10KB </span>","children":null,"spread":false},{"title":"img","children":[{"title":"abt.jpg <span style='color:#111;'> 50.34KB </span>","children":null,"spread":false},{"title":"VCG2.jpg <span style='color:#111;'> 424.87KB </span>","children":null,"spread":false},{"title":"pic4.jpg <span style='color:#111;'> 18.23KB </span>","children":null,"spread":false},{"title":"pic2.jpg <span style='color:#111;'> 26.14KB </span>","children":null,"spread":false},{"title":"pic3.jpg <span style='color:#111;'> 17.78KB </span>","children":null,"spread":false},{"title":"pic1.jpg <span style='color:#111;'> 24.64KB </span>","children":null,"spread":false},{"title":"bnr3.jpg <span style='color:#111;'> 51.55KB </span>","children":null,"spread":false}],"spread":false},{"title":"css","children":[{"title":"style.css <span style='color:#111;'> 25.08KB </span>","children":null,"spread":false},{"title":"bootstrap.min.css <span style='color:#111;'> 114.56KB </span>","children":null,"spread":false},{"title":"dashboard.css <span style='color:#111;'> 1.49KB </span>","children":null,"spread":false},{"title":"bootstrap.css <span style='color:#111;'> 118.19KB </span>","children":null,"spread":false},{"title":"lightbox.css <span style='color:#111;'> 3.85KB </span>","children":null,"spread":false}],"spread":false},{"title":"pic4.html <span style='color:#111;'> 5.36KB </span>","children":null,"spread":false},{"title":"pic6.html <span style='color:#111;'> 33.81KB </span>","children":null,"spread":false},{"title":"pic5.html <span style='color:#111;'> 3.54KB </span>","children":null,"spread":false},{"title":"predict.html <span style='color:#111;'> 7.13KB </span>","children":null,"spread":false},{"title":"pic7.html <span style='color:#111;'> 13.88KB </span>","children":null,"spread":false},{"title":"fonts","children":[{"title":"glyphicons-halflings-regular.woff <span style='color:#111;'> 22.88KB </span>","children":null,"spread":false},{"title":"OpenSans-Bold.ttf <span style='color:#111;'> 219.33KB </span>","children":null,"spread":false},{"title":"OpenSans-Semibold.ttf <span style='color:#111;'> 216.14KB </span>","children":null,"spread":false},{"title":"OpenSans-Regular.ttf <span style='color:#111;'> 212.27KB </span>","children":null,"spread":false},{"title":"OpenSans-ExtraBold.ttf <span style='color:#111;'> 217.37KB </span>","children":null,"spread":false}],"spread":false}],"spread":false}],"spread":true}],"spread":true}],"spread":true}]

评论信息

免责申明

【只为小站】的资源来自网友分享,仅供学习研究,请务必在下载后24小时内给予删除,不得用于其他任何用途,否则后果自负。基于互联网的特殊性,【只为小站】 无法对用户传输的作品、信息、内容的权属或合法性、合规性、真实性、科学性、完整权、有效性等进行实质审查;无论 【只为小站】 经营者是否已进行审查,用户均应自行承担因其传输的作品、信息、内容而可能或已经产生的侵权或权属纠纷等法律责任。
本站所有资源不代表本站的观点或立场,基于网友分享,根据中国法律《信息网络传播权保护条例》第二十二条之规定,若资源存在侵权或相关问题请联系本站客服人员,zhiweidada#qq.com,请把#换成@,本站将给予最大的支持与配合,做到及时反馈和处理。关于更多版权及免责申明参见 版权及免责申明