FEC_DATA_LOADER

上传者: 42127937 | 上传时间: 2022-05-21 17:04:36 | 文件大小: 59.59MB | 文件类型: ZIP
#Fec Data Loader这是我编写的一些代码,用于从FEC下载数据,对其进行归一化和解码,并将其编入弹性搜索中以便在kibana中进行查看。 您也可以在熊猫中使用输出的csv文件,而不必对数据进行任何连接。 请注意,这是非常快捷和肮脏的。 在此处查看第一个分析: : ##用法:1.下载代码2.运行build2.py,这将在data子目录中生成文件。 生成的文件将以下划线(_)开头。 文件是_indiv16.csv,_exp16.csv,_pas216.csv。 (16是数据集年份)3.运行index_to_es.py(可选) ##要求:1. Python 3 2. index_to_es.py的elasticsearch-py(pip安装elasticsearch) ## build2.py从FEC( )下载数据,对数据进行非规范化并将数据作为csv写入文件系统。 这

文件下载

资源详情

[{"title":"( 64 个子文件 59.59MB ) FEC_DATA_LOADER","children":[{"title":"FEC_DATA_LOADER-master","children":[{"title":".gitattributes <span style='color:#111;'> 378B </span>","children":null,"spread":false},{"title":"build2.py <span style='color:#111;'> 7.77KB </span>","children":null,"spread":false},{"title":"__init__.py <span style='color:#111;'> 0B </span>","children":null,"spread":false},{"title":"README.md <span style='color:#111;'> 2.15KB </span>","children":null,"spread":false},{"title":"index_to_es.py <span style='color:#111;'> 4.64KB </span>","children":null,"spread":false},{"title":"DataMap.py <span style='color:#111;'> 9.84KB </span>","children":null,"spread":false},{"title":"tests","children":[{"title":"builder_unittests.py <span style='color:#111;'> 18.54KB </span>","children":null,"spread":false},{"title":"builder_unittests2.py <span style='color:#111;'> 13.99KB </span>","children":null,"spread":false},{"title":"test_data","children":[{"title":"ccl16.zip <span style='color:#111;'> 45.05KB </span>","children":null,"spread":false},{"title":"cm16.zip <span style='color:#111;'> 1.38KB </span>","children":null,"spread":false},{"title":"ccl.txt <span style='color:#111;'> 902B </span>","children":null,"spread":false},{"title":"cm_header_file.csv <span style='color:#111;'> 157B </span>","children":null,"spread":false},{"title":"pas216.zip <span style='color:#111;'> 13.90KB </span>","children":null,"spread":false},{"title":"pas2_header_file.csv <span style='color:#111;'> 211B </span>","children":null,"spread":false},{"title":"cn.txt <span style='color:#111;'> 693B </span>","children":null,"spread":false},{"title":"oth_header_file.csv <span style='color:#111;'> 203B </span>","children":null,"spread":false},{"title":"itoth.txt <span style='color:#111;'> 12.91MB </span>","children":null,"spread":false},{"title":"itcont.txt <span style='color:#111;'> 99.55KB </span>","children":null,"spread":false},{"title":"cn_header_file.csv <span style='color:#111;'> 179B </span>","children":null,"spread":false},{"title":"cm.txt <span style='color:#111;'> 652B </span>","children":null,"spread":false},{"title":"cn16.zip <span style='color:#111;'> 548B </span>","children":null,"spread":false},{"title":"oth16.zip <span style='color:#111;'> 2.84MB </span>","children":null,"spread":false},{"title":"indiv_header_file.csv <span style='color:#111;'> 203B </span>","children":null,"spread":false},{"title":"indiv16.zip <span style='color:#111;'> 25.39KB </span>","children":null,"spread":false},{"title":"itpas2.txt <span style='color:#111;'> 90.52KB </span>","children":null,"spread":false}],"spread":false},{"title":"data","children":[{"title":"ccl16.zip <span style='color:#111;'> 45.05KB </span>","children":null,"spread":false},{"title":"cm16.zip <span style='color:#111;'> 1.55KB </span>","children":null,"spread":false},{"title":"ccl.txt <span style='color:#111;'> 176.33KB </span>","children":null,"spread":false},{"title":"cm_header_file.csv <span style='color:#111;'> 157B </span>","children":null,"spread":false},{"title":"pas216.zip <span style='color:#111;'> 13.90KB </span>","children":null,"spread":false},{"title":"pas2_header_file.csv <span style='color:#111;'> 211B </span>","children":null,"spread":false},{"title":"oth_header_file.csv <span style='color:#111;'> 203B </span>","children":null,"spread":false},{"title":"ccl_header_file.csv <span style='color:#111;'> 78B </span>","children":null,"spread":false},{"title":"itcont.txt <span style='color:#111;'> 99.55KB </span>","children":null,"spread":false},{"title":"cn_header_file.csv <span style='color:#111;'> 179B </span>","children":null,"spread":false},{"title":"cm.txt <span style='color:#111;'> 3.50KB </span>","children":null,"spread":false},{"title":"cn16.zip <span style='color:#111;'> 548B </span>","children":null,"spread":false},{"title":"oth16.zip <span style='color:#111;'> 2.84MB </span>","children":null,"spread":false},{"title":"indiv_header_file.csv <span style='color:#111;'> 203B </span>","children":null,"spread":false},{"title":"indiv16.zip <span style='color:#111;'> 25.39KB </span>","children":null,"spread":false}],"spread":false},{"title":"temp","children":[{"title":"oppexp16.zip <span style='color:#111;'> 5.38MB </span>","children":null,"spread":false},{"title":"oppexp_header_file.csv <span style='color:#111;'> 246B </span>","children":null,"spread":false},{"title":"ccl16.zip <span style='color:#111;'> 45.05KB </span>","children":null,"spread":false},{"title":"cm16.zip <span style='color:#111;'> 527.75KB </span>","children":null,"spread":false},{"title":"ccl.txt <span style='color:#111;'> 176.33KB </span>","children":null,"spread":false},{"title":"cm_header_file.csv <span style='color:#111;'> 157B </span>","children":null,"spread":false},{"title":"pas216.zip <span style='color:#111;'> 1.75MB </span>","children":null,"spread":false},{"title":"oppexp.txt <span style='color:#111;'> 34.53MB </span>","children":null,"spread":false},{"title":"pas2_header_file.csv <span style='color:#111;'> 211B </span>","children":null,"spread":false},{"title":"cn.txt <span style='color:#111;'> 396.14KB </span>","children":null,"spread":false},{"title":"oth_header_file.csv <span style='color:#111;'> 203B </span>","children":null,"spread":false},{"title":"ccl_header_file.csv <span style='color:#111;'> 78B </span>","children":null,"spread":false},{"title":"itoth.txt <span style='color:#111;'> 12.91MB </span>","children":null,"spread":false},{"title":"itcont.txt <span style='color:#111;'> 66.38MB </span>","children":null,"spread":false},{"title":"cn_header_file.csv <span style='color:#111;'> 179B </span>","children":null,"spread":false},{"title":"cm.txt <span style='color:#111;'> 1.46MB </span>","children":null,"spread":false},{"title":"cn16.zip <span style='color:#111;'> 154.80KB </span>","children":null,"spread":false},{"title":"oth16.zip <span style='color:#111;'> 2.84MB </span>","children":null,"spread":false},{"title":"indiv_header_file.csv <span style='color:#111;'> 203B </span>","children":null,"spread":false},{"title":"indiv16.zip <span style='color:#111;'> 14.68MB </span>","children":null,"spread":false},{"title":"itpas2.txt <span style='color:#111;'> 7.96MB </span>","children":null,"spread":false}],"spread":false}],"spread":true},{"title":"misc","children":[{"title":"employers_of_top_10_contributors_to_candidates_raw.csv <span style='color:#111;'> 2.92KB </span>","children":null,"spread":false},{"title":"employers_of_top_10_contributors_to_candidates.png <span style='color:#111;'> 43.56KB </span>","children":null,"spread":false}],"spread":true},{"title":".gitignore <span style='color:#111;'> 2.61KB </span>","children":null,"spread":false}],"spread":true}],"spread":true}]

评论信息

免责申明

【只为小站】的资源来自网友分享,仅供学习研究,请务必在下载后24小时内给予删除,不得用于其他任何用途,否则后果自负。基于互联网的特殊性,【只为小站】 无法对用户传输的作品、信息、内容的权属或合法性、合规性、真实性、科学性、完整权、有效性等进行实质审查;无论 【只为小站】 经营者是否已进行审查,用户均应自行承担因其传输的作品、信息、内容而可能或已经产生的侵权或权属纠纷等法律责任。
本站所有资源不代表本站的观点或立场,基于网友分享,根据中国法律《信息网络传播权保护条例》第二十二条之规定,若资源存在侵权或相关问题请联系本站客服人员,zhiweidada#qq.com,请把#换成@,本站将给予最大的支持与配合,做到及时反馈和处理。关于更多版权及免责申明参见 版权及免责申明