mara-example-project-2:微型项目数据仓库示例,用于python项目统计数据,新项目模板-源码

上传者: 42141437 | 上传时间: 2021-01-30 23:04:36 | 文件大小: 17.65MB | 文件类型: ZIP
玛拉示例项目 一个可运行的应用程序,演示了如何使用mara构建数据仓库。 将库和库与框架结合到一个项目中。 示例ETL将PyPi下载统计信息和GitHub回购活动度量标准集成到了更通用的Python项目活动统计信息中。 该存储库旨在用作新项目的模板。 示例:Python项目统计 该项目使用两个数据源: 在 (需要Google登录)上BigQuery数据集。 它包含每个单独的软件包下载以及项目和客户端属性。 BigQuery资料集位于 。 它几乎包含所有发生在Github存储库中的事件。 从两个数据源中,使用的查询以增量方式下载一组预先聚合和过滤的CSV: $ gunzip --decompress --stdout data/2018/04/10/pypi/downloads-v1.csv.gz | grep " \tflask\t\|day_id " | head -n 11 day_id project project_version python_version installer number_of_downloads 20180410 flask 0.1 ban

文件下载

资源详情

[{"title":"( 61 个子文件 17.65MB ) mara-example-project-2:微型项目数据仓库示例,用于python项目统计数据,新项目模板-源码","children":[{"title":"mara-example-project-2-master","children":[{"title":"requirements.txt.freeze <span style='color:#111;'> 1.66KB </span>","children":null,"spread":false},{"title":"requirements.txt <span style='color:#111;'> 774B </span>","children":null,"spread":false},{"title":"LICENSE <span style='color:#111;'> 1.04KB </span>","children":null,"spread":false},{"title":"README.md <span style='color:#111;'> 9.38KB </span>","children":null,"spread":false},{"title":"Makefile <span style='color:#111;'> 337B </span>","children":null,"spread":false},{"title":"docs","children":[{"title":"mara-web-ui-etl-run.gif <span style='color:#111;'> 16.53MB </span>","children":null,"spread":false},{"title":"postgresql.conf <span style='color:#111;'> 2.64KB </span>","children":null,"spread":false},{"title":"star-schema.png <span style='color:#111;'> 193.36KB </span>","children":null,"spread":false},{"title":"mara-cli-etl-run.gif <span style='color:#111;'> 1.29MB </span>","children":null,"spread":false},{"title":"mara-web-ui-task.png <span style='color:#111;'> 306.53KB </span>","children":null,"spread":false},{"title":"mara-web-ui-pipeline.png <span style='color:#111;'> 766.58KB </span>","children":null,"spread":false}],"spread":true},{"title":".scripts","children":[{"title":"mara-app","children":[{"title":"ensure-pushed.sh <span style='color:#111;'> 548B </span>","children":null,"spread":false},{"title":"install.mk <span style='color:#111;'> 4.30KB </span>","children":null,"spread":false},{"title":"makeshell <span style='color:#111;'> 2.07KB </span>","children":null,"spread":false},{"title":"README.MD <span style='color:#111;'> 235B </span>","children":null,"spread":false},{"title":"check-newer.sh <span style='color:#111;'> 468B </span>","children":null,"spread":false},{"title":"init.mk <span style='color:#111;'> 354B </span>","children":null,"spread":false}],"spread":true}],"spread":true},{"title":".gitignore <span style='color:#111;'> 148B </span>","children":null,"spread":false},{"title":"app","children":[{"title":"config.py <span style='color:#111;'> 314B </span>","children":null,"spread":false},{"title":"ui","children":[{"title":"__init__.py <span style='color:#111;'> 2.70KB </span>","children":null,"spread":false},{"title":"start_page.py <span style='color:#111;'> 258B </span>","children":null,"spread":false},{"title":"static","children":[{"title":"styles.css <span style='color:#111;'> 105B </span>","children":null,"spread":false},{"title":"favicon.ico <span style='color:#111;'> 10.78KB </span>","children":null,"spread":false},{"title":"logo.png <span style='color:#111;'> 22.15KB </span>","children":null,"spread":false}],"spread":false}],"spread":true},{"title":"pipelines","children":[{"title":"utils","children":[{"title":"__init__.py <span style='color:#111;'> 414B </span>","children":null,"spread":false}],"spread":true},{"title":"pypi","children":[{"title":"transform_project_version.sql <span style='color:#111;'> 679B </span>","children":null,"spread":false},{"title":"recreate_schemas.sql <span style='color:#111;'> 140B </span>","children":null,"spread":false},{"title":"constrain_tables.sql <span style='color:#111;'> 90B </span>","children":null,"spread":false},{"title":"transform_download_counts.sql <span style='color:#111;'> 2.25KB </span>","children":null,"spread":false},{"title":"create_data_schema.sql <span style='color:#111;'> 120B </span>","children":null,"spread":false},{"title":"transform_python_version.sql <span style='color:#111;'> 400B </span>","children":null,"spread":false},{"title":"__init__.py <span style='color:#111;'> 5.35KB </span>","children":null,"spread":false},{"title":"create_download_counts_data_set.sql <span style='color:#111;'> 1.71KB </span>","children":null,"spread":false},{"title":"create_download_counts_data_table.sql <span style='color:#111;'> 346B </span>","children":null,"spread":false},{"title":"transform_project.sql <span style='color:#111;'> 324B </span>","children":null,"spread":false},{"title":"preprocess_project_version_1.sql <span style='color:#111;'> 894B </span>","children":null,"spread":false},{"title":"transform_installer.sql <span style='color:#111;'> 350B </span>","children":null,"spread":false},{"title":"preprocess_project_version_2.sql <span style='color:#111;'> 812B </span>","children":null,"spread":false}],"spread":false},{"title":"__init__.py <span style='color:#111;'> 1.42KB </span>","children":null,"spread":false},{"title":"python_projects","children":[{"title":"recreate_schemas.sql <span style='color:#111;'> 181B </span>","children":null,"spread":false},{"title":"constrain_tables.sql <span style='color:#111;'> 50B </span>","children":null,"spread":false},{"title":"extract_python_repo_activity.sql <span style='color:#111;'> 851B </span>","children":null,"spread":false},{"title":"__init__.py <span style='color:#111;'> 2.88KB </span>","children":null,"spread":false},{"title":"transform_python_project_activity.sql <span style='color:#111;'> 2.39KB </span>","children":null,"spread":false},{"title":"create_python_project_activity_data_set.sql <span style='color:#111;'> 1.69KB </span>","children":null,"spread":false}],"spread":false},{"title":"github","children":[{"title":"recreate_schemas.sql <span style='color:#111;'> 133B </span>","children":null,"spread":false},{"title":"create_repo_activity_data_table.sql <span style='color:#111;'> 386B </span>","children":null,"spread":false},{"title":"constrain_tables.sql <span style='color:#111;'> 40B </span>","children":null,"spread":false},{"title":"transform_repo_activity.sql <span style='color:#111;'> 1.73KB </span>","children":null,"spread":false},{"title":"create_data_schema.sql <span style='color:#111;'> 114B </span>","children":null,"spread":false},{"title":"transform_repo.sql <span style='color:#111;'> 379B </span>","children":null,"spread":false},{"title":"__init__.py <span style='color:#111;'> 4.45KB </span>","children":null,"spread":false},{"title":"create_repo_activity_data_set.sql <span style='color:#111;'> 1.57KB </span>","children":null,"spread":false},{"title":"preprocess_repo_activity.sql <span style='color:#111;'> 1.60KB </span>","children":null,"spread":false}],"spread":false}],"spread":true},{"title":"app.py <span style='color:#111;'> 207B </span>","children":null,"spread":false},{"title":"__init__.py <span style='color:#111;'> 594B </span>","children":null,"spread":false},{"title":"data_sets.py <span style='color:#111;'> 1.52KB </span>","children":null,"spread":false},{"title":"bigquery_downloader","children":[{"title":"github-repo-activity.sql <span style='color:#111;'> 1.29KB </span>","children":null,"spread":false},{"title":"__init__.py <span style='color:#111;'> 1.09KB </span>","children":null,"spread":false},{"title":"pypi-downloads.sql <span style='color:#111;'> 469B </span>","children":null,"spread":false}],"spread":false},{"title":"local_setup.py.example <span style='color:#111;'> 1.37KB </span>","children":null,"spread":false}],"spread":true}],"spread":true}],"spread":true}]

评论信息

免责申明

【只为小站】的资源来自网友分享,仅供学习研究,请务必在下载后24小时内给予删除,不得用于其他任何用途,否则后果自负。基于互联网的特殊性,【只为小站】 无法对用户传输的作品、信息、内容的权属或合法性、合规性、真实性、科学性、完整权、有效性等进行实质审查;无论 【只为小站】 经营者是否已进行审查,用户均应自行承担因其传输的作品、信息、内容而可能或已经产生的侵权或权属纠纷等法律责任。
本站所有资源不代表本站的观点或立场,基于网友分享,根据中国法律《信息网络传播权保护条例》第二十二条之规定,若资源存在侵权或相关问题请联系本站客服人员,zhiweidada#qq.com,请把#换成@,本站将给予最大的支持与配合,做到及时反馈和处理。关于更多版权及免责申明参见 版权及免责申明