demo_11.11_storm-spark-hadoop:hadoop_storm_spark结合实验的例子,模拟淘宝双11节,根据订单详细信息,汇总出总销售量,各个省份销售排行,以及后期SQL分析,数据分析,数据挖掘等。 --------大概流程------- 第一阶段(storm实时报表) 第二阶段(离线报表)第三阶段(大规模订单即席查询,和多维度查询) 第四阶段(数据挖掘和图计算)-源码

上传者: 42117116 | 上传时间: 2021-06-22 15:04:33 | 文件大小: 26KB | 文件类型: ZIP
-_11.11_storm-spark-hadoop hadoop_storm_spark结合实验的例子,模拟淘宝双11节,根据订单详细信息,汇总出总销售量,各个省份销售排行,以及后期SQL分析,数据分析,数据挖掘等。 --------大概流程------- 第一阶段(storm实时报表) (1)用户订单入kafka队列, (2)经过storm,实时计算出总销售量,和各个省份的的销售量, (3)将计算结果保存到hbase数据库中。 第二阶段(离线报表) (1)用户订单入oracle数据库, (2)通过sqoop把数据导入hadoop上。 (3)使用mr和rdd对hadoop上的原始订单做etl清洗 (4)建立hive表和sparkSQL内存表。为后期分析做基础 (5)使用HQL实现业务指标分析,和用户画像分析,将结果存在mysql中。供web前台使用 第三阶段(大规模订单即席查询,和多维度

文件下载

资源详情

[{"title":"( 35 个子文件 26KB ) demo_11.11_storm-spark-hadoop:hadoop_storm_spark结合实验的例子,模拟淘宝双11节,根据订单详细信息,汇总出总销售量,各个省份销售排行,以及后期SQL分析,数据分析,数据挖掘等。 --------大概流程------- 第一阶段(storm实时报表) 第二阶段(离线报表)第三阶段(大规模订单即席查询,和多维度查询) 第四阶段(数据挖掘和图计算)-源码","children":[{"title":"demo_11.11_storm-spark-hadoop-master","children":[{"title":"src","children":[{"title":"liguozhong","children":[{"title":"bigdata","children":[{"title":"streaming","children":[{"title":"spark","children":[{"title":"package-info.java <span style='color:#111;'> 152B </span>","children":null,"spread":false}],"spread":true},{"title":"package-info.java <span style='color:#111;'> 92B </span>","children":null,"spread":false},{"title":"storm","children":[{"title":"base","children":[{"title":"package-info.java <span style='color:#111;'> 152B </span>","children":null,"spread":false}],"spread":true},{"title":"trident","children":[{"title":"package-info.java <span style='color:#111;'> 152B </span>","children":null,"spread":false},{"title":"state","children":[{"title":"hbase","children":[{"title":"HBaseAggState.java <span style='color:#111;'> 3.68KB </span>","children":null,"spread":false},{"title":"HBaseAggFactory.java <span style='color:#111;'> 2.24KB </span>","children":null,"spread":false},{"title":"package-info.java <span style='color:#111;'> 160B </span>","children":null,"spread":false},{"title":"util","children":[{"title":"TridentConfig.java <span style='color:#111;'> 1.95KB </span>","children":null,"spread":false},{"title":"package-info.java <span style='color:#111;'> 165B </span>","children":null,"spread":false},{"title":"TupleTableConfig.java <span style='color:#111;'> 1.63KB </span>","children":null,"spread":false},{"title":"HTableConnector.java <span style='color:#111;'> 1.45KB </span>","children":null,"spread":false}],"spread":false}],"spread":true},{"title":"package-info.java <span style='color:#111;'> 154B </span>","children":null,"spread":false}],"spread":true}],"spread":true},{"title":"package-info.java <span style='color:#111;'> 151B </span>","children":null,"spread":false}],"spread":true}],"spread":true},{"title":"search","children":[{"title":"package-info.java <span style='color:#111;'> 128B </span>","children":null,"spread":false},{"title":"solr","children":[{"title":"package-info.java <span style='color:#111;'> 137B </span>","children":null,"spread":false}],"spread":true},{"title":"lucene","children":[{"title":"package-info.java <span style='color:#111;'> 141B </span>","children":null,"spread":false}],"spread":true}],"spread":true},{"title":"graph","children":[{"title":"spark","children":[{"title":"package-info.java <span style='color:#111;'> 147B </span>","children":null,"spread":false}],"spread":true},{"title":"package-info.java <span style='color:#111;'> 130B </span>","children":null,"spread":false}],"spread":true},{"title":"mq","children":[{"title":"package-info.java <span style='color:#111;'> 130B </span>","children":null,"spread":false},{"title":"kafka","children":[{"title":"OrderProducer.java <span style='color:#111;'> 2.01KB </span>","children":null,"spread":false},{"title":"package-info.java <span style='color:#111;'> 135B </span>","children":null,"spread":false},{"title":"KafkaProperties.java <span style='color:#111;'> 454B </span>","children":null,"spread":false}],"spread":true}],"spread":true},{"title":"ml","children":[{"title":"spark","children":[{"title":"package-info.java <span style='color:#111;'> 141B </span>","children":null,"spread":false}],"spread":true},{"title":"package-info.java <span style='color:#111;'> 130B </span>","children":null,"spread":false},{"title":"mahout","children":[{"title":"package-info.java <span style='color:#111;'> 137B </span>","children":null,"spread":false}],"spread":true}],"spread":true},{"title":"package-info.java <span style='color:#111;'> 204B </span>","children":null,"spread":false},{"title":"common","children":[{"title":"package-info.java <span style='color:#111;'> 151B </span>","children":null,"spread":false}],"spread":true},{"title":"sql","children":[{"title":"spark","children":[{"title":"package-info.java <span style='color:#111;'> 140B </span>","children":null,"spread":false}],"spread":true},{"title":"package-info.java <span style='color:#111;'> 131B </span>","children":null,"spread":false},{"title":"hive","children":[{"title":"package-info.java <span style='color:#111;'> 134B </span>","children":null,"spread":false}],"spread":false}],"spread":true},{"title":"util","children":[{"title":"package-info.java <span style='color:#111;'> 129B </span>","children":null,"spread":false},{"title":"DateUtils.java <span style='color:#111;'> 757B </span>","children":null,"spread":false}],"spread":true},{"title":"nosql","children":[{"title":"hbase","children":[{"title":"package-info.java <span style='color:#111;'> 122B </span>","children":null,"spread":false}],"spread":false},{"title":"package-info.java <span style='color:#111;'> 202B </span>","children":null,"spread":false}],"spread":true}],"spread":true}],"spread":true}],"spread":true},{"title":"README.md <span style='color:#111;'> 1.61KB </span>","children":null,"spread":false}],"spread":true}],"spread":true}]

评论信息

免责申明

【只为小站】的资源来自网友分享,仅供学习研究,请务必在下载后24小时内给予删除,不得用于其他任何用途,否则后果自负。基于互联网的特殊性,【只为小站】 无法对用户传输的作品、信息、内容的权属或合法性、合规性、真实性、科学性、完整权、有效性等进行实质审查;无论 【只为小站】 经营者是否已进行审查,用户均应自行承担因其传输的作品、信息、内容而可能或已经产生的侵权或权属纠纷等法律责任。
本站所有资源不代表本站的观点或立场,基于网友分享,根据中国法律《信息网络传播权保护条例》第二十二条之规定,若资源存在侵权或相关问题请联系本站客服人员,zhiweidada#qq.com,请把#换成@,本站将给予最大的支持与配合,做到及时反馈和处理。关于更多版权及免责申明参见 版权及免责申明