基于Spark的高校数据分析系统
介绍
基于Spark的高校数据分析系统 。同时实现了Spark-core（被注释了）;Spark-ML,Spark-streaming。
spark-streaming虽然过时很久了，但是对于我学习来说还是够了。 streaming存在很多的弊端，但是主要思想还是处理流式RDD。
新手gitter，不知道怎么处理项目文件的。这是文件夹的下面的说明，
spark_student：IDEA项目文件。
makeDataByPython : 模拟服务器制造log日志的python代码。
other : 代码设计过程中的思路和想法。
PPT：项目展示的PPT。
reference_code ：参考代码。
reference_data：参考数据。
running_sh：软件运行脚本。
spark_JAR：web_spark.jar。
README.assets：是README.md 的引用文件。
软件架构
运行环境：centos 6.x、java、kafka、zookeeper、Flume、Hbase、HDFS、YARN、Spark、MySQl。
文件下载
资源详情
[{"title":"（ 155 个子文件 173.02MB ） 基于Spark的高校数据分析系统","children":[{"title":"anzxstart <span style='color:#111;'> 1.79KB </span>","children":null,"spread":false},{"title":"anzxstart(1) <span style='color:#111;'> 1.79KB </span>","children":null,"spread":false},{"title":"predictscore$.class <span style='color:#111;'> 11.60KB </span>","children":null,"spread":false},{"title":"linnear_regression_online$.class <span style='color:#111;'> 8.00KB </span>","children":null,"spread":false},{"title":"predictscore$$anonfun$1.class <span style='color:#111;'> 6.83KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$.class <span style='color:#111;'> 6.81KB </span>","children":null,"spread":false},{"title":"myUtils$.class <span style='color:#111;'> 6.76KB </span>","children":null,"spread":false},{"title":"predictscore$$anonfun$4.class <span style='color:#111;'> 6.43KB </span>","children":null,"spread":false},{"title":"pearsonscore$$anonfun$1.class <span style='color:#111;'> 6.00KB </span>","children":null,"spread":false},{"title":"HBaseUtils.class <span style='color:#111;'> 5.48KB </span>","children":null,"spread":false},{"title":"studentBean.class <span style='color:#111;'> 4.97KB </span>","children":null,"spread":false},{"title":"pearsonscore$.class <span style='color:#111;'> 4.56KB </span>","children":null,"spread":false},{"title":"pearsonBean.class <span style='color:#111;'> 4.55KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$4$$anonfun$apply$1.class <span style='color:#111;'> 4.50KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$8$$anonfun$apply$2.class <span style='color:#111;'> 4.27KB </span>","children":null,"spread":false},{"title":"predictscore.class <span style='color:#111;'> 4.16KB </span>","children":null,"spread":false},{"title":"predictscore$$typecreator1$1.class <span style='color:#111;'> 3.55KB </span>","children":null,"spread":false},{"title":"predictscore$$typecreator2$1.class <span style='color:#111;'> 3.55KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$12$$anonfun$apply$3.class <span style='color:#111;'> 3.52KB </span>","children":null,"spread":false},{"title":"scalaTestMain$.class <span style='color:#111;'> 3.51KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$16$$anonfun$apply$4.class <span style='color:#111;'> 3.27KB </span>","children":null,"spread":false},{"title":"featurestudentDao.class <span style='color:#111;'> 3.22KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$24$$anonfun$apply$6.class <span style='color:#111;'> 3.07KB </span>","children":null,"spread":false},{"title":"linnear_regression_online$$typecreator1$1.class <span style='color:#111;'> 3.06KB </span>","children":null,"spread":false},{"title":"linnear_regression_online$$typecreator2$1.class <span style='color:#111;'> 3.06KB </span>","children":null,"spread":false},{"title":"myUtils.class <span style='color:#111;'> 2.76KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$20$$anonfun$apply$5.class <span style='color:#111;'> 2.75KB </span>","children":null,"spread":false},{"title":"studentDao.class <span style='color:#111;'> 2.68KB </span>","children":null,"spread":false},{"title":"pearsonscoreDao.class <span style='color:#111;'> 2.67KB </span>","children":null,"spread":false},{"title":"predictscore$$anonfun$5.class <span style='color:#111;'> 2.49KB </span>","children":null,"spread":false},{"title":"predictscore$$anonfun$3.class <span style='color:#111;'> 2.48KB </span>","children":null,"spread":false},{"title":"sbsmain$.class <span style='color:#111;'> 2.45KB </span>","children":null,"spread":false},{"title":"linnear_regression_online$$anonfun$1.class <span style='color:#111;'> 2.30KB </span>","children":null,"spread":false},{"title":"linnear_regression_online$$anonfun$2.class <span style='color:#111;'> 2.29KB </span>","children":null,"spread":false},{"title":"scalaTestMain$$anonfun$main$3.class <span style='color:#111;'> 1.73KB </span>","children":null,"spread":false},{"title":"scalaTestMain$$anonfun$main$2.class <span style='color:#111;'> 1.73KB </span>","children":null,"spread":false},{"title":"scalaTestMain$$anonfun$main$5.class <span style='color:#111;'> 1.72KB </span>","children":null,"spread":false},{"title":"scalaTestMain$$anonfun$main$4.class <span style='color:#111;'> 1.72KB </span>","children":null,"spread":false},{"title":"scalaTestMain$$anonfun$main$1.class <span style='color:#111;'> 1.72KB </span>","children":null,"spread":false},{"title":"scalaTestMain$$anonfun$main$8.class <span style='color:#111;'> 1.72KB </span>","children":null,"spread":false},{"title":"scalaTestMain$$anonfun$main$9.class <span style='color:#111;'> 1.72KB </span>","children":null,"spread":false},{"title":"scalaTestMain$$anonfun$main$11.class <span style='color:#111;'> 1.72KB </span>","children":null,"spread":false},{"title":"scalaTestMain$$anonfun$main$12.class <span style='color:#111;'> 1.72KB </span>","children":null,"spread":false},{"title":"scalaTestMain$$anonfun$main$10.class <span style='color:#111;'> 1.71KB </span>","children":null,"spread":false},{"title":"scalaTestMain$$anonfun$main$6.class <span style='color:#111;'> 1.71KB </span>","children":null,"spread":false},{"title":"scalaTestMain$$anonfun$main$7.class <span style='color:#111;'> 1.71KB </span>","children":null,"spread":false},{"title":"BaseDao.class <span style='color:#111;'> 1.64KB </span>","children":null,"spread":false},{"title":"predictscore$$anonfun$6.class <span style='color:#111;'> 1.63KB </span>","children":null,"spread":false},{"title":"pearsonscore.class <span style='color:#111;'> 1.61KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$8.class <span style='color:#111;'> 1.58KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$3.class <span style='color:#111;'> 1.56KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$7.class <span style='color:#111;'> 1.55KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$4.class <span style='color:#111;'> 1.54KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$16.class <span style='color:#111;'> 1.47KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$12.class <span style='color:#111;'> 1.47KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$24.class <span style='color:#111;'> 1.47KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$20.class <span style='color:#111;'> 1.44KB </span>","children":null,"spread":false},{"title":"mlConsoleMain$.class <span style='color:#111;'> 1.38KB </span>","children":null,"spread":false},{"title":"predictscore$$anonfun$4$$anonfun$apply$2.class <span style='color:#111;'> 1.35KB </span>","children":null,"spread":false},{"title":"pearsonscore$$anonfun$1$$anonfun$apply$1.class <span style='color:#111;'> 1.35KB </span>","children":null,"spread":false},{"title":"predictscore$$anonfun$1$$anonfun$apply$1.class <span style='color:#111;'> 1.35KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$1.class <span style='color:#111;'> 1.35KB </span>","children":null,"spread":false},{"title":"myUtils$$anonfun$avg_Med$1.class <span style='color:#111;'> 1.27KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$15.class <span style='color:#111;'> 1.26KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$11.class <span style='color:#111;'> 1.26KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$23.class <span style='color:#111;'> 1.26KB </span>","children":null,"spread":false},{"title":"linnear_regression_online$$anonfun$main$1.class <span style='color:#111;'> 1.25KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$19.class <span style='color:#111;'> 1.20KB </span>","children":null,"spread":false},{"title":"scalaTestMain.class <span style='color:#111;'> 1.19KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$14.class <span style='color:#111;'> 1.11KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$22.class <span style='color:#111;'> 1.11KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$18.class <span style='color:#111;'> 1.11KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$10.class <span style='color:#111;'> 1.11KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$2.class <span style='color:#111;'> 1.11KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$6.class <span style='color:#111;'> 1.11KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$17.class <span style='color:#111;'> 1.05KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$21.class <span style='color:#111;'> 1.05KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$13.class <span style='color:#111;'> 1.05KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$1.class <span style='color:#111;'> 1.05KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$9.class <span style='color:#111;'> 1.05KB </span>","children":null,"spread":false},{"title":"sparkStreamingMain$$anonfun$main$5.class <span style='color:#111;'> 1.05KB </span>","children":null,"spread":false},{"title":"predictscore$$anonfun$2.class <span style='color:#111;'> 1.04KB </span>","children":null,"spread":false},{"title":"linnear_regression_online.class <span style='color:#111;'> 692B </span>","children":null,"spread":false},{"title":"sparkStreamingMain.class <span style='color:#111;'> 641B </span>","children":null,"spread":false},{"title":"mlConsoleMain.class <span style='color:#111;'> 610B </span>","children":null,"spread":false},{"title":"sbsmain.class <span style='color:#111;'> 579B </span>","children":null,"spread":false},{"title":"main.class <span style='color:#111;'> 413B </span>","children":null,"spread":false},{"title":"javamain.class <span style='color:#111;'> 377B </span>","children":null,"spread":false},{"title":"joblog1.conf <span style='color:#111;'> 545B </span>","children":null,"spread":false},{"title":"consumeData.csv <span style='color:#111;'> 28.43KB </span>","children":null,"spread":false},{"title":"consumeData(1).csv <span style='color:#111;'> 28.43KB </span>","children":null,"spread":false},{"title":"ccc.csv <span style='color:#111;'> 24.98KB </span>","children":null,"spread":false},{"title":"ccc(1).csv <span style='color:#111;'> 24.98KB </span>","children":null,"spread":false},{"title":"netData.csv <span style='color:#111;'> 14.67KB </span>","children":null,"spread":false},{"title":"spark_student.iml <span style='color:#111;'> 80B </span>","children":null,"spread":false},{"title":"spark_student.iml <span style='color:#111;'> 80B </span>","children":null,"spread":false},{"title":"web-spark.jar <span style='color:#111;'> 70.41MB </span>","children":null,"spread":false},{"title":"studentBean.java <span style='color:#111;'> 5.08KB </span>","children":null,"spread":false},{"title":"HBaseUtils.java <span style='color:#111;'> 5.08KB </span>","children":null,"spread":false},{"title":"pearsonBean.java <span style='color:#111;'> 4.66KB </span>","children":null,"spread":false},{"title":"......","children":null,"spread":false},{"title":"<span style='color:steelblue;'>文件过多，未全部展示</span>","children":null,"spread":false}],"spread":true}]
评论信息
其他资源
- 作用于Unity开发LUA编写代码提示
- ACIS CAD开发类库完整版
- Tsai两步法摄像机标定的Matlab实现
- 费诺编码（fano）matlab程序
- 高级定时器TIM1 四个通道输出不同频率及占空比的PWM波.rarSTM32
- 基于QT5编写的安防视频监控，实现了多画面功能
- 基于Labview的视频播放器
- IBM SPSS Statistics 20.0官方中文手册
- Finite Fields
- 移动代理服务器MAS短信API2.2开发手册及DEMO
- GDAL-API中文开发手册.pdf
- curveshadding matlab中画阴影区域
- 基于RBS的无线传感器网络时间同步算法.pdf
- 课设：中型载货汽车驱动桥设计 catiav5r19
- eclipse-inst-jre-linux64.tar.gz
- dll文件反编译.rar
- 可拓关联函数
- C#SharpAvi桌面录屏源码
- Visual.Basic.2008编程参考手册_源代码
- Ajax 与CGI
- asp校园二手网源码
- G50-80黑苹果EFI驱动
免责申明
【只为小站】的资源来自网友分享，仅供学习研究，请务必在下载后24小时内给予删除，不得用于其他任何用途，否则后果自负。基于互联网的特殊性，【只为小站】 无法对用户传输的作品、信息、内容的权属或合法性、合规性、真实性、科学性、完整权、有效性等进行实质审查；无论 【只为小站】 经营者是否已进行审查，用户均应自行承担因其传输的作品、信息、内容而可能或已经产生的侵权或权属纠纷等法律责任。
本站所有资源不代表本站的观点或立场，基于网友分享，根据中国法律《信息网络传播权保护条例》第二十二条之规定，若资源存在侵权或相关问题请联系本站客服人员，zhiweidada#qq.com，请把#换成@，本站将给予最大的支持与配合，做到及时反馈和处理。关于更多版权及免责申明参见 版权及免责申明
本站所有资源不代表本站的观点或立场，基于网友分享，根据中国法律《信息网络传播权保护条例》第二十二条之规定，若资源存在侵权或相关问题请联系本站客服人员，zhiweidada#qq.com，请把#换成@，本站将给予最大的支持与配合，做到及时反馈和处理。关于更多版权及免责申明参见 版权及免责申明