Spark大数据中文分词统计Scala语言工程源码

上传者: yangdanbo1975 | 上传时间: 2020-01-03 11:43:20 | 文件大小: 395KB | 文件类型: 7z
参考网络资源使用IKAnalyzer分词组件,实现了在Spark框架下使用Scala语言对唐诗宋词等国学经典进行中文分词统计排序的功能,你可以轻松发现唐诗宋词中最常用的词是那几个。

文件下载

资源详情

[{"title":"( 56 个子文件 395KB ) Spark大数据中文分词统计Scala语言工程源码","children":[{"title":"ScalaWordCount","children":[{"title":"bin","children":[{"title":"com","children":[{"title":"magicstudio","children":[{"title":"spark","children":[{"title":"WordCounter.class <span style='color:#111;'> 2.51KB </span>","children":null,"spread":false},{"title":"WordCounter$$anon$2$$anon$9.class <span style='color:#111;'> 729B </span>","children":null,"spread":false},{"title":"text","children":[{"title":"宋词三百首.txt <span style='color:#111;'> 111.45KB </span>","children":null,"spread":false},{"title":"孟子.txt <span style='color:#111;'> 130.63KB </span>","children":null,"spread":false},{"title":"老子道德经.txt <span style='color:#111;'> 21.59KB </span>","children":null,"spread":false},{"title":"庄子南华经.txt <span style='color:#111;'> 240.08KB </span>","children":null,"spread":false},{"title":"唐诗三百首.txt <span style='color:#111;'> 84.94KB </span>","children":null,"spread":false},{"title":"论语.txt <span style='color:#111;'> 74.01KB </span>","children":null,"spread":false}],"spread":true},{"title":"GuiUtils$.class <span style='color:#111;'> 1.31KB </span>","children":null,"spread":false},{"title":"WordCounter$.class <span style='color:#111;'> 1.78KB </span>","children":null,"spread":false},{"title":"WordCounter$$anon$2$$anon$6.class <span style='color:#111;'> 718B </span>","children":null,"spread":false},{"title":"WordCounter$$anon$2$$anon$3.class <span style='color:#111;'> 736B </span>","children":null,"spread":false},{"title":"SparkWordCount$$anonfun$1.class <span style='color:#111;'> 1.25KB </span>","children":null,"spread":false},{"title":"stopword.dic <span style='color:#111;'> 161B </span>","children":null,"spread":false},{"title":"SparkWordCount.class <span style='color:#111;'> 4.63KB </span>","children":null,"spread":false},{"title":"WordCounter$$anon$2$$anon$7.class <span style='color:#111;'> 727B </span>","children":null,"spread":false},{"title":"SparkWordCount$$anonfun$outputResult$1.class <span style='color:#111;'> 1.79KB </span>","children":null,"spread":false},{"title":"WordCounter$$anon$2$$anon$10.class <span style='color:#111;'> 721B </span>","children":null,"spread":false},{"title":"WordCounter$$anon$2$$anon$4.class <span style='color:#111;'> 3.17KB </span>","children":null,"spread":false},{"title":"WordCounter$$anon$2$$anon$8.class <span style='color:#111;'> 701B </span>","children":null,"spread":false},{"title":"WordCounter$$anon$2$$anon$4$$anon$12.class <span style='color:#111;'> 801B </span>","children":null,"spread":false},{"title":"WordCounter$$anon$2$$anon$4$$anon$11.class <span style='color:#111;'> 801B </span>","children":null,"spread":false},{"title":"WordCounter$$anon$2$$anon$1.class <span style='color:#111;'> 1.26KB </span>","children":null,"spread":false},{"title":"WordCounter$$anon$2$$anon$4$$anon$13.class <span style='color:#111;'> 799B </span>","children":null,"spread":false},{"title":"GuiUtils.class <span style='color:#111;'> 1.27KB </span>","children":null,"spread":false},{"title":"WordCounter$$anon$2.class <span style='color:#111;'> 9.35KB </span>","children":null,"spread":false},{"title":"SparkWordCount$$anonfun$2.class <span style='color:#111;'> 1.81KB </span>","children":null,"spread":false},{"title":"SparkWordCount$$anonfun$3.class <span style='color:#111;'> 1.40KB </span>","children":null,"spread":false},{"title":"SparkWordCount$.class <span style='color:#111;'> 1.34KB </span>","children":null,"spread":false},{"title":"SparkWordCount$$anonfun$wordCount$1.class <span style='color:#111;'> 1.33KB </span>","children":null,"spread":false},{"title":"WordCounter$$anon$2$$anon$5.class <span style='color:#111;'> 1.17KB </span>","children":null,"spread":false},{"title":"WordCounter$$anon$2$$anonfun$1.class <span style='color:#111;'> 5.67KB </span>","children":null,"spread":false},{"title":"JavaUtil.class <span style='color:#111;'> 5.45KB </span>","children":null,"spread":false},{"title":"IKAnalyzer.cfg.xml <span style='color:#111;'> 414B </span>","children":null,"spread":false}],"spread":false}],"spread":true}],"spread":true},{"title":"screen shoot2.png <span style='color:#111;'> 144.53KB </span>","children":null,"spread":false},{"title":"scala","children":[{"title":"swing","children":[{"title":"TextPane$$anon$1.class <span style='color:#111;'> 2.39KB </span>","children":null,"spread":false},{"title":"TextPane.class <span style='color:#111;'> 1.65KB </span>","children":null,"spread":false}],"spread":true}],"spread":true}],"spread":true},{"title":".settings","children":[{"title":"org.scala-ide.sdt.core.prefs <span style='color:#111;'> 259B </span>","children":null,"spread":false},{"title":"org.eclipse.jdt.core.prefs <span style='color:#111;'> 598B </span>","children":null,"spread":false}],"spread":true},{"title":"src","children":[{"title":"com","children":[{"title":"magicstudio","children":[{"title":"spark","children":[{"title":"WordCounter.scala <span style='color:#111;'> 6.81KB </span>","children":null,"spread":false},{"title":"GuiUtils.scala <span style='color:#111;'> 1.34KB </span>","children":null,"spread":false},{"title":"text","children":[{"title":"宋词三百首.txt <span style='color:#111;'> 111.45KB </span>","children":null,"spread":false},{"title":"孟子.txt <span style='color:#111;'> 130.63KB </span>","children":null,"spread":false},{"title":"老子道德经.txt <span style='color:#111;'> 21.59KB </span>","children":null,"spread":false},{"title":"庄子南华经.txt <span style='color:#111;'> 240.08KB </span>","children":null,"spread":false},{"title":"唐诗三百首.txt <span style='color:#111;'> 84.94KB </span>","children":null,"spread":false},{"title":"论语.txt <span style='color:#111;'> 74.01KB </span>","children":null,"spread":false}],"spread":true},{"title":"JavaUtil.java <span style='color:#111;'> 4.15KB </span>","children":null,"spread":false},{"title":"stopword.dic <span style='color:#111;'> 161B </span>","children":null,"spread":false},{"title":"SparkWordCount.scala <span style='color:#111;'> 4.60KB </span>","children":null,"spread":false},{"title":"TextPane.scala <span style='color:#111;'> 866B </span>","children":null,"spread":false},{"title":"IKAnalyzer.cfg.xml <span style='color:#111;'> 414B </span>","children":null,"spread":false}],"spread":true}],"spread":true}],"spread":true},{"title":"screen shoot2.png <span style='color:#111;'> 144.53KB </span>","children":null,"spread":false}],"spread":true},{"title":".project <span style='color:#111;'> 448B </span>","children":null,"spread":false},{"title":".classpath <span style='color:#111;'> 610B </span>","children":null,"spread":false},{"title":".cache-main <span style='color:#111;'> 43.75KB </span>","children":null,"spread":false}],"spread":true}],"spread":true}]

评论信息

  • daizhiming :
    具有一定参考性。
    2020-05-23
  • 在屋顶听歌 :
    very good ..... thx
    2018-08-27
  • 青龙圣者 :
    感谢分享,不错。
    2018-07-27
  • space1103 :
    资源可以用,谢谢分享
    2018-03-23
  • chen_xyun :
    不错不错,是不错的资源
    2018-01-16
  • hoomi2020 :
    亲测,可用的
    2017-12-26
  • jzpg5 :
    谢谢,学习一下
    2017-07-22
  • fnzibio1 :
    这个还不错,学习学习
    2017-07-21
  • michael168168168 :
    这个很不错,比较完整,很有学习价值
    2017-04-19
  • 陈凯 :
    很赞,感谢无私分享,正好可以学习一下
    2017-02-04
  • 小小de可爱 :
    很赞,感谢无私分享,正好可以学习一下
    2016-10-21

免责申明

【只为小站】的资源来自网友分享,仅供学习研究,请务必在下载后24小时内给予删除,不得用于其他任何用途,否则后果自负。基于互联网的特殊性,【只为小站】 无法对用户传输的作品、信息、内容的权属或合法性、合规性、真实性、科学性、完整权、有效性等进行实质审查;无论 【只为小站】 经营者是否已进行审查,用户均应自行承担因其传输的作品、信息、内容而可能或已经产生的侵权或权属纠纷等法律责任。
本站所有资源不代表本站的观点或立场,基于网友分享,根据中国法律《信息网络传播权保护条例》第二十二条之规定,若资源存在侵权或相关问题请联系本站客服人员,zhiweidada#qq.com,请把#换成@,本站将给予最大的支持与配合,做到及时反馈和处理。关于更多版权及免责申明参见 版权及免责申明