聚类马氏距离代码MATLAB-SDCOR:用于大规模数据集中局部离群值检测的可扩展的基于密度的聚类

上传者: 38524246 | 上传时间: 2022-12-28 11:42:38 | 文件大小: 203.7MB | 文件类型: ZIP
聚类马氏距离代码MATLAB SDCOR 用于大规模数据集中局部离群值检测的可扩展的基于密度的聚类 作者: Sayyed-Ahmad Naghavi-Nozad,Maryam Amir Haeri和Gianluigi Folino 目录 抽象的: 本文提出了一种基于批量密度的聚类方法,用于大规模数据集中的局部离群值检测。 与众所周知的假定所有数据都驻留在内存中的传统算法不同,我们提出的方法具有可伸缩性,并且可以在有限的内存缓冲区范围内逐块处理输入数据。 在第一阶段建立一个临时的聚类模型; 然后,通过分析点的连续内存负载来逐步更新它。 随后,在可伸缩聚类结束时,获得原始聚类的近似结构。 最后,通过对整个数据集的另一次扫描并使用适当的标准,将偏远评分分配给称为SDCOR(基于可伸缩密度的​​聚类离群值比率)的每个对象。 对现实生活和综合数据集的评估表明,与需要将所有数据加载到内存中的最著名的传统基于密度的方法相比,该方法具有较低的线性时间复杂度,并且更加有效。 还有一些基于快速距离的方法,这些方法可以对磁盘中驻留的数据执行操作。 框架: 更详细地,所提出的方法包括三个主要阶段。 在第一阶段

文件下载

资源详情

[{"title":"( 78 个子文件 203.7MB ) 聚类马氏距离代码MATLAB-SDCOR:用于大规模数据集中局部离群值检测的可扩展的基于密度的聚类","children":[{"title":"SDCOR-master","children":[{"title":"Readme.md <span style='color:#111;'> 19.21KB </span>","children":null,"spread":false},{"title":"images","children":[{"title":"SoftArch.jpg <span style='color:#111;'> 188.99KB </span>","children":null,"spread":false},{"title":"SDCOR_RAMversion.png <span style='color:#111;'> 147.35KB </span>","children":null,"spread":false},{"title":"SDCOR_DiskVersion.png <span style='color:#111;'> 121.46KB </span>","children":null,"spread":false}],"spread":true},{"title":"LICENSE <span style='color:#111;'> 1.07KB </span>","children":null,"spread":false},{"title":"videos","children":[{"title":"SDCOR_RAMversion.wmv <span style='color:#111;'> 13.76MB </span>","children":null,"spread":false},{"title":"SDCOR_DiskVersion.wmv <span style='color:#111;'> 9.24MB </span>","children":null,"spread":false}],"spread":true},{"title":"codes","children":[{"title":"SDCOR _ with visualization - read data from RAM","children":[{"title":"SDCOR.m <span style='color:#111;'> 29.34KB </span>","children":null,"spread":false},{"title":"plotOptional.m <span style='color:#111;'> 12.56KB </span>","children":null,"spread":false},{"title":"MAIN.m <span style='color:#111;'> 24.84KB </span>","children":null,"spread":false},{"title":"MAIN.fig <span style='color:#111;'> 4.50MB </span>","children":null,"spread":false}],"spread":true},{"title":"results","children":[{"title":"testData","children":[{"title":"SDCOR(noVisDsk)_result_$testData2_(21867by2_600go)$_ROC=1.000_ROCstd=0.000_PR=0.998_PRstd=0.000_maxRun=1_Time=0.830.mat <span style='color:#111;'> 218.30KB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$testData1_(21467by2_200lo)$_ROC=1.000_ROCstd=0.000_PR=0.995_PRstd=0.000_maxRun=1_Time=0.815.mat <span style='color:#111;'> 216.59KB </span>","children":null,"spread":false}],"spread":true},{"title":"synthData","children":[{"title":"Tolerance to a high number of outliers","children":[{"title":"SDCOR(noVisDsk)_result_$tolrData03_(34000by2_14000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=8.608.mat <span style='color:#111;'> 314.68KB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$tolrData10_(48000by2_28000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=35.066.mat <span style='color:#111;'> 429.33KB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$tolrData09_(46000by2_26000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=29.834.mat <span style='color:#111;'> 415.41KB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$tolrData06_(40000by2_20000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=18.604.mat <span style='color:#111;'> 363.88KB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$tolrData02_(32000by2_12000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=6.355.mat <span style='color:#111;'> 297.87KB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$tolrData04_(36000by2_16000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=11.123.mat <span style='color:#111;'> 330.98KB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$tolrData01_(30000by2_10000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=4.483.mat <span style='color:#111;'> 281.29KB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$tolrData11_(50000by2_30000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=40.334.mat <span style='color:#111;'> 447.99KB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$tolrData07_(42000by2_22000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=21.989.mat <span style='color:#111;'> 380.53KB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$tolrData08_(44000by2_24000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=25.401.mat <span style='color:#111;'> 398.85KB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$tolrData05_(38000by2_18000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=14.291.mat <span style='color:#111;'> 347.56KB </span>","children":null,"spread":false}],"spread":false},{"title":"Scalability test","children":[{"title":"SDCOR(noVisDsk)_result_$scalData06_(120200by10_200o)$_ROC=1.000_ROCstd=0.000_PR=0.995_PRstd=0.000_maxRun=40_Time=1.303.mat <span style='color:#111;'> 987.25KB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$scalData02_(40200by10_200o)$_ROC=1.000_ROCstd=0.000_PR=0.995_PRstd=0.000_maxRun=40_Time=0.885.mat <span style='color:#111;'> 347.53KB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$scalData10_(200200by10_200o)$_ROC=1.000_ROCstd=0.000_PR=0.995_PRstd=0.000_maxRun=40_Time=1.868.mat <span style='color:#111;'> 1.59MB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$scalData07_(140200by10_200o)$_ROC=1.000_ROCstd=0.000_PR=0.995_PRstd=0.000_maxRun=40_Time=1.515.mat <span style='color:#111;'> 1.12MB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$scalData03_(60200by10_200o)$_ROC=1.000_ROCstd=0.000_PR=0.995_PRstd=0.000_maxRun=40_Time=1.002.mat <span style='color:#111;'> 507.02KB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$scalData09_(180200by10_200o)$_ROC=1.000_ROCstd=0.000_PR=0.995_PRstd=0.000_maxRun=40_Time=1.749.mat <span style='color:#111;'> 1.43MB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$scalData04_(80200by10_200o)$_ROC=1.000_ROCstd=0.000_PR=0.995_PRstd=0.000_maxRun=40_Time=1.100.mat <span style='color:#111;'> 666.51KB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$scalData08_(160200by10_200o)$_ROC=1.000_ROCstd=0.000_PR=0.995_PRstd=0.000_maxRun=40_Time=1.634.mat <span style='color:#111;'> 1.27MB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$scalData01_(20200by10_200o)$_ROC=1.000_ROCstd=0.000_PR=0.995_PRstd=0.000_maxRun=40_Time=0.812.mat <span style='color:#111;'> 190.17KB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$scalData05_(100200by10_200o)$_ROC=1.000_ROCstd=0.000_PR=0.995_PRstd=0.000_maxRun=40_Time=1.204.mat <span style='color:#111;'> 828.29KB </span>","children":null,"spread":false}],"spread":true},{"title":"Accuracy and stability analysis","children":[{"title":"SDCOR(noVisDsk)_result_$accrData2_(1000000by40_10000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=41.162.mat <span style='color:#111;'> 7.83MB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$accrData1_(500000by30_5000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=12.863.mat <span style='color:#111;'> 3.93MB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$accrData3_(1500000by50_15000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=89.455.mat <span style='color:#111;'> 11.72MB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$accrData4_(2000000by60_20000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=161.932.mat <span style='color:#111;'> 15.52MB </span>","children":null,"spread":false}],"spread":true}],"spread":true},{"title":"realData","children":[{"title":"SDCOR(noVisDsk)_result_$Mammography_(11183by6_260o)$_ROC=0.820_ROCstd=0.037_PR=0.148_PRstd=0.067_maxRun=40_Time=0.701.mat <span style='color:#111;'> 92.14KB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$Shuttle_(49097by9_3511o)$_ROC=0.969_ROCstd=0.009_PR=0.617_PRstd=0.049_maxRun=40_Time=0.907.mat <span style='color:#111;'> 399.55KB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$Http_(567498by3_2211o)$_ROC=0.999_ROCstd=0.001_PR=0.463_PRstd=0.063_maxRun=40_Time=1.848.mat <span style='color:#111;'> 2.94MB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$CreditCardFraud_(284807by29_492o)$_ROC=0.960_ROCstd=0.001_PR=0.708_PRstd=0.003_maxRun=40_Time=7.811.mat <span style='color:#111;'> 2.08MB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$Smtp_(95156by3_30o)$_ROC=0.779_ROCstd=0.008_PR=0.245_PRstd=0.083_maxRun=40_Time=0.895.mat <span style='color:#111;'> 731.54KB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$Hepc_(2003171by7_5123o)$_ROC=0.989_ROCstd=0.003_PR=0.426_PRstd=0.070_maxRun=40_Time=17.632.mat <span style='color:#111;'> 14.68MB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$ForestCover_(286048by10_2747o)$_ROC=0.935_ROCstd=0.006_PR=0.089_PRstd=0.009_maxRun=40_Time=1.643.mat <span style='color:#111;'> 2.11MB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$Skin_(199283by3_5085o)$_ROC=0.882_ROCstd=0.009_PR=0.096_PRstd=0.007_maxRun=40_Time=1.307.mat <span style='color:#111;'> 1.04MB </span>","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$Adult_(38323by6_1168o)$_ROC=0.590_ROCstd=0.036_PR=0.073_PRstd=0.020_maxRun=40_Time=0.855.mat <span style='color:#111;'> 335.01KB </span>","children":null,"spread":false}],"spread":true}],"spread":true},{"title":"datasets","children":[{"title":"testData","children":[{"title":"testData1_(21467by2_200lo).mat <span style='color:#111;'> 329.38KB </span>","children":null,"spread":false},{"title":"testData2_(21867by2_600go).mat <span style='color:#111;'> 336.68KB </span>","children":null,"spread":false}],"spread":true},{"title":"synthData","children":[{"title":"Readme.md <span style='color:#111;'> 991B </span>","children":null,"spread":false}],"spread":true},{"title":"realData","children":[{"title":"Shuttle_(49097by9_3511o).mat <span style='color:#111;'> 538.52KB </span>","children":null,"spread":false},{"title":"Adult_(38323by6_1168o).mat <span style='color:#111;'> 502.94KB </span>","children":null,"spread":false},{"title":"Mammography_(11183by6_260o).mat <span style='color:#111;'> 224.71KB </span>","children":null,"spread":false},{"title":"Smtp_(95156by3_30o).mat <span style='color:#111;'> 744.50KB </span>","children":null,"spread":false},{"title":"ForestCover_(286048by10_2747o).mat <span style='color:#111;'> 4.64MB </span>","children":null,"spread":false},{"title":"Http_(567498by3_2211o).mat <span style='color:#111;'> 2.64MB </span>","children":null,"spread":false},{"title":"CreditCardFraud_(284807by29_492o).mat <span style='color:#111;'> 59.49MB </span>","children":null,"spread":false},{"title":"Hepc_(2003171by7_5123o).mat <span style='color:#111;'> 34.20MB </span>","children":null,"spread":false},{"title":"Skin_(199283by3_5085o).mat <span style='color:#111;'> 1.37MB </span>","children":null,"spread":false}],"spread":true}],"spread":true},{"title":"_competing methods","children":[{"title":"LOF & LoOP","children":[{"title":"Readme.md <span style='color:#111;'> 2.59KB </span>","children":null,"spread":false},{"title":"LOF_LoOP.m <span style='color:#111;'> 8.96KB </span>","children":null,"spread":false}],"spread":true},{"title":"DOLPHIN","children":[{"title":"Readme.md <span style='color:#111;'> 7.57KB </span>","children":null,"spread":false},{"title":"DOLPHIN_dsload.m <span style='color:#111;'> 518B </span>","children":null,"spread":false},{"title":"DOLPHIN_dssave.m <span style='color:#111;'> 394B </span>","children":null,"spread":false},{"title":"dolphin.bin <span style='color:#111;'> 65.05KB </span>","children":null,"spread":false},{"title":"DolphinParamEstim.m <span style='color:#111;'> 776B </span>","children":null,"spread":false},{"title":"Experiment_AUCcalc.m <span style='color:#111;'> 1.88KB </span>","children":null,"spread":false}],"spread":true},{"title":"EnLOF","children":[{"title":"Readme.md <span style='color:#111;'> 2.98KB </span>","children":null,"spread":false},{"title":"EnLOF.m <span style='color:#111;'> 881B </span>","children":null,"spread":false}],"spread":true},{"title":"Sp","children":[{"title":"Sp.m <span style='color:#111;'> 468B </span>","children":null,"spread":false},{"title":"Readme.md <span style='color:#111;'> 2.78KB </span>","children":null,"spread":false}],"spread":true},{"title":"ORCA","children":[{"title":"Readme.md <span style='color:#111;'> 6.24KB </span>","children":null,"spread":false},{"title":"ptime.exe <span style='color:#111;'> 24.00KB </span>","children":null,"spread":false}],"spread":false},{"title":"X-means","children":[{"title":"Readme.md <span style='color:#111;'> 3.75KB </span>","children":null,"spread":false},{"title":"ptime.exe <span style='color:#111;'> 24.00KB </span>","children":null,"spread":false}],"spread":false}],"spread":true},{"title":"SDCOR _ without visualization - read data from Disk","children":[{"title":"SDCOR.m <span style='color:#111;'> 27.28KB </span>","children":null,"spread":false},{"title":"MAIN.m <span style='color:#111;'> 19.84KB </span>","children":null,"spread":false},{"title":"MAIN.fig <span style='color:#111;'> 3.52MB </span>","children":null,"spread":false}],"spread":true}],"spread":true}],"spread":true}],"spread":true}]

评论信息

免责申明

【只为小站】的资源来自网友分享,仅供学习研究,请务必在下载后24小时内给予删除,不得用于其他任何用途,否则后果自负。基于互联网的特殊性,【只为小站】 无法对用户传输的作品、信息、内容的权属或合法性、合规性、真实性、科学性、完整权、有效性等进行实质审查;无论 【只为小站】 经营者是否已进行审查,用户均应自行承担因其传输的作品、信息、内容而可能或已经产生的侵权或权属纠纷等法律责任。
本站所有资源不代表本站的观点或立场,基于网友分享,根据中国法律《信息网络传播权保护条例》第二十二条之规定,若资源存在侵权或相关问题请联系本站客服人员,zhiweidada#qq.com,请把#换成@,本站将给予最大的支持与配合,做到及时反馈和处理。关于更多版权及免责申明参见 版权及免责申明