聚类马氏距离代码MATLAB-SDCOR:用于大规模数据集中局部离群值检测的可扩展的基于密度的聚类

系统开源

聚类马氏距离代码MATLAB SDCOR 用于大规模数据集中局部离群值检测的可扩展的基于密度的聚类作者： Sayyed-Ahmad Naghavi-Nozad，Maryam Amir Haeri和Gianluigi Folino 目录抽象的：本文提出了一种基于批量密度的聚类方法，用于大规模数据集中的局部离群值检测。与众所周知的假定所有数据都驻留在内存中的传统算法不同，我们提出的方法具有可伸缩性，并且可以在有限的内存缓冲区范围内逐块处理输入数据。在第一阶段建立一个临时的聚类模型；然后，通过分析点的连续内存负载来逐步更新它。随后，在可伸缩聚类结束时，获得原始聚类的近似结构。最后，通过对整个数据集的另一次扫描并使用适当的标准，将偏远评分分配给称为SDCOR（基于可伸缩密度的聚类离群值比率）的每个对象。对现实生活和综合数据集的评估表明，与需要将所有数据加载到内存中的最著名的传统基于密度的方法相比，该方法具有较低的线性时间复杂度，并且更加有效。还有一些基于快速距离的方法，这些方法可以对磁盘中驻留的数据执行操作。框架：更详细地，所提出的方法包括三个主要阶段。在第一阶段

文件下载

资源详情

[{"title":"（ 78 个子文件 203.7MB ）聚类马氏距离代码MATLAB-SDCOR:用于大规模数据集中局部离群值检测的可扩展的基于密度的聚类","children":[{"title":"SDCOR-master","children":[{"title":"Readme.md 19.21KB ","children":null,"spread":false},{"title":"images","children":[{"title":"SoftArch.jpg 188.99KB ","children":null,"spread":false},{"title":"SDCOR_RAMversion.png 147.35KB ","children":null,"spread":false},{"title":"SDCOR_DiskVersion.png 121.46KB ","children":null,"spread":false}],"spread":true},{"title":"LICENSE 1.07KB ","children":null,"spread":false},{"title":"videos","children":[{"title":"SDCOR_RAMversion.wmv 13.76MB ","children":null,"spread":false},{"title":"SDCOR_DiskVersion.wmv 9.24MB ","children":null,"spread":false}],"spread":true},{"title":"codes","children":[{"title":"SDCOR _ with visualization - read data from RAM","children":[{"title":"SDCOR.m 29.34KB ","children":null,"spread":false},{"title":"plotOptional.m 12.56KB ","children":null,"spread":false},{"title":"MAIN.m 24.84KB ","children":null,"spread":false},{"title":"MAIN.fig 4.50MB ","children":null,"spread":false}],"spread":true},{"title":"results","children":[{"title":"testData","children":[{"title":"SDCOR(noVisDsk)_result_$testData2_(21867by2_600go)$_ROC=1.000_ROCstd=0.000_PR=0.998_PRstd=0.000_maxRun=1_Time=0.830.mat 218.30KB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$testData1_(21467by2_200lo)$_ROC=1.000_ROCstd=0.000_PR=0.995_PRstd=0.000_maxRun=1_Time=0.815.mat 216.59KB ","children":null,"spread":false}],"spread":true},{"title":"synthData","children":[{"title":"Tolerance to a high number of outliers","children":[{"title":"SDCOR(noVisDsk)_result_$tolrData03_(34000by2_14000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=8.608.mat 314.68KB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$tolrData10_(48000by2_28000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=35.066.mat 429.33KB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$tolrData09_(46000by2_26000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=29.834.mat 415.41KB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$tolrData06_(40000by2_20000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=18.604.mat 363.88KB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$tolrData02_(32000by2_12000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=6.355.mat 297.87KB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$tolrData04_(36000by2_16000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=11.123.mat 330.98KB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$tolrData01_(30000by2_10000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=4.483.mat 281.29KB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$tolrData11_(50000by2_30000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=40.334.mat 447.99KB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$tolrData07_(42000by2_22000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=21.989.mat 380.53KB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$tolrData08_(44000by2_24000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=25.401.mat 398.85KB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$tolrData05_(38000by2_18000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=14.291.mat 347.56KB ","children":null,"spread":false}],"spread":false},{"title":"Scalability test","children":[{"title":"SDCOR(noVisDsk)_result_$scalData06_(120200by10_200o)$_ROC=1.000_ROCstd=0.000_PR=0.995_PRstd=0.000_maxRun=40_Time=1.303.mat 987.25KB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$scalData02_(40200by10_200o)$_ROC=1.000_ROCstd=0.000_PR=0.995_PRstd=0.000_maxRun=40_Time=0.885.mat 347.53KB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$scalData10_(200200by10_200o)$_ROC=1.000_ROCstd=0.000_PR=0.995_PRstd=0.000_maxRun=40_Time=1.868.mat 1.59MB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$scalData07_(140200by10_200o)$_ROC=1.000_ROCstd=0.000_PR=0.995_PRstd=0.000_maxRun=40_Time=1.515.mat 1.12MB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$scalData03_(60200by10_200o)$_ROC=1.000_ROCstd=0.000_PR=0.995_PRstd=0.000_maxRun=40_Time=1.002.mat 507.02KB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$scalData09_(180200by10_200o)$_ROC=1.000_ROCstd=0.000_PR=0.995_PRstd=0.000_maxRun=40_Time=1.749.mat 1.43MB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$scalData04_(80200by10_200o)$_ROC=1.000_ROCstd=0.000_PR=0.995_PRstd=0.000_maxRun=40_Time=1.100.mat 666.51KB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$scalData08_(160200by10_200o)$_ROC=1.000_ROCstd=0.000_PR=0.995_PRstd=0.000_maxRun=40_Time=1.634.mat 1.27MB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$scalData01_(20200by10_200o)$_ROC=1.000_ROCstd=0.000_PR=0.995_PRstd=0.000_maxRun=40_Time=0.812.mat 190.17KB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$scalData05_(100200by10_200o)$_ROC=1.000_ROCstd=0.000_PR=0.995_PRstd=0.000_maxRun=40_Time=1.204.mat 828.29KB ","children":null,"spread":false}],"spread":true},{"title":"Accuracy and stability analysis","children":[{"title":"SDCOR(noVisDsk)_result_$accrData2_(1000000by40_10000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=41.162.mat 7.83MB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$accrData1_(500000by30_5000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=12.863.mat 3.93MB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$accrData3_(1500000by50_15000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=89.455.mat 11.72MB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$accrData4_(2000000by60_20000o)$_ROC=1.000_ROCstd=0.000_PR=1.000_PRstd=0.000_maxRun=40_Time=161.932.mat 15.52MB ","children":null,"spread":false}],"spread":true}],"spread":true},{"title":"realData","children":[{"title":"SDCOR(noVisDsk)_result_$Mammography_(11183by6_260o)$_ROC=0.820_ROCstd=0.037_PR=0.148_PRstd=0.067_maxRun=40_Time=0.701.mat 92.14KB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$Shuttle_(49097by9_3511o)$_ROC=0.969_ROCstd=0.009_PR=0.617_PRstd=0.049_maxRun=40_Time=0.907.mat 399.55KB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$Http_(567498by3_2211o)$_ROC=0.999_ROCstd=0.001_PR=0.463_PRstd=0.063_maxRun=40_Time=1.848.mat 2.94MB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$CreditCardFraud_(284807by29_492o)$_ROC=0.960_ROCstd=0.001_PR=0.708_PRstd=0.003_maxRun=40_Time=7.811.mat 2.08MB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$Smtp_(95156by3_30o)$_ROC=0.779_ROCstd=0.008_PR=0.245_PRstd=0.083_maxRun=40_Time=0.895.mat 731.54KB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$Hepc_(2003171by7_5123o)$_ROC=0.989_ROCstd=0.003_PR=0.426_PRstd=0.070_maxRun=40_Time=17.632.mat 14.68MB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$ForestCover_(286048by10_2747o)$_ROC=0.935_ROCstd=0.006_PR=0.089_PRstd=0.009_maxRun=40_Time=1.643.mat 2.11MB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$Skin_(199283by3_5085o)$_ROC=0.882_ROCstd=0.009_PR=0.096_PRstd=0.007_maxRun=40_Time=1.307.mat 1.04MB ","children":null,"spread":false},{"title":"SDCOR(noVisDsk)_result_$Adult_(38323by6_1168o)$_ROC=0.590_ROCstd=0.036_PR=0.073_PRstd=0.020_maxRun=40_Time=0.855.mat 335.01KB ","children":null,"spread":false}],"spread":true}],"spread":true},{"title":"datasets","children":[{"title":"testData","children":[{"title":"testData1_(21467by2_200lo).mat 329.38KB ","children":null,"spread":false},{"title":"testData2_(21867by2_600go).mat 336.68KB ","children":null,"spread":false}],"spread":true},{"title":"synthData","children":[{"title":"Readme.md 991B ","children":null,"spread":false}],"spread":true},{"title":"realData","children":[{"title":"Shuttle_(49097by9_3511o).mat 538.52KB ","children":null,"spread":false},{"title":"Adult_(38323by6_1168o).mat 502.94KB ","children":null,"spread":false},{"title":"Mammography_(11183by6_260o).mat 224.71KB ","children":null,"spread":false},{"title":"Smtp_(95156by3_30o).mat 744.50KB ","children":null,"spread":false},{"title":"ForestCover_(286048by10_2747o).mat 4.64MB ","children":null,"spread":false},{"title":"Http_(567498by3_2211o).mat 2.64MB ","children":null,"spread":false},{"title":"CreditCardFraud_(284807by29_492o).mat 59.49MB ","children":null,"spread":false},{"title":"Hepc_(2003171by7_5123o).mat 34.20MB ","children":null,"spread":false},{"title":"Skin_(199283by3_5085o).mat 1.37MB ","children":null,"spread":false}],"spread":true}],"spread":true},{"title":"_competing methods","children":[{"title":"LOF & LoOP","children":[{"title":"Readme.md 2.59KB ","children":null,"spread":false},{"title":"LOF_LoOP.m 8.96KB ","children":null,"spread":false}],"spread":true},{"title":"DOLPHIN","children":[{"title":"Readme.md 7.57KB ","children":null,"spread":false},{"title":"DOLPHIN_dsload.m 518B ","children":null,"spread":false},{"title":"DOLPHIN_dssave.m 394B ","children":null,"spread":false},{"title":"dolphin.bin 65.05KB ","children":null,"spread":false},{"title":"DolphinParamEstim.m 776B ","children":null,"spread":false},{"title":"Experiment_AUCcalc.m 1.88KB ","children":null,"spread":false}],"spread":true},{"title":"EnLOF","children":[{"title":"Readme.md 2.98KB ","children":null,"spread":false},{"title":"EnLOF.m 881B ","children":null,"spread":false}],"spread":true},{"title":"Sp","children":[{"title":"Sp.m 468B ","children":null,"spread":false},{"title":"Readme.md 2.78KB ","children":null,"spread":false}],"spread":true},{"title":"ORCA","children":[{"title":"Readme.md 6.24KB ","children":null,"spread":false},{"title":"ptime.exe 24.00KB ","children":null,"spread":false}],"spread":false},{"title":"X-means","children":[{"title":"Readme.md 3.75KB ","children":null,"spread":false},{"title":"ptime.exe 24.00KB ","children":null,"spread":false}],"spread":false}],"spread":true},{"title":"SDCOR _ without visualization - read data from Disk","children":[{"title":"SDCOR.m 27.28KB ","children":null,"spread":false},{"title":"MAIN.m 19.84KB ","children":null,"spread":false},{"title":"MAIN.fig 3.52MB ","children":null,"spread":false}],"spread":true}],"spread":true}],"spread":true}],"spread":true}]

评论信息

其他资源

免责申明

【只为小站】的资源来自网友分享，仅供学习研究，请务必在下载后24小时内给予删除，不得用于其他任何用途，否则后果自负。基于互联网的特殊性，【只为小站】无法对用户传输的作品、信息、内容的权属或合法性、合规性、真实性、科学性、完整权、有效性等进行实质审查；无论【只为小站】经营者是否已进行审查，用户均应自行承担因其传输的作品、信息、内容而可能或已经产生的侵权或权属纠纷等法律责任。
本站所有资源不代表本站的观点或立场，基于网友分享，根据中国法律《信息网络传播权保护条例》第二十二条之规定，若资源存在侵权或相关问题请联系本站客服人员，zhiweidada#qq.com，请把#换成@，本站将给予最大的支持与配合，做到及时反馈和处理。关于更多版权及免责申明参见版权及免责申明

聚类马氏距离代码MATLAB-SDCOR:用于大规模数据集中局部离群值检测的可扩展的基于密度的聚类

文件下载

资源详情

评论信息

其他资源

免责申明

个人信息

相关资源标签

热门下载

最新下载