tailieunhanh - An evaluation method for unsupervised anomaly detection algorithms

In this paper, the authors introduce a method for evaluating the performance of unsupervised anomaly detection techniques. The method is based on the application of internal validation metrics in clustering algorithms to anomaly detection. The experiments were conducted on a number of benchmarking datasets. The results are compared with the result of a recent proposed approach that shows that some proposed metrics are very consistent when being used to evaluate the performance of unsupervised anomaly detection algorithms. | Journal of Computer Science and Cybernetics, , (2016), 259–272 DOI AN EVALUATION METHOD FOR UNSUPERVISED ANOMALY DETECTION ALGORITHMS HUY VAN NGUYEN1 , TRUNG THANH NGUYEN2 , AND QUANG UY NGUYEN2 1 Institute of Information Technology, Vietnam Academy of Military Science and Technology; 2 Faculty of IT, Le Quy Don Technical University; 1 ; 2 quanguyhn@, 2 trungthanhnt@ Abstract. In data mining, anomaly detection aims at identifying the observations which do not conform to an expected behavior. To date, a large number of techniques for anomaly detection have been proposed and developed. These techniques have been successfully applied to many real world applications such as fraud detection for credit cards and intrusion detection in network security. However, there are very little research relating to the method for evaluating the goodness of unsupervised anomaly detection techniques. In this paper, the authors introduce a method for evaluating the performance of unsupervised anomaly detection techniques. The method is based on the application of internal validation metrics in clustering algorithms to anomaly detection. The experiments were conducted on a number of benchmarking datasets. The results are compared with the result of a recent proposed approach that shows that some proposed metrics are very consistent when being used to evaluate the performance of unsupervised anomaly detection algorithms. Keywords. Anomaly detection, evaluation, clustering validation. 1. INTRODUCTION Detecting anomaly has received great attention from the research community in machine learning [6]. Anomaly detection aims at finding samples in data that do not follow the expected behavior. These samples are often referred to as anomalies or outliers. These two terms are often used interchangeably. Anomaly detection techniques have extensively been applied to a wide variety of applications such as .