Back to articles
Volume: 30 | Article ID: art00013
Outlier Detection in Large-Scale Traffic Data by Regression Analysis
  DOI :  10.2352/ISSN.2470-1173.2018.09.IRIACV-276  Published OnlineJanuary 2018

A robust outlier detection for large-scale traffic data by an unsupervised regression method is proposed in this paper. Traffic data is collected from loops, sensors and digital cameras all around a city every day. The data size is massive and in a big data format. Outlier is regarded as abnormal traffic situation like traffic jams, low traffic flows, or incidents as well as errors and noise in data storage and transmission. The traffic data to be tackled in this paper is represented by spatial temporal (ST) signals. A principle component analysis (PCA) is used for dimension reduction and to generate a representation of (x, y) –coordinates from the first two component's coefficients in the ST signals. The (x, y) –coordinate points of inliers are measured by Standardized Residual (SR), Hat Matrix (HM) and Cook's Distance (CD) in the regression method so that outliers are assumed to have high changes in these three metrics in the best fit regression model. Experimental result of the proposed method for the Level 1 data achieves detection success rates (DSRs) of 97.37% (SR), 91.19% (HM), 94.28% (CD) for linear regression model, respectively, and 96.80% (SR), 89.71% (HM), 93.14% (CD) for quadratic regression model, respectively. For a finer granularity of Level 2 data, the regression method with the CD metric achieves 94.44% DSR.

Subject Areas :
Views 18
Downloads 3
 articleview.views 18
 articleview.downloads 3
  Cite this article 

Philip Lam, Lili Wang, Henry Y.T. Ngan, Nelson H.C. Yung, Michael K. Ng, "Outlier Detection in Large-Scale Traffic Data by Regression Analysisin Proc. IS&T Int’l. Symp. on Electronic Imaging: Intelligent Robotics and Industrial Applications using Computer Vision,  2018,  pp 276-1 - 276-6,

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2018
Electronic Imaging
Society for Imaging Science and Technology