Maximum Relevance Maximum Anti-Redundancy (mRmA) Feature Selection

Authors

  • Abdul Mannan
  • Kashif Javed
  • Serosh Karim Noon

Abstract

Filters represent a class of feature selection methods used to select a subset of useful features from high dimensional data on the basis of relevance and redundancy analysis. Maximum relevance minimum redundancy (mRMR) is a famous feature selection algorithm for microarray data [1]. The quotient based version of maximum relevance minimum redundancy (Q-mRMR) filter [1],[2] selects, at each iteration, the feature scoring maximum ratio between its class relevance and average redundancy over already selected subset. This ratio can be surprisingly large if the denominator i.e. redundancy term is very small, hence suppressing the effect of relevance and leads to the selection of features which can be very weak representatives of the class. This paper addresses this issue by presenting a maximum relevance maximum antiredundancy (mRmA) filter method. For mRmA the value of objective function is within reasonable limits for all values of relevance and redundancy, hence, making selection of appropriate features more probable. Our 10 fold cross validation accuracy results using naive Bayes and support vector machines (SVM) classifiers confirm that the proposed method outperforms both Q-mRMR and Fast Correlation based Filter (FCBF) methods on six datasets from various applications like microarray, image and physical domains.

References

W. S. Kaggwa, M. B. Jaksa and R. K. Jha; Development of Automated Dilatometer and Comparison with Cone Penetration tests at the University of Adelaide, Australia, Advances in Site Investigation Practice, Thomas Telford, London, (1996)

J. E. Bowles; Foundation Analysis and Design, 5th ed. McGraw Hill Book Company, New York, (1996)

P. K. Robertson; In Situ Testing and Its Application to Foundation Engineering, Canadian Geotech. J., Vol. 23, No.4, (1986), 573-594.

N. J. Withers, L.H.J. Schaap and C. P. Dalton; The Development of a Full Displacement Pressuremeter, The Pressuremeter and its Marine Applications: Second International Symposium. ASTM STP 950, (1986), 38-56

H. M. Zuidberg and M. L. Post; The Cone Pressuremeter: An Efficient Way of Pressuremeter Testing, Proc. 4th Int. Symp. on Pressuremeter Testing (ISP4), “The Pressuremeter and its New Avenue” Balkema, (1995), 387-394

A. Akbar; Development of Low Cost In-situ Testing Devices, Ph.D. Thesis, Department of Civil Engineering, University of Newcastle, Newcastle Upon Tyne, UK, (2001)

A. Akbar, B. G. Clarke and P. G. Allen; A Low Cost Newcastle Full-Displacement Cone Pressuremeter, UET Research Journal, Vol. 14, Jan. 2003, Nos. 1-2, (2003), 21-25

A. Akbar, M. Arshad and B. G. Clarke; Site Characterization Using CPT, DMT, SPT and Laboratory Test Results, Proceedings, International Conference on Geotechnical and Geophysical Site Characterization, Taipei, Taiwan, (2008), 251-256

B. G. Clarke; Pressuremeters in Geotechnical Design, Blackie Academic and Professional, London, (1995)

B. G. Clarke; Pressuremeter Testing in Ground Investigation, Part I-Site Operations, Proc. Instn. Civ. Engr. Geotech. Engg. 119, April (1996), 96-108

G. T. Houlsby and N. J. Withers, Analysis of the Cone Pressuremeter Test in Clay, Geotechnique 38, No. 4, (1988), 575-587.

A. Marsland and M. F. Randolph; Comparisons of Results from Pressuremeter Tests and Large In-situ Plate Tests in London Clay, Geotechnique 27, No. 2, (1977), 217-243

T. Lunne, S. Lacasse and N. S. Rad; General Report: SPT, CPT, Pressuremeter Testing and Recent Developments in In-Situ Testing, Proceedings, 12th International Conference on Soil Mechanics and Foundation Engineering, Vol. 4, Rio de Janeiro, (1992), 2339-2403

M. Aziz; Calibration of Newcastle Dilatometer in Cohesive Soil, M.Sc. Thesis, Department of Civil Engineering, University of Engineering and Technology, Lahore, Pakistan, (2006)

G. E. Bauer and A. Tanaka; Penetration Testing of a Desiccated Clay Crust, Penetration Testing, ISOPT- 1, De Ruiter (ed.) Balkema, Rotterdam, (1988), 477- 488

S. Amar, and J. F. Jéséquel; Essais en place et en laboratoire sur sols cohérent comparaison des résultats, Bull.de Liaison de LCPC, Paris, No. 58, (1972), 97-108

D.Muir-Wood; Strain Dependent Moduli and Pressuremeter Tests, Geotechnique, 40(26), (1990), 509-512

G. T. Houlsby and N. R. F. Nutt; Development of the Cone Pressuremeter, Predictive Soil Mechanics, Proc. Wroth Memorial Symp., Oxford, (1993), 254-271

L. A. Ajayi et al.; Penetration Testing in Tropical Lateritic and Residual Soils- Nigerian Experience, Penetration Testing, ISOPT-1, De Ruiter (ed.), Balkema, Rotterdam (1988), 315-328

Downloads

Published

2017-08-21

Issue

Section

Electrical Engineering and Computer Science