Sequential Retreating Search Methods in Feature Selection

0357268 - ÚTIA 2011 CZ eng V - Výzkumná zpráva
Somol, Petr - Pudil, Pavel
Sequential Retreating Search Methods in Feature Selection.
Praha: ÚTIA, 2010. 21 s. Research Report, 2286.
Grant CEP: GA MŠMT 1M0572; GA AV ČR IAA2075302
Grant ostatní: GA ČR(CZ) GA402/03/1310; GA MŠk(CZ) 2C06019
Výzkumný záměr: CEZ:AV0Z10750506
Klíčová slova: feature selection * wrappers * sequential search * subset search * method evaluation * classifier performance * pattern recognition
Kód oboru RIV: BD - Teorie informace

Inspired by Floating Search, our new pair of methods, the Sequential Forward Retreating Search (SFRS) and Sequential Backward Retreating Search (SBRS) is exceptionally suitable for Wrapper based feature selection. (Conversely, it cannot be used with monotonic criteria.) Unlike most of other known sub-optimal search methods, both the SFRS and SBRS are parameter-free deterministic sequential procedures that incorporate in the optimization process both the search for the best subset and the determination of the best subset size. The subset yielded by either of the two new methods is to be expected closer to optimum than the best of all subsets yielded in one run of the Floating Search. Retreating Search time complexity is to be expected slightly worse but in the same order of magnitude as that of the Floating Search. In addition to introducing the new methods we provide a testing framework to evaluate them with respect to other existing tools.
Trvalý link: http://hdl.handle.net/11104/0195586