Transfer of Knowledge for Surrogate Model Selection in Cost-Aware Optimization

0493290 - ÚI 2019 RIV IE eng A - Abstract
Pitra, Zbyněk - Repický, Jakub - Holeňa, Martin
Transfer of Knowledge for Surrogate Model Selection in Cost-Aware Optimization.
ECML PKDD 2018: Workshop on Interactive Adaptive Learning. Proceedings. Dublin, 2018 - (Krempl, G.; Lemaire, V.; Kottke, D.; Calma, A.; Holzinger, A.; Polikar, R.; Sick, B.). s. 89-94
[ECML PKDD 2018: The European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases. 10.09.2018-14.09.2018, Dublin]
R&D Projects: GA ČR GA17-01251S
Grant - others:ČVUT(CZ) SGS17/193/OHK4/3T/14; GA MŠk(CZ) LM2015042
Institutional support: RVO:67985807
Keywords : Metalearing * Surrogate model * Gaussian process * Random forest * Exploratory landscape analysis
OECD category: Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)
https://www.ies.uni-kassel.de/p/ial2018/ialatecml2018.pdf

PUBLISHED IN: ECML PKDD 2018: Workshop on Interactive Adaptive Learning. Proceedings. Dublin, 2018 - (Krempl, G., Lemaire, V., Kottke, D., Calma, A., Holzinger, A., Polikar, R., Sick, B.). s. 89-94. [ECML PKDD 2018: The European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases. 10.09.2018-14.09.2018, Dublin]. Grant CEP: GA ČR GA17-01251S. ABSTRACT: Surrogate model selection is an active-learning approach to cost-aware continuous black-box optimization in domains where the evaluation of the black-box objective function is expensive, e. g., obtained experimentally or resulting from comprehensive simulations. Active reusing of knowledge represented by landscape properties of the objective function accross different tasks can provide additional information for more reliable decisions in terms of a suitable surrogate model and a suitable setting of its hyperparameters. However, research into using metalearning and especially Exploratory Landscape Analysis (ELA) in this context is only starting. Our goal is to develop a learning system capable to recommend a surrogate model on the basis of the knowledge obtained in previous black-box optimization tasks. In this paper, we provide a first step necessary to construct a learning system applying knowledge from previous tasks to a new one: a study of the applicability of ELA to two important kinds of surrogate models – Gaussian processes (GP) and ensembles of regression trees (random forests, RF). Results using the noiseless benchmarks of the Comparing-Continuous-Optimisers (COCO) platform in the expensive scenario, where at most 50D evaluations are available, are analysed for statistical dependences between model performance and a broad variety of landscape features.

Permanent Link: http://hdl.handle.net/11104/0286679