Experiments with the User’s Feedback in Preference Elicitation

0575198 - ÚTIA 2024 RIV DE eng C - Conference Paper (international conference)
Siváková, Tereza - Kárný, Miroslav
Experiments with the User’s Feedback in Preference Elicitation.
AIABI-2022 : Artificial Intelligence and Applications for Business and Industries 2022. Achen: CEUR-WS, 2023. ceur-ws.org, 3463. E-ISSN 1613-0073.
[Artificial Intelligence and Applications for Business and Industries 2022. Udine (IT), 27.11.2022-02.12.2022]
Institutional support: RVO:67985556
Keywords : Preference elicitation * Adaptive agent * Decision making * Bayes rule
OECD category: Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)
http://library.utia.cas.cz/separaty/2023/AS/sivakova-0575198.pdf

This paper deals with user’s preferences (wishes). Common users are uneducated in the decision-making (DM) theory and present their preferences incompletely. That is why we elicit them from such a user during the DM. The paper works with the DM theory called fully probabilistic design (FPD). FPD models closed DM loop, made by the user and the system, by the joint probability density (pd, real pd). A joint ideal pd quantifies the user’s preferences. It assigns high probability values to preferred closed-loop behaviors and low values to undesired behaviors. The real pd should be kept near the ideal pd. By minimizing the Kullback-Leibler divergence of the real and ideal pds, the optimal decision policy is found. The presented algorithmic quantification of preferences provides ambitious but potentially reachable DM aims. It suppresses demands on tuning preference-expressing parameters. The considered ideal pd assigns high probabilities to desired (ideal) sets of states and actions. The parameters of the ideal pd (tuned during the DM via the user’s feedback) are: ▶ relative significance of respective probabilities. ▶ a parameter balancing exploration with exploitation. Their systematic tuning solves meta-DM level task, which observes the agent’s satisfaction expressed humanly by “school-marks”. It opts free parameters to reach the best marks. A formalization and solution of this meta-task were recently done, but experience with it is limited. This paper recalls the theory and provides representative samples of extensive up to now missing simulations.

Permanent Link: https://hdl.handle.net/11104/0345034