Search

We propose a preference-learning algorithm for uncovering Decision Makers' (DMs') contingent evaluation strategies in the context of multiple criteria sorting. We assume the preference information in the form of holistic assignment examples derived from the analysis of alternatives' performance vectors and textual descriptions. We characterize the decision policies using a mixture of threshold-based, value-driven preference models and associated latent topics. The latter serve as the stimuli underlying the contingency in decision behavior. Such a probabilistic model is constructed by using a flexible and nonparametric Bayesian framework. The proposed method adopts a hierarchical Dirichlet process as the prior so that a group of DMs can share a countably infinite number of contingent models and topics. For all DMs, it automatically identifies the components representing their evaluation strategies adequately. The posterior is summarized by using the Hamiltonian Monte Carlo sampling method. We demonstrate the method's practical usefulness in a real-world recruitment problem considered by a Chinese IT company. We also compare the approach with counterparts that use a single preference model, implement the parametric framework, or consider each DM's preferences individually. The results indicate that our approach performs favorably in both interpreting DMs' contingent decision behavior and recommending decisions on new alternatives. Furthermore, the approach's performance and robustness are investigated through a computational experiment involving real-world data sets. History: Accepted by Ram Ramesh, Area Editor for Data Science and Machine Learning. Funding: J. Liu received financial support from the National Natural Science Foundation of China [Grants 72071155 and 71701160]. M. Kadziński received financial support from the Polish National Science Center under the SONATA BIS project [Grant DEC-2019/34/E/HS4/00045]. X. Liao received financial support from the National Natural Science Foundation of China [Grant 71872144]. Supplemental Material: The software that supports the findings of this study is available within the paper and its Supplemental Information (https://pubsonline.informs.org/doi/suppl/10.1287/ijoc.2023.1292) as well as from the IJOC GitHub software repository (https://github.com/INFORMSJoC/2021.0328) at (http://dx.doi.org/10.5281/zenodo.7608750). [ABSTRACT FROM AUTHOR]

The learning of predictive models for data-driven decision support has been a prevalent topic in many fields. However, construction of models that would capture interactions among input variables is a challenging task. In this paper, we present a new preference learning approach for multiple criteria sorting with potentially interacting criteria. It employs an additive piecewise-linear value function as the basic preference model, which is augmented with components for handling the interactions. To construct such a model from a given set of assignment examples concerning reference alternatives, we develop a convex quadratic programming model. Because its complexity does not depend on the number of training samples, the proposed approach is capable for dealing with data-intensive tasks. To improve the generalization of the constructed model on new instances and to overcome the problem of overfitting, we employ the regularization techniques. We also propose a few novel methods for classifying nonreference alternatives in order to enhance the applicability of our approach to different data sets. The practical usefulness of the proposed approach is demonstrated on a problem of parametric evaluation of research units, whereas its predictive performance is studied on several monotone classification problems. The experimental results indicate that our approach compares favourably with the classical UTilités Additives DIScriminantes (UTADIS) method and the Choquet integral-based sorting model. Summary of Contribution. The paper tackles vital challenges at the intersections of multiple criteria decision analysis and machine learning, showing how computationally advanced techniques can be used for faithfully representing human preferences and dealing with complex decision problems. Specifically, we propose a novel preference learning method for multiple criteria sorting problems. The introduced approach incorporates convex quadratic programming to construct a value-based preference model based on large sets of preference statements. In this way, we extend the applicability of decision analysis methods to preferences derived from historical data or observation of users' behavior in addition to the preference judgments explicitly revealed by the decision-makers. The method's practical usefulness is illustrated on a variety of real-world datasets from fields such as higher education, medicine, human resources, and housing market. Its potential for supporting better decision-making is enhanced by both an interpretable form of the assumed model handling interactions between criteria as well as a high predictive performance demonstrated in the extensive computational experiments. [ABSTRACT FROM AUTHOR]