The analysis of expert opinions’ consensus quality.

In many situations we need to obtain one, common decision (which can be understood as a consistent state of knowledge) out of opinions collected from many experts or any other external sources. This entails a problem concerning the reliability of such decision. We would like to know that decisions based on experts’ opinions are trustworthy. Unfortunately, in many cases the determination of such decision is difficult and expensive, especially when big sets of input data are involved in the process. This paper presents a framework which allows to assess the quality of the aforementioned final decision. Its output is based solely on the analysis of its input (e.g. an assumed representation of experts’ opinions). Moreover, the paper contains an overview of several types of possible approaches to the considered topic. [ABSTRACT FROM AUTHOR]