Search

The most widely spread measure of performance, accuracy, suffers from a paradox: predictive models with a given level of accuracy may have greater predictive power than models with higher accuracy. Despite optimizing classification error rate, high accuracy models may fail to capture crucial information transfer in the classification task. We present evidence of this behavior by means of a combinatorial analysis where every possible contingency matrix of 2, 3 and 4 classes classifiers are depicted on the entropy triangle, a more reliable information-theoretic tool for classification assessment. Motivated by this, we develop from first principles a measure of classification performance that takes into consideration the information learned by classifiers. We are then able to obtain the entropy-modulated accuracy (EMA), a pessimistic estimate of the expected accuracy with the influence of the input distribution factored out, and the normalized information transfer factor (NIT), a measure of how efficient is the transmission of information from the input to the output set of classes. The EMA is a more natural measure of classification performance than accuracy when the heuristic to maximize is the transfer of information through the classifier instead of classification error count. The NIT factor measures the effectiveness of the learning process in classifiers and also makes it harder for them to "cheat" using techniques like specialization, while also promoting the interpretability of results. Their use is demonstrated in a mind reading task competition that aims at decoding the identity of a video stimulus based on magnetoencephalography recordings. We show how the EMA and the NIT factor reject rankings based in accuracy, choosing more meaningful and interpretable classifiers. Francisco José Valverde-Albacete has been partially supported by EU FP7 project LiMoSINe (contract 288024): www.limosine-project.eu Carmen Peláez Moreno has been partially supported by the Spanish Government-Comisión Interministerial de Ciencia y Tecnología project TEC2011–26807.

A fundamental question of biology is how nucleic acids first assembled and then were incorporated into the earliest forms of cellular life 4 billion years ago. The polymerization of nucleotides is a condensation reaction in which phosphodiester bonds are formed. This reaction cannot occur in aqueous solutions, but guided polymerization in an anhydrous lipid environment could promote a non-enzymatic condensation reaction in which oligomers of single stranded nucleic acids are synthesized. We used X-ray scattering to investigate 5′-adenosine monophosphate (AMP) molecules captured in a multilamellar phospholipid matrix composed of dimyristoylphosphatidylcholine. Bragg peaks corresponding to the lateral organization of the confined AMP molecules were observed. Instead of forming a random array, the AMP molecules are highly entangled, with the phosphate and ribose groups in close proximity. This structure may facilitate polymerization of the nucleotides into RNA-like polymers.