1. <scp>mvp</scp> – an open‐source preprocessor for cleaning duplicate records and missing values in mass spectrometry data
- Author
-
Byung Hwa Jung, Hojung Nam, Geunho Lee, and Lee Hyun Beom
- Subjects
Engineering ,Dirty data ,dirty data ,Method ,Mass spectrometry ,computer.software_genre ,01 natural sciences ,General Biochemistry, Genetics and Molecular Biology ,03 medical and health sciences ,0302 clinical medicine ,Software ,missing value ,MS data preprocessor ,Preprocessor ,030212 general & internal medicine ,mass spectrometry ,Statistical hypothesis testing ,business.industry ,R package ,010401 analytical chemistry ,Graph theory ,duplicate record ,MS datapreprocessor ,Missing data ,0104 chemical sciences ,Identifier ,Data mining ,business ,computer - Abstract
Mass spectrometry (MS) data are used to analyze biological phenomena based on chemical species. However, these data often contain unexpected duplicate records and missing values due to technical or biological factors. These 'dirty data' problems increase the difficulty of performing MS analyses because they lead to performance degradation when statistical or machine-learning tests are applied to the data. Thus, we have developed missing values preprocessor (MVP), an open-source software for preprocessing data that might include duplicate records and missing values. MVP uses the property of MS data in which identical chemical species present the same or similar values for key identifiers, such as the mass-to-charge ratio and intensity signal, and forms cliques via graph theory to process dirty data. We evaluated the validity of the MVP process via quantitative and qualitative analyses and compared the results from a statistical test that analyzed the original and MVP-applied data. This analysis showed that using MVP reduces problems associated with duplicate records and missing values. We also examined the effects of using unprocessed data in statistical tests and examined the improved statistical test results obtained with data preprocessed using MVP.
- Published
- 2017
- Full Text
- View/download PDF