Back to Search
Start Over
<scp>mvp</scp> – an open‐source preprocessor for cleaning duplicate records and missing values in mass spectrometry data
- Source :
- FEBS Open Bio, FEBS OPEN BIO(7): 7
- Publication Year :
- 2017
- Publisher :
- Wiley, 2017.
-
Abstract
- Mass spectrometry (MS) data are used to analyze biological phenomena based on chemical species. However, these data often contain unexpected duplicate records and missing values due to technical or biological factors. These 'dirty data' problems increase the difficulty of performing MS analyses because they lead to performance degradation when statistical or machine-learning tests are applied to the data. Thus, we have developed missing values preprocessor (MVP), an open-source software for preprocessing data that might include duplicate records and missing values. MVP uses the property of MS data in which identical chemical species present the same or similar values for key identifiers, such as the mass-to-charge ratio and intensity signal, and forms cliques via graph theory to process dirty data. We evaluated the validity of the MVP process via quantitative and qualitative analyses and compared the results from a statistical test that analyzed the original and MVP-applied data. This analysis showed that using MVP reduces problems associated with duplicate records and missing values. We also examined the effects of using unprocessed data in statistical tests and examined the improved statistical test results obtained with data preprocessed using MVP.
- Subjects :
- Engineering
Dirty data
dirty data
Method
Mass spectrometry
computer.software_genre
01 natural sciences
General Biochemistry, Genetics and Molecular Biology
03 medical and health sciences
0302 clinical medicine
Software
missing value
MS data preprocessor
Preprocessor
030212 general & internal medicine
mass spectrometry
Statistical hypothesis testing
business.industry
R package
010401 analytical chemistry
Graph theory
duplicate record
MS datapreprocessor
Missing data
0104 chemical sciences
Identifier
Data mining
business
computer
Subjects
Details
- ISSN :
- 22115463
- Volume :
- 7
- Database :
- OpenAIRE
- Journal :
- FEBS Open Bio
- Accession number :
- edsair.doi.dedup.....881a7844a10ce9f6eae87cc59f518b97
- Full Text :
- https://doi.org/10.1002/2211-5463.12247