Assessment of monitoring systems in the management of severe acute malnutrition in northern Nigeria

Background In northern Nigeria, UNICEF has supported introduction of a short message service (SMS) system for data transmission in the Community-based Management of Acute Malnutrition (CMAM) programme. The SMS system operates in parallel to the traditional paper-based system, and weekly data are transmitted directly from the health facilities to the federal level. For the paper system, monthly data summaries are passed through all levels of government. We assessed the data quality and performance of both CMAM information systems. Methods We undertook a contextualised study in one state in north-west Nigeria, with additional analysis of secondary data from five states. Fieldwork methods included: observation of the data system in nine selected facilities in three local government areas; recounting of data for admissions, exits, and ready-to-use therapeutic food (RUTF) utilisation; and interviews with health workers and government officials. Results While the small number of facilities does not enable robust generalisation of the quantitative findings, the strengths and weaknesses detected pertain to the whole programme, as they relate to how the system was designed and is operated. We found that the accuracy and reliability of CMAM data were deficient to a similar extent in the paper-based and SMS systems. For the audited month, we found large discrepancies between recounted data and paper records in regard to admissions, exits and RUTF cartons consumed in the majority of facilities visited. There was also a large discrepancy in the reported percentage of “deaths or defaulters” (6.5%) compared to 22% based on a recount of outpatient cards. Errors are mainly introduced during data collection and when completing tallies at facility level. Conclusion Our findings indicate the need for improvements in the design of the monitoring system, training and supervision of data management, and communication of results; as well as clear evidence on how measures to improve data quality may affect performance of individual CMAM clinics. The CMAM default and death rates currently reported in Nigeria are likely to be under-estimates, and therefore provide a misleadingly good impression of CMAM programme performance.