This article charts the innovative evaluation journey an Australian nonprofit organisation, The Pyjama Foundation (PJF), has taken when designing an evaluation instrument to gain feedback from programme beneficiaries. PJF sought to develop a formal, targeted approach to hear the perspectives of children living in out-of-home care, who are involved with their Love of Learning educational programme. The design process included two focus group discussions with foster carers, programme volunteers, and child development experts. From this, an evaluation survey for children to use was developed. The survey’s underpinning conceptual framework, based on key protective factors influencing educational outcomes for children in out-of-home care, is a key contribution of this research. In addition, the design and implementation issues PJF encountered contribute insights for other nonprofit organisations and evaluators and academic knowledge towards evaluations involving children and vulnerable stakeholders. Hearing children’s views on programmes they are involved in is vital in helping to develop safe spaces for children to engage, where their thoughts are valued and opinions matter. As such, the processes detailed within this article support the development of evaluation practices that value children’s voices.