Black, Indigenous, and Latinx students often participate in programs being evaluated, yet they are generally excluded from being involved in the evaluation process. In addition, the staff of organizations that conduct evaluations are predominately White and often implement research methods that may perpetuate racial biases and unequal power dynamics that exist in our society (Caldwell & Bledsoe, 2019; Hall, 2018; Leiderman, 2017; Public Policy Associates, 2015; Stanfield, 1999). These dynamics may produce inaccurate findings that can impact recommendations for program improvement and future funding decisions, potentially doing a disservice to the students and communities that the programs are intended to support. Our organization is conducting a comprehensive evaluation of a large-scale National Science Foundation (NSF) grant initiative. The mixed-methods evaluation combines formative and summative components. The formative component is used to provide ongoing data to the project's leaders that can be used to improve the work. The focus of this aspect of the evaluation is to understand the experiences of graduate students in Bridge Programs in chemistry, geoscience, and physics. Participants are asked questions about department climate, sense of belonging, funding, support from their program, faculty and peers, mental health support, and imposter syndrome. Faculty at the departments that house these graduate students applied to the various disciplinary societies to become a Bridge Program site. The application process included departments outlining the work done to make their program more inclusive and supportive. Our goals are to determine how students are supported in their program and how programs can find ways to support their students better. The assumption is that if students are feeling supported in their graduate programs, they will persist and be successful. The study participants are graduate students who were enrolled in Bridge Programs at universities across the country. Due to the pandemic, the research occurred online using Zoom to conduct individual interviews. The population being studied include Black, Indigenous, and Latinx graduate students in graduate programs in chemistry, geoscience, and physics. The students all matriculated into their graduate program through a Bridge Program established through the disciplinary society partner. At the time of the evaluation, 221 students were enrolled in Bridge Programs. The purpose of the Bridge Programs is to raise awareness of the experiences Black, Indigenous, and Latinx students face in pursuing graduate degrees; to inspire departments to adopt inclusive practices; to begin to build a recognizable disciplinary movement toward the adoption of inclusive practices in graduate education; and to increase the number of Black, Indigenous, and Latinx students earning graduate degrees, while creating a network to support and serve students in the physical sciences. The evaluation team studying the Bridge Programs consists of a mixed-race female who appears White and a White male. Acknowledging that our evaluation team is not representative of the Bridge Program participants, and understanding and reflecting on how our own assumptions, biases, and experiences related to race and ethnicity may influence data collection, analysis, and interpretation, we sought to engage in anti-racist, culturally responsive, and participatory evaluation practices by collaborating with program participants to inform the evaluation design and implementation. We recruited graduate students in Bridge Programs to review our data collection protocols and provide feedback to test the validity and cultural appropriateness of our qualitative and quantitative items before administration, and participate in the qualitative coding of narrative data. During interviews with students, we worked to foster a safe environment and shared understanding by informing each participant about the purpose of the interview and that they are free to end the interview at any time or pass on any question they did not want to answer. We started the interview by asking which program they are in and their career goals, followed by questions about support they receive from their programs, faculty, and peers. Prior to asking questions about race, identity, or department climate, researchers first prepared the interviewee with the following introduction: "The goal of the Bridge Program is to increase the number of Black, Indigenous, and Latinx graduate students in chemistry/geosciences/physics. The Bridge Programs already know how many Black, Indigenous, and Latinx students are being admitted to programs and whether they are still in graduate school, but they know less about their experiences during graduate school. We'd like to know more about that so the Bridge Program can better support students in the future. Would it be ok if I asked a few questions about this?" All eight participants agreed to provide answers to the items in this section. The first item in this portion of the interview asked the open-ended question, "Do you identify as a member of an underrepresented racial group in chemistry/geosciences/physics? How would you describe yourself?" allowing participants to self-identify rather than imposing predetermined categories. Finally, to include partners who share the background and experiences of the program participants, we recruited two students who expressed interest in the evaluation process during interviews as paid temporary employees. The students completed training in human subjects research and training in qualitative coding, including calibration activities with an experienced qualitative researcher. The students then reviewed and coded narrative data from Bridge faculty and graduate students and modified the coding scheme given their insight and experiences. They also reviewed the report section on Bridge Programs to ensure accuracy and made suggested edits. Both students were authors on the final report and presented the findings to leadership of various organizations. The insight and input of the graduate students greatly strengthened the information the evaluation team provided to leadership to inform program improvement in regard to further training needed by faculty in Bridge Programs and additional support students need to be successful. Given the success of the inclusion of program participants in the evaluation, we expanded and formalized this work into an Evaluation Committee. The Committee is Co-Chaired by one of the graduate students who initially worked on the evaluation and co-author on this conference proposal. We also recruited 7 more graduate students as paid temporary employees, representing all disciplines and demographic groups targeted in this program.