Search

Lessons learned from implementing evaluations for Gavi, the Vaccine Alliance and the Global Fund for AIDS, Tuberculosis, and Malaria can help inform the design and implementation of ongoing or future evaluations of complex interventions. We share 5 lessons distilled from over 7 years of experience implementing evaluations in 7 countries., Key Findings We present 5 key lessons distilled from 7 years of experience implementing evaluations in 7 countries, which include the importance of: Including an inception phase to engage stakeholders and inform a relevant, useful evaluation designAligning on the degree to which the evaluation is embedded in the program implementationMonitoring programmatic, organizational, or contextual changes and adapting the evaluation accordinglyHiring evaluators with mixed-methods expertise and using tools and approaches that facilitate mixing methodsContextualizing recommendations and clearly communicating their underlying strength of evidence Key Implications Global health initiatives, particularly those funding or implementing complex interventions, should consider embedding evaluations to understand how and why the programs are working to adapt as necessary and maximize impact.Evaluators of complex interventions should continue to share lessons learned related to balancing stakeholder priorities, aligning on “breadth” versus “depth” of the evaluation scope and ensuring use of the evaluation findings., Introduction: As global health programs have become increasingly complex, corresponding evaluations must be designed to assess the full complexity of these programs. Gavi and the Global Fund have commissioned 2 such evaluations to assess the full spectrum of their investments using a prospective mixed-methods approach. We aim to describe lessons learned from implementing these evaluations. Methods: This article presents a synthesis of lessons learned based on the Gavi and Global Fund prospective mixed-methods evaluations, with each evaluation considered a case study. The lessons are based on the evaluation team’s experience from over 7 years (2013–2020) implementing these evaluations. The Centers for Disease Control and Prevention Framework for Evaluation in Public Health was used to ground the identification of lessons learned. Results: We identified 5 lessons learned that build on existing evaluation best practices and include a mix of practical and conceptual considerations. The lessons cover the importance of (1) including an inception phase to engage stakeholders and inform a relevant, useful evaluation design; (2) aligning on the degree to which the evaluation is embedded in the program implementation; (3) monitoring programmatic, organizational, or contextual changes and adapting the evaluation accordingly; (4) hiring evaluators with mixed-methods expertise and using tools and approaches that facilitate mixing methods; and (5) contextualizing recommendations and clearly communicating their underlying strength of evidence. Conclusion: Global health initiatives, particularly those leveraging complex interventions, should consider embedding evaluations to understand how and why the programs are working. These initiatives can learn from the lessons presented here to inform the design and implementation of such evaluations.

Early detection and treatment can prevent irreversible blindness from diabetic retinopathy (DR), which is the leading cause of visual impairment among working-aged adults worldwide. Some 80% of affected persons live in low- and middle-income countries, yet lack of resources has largely prevented DR screening implementation in these world regions. Smartphone-based fundus imaging (SBFI) allows for low-cost mobile fundus examination using an adapter on a smartphone; however, key aspects such as image quality, diagnostic accuracy, and comparability of different approaches have not been systematically assessed to date.Evaluation of diagnostic technology.A total of 381 eyes of 193 patients with diabetes were recruited at outreach eye clinics in South India.We compared 4 technically different approaches of SBFI (3 approaches based on direct and 1 approach based on indirect ophthalmoscopy) in terms of image quality and diagnostic accuracy for DR screening.Image quality (sharpness/focus, reflex artifacts, contrast, and illumination), field-of-view, examination time, and diagnostic accuracy for DR screening were analyzed against conventional fundus photography and clinical examination.Smartphone-based fundus imaging based on indirect ophthalmoscopy yielded the best image quality (P0.01), the largest field-of-view, and the longest examination time (111 vs. 68-86 seconds, P0.0001). Agreement with the reference standard (Cohen's kappa 0.868) and sensitivity/specificity to detect DR were highest for the indirect SBFI approach (0.79/0.99 for any DR and 1.0/1.0 for severe DR, 0.79/1.0 for diabetic maculopathy).Smartphone-based fundus imaging can meet DR screening requirements in an outreach setting; however, not all devices are suitable in terms of image quality and diagnostic accuracy. Smartphone-based fundus imaging might aid in alleviating the burden of DR screening in low- and middle-income countries, and these results will allow for a better selection of SBFI devices in field trials for DR screening.

This study reports on the actual energy and economic performances of a water source heat pump recently installed and operated at a Glasgow Subway station in the UK using subsurface water ingress to provide heating and domestic hot water. This follows from a previous publication that detailed the empirical measurements and design of a heating system designed on the basis of a 15-month monitoring period of the water flow and temperature. The perennial water flow at a relatively high temperature enabled the system to operate more efficiently than a typical heat pump system with boreholes or trenches. The performance of the water source heat pump has been monitored for a 4-month period, and the coefficient of performance as well as the energy saving is reported in the present study. The findings of this study not only indicate the energy, carbon dioxide and financial benefits of the heating system, but also highlight key issues during the operation in such a demanding underground environment. Further renewable heat potentials for the rest of the subway network and opportunities to commercialise the excess heat energy output are explored.

When designing high performance sports equipment for Paralympic athletes, there are many unknowns for the design engineer to consider. The design challenge is an optimisation task per individual athlete. However, modelling this optimisation is difficult due to the many variables. This article presents the design of an experiment for identifying and evaluating various seating positions in Paralympic rowing by using a rowing ergometer with a modified seat. Results indicate that changing seating position has a substantial impact on per-athlete rowing performance.

The paper investigates the relationship between the forms through which products are represented and the outcomes of evaluations made by observers. In particular, the study focuses on perceived affordances of creative designs, meant as the capability of capturing original elements and corresponding functions, for products presented through static images or videos. Also thanks to the use of Eye Tracking, the experimental results show how dynamic effects that involve salient aspects of products, as well as creative features, are critical to observers’ capability of capturing design intentions.

The use of product-service systems business models is increasing in today's economy. Because the products that provide the service to the customers incur cost during their lifetime, the method of lifecycle costing finds wide-spread use. However, this paper shows the current methods have some inaccuracies when determining lifecycle costs. The methods do not consider the required number of products necessary to provide the offered service to the customers. This paper describes a new framework for lifecycle costing that includes these cost components.

Advanced Driver Assistance Systems (ADAS) require a high level of interaction between the driver and the system, depending on driving context at a particular moment. Context-aware ADAS evaluation based on vehicle data is the most prominent way to assess the complexity of ADAS interactions. In this study, we conducted interviews with the ADAS development team at Volvo Cars to understand the role of vehicle data in the ADAS development and evaluation. The interviews’ analysis reveals strategies for improvement of current practices for vehicle data-driven ADAS evaluation.

As the complexity of the systems increases, so does the complexity of designing a suitable engineering IT architecture. Challenges reach from the definition of required and consistent functionalities and interfaces to the evaluation, which combination of IT tools fulfils the required functionality, usability and interoperability in the best way. Thus, we provide a procedure, methodology and modelling support for the definition of functional and logical engineering IT architectures and their holistic evaluation. The approach is part of an overall procedure and demonstrated in an example.

Eco-Design Strategies lead to both enhanced environmental sustainability and product differentiation, which, however, takes place only if observers recognize and value these advantages. To study this aspect, a sample of 40 product pictures has been administered to 12 subjects with experience in eco-design. They were asked to evaluate whether one or more Eco-Design Strategies (in Vezzoli and Manzini's version) were implemented in each depicted product. The outcome of the evaluation was an overall fair agreement. Useful information for eco-design is inferred from nuances of the results.

The development of the industrial world that is increasingly making the production process in an industry or factory requires increasingly developing technology and materials and tools that are easy to obtain so that the production process can run smoothly. One component needed in the industrial world is a material in the form of a pipe. Some industries still do the pipe cutting process using oxy acetylene welding which still uses hand and saw saws. This is certainly not effective because the pipes have different size and thickness. To cut the pipe using oxy acetylene welding will produce less neat pieces because the process is still manual by hand and must rotate the pipe, so we need a tool to facilitate the cutting process. Pipe cutting machine using plasma cutting is a machine made to facilitate the pipe cutting process. The process of cutting pipes is cutting tools that move around to produce pieces of pipe. With this machine, it can help speed up students in the process of cutting pipes without having to rotate the pipe to be cut. The purpose of the skeletal design of the pipe cutting machine using plasma cutting is to count the elements of the machine, determine the frame of the machine, determine the design concept of the machine and make the design of the draw frame. In making this machine the author uses the design method approach of VDI 222, drawing software using Solidworks 2017 and working drawings using ISO standards. The results of the concept design evaluation decision are, the framework uses 40 x 40 x 3mm hollow iron with an estimated production time used is 15.32 hours or equal to 2 working days if it is done in 1 day for 8 hours. Then the bill of material in making the frame on this machine spent 53 parts. The best cutting results are obtained from cutting 8 mm thick pipes with a speed of 10 rpm. So from the planning, the framework on the pipe cutting machine using plasma cutting, can function properly. so we need a tool to facilitate the cutting process.

The heat treatment process using the fuel system is very numerous and the heating time is quite long. The use of induction heaters, heat treatment can be done with a shorter time and less energy. The purpose of this research are; (1) Make a plan design, (2) Measure the part of machine element, (3) Measure the estimation of time and design budget, (4) Test the result of induction heater machine. The method in this study uses experimental. The result of concept design evaluation, i.e., the use of trapezoid screw on the lifter system was 0,2 kilowatt of motor power, 12 mm of shaft diameter, and ball bearing 6201 with the age of 0,31 years which determined from the calculation of machine element on the induction heater system. The total of time for making this machine was 3.182,06 minutes and it spent Rp 5.360.700,-. The result of test shows that the hardness rate of raw material mild steel that given heat of hardening temperature of 850 0 C, that endured for 45 minutes increasing being 84,3 HRB. However, after being tempered temperature of 400 0 C having a decrease being 69 HRB.

The objectives of this study are to investigate the general patterns of the triadic components drawn from the triad problem-solving model of design and to examine how the triadic components are associated with design task, process, and outcome. We conducted the protocol analysis with trashcan design tasks at two different determinization levels and the post-experiment survey. Through the protocol analysis, we identified that both the percentage and increase rate of the solution category were highest while those of the problem category were lowest. This indicates that designers spend most times on creating solutions while least times on analyzing design problems, and these patterns of the triadic components become more dominant as the problem-solving activities progressed. Through correlation analysis, we found the positive effect of the goal-oriented problem-solving process on the concept generation and the importance of the analyzing problems to produce solutions with better functional utility.

During product development, many decisions have to be made that affect the entire product life cycle and often lead to errors that cause additional effort. To proactively support the engineer in evaluating his design in a CAD program, in this paper an approach to evaluate milling designs using a multi-agent system (MAS) is presented. The CommonKADS method is used and the MAS is validated against an application example of a gearbox housing that has been checked for design guidelines, standards, and tool or machine portfolios.

International Transaction Journal of Engineering, Management, & Applied Sciences & Technologies, 13, 7, 13A7K: 1-13

One of the great challenges of artificial spinal disc (ASD) design lies in the reproduction of the complex mechanics of an intervertebral disc (IVD) that is characterized by a viscoelastic, nonlinear, and anisotropic behavior. Although the development of multi-material additive manufacturing (AM) combined with biomimetic design provide new opportunities for the realization of ASDs with complex behavior, the influence of different biomimetic designs on the kinematics of ASD in conjunction with AM is not yet explored. Therefore, this study proposes and fabricates four types of biomimetic, multi-material ASD designs based on mimicking either the material stiffness gradient or the structure found in a natural IVD. The results show that all the designs exhibit a desired viscoelastic behavior, while the ASD design based on a chainmail-like structure exhibits a nature-mimicking nonlinear rotational load response. In terms of restoring the natural trend of an IVD's anisotropic behavior, the ASD design that mimics the structure found in an IVD outperforms the design that solely mimics an IVD's material stiffness gradient. Additionally, all the designs proposed in this study show comparable instant helical axis (IHA) and instant center of rotation (ICOR) to an IVD's regarding their location and moving direction., Materials & Design, 210, ISSN:0264-1275, ISSN:1873-4197

Multiobjective design optimization studies typically derive Pareto sets or use a scalar substitute function to capture design trade-offs, leaving it up to the designer’s intuition to use this information for design refinements and decision-making. Understanding the causality of trade-offs more deeply, beyond simple postoptimality parametric studies, would be particularly valuable in configuration design problems to guide configuration redesign. This article presents the method of multiobjective monotonicity analysis to identify root causes for the existence of trade-offs and the particular shape of Pareto sets. This analysis process involves reducing optimization models through constraint activity identification to a point where dependencies specific to the Pareto set and the constraints that cause them are revealed. The insights gained can then be used to target configuration design changes. We demonstrate the proposed approach in the preliminary design of a medical device for oral drug delivery.

The absence of existing standards for product recovery planning and the associated difficulty in prioritising the conflicting design requirements are among the main challenges faced during product design. In this paper, a concept for the Design for Multiple Life-Cycles (DFMLC) is proposed to address this situation. The objective of the DFMLC model is to assist designers in evaluating design attributes of Multiple Life-Cycle Products (MLCP) at the early design stage. The methodology adopted for the evaluation of MLCP design strategies has been based on a modified Analytical Hierarchy Process (AHP). Two mapping matrices of the design guidelines and design strategies concerning MLCP design attributes were developed for the modified AHP model. Disassemblability (> 21 %) was found to be the most important design element for MLCP followed by serviceability (> 20 %) and reassembly (> 12 %).

Background US medical schools are increasingly integrating lifestyle medicine competencies into their academic programs. Yet, physician assistant (PA) academic programs have been slower to respond. Methods We developed, implemented, and evaluated a nutrition-centered lifestyle medicine curriculum for 2nd-year PA students (n = 24). The 4-week hybrid, 2-credit hour course activities aligned with the American College of Lifestyle Medicine competencies for primary care providers and reinforced four of the Accreditation Standards for PA Education. We combined didactic lectures with weekly hands-on cooking modules from the “Health meets Food” courseware for medical students. We employed a pre-post evaluation design including a comparison group of 2nd-year PA students in a separate program. We assessed changes in personal nutrition behaviors and knowledge and confidence for counseling in nutrition, exercise/physical activity, weight, smoking, and alcohol, using the modified 5A’s framework (assess, advise, agree, assist, and arrange) for lifestyle counseling. Results Students receiving the intervention demonstrated significantly higher gains in both knowledge and confidence for the 5A’s of nutrition counseling compared to the control group. Self-reported knowledge and confidence for the 5A’s of counseling for the other lifestyle behaviors similarly improved among the intervention group compared to the control group, but to a lesser extent. Conclusion A nutrition-centered lifestyle medicine course can demonstrate PA academic program adherence to accreditation standards, while also introducing students to nutrition and lifestyle medicine competencies. Hands-on experiences that reinforce didactic instruction may maximize student knowledge and self-efficacy for implementing lifestyle medicine into their practice.

In the environment of massive data, education data analysis plays an increasingly important role in expanding education. Effective teaching management and teaching evaluation are of great significance for university teachers to renew themselves, improve classroom quality and improve teaching management. However, there are still many problems in how to improve teaching management, design evaluation indicators better, use evaluation data and analyze mining and analysis. This paper starts from the analysis of the problems, and points out that there are the following problems in Higher Education: standardized teaching, low level of scientific research management, low technical awareness, information independence of each department, and difficulties in managing teaching and scientific research data. Aiming at the related problems, this paper puts forward the innovative application ways of information management under the background of big data (BD), correctly applying the concept of BD, and creating a BD technical team, so as to improve the quality of teaching and scientific research in Colleges. Research shows that the establishment of information system for colleges in the BD environment can further provide information for university information. By improving the teaching management, we can improve the teaching management and teaching evaluation information system of Colleges, make the management of the system more scientific, intelligent and standardized, and it is also good to the development of students' learning ability, employment and enrollment.

In modern society, humans spend most of their time in the indoor environment (home, work, school...). This indoor lifestyle constantly poses challenges to our physical and mental health by affecting our hormone levels and circadian rhythm. This article deals with the possible connection between human and working environment factors and the emergence of health problems in connection with work. Using statistical methods, the dependence between the six characteristics (age, length of employment, visual demand of the work task, satisfaction with lighting conditions, and shift work) and occurrence of health-related problems and discomfort (i.e., eye discomfort, headache, eye fatigue, and seasonal affective disorder symptoms) was examined. The paper also deals with the evaluation of lighting conditions in the workshop using the lighting design software DIALux evo 9.2. Using this software, two lighting variants were modeled. The first simulated variant included lighting parameters according to the currently used luminaries and the second variant contained more efficient LED luminaries.

One of the fundamental strategies in attempts to develop athletic sports in Surabaya was to conduct special training through athletic extracurricular activities in schools, hence it was the starting point for the discovery of potential athletes. The purpose of this study was to determine the strengths, weaknesses, opportunities, and Threat from athletic extracurricular management which included Planning, Organizing, Implementing and Supervising which was conducted by Dr. Soetomo and Jalan Jawa Junior High School in Surabaya. The approach used in this study was a qualitative approach and the type of evaluative research (Evaluation Research) used descriptive methods. The evaluation design used in this study was the SWOT Analysis. The results and conclusions of this study indicated that the athletic extracurricular management at Dr Soetomo Junior High School; The Planning was already a good program, The Organizing used the organizational structure and cooperation which already existed so the working mechanism was clear of its functions and parts, The Actuating contained the schedule of activities, the attendance of students and the coaches are well-monitored by the extracurricular coordinator, The Controlling implemented a routine evaluation that carried out at the end of the school year, but for the achievements have not been as the expectation. On the other hand, Jalan Jawa Junior High School implemented the management as; The Planning of this school did not have a good program, The Organizing included the involved cooperation of leaders, teachers and parents of students was very good, The Actuating related to the exercise did not run well, The Oversight represented almost every championship in Surabaya, Jalan Jawa Junior High School got good marks. The researchers have conducted more in-depth analysis of the strengths, weaknesses, opportunities, and Threat of athletic extracurricular management which included Planning, Organizing, Implementing and Supervising which was conducted by Dr Soetomo and Jalan Jawa Junior High School in Surabaya, furthermore resulting some recommendations for Dr. Soetomo and Jalan Jawa Junior High School.

Fathers are under-represented in pediatric palliative care research despite frequently playing a key role in the lives of their children. The purpose of this study was to identify factors that affected paternal study invitation and participation. A secondary mixed-methods evaluation design guided examination of interview and focus group data as well as field notes from a qualitative study that examined the experiences and support needs of fathers of children with a life-limiting illness. Facilitators of paternal participation in the study consisted of: fathers' desire to gain from study participation either for themselves or others, perception of the study's importance, sense of appreciation for the study's focus on fathers and an established relationship with recruiting health care providers. Barriers to study participation included: recruiting health care providers' appraisal of fathers' lack of well-being, bereaved fathers' self-reported poor coping and the inability to locate and contact fathers, particularly after a child's death. Strategies for improving the engagement of fathers into research entailed: educating recruitment personnel, designing "father-focused" studies, communicating the value of the research to recruitment personnel and potential participants, and ensuring that child health records are accurate and include fathers' contact information.

Pay attention to the home living environment of low-and middle-income groups, study the user-centered design evaluation method to guide the design of home chairs suitable for low-and middle-income groups. Introducing Analytic Hierarchy Process（AHP）into home chairs’ design evaluation, it establishes a different layer and different elements structure model based on sensory experience, behavioral experience, emotional experience and economic experience from the point of user experience. Scoring each element, it calculates and determines the weight value of every element, and forms an evaluation method of home chairs for low-and middle-income Groups. Using the method to evaluate the design schemes of 3 home chairs, it obtains the optimal scheme. Then, surveying the market sales data to verify the accuracy of the result. The evaluation method consists of four major elements: sensory experience(B1), 27%; behavior experience(B2), 41%; emotional experience(B3), 10%; economic experience(B4), 22%. The method can effectively solve the complex comparison of multiple elements in design evaluation and provide a comprehensive method combining qualitative and quantitative methods for product design, and provides reference for products design and evaluation of the same type

The active design evaluation on the media of active living around urban public space The rise of development, technology and culture in urban communities has produced various positive and negative impacts, one of the negative impacts is the decline in public health factors and the increase of various cardiovascular diseases in urban communities caused by sedentary lifestyle. Based on this phenomenon we began to develop the Active Design principle. The active design is a design principles to makes some environment that can stimulate its users to carry out physical activity naturally. The active design principles has a significant impact on improving public health factors when applied around the centre of communities activities. Along with this phenomenon, the city of Bandung has carried out various revitalization on its public open spaces, one of which is revitalization in the Saparua park, which has become the centre of community activities in sports and recreation. This is a qualitative-descriptive study with the aim of evaluation. The research begins by formulating active design indicators from various literatures, then evaluating the object of study based on the indicators. Produce an understanding of the extent to which the principles of active design materialize on the object of study, the potential for future development and any manifestations that can be used as examples for design elsewhere. © 2019 Raden Rangga Ilham Irfandian, Herman Wilianto

Design intelligence is an important branch of artificial intelligence (AI), focusing on the intelligent models and algorithms in creativity and design. In the context of AI 2.0, studies on design intelligence have developed rapidly. We summarize mainly the current emerging framework of design intelligence and review the state-of-the-art techniques of related topics, including user needs analysis, ideation, content generation, and design evaluation. Specifically, the models and methods of intelligence-generated content are reviewed in detail. Finally, we discuss some open problems and challenges for future research in design intelligence.

College students frequently use mobile devices (e.g., smartphones and tablets) to access online courses yet online course designers often do not design courses with mobile learning in mind. This research identified seven national and statewide online course design evaluation instruments and examined the criteria that guide course designers designing online courses for learning with mobile devices. Currently, minimal guidance on course design for mobile learning is offered in most of the national and statewide online course design instruments. Research-supported design tips that promote device compatibility, content readability, format optimization, and mobile-friendly navigation are suggested in this paper to guide future online course design for mobile delivery.

L’Ufficio di Presidenza della "Commissione parlamentare d’inchiesta sul fenomeno degli infortuni sul lavoro e delle malattie professionali" del Senato della Repubblica, ha promosso un’attività di valutazione delle politiche di propria competenza, che testimonia, insieme a molte altre, del crescente interesse manifestato dal Senato per il tema della valutazione. La Commissione ha incaricato alcuni esperti del CNR di avviare dapprima uno studio di fattibilità e, a seguire, un’attività di valutazione relativa agli incentivi agli investimenti in sicurezza nei luoghi di lavoro. Il lavoro presenta non solo le caratteristiche del disegno di valutazione (lo studio non è concluso) ma soprattutto l’esperienza fatta nella relazione fra valutatore, committente e ente gestore. Il ruolo particolare della valutazione nella missione degli organi legislativi impone sia caratteristiche specifiche alla valutazione stessa, sia peculiarità nel rapporto con il committente che vengono esaminate nel saggio.

this article researches problems of designing restaurant and café menus. Description of different menu types and graphical requirements of restaurant menu were discussed. Analyzing Uzbek restaurants and fast-food menus author forms table of evaluation design and translation of menu. Given recommendations can be used as marketing guideline in restaurant business and will help to increase service in restaurants , cafes and fast foods.

The success in the modern era is determined by how students strive to have certain skills. This can be achieved by students through the development of cognitive domain, because it is considered as the ability to master subject matter with regard to thinking ability in addition to learning. Hence, this research aims at improving the learning outcomes in the cognitive domain of students at the primary school level. This research was conducted using the Pre-Experiment method with the pretest-posttest One-Group design. The lessons were implemented using Science, Technology, Engineering, and Mathematics (STEM)-based learning, while the learning method was referred to the Engineering Design Process. The stages consist of problem scoping, idea generation, design and construct, design evaluation and re-design. The research involved 30 fourth grade primary school students in Cimahi City as the research samples. The data were collected using observation and analyzed using quantitative descriptive analysis. The research results revealed that there were differences in learning outcomes in the cognitive domain. To conclude, STEM-based learning could improve primary school students’ cognitive skills.