Search

The insertion of Machine Learning (ML) in everyday life demonstrates the importance of popularizing an understanding of ML already in school. Accompanying this trend arises the need to assess the students’ learning. Yet, so far, few assessments have been proposed, most lacking an evaluation. Therefore, we evaluate the reliability and validity of an automated assessment of the students’ learning of an image classification model created as a learning outcome of the “ML for All!” course. Results based on data collected from 240 students indicate that the assessment can be considered reliable (coefficient Omega = 0.834/Cronbach's alpha α=0.83). We also identified moderate to strong convergent and discriminant validity based on the polychoric correlation matrix. Factor analyses indicate two underlying factors “Data Management and Model Training” and “Performance Interpretation”, completing each other. These results can guide the improvement of assessments, as well as the decision on the application of this model in order to support ML education as part of a comprehensive assessment.

Information technology (IT) is transforming the world. Therefore, exposing students to computing at an early age is important. And, although computing is being introduced into schools, students from a low socio-economic status background still do not have such an opportunity. Furthermore, existing computing programs may need to be adjusted in accordance to the specific characteristics of these students in order to help them to achieve the learning goals. Aiming at bringing computing education to all middle and high-school students, we performed a systematic literature review, in order to analyze the content, pedagogy, technology, as well as the main findings of instructional units that teach computing in this context. First results show that these students are able to learn computing, including concepts ranging from algorithms and programming languages to artificial intelligence. Difficulties are mainly linked to the lack of infrastructure and the lack of pre-existing knowledge in using IT as well as creating computing artifacts. Solutions include centralized teaching in assistive centers as well as a stronger emphasis on unplugged strategies. However, there seems to be a lack of more research on teaching computing to students from a low socio-economic status background, unlocking their potential as well to foster their participation in an increasing IT market.

Knowledge about Machine Learning is becoming essential, yet it remains a restricted privilege that may not be available to students from a low socio-economic status background. Thus, in order to provide equal opportunities, we taught ML concepts and applications to 158 middle and high school students from a low socio-economic background in Brazil. Results show that these students can understand how ML works and execute the main steps of a human-centered process for developing an image classification model. No substantial differences regarding class periods, educational stage, and sex assigned at birth were observed. The course was perceived as fun and motivating, especially to girls. Despite the limitations in this context, the results show that they can be overcome. Mitigating solutions involve partnerships between social institutions and university, an adapted pedagogical approach as well as increased on-by-one assistance. These findings can be used to guide course designs for teaching ML in the context of underprivileged students from a low socio-economic status background and thus contribute to the inclusion of these students.

Machine Learning (ML) is becoming increasingly present in our lives. Thus, it is important to introduce ML already in High School, enabling young people to become conscious users and creators of intelligent solutions. Yet, as typically ML is taught only in higher education, there is still a lack of knowledge on how to properly teach younger students. Therefore, in this systematic literature review, we analyze findings on teaching ML in High School with regard to content, pedagogical strategy, and technology. Results show that High School students were able to understand and apply basic ML concepts, algorithms and tasks. Pedagogical strategies focusing on active problem/project-based hands-on approaches were successful in engaging students and demonstrated positive learning effects. Visual as well as text-based programming environments supported students to build ML models in an effective way. Yet, the review also identified the need for more rigorous evaluations on how to teach ML.

Although Machine Learning (ML) is used already in our daily lives, few are familiar with the technology. This poses new challenges for students to understand ML, its potential, and limitations as well as to empower them to become creators of intelligent solutions. To effectively guide the learning of ML, this article proposes a scoring rubric for the performance-based assessment of the learning of concepts and practices regarding image classification with artificial neural networks in K-12. The assessment is based on the examination of student-created artifacts as a part of open-ended applications on the use stage of the Use-Modify-Create cycle. An initial evaluation of the scoring rubric through an expert panel demonstrates its internal consistency as well as its correctness and relevance. Providing a first step for the assessment of concepts on image recognition, the results may support the progress of learning ML by providing feedback to students and teachers.

Although Machine Learning (ML) has already become part of our daily lives, few are familiar with this technology. Thus, in order to help students to understand ML, its potential, and limitations and to empower them to become creators of intelligent solutions, diverse courses for teaching ML in K-12 have emerged. Yet, a question less considered is how to assess the learning of ML. Therefore, we performed a systematic mapping identifying 27 instructional units, which also present a quantitative assessment of the students’ learning. The simplest assessments range from quizzes to performance-based assessments assessing the learning of basic ML concepts, approaches, and in some cases ethical issues and the impact of ML on lower cognitive levels. Feedback is mostly limited to the indication of the correctness of the answers and only a few assessments are automated. These results indicate a need for more rigorous and comprehensive research in this area.

In today’s society, creativity plays a key role, emphasizing the importance of its development in K-12 education. Computing education may be an alternative for students to extend their creativity by solving problems and creating computational artifacts. Yet, there is little systematic evidence available to support this claim, also due to the lack of assessment models. This article presents SCORE, a model for the assessment of creativity in the context of computing education in K-12. Based on a mapping study, the model and a self-assessment questionnaire are systematically developed. The evaluation, based on 76 responses from K-12 students, indicates a high internal reliability (Cronbach’s alpha = 0.961) and confirmed the validity of the instrument suggesting only the exclusion of 3 items that do not seem to be measuring the concept. As such, the model represents a first step aiming at the systematic improvement of teaching creativity as part of computing education.

Creativity has emerged as an important 21st-century competency. Although it is traditionally associated with arts and literature, it can also be developed as part of computing education. Therefore, this article -presents a systematic mapping of approaches for assessing creativity based on the analysis of computer programs created by the students. As result, only ten approaches reported in eleven articles have been encountered. These reveal the absence of a commonly accepted definition of product creativity customized to computer education, confirming only originality as one of the well-established characteristics. Several approaches seem to lack clearly defined criteria for effective, efficient and useful creativity assessment. Diverse techniques are used including rubrics, mathematical models and machine learning, supporting manual and automated approaches. Few performed a comprehensive evaluation of the proposed approach regarding their reliability and validity. These results can help instructors to choose and adopt assessment approaches and guide researchers by pointing out shortcomings.

The manual transformation of a user interface design into code is a costly and time-consuming process. A solution can be the automation of the generation of code based on sketches or GUI design images. Recently, Machine Learning approaches have shown promising results in detecting GUI elements for such automation. Thus, to provide an overview of existing approaches, we performed a systematic mapping study. As a result, we identified and compared 20 approaches, that demonstrate good performance results being considered useful. These results can be used by researchers and practitioners in order to improve the efficiency of the GUI design process as well as continue to evolve and improve approaches for its support.

Although Machine Learning (ML) is integrated today into various aspects of our lives, few understand the technology behind it. This presents new challenges to extend computing education early to ML concepts helping students to understand its potential and limits. Thus, in order to obtain an overview of the state of the art on teaching Machine Learning concepts in elementary to high school, we carried out a systematic mapping study. We identified 30 instructional units mostly focusing on ML basics and neural networks. Considering the complexity of ML concepts, several instructional units cover only the most accessible processes, such as data management or present model learning and testing on an abstract level black-boxing some of the underlying ML processes. Results demonstrate that teaching ML in school can increase understanding and interest in this knowledge area as well as contextualize ML concepts through their societal impact.

Knowledge about Machine Learning (ML) is becoming essential, yet it remains a restricted privilege that may not be available to students from a low socio-economic status background. Thus, in order to provide equal opportunities, we taught ML concepts and applications to 158 middle and high school students from a low socio-economic background in Brazil. Results show that these students can understand how ML works and execute the main steps of a human-centered process for developing an image classification model. No substantial differences regarding class periods, educational stage, and sex assigned at birth were observed. The course was perceived as fun and motivating, especially to girls. Despite the limitations in this context, the results show that they can be overcome. Mitigating solutions involve partnerships between social institutions and university, an adapted pedagogical approach as well as increased on-by-one assistance. These findings can be used to guide course designs for teaching ML in the context of underprivileged students from a low socio-economic status background and thus contribute to the inclusion of these students.

Teaching computational thinking in K-12 as a 21th century skill is becoming increasingly important. Computational thinking describes a specific way of reasoning building on concepts and processes derived from algorithms and programming. One way to teach these concepts is games as an effective and efficient alternative. This article presents SplashCode, a low-cost board game to reinforce basic algorithms and programming concepts. The game was developed in a systematic way following an instructional design process, and applied and evaluated in a Brazilian public school with a total of 65 students (grade 5 to 9). First results indicate that the game can have a positive impact on motivation, learning experience, and students' learning, as well as contribute positively to social interaction, relevance, and fun. Results of this study may assist in the selection of games as an instructional strategy and/or in the development of new games for teaching computational thinking.

Software Project Management (SPM) is considered important to ensure that software projects are delivered with success, with respect to project scope, time, cost and quality requirements. However, teaching SPM remains a challenging issue. In this context, educational games have been used in order to provide more practical opportunities in SPM education. Yet, there is a lack of studies with more rigorous research design in order to analyse the real effectiveness of such games. The objective of this study is to analyse the effectiveness of educational games with respect to the students' experience and learning in SPM education. An experimental study is conducted in two SPM courses, involving an experimental group, adopting games; and a control group, using traditional exercises. The results indicate that games provide a positive contribution to the students' perceived learning, as well as provide an engaging experience, mainly in terms of challenge, social interaction, fun and focused attention. Yet, no indication that the games provide a better learning effect than exercises could be identified, although the results show an increase in the students' performance over time playing the games. Results of this study may assist instructors to select such games and contribute to their adoption for SPM education.

As computing has become an integral part of our world, demand for teaching computational thinking in K-12 has increased. One of its basic competences is programming, often taught by learning activities without a predefined solution using block-based visual programming languages. Automatic assessment tools can support teachers with their assessment and grading as well as guide students throughout their learning process. Although being already widely used in higher education, it remains unclear if such approaches exist for K-12 computing education. Thus, in order to obtain an overview, we performed a systematic mapping study. We identified 14 approaches, focusing on the analysis of the code created by the students inferring computational thinking competencies related to algorithms and programming. However, an evident lack of consensus on the assessment criteria and instructional feedback indicates the need for further research to support a wide application of computing education in K-12 schools.

A importância da aprendizagem do pensamento computacional já é discutida na Educação Básica. O pensamento computacional engloba a resolução de problemas, além de outras habilidades, conhecimento de algoritmos e programação o que pode ser ensinado por meio do desenvolvimento de aplicativos móveis. Utilizando uma linguagem de programação visual, como App Inventor, estudantes da Educação Básica podem desenvolver aplicativos funcionais para smartphones, possibilitando a eles aprenderem conceitos de computação, de design de interface entre outras habilidades. É adotada como estratégia metodológica a ação computacional, uma abordagem que visa ensinar computação por meio da resolução de problemas na comunidade local. O artigo apresenta um estudo de caso avaliando a experiência de aprendizagem de estudantes no projeto “Jovens Tutores de Programação” a partir da prática pedagógica “Faça seu primeiro app”, criada pela Iniciativa Computação na Escola/INCoD/INE/UFSC em 2018, que visa ensinar pensamento computacional a jovens do Ensino Fundamental por meio do desenvolvimento de aplicativos. Além disso, os jovens colaboram ensinando o conhecimento de computação para outros alunos do Ensino Fundamental. Os resultados desse estudo de caso mostram que essa prática pedagógica pode contribuir no interesse e na motivação dos estudantes abrangendo temáticas com base na vida deles e da comunidade, e com isso oportunizando o protagonismo dos estudantes. Tais perspectivas tendem a fortalecer a construção do conhecimento e do desenvolvimento de habilidades dos estudantes, incentivando a construção ao invés de apenas consumo de tecnologia.

Diverse initiatives have emerged to popularize the teaching of computing in K-12 mainly through programming. This, however, may not cover other important core computing competencies, such as Software Engineering (SE). Thus, in order to obtain an overview of the state of the art and practice of teaching SE competences in K-12, we carried out a systematic mapping study. We identified 17 instructional units mostly adopting the waterfall model or agile methodologies focusing on the main phases of the software process. However, there seems to be a lack of details hindering large-scope adoption of these instructional units. Many articles also do not report how the units have been developed and/or evaluated. However, results demonstrating both the viability and the positive contribution of initiating SE education already in K-12, indicate a need for further research in order to improve computing education in schools contributing to the popularization of SE competencies.

O projeto Jovens Tutores de Programação tem o objetivo de capacitar jovens dos últimos anos do ensino fundamental para a aplicação e ensino de programação de aplicativos móveis, com o apoio de profissionais da indústria de software e de alunos extensionistas, ao mesmo tempo que ensina o conhecimento computacional e programação a outros alunos de uma escola pública municipal de Florianópolis. O projeto é realizado de abril a setembro de 2017. Durante o projeto são realizadas as etapas de: preparação de unidades instrucionais e ferramentas, capacitação dos participantes, formação para os tutores, realização de oficinas de programação e documentação do projeto. Os resultados observados indicam o atingimento dos objetivos do projeto, e incluem: capacitação de três jovens tutores de programação e seis profissionais da indústria, realização de oficinas de programação para cinquenta alunos da escola, diversos prêmios e destaques em feiras e eventos.

The development of computational thinking is a major topic in K-12 education. Many of these experiences focus on teaching programming using block-based languages. As part of these activities, it is important for students to receive feedback on their assignments. Yet, in practice it may be difficult to provide personalized, objective and consistent feedback. In this context, automatic assessment and grading has become important. While there exist diverse graders for text-based languages, support for block-based programming languages is still scarce. This article presents CodeMaster, a free web application that in a problem-based learning context allows to automatically assess and grade projects programmed with App Inventor and Snap!. It uses a rubric measuring computational thinking based on a static code analysis. Students can use the tool to get feedback to encourage them to improve their programming competencies. It can also be used by teachers for assessing whole classes easing their workload.

Although Machine Learning (ML) is found practically everywhere, few understand the technology behind it. This presents new challenges to extend computing education by including ML concepts in order to help students to understand its potential and limits and empowering them to become creators of intelligent solutions. Therefore, we developed an introductory course to teach basic ML concepts, such as fundamentals of neural networks as well as limitations and ethical concerns in alignment with the K-12 Guidelines for Artificial Intelligence. It also teaches the application of these concepts, by guiding the students to develop a first classification model of recycling trash images using Google Teachable Machine. In order to promote ML education, the interactive course is available online in Brazilian Portuguese to be used as an extracurricular course or in an interdisciplinary way as part of science classes covering recycling topics. The course was applied and evaluated through a series of exploratory case studies with a total of 108 middle and high school students. The results of the evaluation show that middle and high school students were able to understand ML concepts and develop an image classification model. No substantial difference with regard to the educational stage, gender and instructional mode was observed. The course was also perceived as an enjoyable learning experience motivating students to learn more about ML.

The management of contemporary software projects is unfeasible without the support of a Project Management (PM) tool. In order to enable the adoption of PM tools in practice, teaching its usage is important as part of computer education. Aiming at teaching PM tools, several approaches have been proposed, such as the development of educational PM tools. However, such approaches are typically limited with respect to content coverage and instructional support. In this context, an important technique is the provision of instructional feedback, which is essential in order to help the students to learn based on the evaluation of their own actions. In order to take advantage of this technique, this article proposes its employment in an Instructional Unit, being integrated into the PM tool dotProject+, providing automated feedback based on the project plan being developed with the tool. This technique has been evaluated through a series of case studies.

The teaching of sorting algorithms is an essential topic in undergraduate computing courses. Typically the courses are taught through traditional lectures and exercises involving the implementation of the algorithms. As an alternative, this article presents the design and evaluation of three educational games for teaching Quicksort and Heapsort. The games have been evaluated in a series of case studies, including 23 applications of the games in data structures courses at the Federal University of Santa Catarina with the participation of a total of 371 students. The results provide a first indication that such educational games can contribute positively to the learning outcome on teaching sorting algorithms, supporting the students to achieve learning on higher levels as well as to increase the students' motivation on this topic. The social interaction the games promote allows the students to cooperate or compete while playing, making learning more fun.