Search

Abstract: It has repeatedly been demonstrated that automatic speech recognition can benefit from syntactic information. However, virtually all syntactic language models for large-vocabulary continuous speech recognition are based on statistical parsers. In this paper, we investigate the use of a formal grammar as a source of syntactic information. We describe a novel approach to integrating formal grammars into speech recognition and evaluate it in a series of experiments. For a German broadcast news transcription task, the approach was found to reduce the word error rate by 9.7% (relative) compared to a competitive baseline speech recognizer. We provide an extensive discussion on various aspects of the approach, including the contribution of different kinds of information, the development of a precise formal grammar and the acquisition of lexical information. [Copyright &y& Elsevier]

Background: Formative assessments are needed to enable monitoring how student knowledge develops throughout a unit. Constructed response items which require learners to formulate their own free‐text responses are well suited for testing their active knowledge. However, assessing such constructed responses in an automated fashion is a complex task and requires the application of natural language processing methodology. In this article, we implement and evaluate multiple machine learning models for coding energy knowledge in free‐text responses of German K‐12 students to items in formative science assessments which were conducted during synchronous online learning sessions. Dataset: The dataset we collected for this purpose consists of German constructed responses from 38 different items dealing with aspects of energy such as manifestation and transformation. The units and items were implemented with the help of project‐based pedagogy and evidence‐centered design, and the responses were coded for seven core ideas concerning the manifestation and transformation of energy. The data was collected from students in seventh, eighth and ninth grade. Methodology: We train various transformer‐ and feature‐based models and compare their ability to recognize the respective ideas in students' writing. Moreover, as domain knowledge and its development can be formally modeled through knowledge networks, we evaluate how well the detection of the ideas within responses translated into accurate co‐occurrence‐based knowledge networks. Finally, in terms of the descriptive accuracy of our models, we inspect what features played a role for which prediction outcome and if the models pick up on undesired shortcuts. In addition to this, we analyze how much the models match human coders in what evidence within responses they consider important for their coding decisions. Results: A model based on a modified GBERT‐large can achieve the overall most promising results, although descriptive accuracy varies much more than predictive accuracy for the different ideas assessed. For reasons of comparability, we also evaluate the same machine learning architecture using the SciEntsBank 3‐Way benchmark with an English RoBERTa‐large model, where it achieves state‐of‐the‐art results in two out of three evaluation categories. Lay Description: What is already known about this topic?: Formative assessments are needed to test and monitor the development of learners' knowledge throughout a unit to provide them with appropriate automated feedback.Constructed response items which require learners to formulate their own free‐text responses are well suited for testing their active knowledge.Assessing constructed responses in an automated fashion is a widely researched topic, but the problem is far from solved and most of the work focuses on predicting holistic scores or grades.To allow for a more fine‐grained and analytic assessment of learners' knowledge, systems which go beyond predicting simple grades are required.To guarantee that models are stable and make their predictions for the correct reasons, methods for explaining the models are required. What this papers adds?: A core topic in physics education is the concept of energy.We implement and evaluate multiple systems based on natural language processing technology for assessing learners' conceptual knowledge about energy physics using transformer language models as well as feature‐based approaches.The systems assess students' knowledge about various forms of energy, indicators for the same and the transformation of energy from form into another.As our systems are based on machine learning methodology, we introduce a novel German short answer dataset for training them to detect the respective knowledge elements within students' free‐text responses.We evaluate the performance of these systems using this dataset as well as the well‐established SciEntsBand‐3‐Way dataset and manage to achieve, to our best knowledge, new state‐of‐the‐art results for the latter.Moreover, we apply methodology for explaining model predictions to assess whether predictions are carried out for the correct reasons. Implications for practice and/or policy: It is indeed possible to assess constructed responses for the demonstrated knowledge about energy physics in an analytic fashion using natural language processing.Transformer language models can outperform more specialized feature‐based approaches for this task in terms of predictive and descriptive accuracy.Co‐occurrences of different concepts within the same responses can lead models to learn undesired shortcuts which make them unstable. [ABSTRACT FROM AUTHOR]

Supervised machine learning (SML) provides us with tools to efficiently scrutinize large corpora of communication texts. Yet, setting up such a tool involves plenty of decisions starting with the data needed for training, the selection of an algorithm, and the details of model training. We aim at establishing a firm link between communication research tasks and the corresponding state-of-the-art in natural language processing research by systematically comparing the performance of different automatic text analysis approaches. We do this for a challenging task – stance detection of opinions on policy measures to tackle the COVID-19 pandemic in Germany voiced on Twitter. Our results add evidence that pre-trained language models such as BERT outperform feature-based and other neural network approaches. Yet, the gains one can achieve differ greatly depending on the specific merits of pre-training (i.e., use of different language models). Adding to the robustness of our conclusions, we run a generalizability check with a different use case in terms of language and topic. Additionally, we illustrate how the amount and quality of training data affect model performance pointing to potential compensation effects. Based on our results, we derive important practical recommendations for setting up such SML tools to study communication texts. [ABSTRACT FROM AUTHOR]

Research Findings: We assessed socio-emotional behavior, nonverbal reasoning, German receptive language, and motor skills of refugee children attending early childhood development [ECD] programs and of those who did not (N = 207, mean age = 69.4 months). Young refugee children overall demonstrated lower levels of development and more socio-emotional behavior problems. Attendance of preschool-based ECD programs was inconsistently linked to better outcomes. Only moderate improvements in German receptive language skills could be supported across different methodological approaches. Although socio-emotional problems of refugee children attending ECD programs persisted on high levels, those children showed overall fewer problems when compared to non-attenders at the transition to first grade, especially less hyperactivity/inattention and more prosocial behavior. Practice or Policy: Our study supports that refugee experiences during early childhood are linked to lower developmental learning foundations. Specialized ECD programs for refugees can compensate a general shortage in regular ECD services in times of increased demands. Such programs thus increase the chances of refugee children to keep pace academically with their non-refugee peers. However, as specialized programs for refugee children establish a non-inclusive route in the early education sector of Germany, they still have to empirically prove quality and promoting effects on the children's ECD. [ABSTRACT FROM AUTHOR]

Touch interaction has established a dominating role in the realisation of Human–Machine Interfaces. However, to be able to use touch effectively and efficiently, users have to comply with particular prerequisites. Due to age-related changes, such as the decline of tactile accuracy and speed, especially elderly users often struggle with the touch modality. Interfaces that adapt to specific user characteristics could be a promising solution to overcome this problem. Notwithstanding the advantages of adaptive systems, perceived changes in the user interface can reduce the system's predictability and transparency. The present study compares three approaches concerning the adaptation of touch button sizes: no adaptation and adaptation with visible and invisible feedback. Results show that especially elderly users substantially benefit from an adaptive approach. Furthermore, data shows that the type of adaptation supports different usage goals. While adaption with visual feedback enables a higher interaction speed, invisible adaptation leads to a higher degree of accuracy. [ABSTRACT FROM AUTHOR]

The prediction of near-surface ozone concentrations is important for supporting regulatory procedures for the protection of humans from high exposure to air pollution. In this study, we introduce a data-driven forecasting model named "IntelliO3-ts", which consists of multiple convolutional neural network (CNN) layers, grouped together as inception blocks. The model is trained with measured multi-year ozone and nitrogen oxide concentrations of more than 300 German measurement stations in rural environments and six meteorological variables from the meteorological COSMO reanalysis. This is by far the most extensive dataset used for time series predictions based on neural networks so far. IntelliO3-ts allows the prediction of daily maximum 8 h average (dma8eu) ozone concentrations for a lead time of up to 4 d, and we show that the model outperforms standard reference models like persistence models. Moreover, we demonstrate that IntelliO3-ts outperforms climatological reference models for the first 2 d, while it does not add any genuine value for longer lead times. We attribute this to the limited deterministic information that is contained in the single-station time series training data. We applied a bootstrapping technique to analyse the influence of different input variables and found that the previous-day ozone concentrations are of major importance, followed by 2 m temperature. As we did not use any geographic information to train IntelliO3-ts in its current version and included no relation between stations, the influence of the horizontal wind components on the model performance is minimal. We expect that the inclusion of advection–diffusion terms in the model could improve results in future versions of our model. [ABSTRACT FROM AUTHOR]

Research Findings: Are family literacy activities linked to gains in preschool-aged dual language learners' (DLLs') societal language vocabulary? To understand connections between literacy activities and vocabulary, we separately considered literacy activities in the respective heritage language and in the societal language, German, and accounted for heterogeneity in DLLs' family and preschool language environment. DLLs (n = 115) were administered the German PPVT-4 twice (at 40 and 51 months). Literacy activities as well as other family language environment variables were reported by mothers. Classroom language stimulation was observed with the CLASS Pre-K language modeling scale. Two different models of change revealed that family literacy activities in the heritage language predicted gains in German vocabulary for children with low levels of classroom language stimulation (albeit at the p = 0.10-level in one set of models). There was no evidence that literacy activities in German were positively connected to gains in German vocabulary. Practice or Policy: This study suggests that family literacy activities in the heritage language may have the potential to support societal language vocabulary. More research is needed to understand under what circumstances family literacy activities in the societal language are supportive of DLLs' societal language vocabulary.

Industry 4.0, a term invented by Wolfgang Wahlster in Germany, is celebrating its 10th anniversary in 2021. Still, the digitalization of the production environment is one of the hottest topics in the computer science departments at universities and companies. Optimization of production processes or redefinition of the production concepts is meaningful in light of the current industrial and research agendas. Both the mentioned optimization and redefinition are considered in numerous subtopics and technologies. One of the most significant topics in these areas is the newest findings and applications of artificial intelligence (AI)—machine learning (ML) and deep convolutional neural networks (DCNNs). The authors invented a method and device that supports the wiring assembly in the control cabinet production process, namely, the Wire Label Reader (WLR) industrial system. The implementation of this device was a big technical challenge. It required very advanced IT technologies, ML, image recognition, and DCNN as well. This paper focuses on an in-depth description of the underlying methodology of this device, its construction, and foremostly, the assembly industrial processes, through which this device is implemented. It was significant for the authors to validate the usability of the device within mentioned production processes and to express both advantages and challenges connected to such assembly process development. The authors noted that in-depth studies connected to the effects of AI applications in the presented area are sparse. Further, the idea of the WLR device is presented while also including results of DCNN training (with recognition results of 99.7% although challenging conditions), the device implementation in the wire assembly production process, and its users' opinions. The authors have analyzed how the WLR affects assembly process time and energy consumption, and accordingly, the advantages and challenges of the device. Among the most impressive results of the WLR implementation in the assembly process one can be mentioned—the device ensures significant process time reduction regardless of the number of characters printed on a wire. [ABSTRACT FROM AUTHOR]