Search

Abstract Large language models (LLMs) are an exciting breakthrough in the rapidly growing field of artificial intelligence (AI), offering unparalleled potential in a variety of application domains such as finance, business, healthcare, cybersecurity, and so on. However, concerns regarding their trustworthiness and ethical implications have become increasingly prominent as these models are considered black-box and continue to progress. This position paper explores the potentiality of LLM from diverse perspectives as well as the associated risk factors with awareness. Towards this, we highlight not only the technical challenges but also the ethical implications and societal impacts associated with LLM deployment emphasizing fairness, transparency, explainability, trust and accountability. We conclude this paper by summarizing potential research scopes with direction. Overall, the purpose of this position paper is to contribute to the ongoing discussion of LLM potentiality and awareness from the perspective of trustworthiness and responsibility in AI.

Article highlights Automated control system for paper production has been developed, which has increased the accuracy and stability of regulating the weight of paper web. Fiber consumption rates decreased by 2%. The standard deviation of the weight of the paper web decreased by 1.5-2%.

In this paper, we put in dialogue the local dimension of a nation-state with the global challenges faced by universities worldwide. We focus on the case of Denmark, a nation that was exceptionally active in implementing international university reforms and where digitalisation is a high priority of the public sector governance. The article seeks to contribute to speculative research and critical studies by presenting a mixed-methods study that explores higher education teachers' views about desirable and realistic future scenarios in Denmark. The study draws on data from a survey applied at a large Danish university, analysed both quantitatively (N = 755) and qualitatively (N = 53). The findings show that teachers share clusters of concern about uncontrolled digitalisation and teaching automation, commodification of education, and modularisation of university courses, the latter being a contested but realistic perspective in the latest political reforms. They reaffirm the mission of the university as preparing students for solving real problems and contributing to the challenges of the present time. The paper concludes with a call for university management to recalibrate future imaginaries to the values expressed by the teachers, and the university they wish to create.

This paper proposes a Project-based team instruction methodology with open-ended projects to teach students critical analysis, design and implementation steps of developing Robotic Process Automation (RPA) for information systems. The use of project-based learning is appropriate for teaching RPA analysis and design with lean Six Sigma tools because of its experimental approach and documentation of logical steps needed to learn how to implement RPA successfully. The approach systematically documents work currently performed and defines future actions of the process while ensuring significant benefits are achieved with the RPA enhanced process. This methodology is important because the application of RPA is not commonly taught in Management Information System (MIS) programs. MIS students may not understand the significance of combined methodology, RPA tool, and usefulness of RPA until they enter the workforce where RPA is rapidly becoming available and easier to implement. The lecture sessions and exercises are valuable because it is easy to communicate the value of RPA in terms of time, quality, volume of transactions, etc. using Lean Six Sigma analytic approaches. The exercises involve hands on activities to make this learning experience interesting for students to readily associate the theoretical process improvement agreement and visualize the practical value of RPA enhanced projects. The paper discusses the need for process changes (and new development approaches) in organization to match the properties and functions within enterprise systems and ERPs that has led to criticism of the enterprise systems. This criticism is attributable to the ERPs' many subfunctions and operations that have limited adaptability and reduced functional and operational flexibility. The RPAs require limited prior knowledge of ERPs or their sub-processes for the improvements that are made in the performance of the organization. Thus, students do not have to "learn" how these enterprise or ERP systems operate to make changes or task improvements. This paper presents a project-based methodology and design approach focusing on development of RPAs that help students learning how to make the improvements using the RPS tools. The students learn that projects can deliver significant and tangible benefits to organizations while engaging students in key activities of the analysis, design and development process from a low code-no code perspective.

Institutional discovery environments now serve as central resource databases for researchers in the academic environment. Over the last several decades, there have been numerous discovery layer research inquiries centering primarily on user satisfaction measures of discovery system effectiveness. This study focuses on the creation of a largely automated method for evaluating discovery layer quality, utilizing the bibliographic sources from student research projects. Building on past research, the current study replaces a semiautomated Excel Fuzzy Lookup Add-In process with a fully scripted R-based approach, which employs the stringdist R package and applies the Jaro-Winkler distance metric as the matching evaluator. The researchers consider the error rate incurred by relying solely on an automated matching metric. They also use Open Refine for normalization processes and package the tools together on an OSF site for other institutions to use. Since the R-based approach does not require special processing or time and can be reproduced with minimal effort, it will allow future studies and users of our method to capture larger sample sizes, boosting validity. While the assessment process has been streamlined and shows promise, there remain issues in establishing solid connections between research paper bibliographies and discovery layer use. Subsequent research will focus on creating alternatives to paper titles as search proxies that better resemble genuine information-seeking behavior and comparing undergraduate and graduate student interactions within discovery environments. [ABSTRACT FROM AUTHOR]

Large language models (LLMs) are an exciting breakthrough in the rapidly growing field of artificial intelligence (AI), offering unparalleled potential in a variety of application domains such as finance, business, healthcare, cybersecurity, and so on. However, concerns regarding their trustworthiness and ethical implications have become increasingly prominent as these models are considered black-box and continue to progress. This position paper explores the potentiality of LLM from diverse perspectives as well as the associated risk factors with awareness. Towards this, we highlight not only the technical challenges but also the ethical implications and societal impacts associated with LLM deployment emphasizing fairness, transparency, explainability, trust and accountability. We conclude this paper by summarizing potential research scopes with direction. Overall, the purpose of this position paper is to contribute to the ongoing discussion of LLM potentiality and awareness from the perspective of trustworthiness and responsibility in AI. [ABSTRACT FROM AUTHOR]

This paper explores international students' engagement with educational technology for self-regulated English learning at an Australian university. Despite the increased use of automated feedback systems (AFSs) for language assessment, students' critical engagement with them for independent learning remains under-researched. The study primarily employed a qualitative approach to understand the students' preferred AFS tools and critical engagement throughout their personalised learning journeys but it also included a small-scale quantitative component. Data were gathered from seven students' e-portfolios, focus group interviews as well as a survey among 32 participants. Results highlight positive perceptions and successful use of AFSs, with students leveraging these tools to identify improvement areas, track progress and gain confidence. The study emphasises the importance of course structure, teacher guidance and a combination of human and automated feedback, in fostering learner autonomy and emotional self-regulation. The paper underscores the potential for sustained use of AFSs beyond the cours, and the significance of guiding learners to critically use these tools for ongoing learning and growth rather than dependence. These findings have significant implications, as readily available artificial intelligence tools such as ChatGPT hold great pedagogical potential for self-regulated learning within and beyond the language learning field.

Ensuring equity in education is a goal for sustainable development. Among the factors that hinder equity, socioeconomic status (SES) has the highest impact on learning Mathematics. This paper addresses the issue of equity at the secondary school level by proposing an approach based on adopting automatic formative assessment (AFA). Carefully designed mathematical activities with interactive feedback were experimented with a sample of 299 students of grade 8 for a school year. A control group of 257 students learned the same topics using traditional methodologies. Part of the sample belonged to low SES. The learning achievement was assessed through pre-and post-tests to understand if the adoption of AFA impacted learning and whether the results depended on the students' SES. The results show a positive effect of the experimentation (effect size: 0.42). Moreover, the effect size of the experimentation restricted to the low-SES group is high (0.77). In the treatment group, the results do not depend on SES, while in the control group, they do, suggesting that AFA is an equitable approach while traditional instruction risks perpetuating inequalities.

Purpose: Chatbots and artificial intelligence (AI) have the potential to alleviate some of the challenges faced by humans. Faculties frequently swamped with teaching and research may find it difficult to act in a parental role for students by offering them individualized advice. Hence, the primary purpose of this study is to review the literature on chatbots and AI in light of their role in auto-advising systems. The authors aimed to gain insights into the most pertinent topics and concerns related to robo academic advisor and identify any gaps in the literature that could serve as potential avenues for further research. Design/methodology/approach: The research employs a systematic literature review and bibliometric techniques to find 67 primary papers that have been published between 1984 and 2023. Using the Scopus database, the researchers built a summary of the literature on chatbots and AI in academic advice. Findings: Chatbot applications can be a promising approach to address the challenges of balancing personalized student advising with automation. More empirical research is required, especially on chatbots and other AI-based advising systems, to understand their effectiveness and how they can be integrated into educational settings. Research limitations/implications: This research's sample size may restrict its findings' generalizability. Furthermore, the study's focus on chatbots may overlook the potential benefits of other AI technologies in enhancing robo academic advising systems. Future research could explore the impact of robo academic advisors in diverse societal backgrounds to gain a more comprehensive understanding of their implications. Practical implications: Higher educational institutions (HEIs) should establish a robo academic advising system that serves various stakeholders. The system's chatbots and AI features must be user-friendly, considering the customers' familiarity with robots. Originality/value: This study contributes to a better understanding of HEIs' perceptions of the adoption of chatbots and AI in academic advising by providing insightful information about the main forces behind robo academic advising, illuminating the most frequently studied uses of chatbots and AI in academic advising.

Artificial intelligence (AI) and automation are newly impacting the governance of international students, a temporary resident category significant for both direct economic contributions and the formation of a "pool" of potential future immigrants in many immigrant-dependent countries. This paper focuses on tensions within Canada's education-migration ("edugration") system as new technologies intersect with migration regimes, which in turn relate to broader issues of security, administrative burdens, migration governance, and border imperialism. Using an Accidental Ethnography (AccE) approach drawing from practitioner-based legal research, we discuss three themes: (1) "bots at the gate" and the guise of AI's objectivity; (2) a murky international edu-tech industry; and (3) the administrative burdens of digitalized application systems. We suggest that researchers, particularly in education, can benefit from the insights of immigration practitioners who often become aware of potential trends before those less embedded in the everyday negotiation of migration governance.

Hypothesis Descriptions are a type of manuscript dedicated to the formal description of a hypothesis, as introduced in an accompanying editorial and an examplary Hypothesis Description for the Enemy Release Hypothesis that is used in invasion biology. This questionnaire provides a template for such a Hypothesis Description manuscript. The template's format was designed for simplicity to facilitate adoption, and it can be easily extended to capture additional information, e.g. instructions for falsification or generalization, taxonomic or geographic scope, etymology, or relevant information in other research fields or other languages. The template reflects the recommended structure for a Hypothesis Description manuscript in that each of its sections provides the title for a section in a Hypothesis Description manuscript and indicates whether that section is mandatory or optional. Four sections - Keywords (mandatory), Conflicts of interest (optional), Acknowledgments (optional) and References (mandatory) - are in this template filled in for the template itself but should otherwise be adjusted for the hypothesis at hand. Comments to guide authors who work on a Hypothesis Description manuscript are provided as well. [ABSTRACT FROM AUTHOR]

Simple Summary: Automatic segmentation of organs and other regions of interest is a promising approach for reducing the workload of doctors in radiotherapeutic planning, but it can be hard for doctors and researchers to keep up with current developments. This review evaluates 807 papers and reveals trends, commonalities, and gaps in the existing corpus. A set of recommendations for conducting effective segmentation studies is also provided. This review provides a formal overview of current automatic segmentation studies that use deep learning in radiotherapy. It covers 807 published papers and includes multiple cancer sites, image types (CT/MRI/PET), and segmentation methods. We collect key statistics about the papers to uncover commonalities, trends, and methods, and identify areas where more research might be needed. Moreover, we analyzed the corpus by posing explicit questions aimed at providing high-quality and actionable insights, including: "What should researchers think about when starting a segmentation study?", "How can research practices in medical image segmentation be improved?", "What is missing from the current corpus?", and more. This allowed us to provide practical guidelines on how to conduct a good segmentation study in today's competitive environment that will be useful for future research within the field, regardless of the specific radiotherapeutic subfield. To aid in our analysis, we used the large language model ChatGPT to condense information. [ABSTRACT FROM AUTHOR]

Effective learning depends on effective feedback, which in turn requires a set of skills, dispositions and practices on the part of both students and teachers which have been termed "feedback literacy." A previously published teacher "feedback literacy competency framework" has identified what is needed by teachers to implement feedback well. While this framework refers in broad terms to the potential uses of educational technologies, it does not examine in detail the new possibilities of "automated feedback" (AF) tools, especially those that are open by offering varying degrees of transparency and control to teachers. Using analytics and artificial intelligence, open AF tools permit automated processing and feedback with a speed, precision and scale that exceeds that of humans. This raises important questions about how human and machine feedback can be combined optimally and what is now required of teachers to use such tools skillfully. The paper addresses two research questions: "Which teacher feedback competencies are necessary for the skilled use of open AF tools?" and "What does the skilled use of open AF tools add to our conceptions of teacher feedback competencies?" We conduct an analysis of published evidence concerning teachers' use of open AF tools through the lens of teacher feedback literacy, which produces summary matrices revealing relative strengths and weaknesses in the literature, and the relevance of the feedback literacy framework. We conclude firstly, that when used effectively, open AF tools exercise a range of teacher feedback competencies. The paper thus offers a detailed account of the nature of teachers' feedback literacy practices within this context. Secondly, this analysis reveals gaps in the literature, signalling opportunities for future work. Thirdly, we propose several examples of "automated feedback literacy," that is, distinctive teacher competencies linked to the skilled use of open AF tools.

The pandemic has accelerated technological advances in higher education. Learning management systems that make use of the persistent platform, a wide range of communication options, and profoundly immersive qualities quickly become the platform of choice for learning management systems. The blockchain enables non-fungible tokens (NFTs) and uses the blockchain architecture to validate college diplomas and transcripts, opening the way for a diverse variety of e-portfolios owned and shared by students and teachers. Another type of blockchain that is relatively new to the education scene is decentralized autonomous organizations (DAOs). Through this, technology courses, certificates, and more can become automated and authenticated on the blockchain. The current state of the web is rapidly evolving into what is known as Web 3.0. It is the emerging evolution of the internet to make it machine-readable, which includes leveraging technologies such as artificial intelligence (AI), the cloud, and distributed ledger technologies such as blockchain. From the perspectives of the university and the metaverse, this paper discusses the shift in education brought about by NFTs, DAOs, Web 3.0, and the metaverse. The powerful mix of Web 3.0 and the metaverse is about to revolutionize the way people learn and teach in the modern world.

Although automation is not a novelty, high hopes are currently pinned on more and more ingenious devices built with Artificial Intelligence (AI). AI has become a key discussion point in the agendas of governments and multinational agencies, with particular interest in educational applications. This article explores parallels between ideas surrounding AI in education and conceptions proposed in the 17th century by Jan Amos Comenius, known as the father of modern education. Drawing upon illustrations from ongoing research that takes metaphor as its core analytical category, the piece assumes that metaphors are not mere stylistic elements, but strategic persuasive devices. Comenius' "didachography," a portmanteau coined in his 1657 "Didactica Magna" to describe an inclusive educational system, relies heavily on metaphors that suggest remarkable similarities with contemporary EdTech rhetoric, especially on AI-related developments. Whilst exemplifying that ideas and premises entailed in current discourses on EdTech may hark back to centuries-old ideas, the paper argues that, despite taking on varying, contextually situated linguistic expressions, underlying metaphors appear to have endured from Comenius' time to support the advent of an educational system poised to automate teaching and, thus, dispense with a key part of his scheme: the teacher. In closing, the piece suggests that we may need to acknowledge the contingent nature of teaching and learning, perhaps accepting that key aspects of what makes us human may always resist engineering.

Purpose: Artificial intelligence (AI) chatbots, such as ChatGPT and GPT-4, developed by OpenAI, have the potential to revolutionize education. This study explores the potential benefits and challenges of using ChatGPT in education (or "educative AI"). Design/Approach/Methods: This paper proposes a theoretical framework called "IDEE" for educative AI such as using ChatGPT and other generative AI in education, which includes identifying the desired outcomes, determining the appropriate level of automation, ensuring ethical considerations, and evaluating effectiveness. Findings: The benefits of using ChatGPT in education or more generally, educative AI, include a more personalized and efficient learning experience for students as well as easier and faster feedback for teachers. However, challenges such as the untested effectiveness of the technology, limitations in the quality of data, and ethical and safety concerns must also be considered. Originality/Value: This study explored the opportunities and challenges of using ChatGPT in education within the proposed theoretical framework.

There is an increasing interest and growing practice in Citizen Science (CS) that goes along with the usage of websites for communication as well as for capturing and processing data and materials. From an educational perspective, it is expected that by integrating information about CS in a formal educational setting, it will inspire teachers to create learning activities. This is an interesting case for using bots to automate the process of data extraction from online CS platforms to better understand its use in educational contexts. Although this information is publicly available, it has to follow GDPR rules. This paper aims to explain (1) how CS communicates and is promoted on websites, (2) how web scraping methods and anonymization techniques have been designed, developed and applied to collect information from online sources and (3) how these data could be used for educational purposes. After the analysis of 72 websites, some of the results obtained show that only 24.8% includes detailed information about the CS project and 48.61% includes information about educational purposes or materials.

Formative assessment is about providing and using feedback and diagnostic information. On this basis, further learning or further teaching should be adaptive and, in the best case, optimized. However, this aspect is difficult to implement in reality, as teachers work with a large number of students and the whole process of formative assessment, especially the evaluation of student performance takes a lot of time. To address this problem, this paper presents an approach in which student performance is collected through a concept map and quickly evaluated using Machine Learning techniques. For this purpose, a concept map on the topic of mechanics was developed and used in 14 physics classes in Germany. After the student maps were analysed by two human raters on the basis of a four-level feedback scheme, a supervised Machine Learning algorithm was trained on the data. The results show a very good agreement between the human and Machine Learning evaluation. Based on these results, an embedding in everyday school life is conceivable, especially as support for teachers. In this way, the teacher can use and interpret the automatic evaluation and use it in the classroom.

Automated essay scoring (AES) has become a valuable tool in educational settings, providing efficient and objective evaluations of student essays. However, the majority of AES systems have primarily focused on native English speakers, leaving a critical gap in the evaluation of non-native speakers' writing skills. This research addresses this gap by exploring the effectiveness of automated essay-scoring methods specifically designed for non-native speakers. The study acknowledges the unique challenges posed by variations in language proficiency, cultural differences, and linguistic complexities when assessing non-native speakers' writing abilities. This work focuses on the automated student assessment prize and Khon Kaen University academic English language test dataset and presents an approach that leverages variants of the long short-term memory network model to learn features and compare results with the Kappa coefficient. The findings demonstrate that the proposed framework and approach, which involve joint learning of different essay representations, yield significant benefits and achieve results comparable to state-of-the-art deep learning models. These results suggest that the novel text representation proposed in this paper holds promise as a new and effective choice for assessing the writing tasks of non-native speakers. The result of this study can apply to advance educational assessment practices and promote equitable opportunities for language learners worldwide by enhancing the evaluation process for non-native speakers.

The increasing volume of large-scale assessment data poses a challenge for testing organizations to manage data and conduct psychometric analysis efficiently. Traditional psychometric software presents barriers, such as a lack of functionality for managing data and conducting various standard psychometric analyses efficiently. These challenges have resulted in high costs to achieve the desired research and analysis outcomes. To address these challenges, we have designed and implemented a modernized data pipeline that allows psychometricians and statisticians to efficiently manage the data, conduct psychometric analysis, generate technical reports, and perform quality assurance to validate the required outputs. This modernized pipeline has proven to scale with large databases, decrease human error by reducing manual processes, efficiently make complex workloads repeatable, ensure high quality of the outputs, and reduce overall costs of psychometric analysis of large-scale assessment data. This paper aims to provide information to support the modernization of the current psychometric analysis practices. We shared details on the workflow design and functionalities of our modernized data pipeline, which provide a universal interface to large-scale assessments. The methods for developing non-technical and user-friendly interfaces will also be discussed.

This paper compares the speaking scores generated by two online systems that are designed to automatically grade student speech and provide personalized speaking feedback in an EFL context. The first system, "Speech Assessment for Moodle" ("SAM"), is an open-source solution developed by the author that makes use of Google's speech recognition engine to transcribe speech into text which is then automatically scored using a phoneme-based algorithm. "SAM" is designed as a custom quiz type for "Moodle," a widely adopted open-source course management system. The second auto-scoring system, "EnglishCentral," is a popular proprietary language learning solution which utilizes a trained intelligibility model to automatically score speech. Results of this study indicated a positive correlation between the speaking scores generated by both systems, meaning students who scored higher on the "SAM" speaking tasks also tended to score higher on the "EnglishCentral" speaking tasks and vice versa. In addition to comparing the scores generated from these two systems against each other, students' computer-scored speaking scores were compared to human-generated scores from small-group face-to-face speaking tasks. The results indicated that students who received higher scores with the online computer-graded speaking tasks tended to score higher on the human-graded small-group speaking tasks and vice versa.