Search

Science educators need tools to assess to what extent learners’ knowledge can be transferred to novel real-world situations. Virtual reality learning environments (VRLEs) offer the possibility of creating authentic tools where situated learning and assessment can take place, but there is a lack of evidence-based guidelines to inform the design and development of the VRLEs focussing on the user, that is the learner experience, especially for secondary schools. Drawing on theoretical premises and guidelines from user experience, usability, and technologically enabled assessment literature, we designed, developed, evaluated, and refined a VRLE prototype for the authentic assessment of knowledge transfer in the secondary school science classroom as guided by the design science research approach. Lessons learnt from the implementation and iterative evaluation of the prototype are presented as a set of literature-based, empirically validated guidelines to support and guide educational designers and developers to create VRLEs focused on supporting the learner experience. The contribution of this study is a VRLE design model with the learner at its core, the definition of VLX to include learner-specific aspects of immersive environments, and guidelines for the development of an effective and efficient virtual reality environment for the assessment of knowledge transfer in science education.

Collaboration among researchers and across disciplinary, organisational and cultural boundaries is essential for addressing the increasingly complex challenges and opportunities facing international development. Despite the known advantages and various incentives, research collaboration within Africa (specifically within South Africa) is lacking. To better understand the reasons for this lack of research collaboration, this study explored collaboration between students and supervisors in an information and communication technology for development (ICT4D) postgraduate student project in South Africa. South Africa, a country with major social inequalities and asymmetric power relations, provides an appropriate context. The students’ perspectives provided a space for investigating the collaboration factors by unpacking the capability inputs according to Robeyns’ representation of personal capabilities. Data were captured from a survey and focus groups (FG) with students and supervisors in ICT4D from different universities in South Africa. Thematic analysis was used to identify and link the participants’ expectations of research collaboration with their perceptions of the challenges of such collaborations. The contribution is a conceptualisation of the main components representing research collaboration viewed in terms of personal capabilities, including the factors that influence collaboration. Transdisciplinarity contribution: Research collaboration is fundamental to promoting multi-, inter- and transdisciplinary research. The novelty of this study lies in applying a theoretical lens from the field of human development to explore research collaboration in the transdisciplinary field of ICT4D. Given the research application context and the theoretical lens applied, the findings have implications for initiatives and policies on funding transdisciplinary research collaboration.

The human–computer interaction for development (HCI4D) field emerged at the intersection of the fields of information and communication technology for development (ICT4D) and human–computer interaction (HCI). In 2010, Michael Best nominated HCI4D as one of ICT4D’s “grand challenges”. This HCI4D field is now entering its second decade, and it is important to reflect on the research that has been conducted, and to consider how HCI4D researchers have addressed the challenge that constitutes the raison d’être of HCI4D’s existence. Best provided four guidelines to inform researchers embracing this challenge. This study commences by identifying the primary HCI4D-specific themes, and then carries out a systematic literature review of the HCI4D literature to build a corpus to support the analysis. The corpus is analysed to reflect on how well the field’s practices align with Best’s guidelines. The overall finding is that HCI4D researchers have largely been following Best’s guidelines and that the HCI4D field is demonstrating encouraging signs of emerging maturity.

The South Africa Connect national broadband policy of 2013 aims to ensure that the country achieves universal internet access by 2030, thereby fostering digital skills development. This study investigates one dimension of the South Africa Connect policy objectives, by considering rural teachers’ adoption of information and communication technologies (ICTs) for teaching and learning at 24 schools. This research used baseline data from the Information and Communication Technology for Education (ICT4E) project undertaken in rural schools in seven South African provinces. The technology readiness index (TRI) was used as the theoretical lens. We found that the vast majority of the teachers surveyed were optimistic about the use of ICTs for teaching and learning, which suggests teachers’ readiness to use ICTs despite the existing financial, technical and digital skills challenges at their schools. We also found that the majority of the schools had policies prohibiting student use of personal digital devices, apart from calculators, on school premises. In our analysis, these policies potentially conflict with the objectives of South Africa Connect. This study contributes to theory and practice by offering empirical evidence of the usefulness of the TRI for presenting teachers’ readiness to adopt ICTs in situations of conflicting forces. The study also has the potential to contribute to policy deliberations by highlighting the possible disconnect between the schools’ bans on student personal digital devices and the objectives and targets set by the South Africa Connect policy.

Indigenous or local researchers from developing countries have not made a leading contribution to development informatics (DI) or information and communication technologies for development (ICT4D) research. This is noteworthy since these researchers should be in a prominent position to contribute to the discourse, where context knowledge is regarded as vital. Furthermore, a dependence on foreign scholarly direction can create a gap between research and reality in a way that affects the success of ICT programmes in African countries. Extant literature highlights this problem, but most studies stop short of considering the causes and proposing how to amplify the voice of developing country researchers. This paper documents the ICT4D/DI research discourse that took place during four seminal academic events in South Africa during the period 2012 to 2015. Those discussions are presented and analysed here to contribute to the wider discourse on ICT research and practice in developing countries, with the aim of enhancing the research contribution of developing countries. An interpretivist, involved researcher analysis of the workshop reports is conducted to gain an improved understanding of the South African ICT4D/DI researcher’s challenges to proportional participation. While this study takes a South African perspective, many of the findings could apply to researchers in other developing countries.

Many higher education students live and operate in mobile-centric environments. The question is whether the policies of higher education institutions (HEI) are aligned with students’ readiness for mobile technology information access and interaction. To investigate this question from a policy perspective, nine policies from the open and distance learning (ODL) university in South Africa were analysed for providing institutional mobile-centric support. Policy document analysis was used to evaluate five information and communication technology (ICT) polices and four teaching and learning policies. The analysis focused on how the policies support the provision of mobile infrastructure, technical support and learning resources. To investigate from the students’ perspective, quantitative data was captured on Information Systems students’ readiness through a survey of a total of 129 respondents from the same university. The mobile-centric readiness of students was evaluated based on factors that could affect the readiness of students in accessing and interacting with mobile-centric services. The factors investigated were infrastructure ownership, knowledge of mobile phone features and mobile phone Internet activities. The findings revealed that Information Systems students are ready to use mobile phones as tools for information access and interaction, but some inadequacies were observed in the way the policies support the students’ needs. This study proposes some recommendations on how the policies could better support students’ mobile phone information access and interaction.

In the context of assessment, two specific challenges face South African academics. The first is that their universities have experienced an unprecedented increase in postgraduate students without a concomitant increase in supervision capacity. The second challenge is that many South African students are studying in a second or third language and struggle to express themselves in English. It is notoriously difficult to write text that is easy to read. Examiners are thus finding it challenging to maintain their own existing high standards of consistency, accuracy and fairness. This paper focuses on identifying a way of making the assessment of dissertations more efficient, while retaining rigour and fairness. In so doing, we want to provide students with a tool that will help them to communicate their research more effectively. In seeking an intervention, we noted the emerging use of visualisation as a communication facilitator in other areas of academia. Given the innate human ability to understand and remember visual representations, and the deep level of cognitive processing required to produce such visualisations, the considered inclusion of visualisations could be the means we are seeking. In this paper we report on an investigation into the extant use and potential usefulness of visualisation in a number of dissertations. We also explore supervisor expectations with respect to the use of visualisation in research reporting. Based on our findings, we propose that a discourse be opened into the deliberate use of visualisation in postgraduate research reporting.

Guidelines are recommended as a tool for informing user interface design. Despite a proliferation of guidelines in the research literature, there is little evidence of their use in industry, nor their influence in academic literature. In this paper, we explore the research literature related to mobile phone design guidelines to find out why this should be so. We commenced by carrying out a scoping literature review of the mobile phone design guideline literature to gain insight into the maturity of the field. The question we wanted to explore was: “Are researchers building on each others’ guidelines, or is the research field still in the foundational stage?” We discovered a poorly structured field, with many researchers proposing new guidelines, but little incremental refinement of extant guidelines. It also became clear that the current reporting of guidelines did not explicitly communicate their multi-dimensionality or deployment context. This leaves designers without a clear way of discriminating between guidelines, and could contribute to the lack of deployment we observed. We conducted a thematic analysis of papers identified by means of a systematic literature review to identify a set of dimensions of mobile phone interface design guidelines. The final dimensions provide a mechanism for differentiating guidelines and expediting choice.

Background: Management information systems (MIS) are pivotal in the efficient and effective running of Further Education and Training (FET) colleges. Therefore, the evaluation of MIS success is an essential spoke in the wheel of FET college success. Based on an extensive literature review it was concluded that no MIS success evaluation model for FET colleges in South Africa exists. Objectives: The main objective was to propose a MIS evaluation model and evaluation tool(questionnaire), and verify the model empirically by evaluating the MIS at a selected FET college. The supporting objectives were firstly, to identify the most appropriate MIS evaluation models from literature. Secondly, to propose a MIS evaluation model for FET colleges based on the literature. Thirdly, to develop the evaluation tool (questionnaire) based on these models. Fourthly, to capture and analyse data from one FET college, in order to evaluate the performance of the MIS at the college. The final supporting objective was to evaluate the proposed model by triangulating the findings from the survey with the findings from the interviews. Method: The proposed MIS evaluation model is based on the integration of three existing MIS evaluation models. The evaluation tool was developed by combining four empirically tested questionnaires that capture the constructs in the underlying models. A survey and semi-structured interviews were used as data collection methods. The statistical tests for consistency, scale reliability (Cronbach’s alpha) and unidimensionality (Principal Component Analysis) were applied to explore the constructs in the model. Results: Results from the empirical testing of the newly designed evaluation tool were used to refine the initial model. The qualitative data capturing and analysis added value in explaining and contextualising the quantitative findings. Conclusion: The main contribution is the SA-FETMIS success model and evaluation tool which managers can use to evaluate the MIS at an educational institution. The novelty of the research lies in using a mixed methods approach where previous MIS success evaluation studies mainly used quantitative methods.

Background:Management information systems (MIS) are pivotal in the efficient and effective running of Further Education and Training (FET) colleges. Therefore, the evaluation of MIS success is an essential spoke in the wheel of FET college success. Based on an extensive literature review it was concluded that no MIS success evaluation model for FET colleges in South Africa exists. Objectives:The main objective was to propose a MIS evaluation model and evaluation tool (questionnaire), and verify the model empirically by evaluating the MIS at a selected FET college. The supporting objectives were firstly, to identify the most appropriate MIS evaluation models from literature. Secondly, to propose a MIS evaluation model for FET colleges based on the literature. Thirdly, to develop the evaluation tool (questionnaire) based on these models. Fourthly, to capture and analyse data from one FET college, in order to evaluate the performance of the MIS at the college. The final supporting objective was to evaluate the proposed model by triangulating the findings from the survey with the findings from the interviews.Method:The proposed MIS evaluation model is based on the integration of three existing MIS evaluation models. The evaluation tool was developed by combining four empirically tested questionnaires that capture the constructs in the underlying models. A survey and semi-structured interviews were used as data collection methods. The statistical tests for consistency, scale reliability (Cronbach’s alpha) and unidimensionality (Principal Component Analysis) were applied to explore the constructs in the model.Results:Results from the empirical testing of the newly designed evaluation tool were used to refine the initial model. The qualitative data capturing and analysis added value in explaining and contextualising the quantitative findings.Conclusion: The main contribution is the SA-FETMIS success model and evaluation tool which managers can use to evaluate the MIS at an educational institution. The novelty of the research lies in using a mixed methods approach where previous MIS success evaluation studies mainly used quantitative methods.

Variability of goals and evolving research methodologies are fundamental characteristics of transdisciplinary research. This integration of research strategies from different fields complicates the evaluation of transdisciplinary research since the variability of goals drives variability of criteria and quality indicators. The aim of this research is to investigate the implications of using research methods across disciplinary boundaries by drilling down into the use of one research strategy in one research context (Information Systems) and a related sub-context (Human-Computer Interaction). Surveys with questionnaires as data-capturing tools were selected as an established research method which is widely used in transdisciplinary research. Questionnaires are one of the most established data capturing tools and yet the validity of questionnaire-based findings have often been questioned. The main problem areas have been identified as the sampling of the data, the questionnaire design and the interpretation of the results. This paper looks into questionnaire reporting practices - an essential determinant in the validity and reliability of survey-based research. The field of Information Systems and Human- Computer Interaction has been chosen as the research context. Information Systems research is by nature interdisciplinary in focusing on social and organisational issues regarding the development and use of software in organisations. Human-Computer Interaction studies address the challenges of making computers and computations useful, usable, and universally accessible to humans. Both Information Systems and Human- Computer Interaction studies address complex, heterogeneous, real-world problems, thereby meeting the first criteria to be classified as transdisciplinary research. The research design entails document analysis of papers presented at conferences in Computer Science and Information Systems over a three-year period to identify trends in the reporting of survey results, especially the questionnaire design. Transdisciplinary research methodology facilitates the application of research methods across fields. However, if the constraints of the method are not recognised the validity of the results may be compromised in a plethora of ways. While fusion of methods are encouraged on a theoretical level in transdisciplinary research the findings of this study are a warning about the dangers of interdisciplinary application of research strategies without due diligence in observing best practices in the parent discipline. The paper aims to advance the discussion on research design and practice beyond disciplinary research and should be of interest to researchers and practitioners who deal with multidisciplinary, interdisciplinary, and transdisciplinary research. Keywords: transdisciplinary, interdisciplinary, mutlidisciplinary, questionnaire design Disciplines: Research methodology, Information Systems, Human-Computer Interaction Studies