Search

The purpose of this research was to explore the factors associated with online learning anxiety by carefully designing, developing, and providing preliminary validity and reliability evidence of a scale to measure undergraduate students' online learning anxiety. We created a conceptual framework to organize the literature surrounding online learning anxiety and used this framework to develop an initial item pool of 30 items. The researchers recruited N = 297 undergraduate student participants from four public universities in the southeastern United States from whom we collected and analyzed data for descriptive statistics, internal consistency reliability, exploratory factor analysis, and correlational analysis. Following systematic analytic procedures, we arrived at a three-factor model explaining approximately 65% of the variability in these data and retained 24 items in the final model with minimal cross-loadings in the pattern matrix. We labeled the identified factors as (1) online learner feelings of negativity and inadequacy, (2) online learner apprehension towards personal communication, and (3) online learner discomfort with instructor capacity and communication. The final instrument was named the Online Learner Anxiety Scale (OLAS). Scores on the OLAS were correlated with five other measures hypothesized to relate to online learning anxiety thereby providing stronger construct validity evidence. The OLAS was found to produce reliable scores that can be validly inferred as measures of online learning anxiety among undergraduate students in institutions of higher education. These findings are discussed and framed in light of current literature on online learning and possible future research directions.

This study tested the influence of instructional elements within an online Open Educational Resource (OER) focused on information literacy (IL) on outcome measures of IL achievement, learner satisfaction and IL self-efficacy among undergraduate students. An online OER was designed to address the domains of access, evaluation and communication of IL guided by the notion of instructional scaffolding and self-regulated learning. Participants were randomly placed into one of six different OER conditions: (a) full version with all instructional elements, (b) lean version, (c) version without tooltip text, (d) version without embedded practice questions, (e) version without learning objectives and (f) version without summaries. There were no significant differences found across the six conditions on the dependent measures. Participants averaged 58% for IL achievement, performing slightly better in the domain of access versus evaluate and communicate. Limitations include a controlled laboratory setting where participants were not necessarily motivated to complete the study tasks at a high level of achievement. Future research can explore more ecologically valid environments where learners might be more motivated, along with more rigorous intervention and assessment construction. This paper includes implications for educators and researchers to explore the established and innovative instructional elements that are natural affordances of an online OER in IL. This paper presents innovative IL instruction that does not require instructor or learner training and evaluates its effectiveness using a sound, replicable methodological approach to isolate the effects of the individual instructional elements.

Online instructors play a critical role in online student success and need various forms of institutional support to succeed in online teaching. This article describes the creation, validation, and results of the Online Instructor Support Survey (OISS) based on seven areas identified in the literature: (a) technology infrastructure; (b) technical support; (c) online course development and teaching; (d) instructor rewards and incentives; (e) administrative and academic support; (f) institutional policies and culture; and (g) program and legal support. Online instructor (N = 275) responses highlighted areas of support that are largely prevalent and areas where further support and awareness of such support is needed at higher education institutions. A 7-factor model explained 67% of the variance in these data. A discussion and limitations are provided.

As journal editors play an important role in defining and shaping academic discourse, knowing their opinions could likely prove beneficial for both current and future academic journal stakeholders. Within this vein, this study used the Delphi method to help build a profile on the trends and priorities within educational technology, from the unique perspective of the journals' editors-in-chief. This expert panel--initially built from 117 national and international research journals--concluded with 25 editors-in-chief who finished all three rounds of the survey. Results indicated five emerging themes for trends and priorities: computer-focused, teaching and learning, online and digital education, societal, and research and theory. By exploring these current trends and priorities within educational technology, this study may provide meaningful insights to better understand the field as a whole and may also help scholars in their goal of publishing relevant, high-quality academic scholarship.

Synchronous online learning (SOL) provides an opportunity for instructors to connect in real-time with their students though separated by geographical distance. This meta-analysis examines the overall effect of SOL on cognitive and affective educational outcomes, while using asynchronous online learning or face-to-face learning as control groups. The effects are also examined for several moderating methodological, pedagogical, and demographical factors. Following a systematic identification and screening procedure, we identified 19 publications with 27 independent effect sizes published between 2000 and 2019. Overall, there was a statistically significant small effect in favor of synchronous online learning versus asynchronous online learning for cognitive outcomes. However, the other models were not statistically significant in this meta-analysis. The effect size data were normally distributed and significantly moderated by course duration, instructional method, student equivalence, learner level, and discipline. Implications for educational practice and research are included.

The purpose of this research was to provide validity evidence for the Information Literacy Self-Efficacy Scale (ILSES), a widely used instrument that was constructed in 2006. The researchers were interested in investigating the validity of this instrument due to the evolution of the information environment that has taken place since the scale's original development, mostly as a result of the prominence of the internet. Data were collected from undergraduate students participating in a broader information literacy research study (n = 253). Data were subjected to descriptive analyses, internal consistency reliability, and a confirmatory factor analysis (CFA). After evaluating three different CFA models based on the ILSES' construction, the researchers determined that a four-factor model fit the data with the following latent constructs: 1) Initiating the search strategy, 2) Assessing and comprehending the information, 3) Interpreting, synthesizing, and using the information, and 4) Evaluating the product and process. A discussion of these findings is provided in light of the evolving information environments in which undergraduate students are expected to use information for their academic, personal, and professional lives.

Computational thinking is believed to be beneficial for Science, Technology, Engineering, and Mathematics (STEM) learning as it is closely related to many other skills required by STEM disciplines. There has been an increasing interest in integrating computational thinking into STEM and many studies have been conducted to examine the effects of this intervention. This meta-analysis examined the effects of computational thinking integration in STEM on students' STEM learning performance in the K-12 education context. Following systematic procedures, we identified 20 publications with 21 studies meeting the inclusion and exclusion criteria from a range of academic databases. We extracted effect sizes on student learning outcomes in one-group pretest-posttest designs. We also examined a range of moderating variables in the models, including student levels, STEM disciplines, intervention durations, alignment with content standards (e.g., CSTA/NGSS), types of intervention (e.g., simulation), and the use of unplugged/plugged activities. Overall, we found a statistically significant large effect size (g = 0. 85 [95% CI of 0.57-1.14]; p < 0.001), indicating a large overall effect of computational thinking integration on STEM learning outcomes. The effect sizes were significantly moderated by intervention durations. We provide a discussion of the findings and present implications for future research and practice.

The purpose of this research study is to design, develop, and validate an instrument for measuring undergraduate students' conceptions of artificial intelligence in education. Following systematic procedures, our team created a conceptual framework through an extant literature review and used it to create an initial item pool of 48-items across eight educational application domains of AI (Ahmad et al. (2020). We conducted think aloud protocols with a small group (N = 4) of undergraduate students and an expert review with researchers experienced in AI, psychometrics, and education (N = 3) to ensure the intended meaning of the language was aligned with our framework. Next, we recruited undergraduate student participants (N = 445) from two public universities and one state college in the southeastern United States to complete the final survey. Data were randomly split into two datasets, one for fitting a Confirmatory Factor Analysis model, and the other one for testing the model. The final model retained 37-items across the eight factors of conceptions of AI in education: (AI1) intelligent tutoring system, (AI2) students' grading and evaluation, (AI3) students' retention and dropout, (AI4) sentiment analysis in education, (AI5) recommendation systems, (AI6) classroom monitoring and visual analysis, (AI7) personalized learning, and (AI8) student's performance prediction. We present the results, provide interpretations and explanations, outline the limitations and delimitations of the study, and highlight recommendations for future research and practice.

Purpose: The purpose of this study is to explore the role skepticism plays among adolescents' online information literacy skills. Design/methodology/approach: The authors provide the conceptual grounding to operationalize and measure the notion of skepticism in an online information literacy context. Inspired by an existing measure known as the Skepticism Scale (Hurtt, 2010), the authors made substantial revisions to the scale to target middle school and high school students' skepticism in six distinct, but related factors: questioning mind; search for knowledge; suspension of judgment; self-esteem; interpersonal understanding; and autonomy. The authors provide preliminary evidence of validity and reliability of the revised Skepticism Scale using Exploratory Factor Analysis and performed multiple linear regression using the Skepticism Scale measures to predict an adolescents' online information literacy skills. Findings: The Skepticism Scale was found to produce internally consistent constructs for all six measures. Three of the six measures were related to online information literacy skills, including the search for knowledge, interpersonal understanding and questioning mind. Originality/value: This paper attempts to examine the potentially positive role of skepticism in information literacy skills among adolescents.

The purpose of this study was to explore award-winning instructors' insights on elements of their course design that were award-winning and the differences between expert and novice online instructors. Interviews were conducted with eight award-winning online faculty members from across the United States who had received online teaching awards from one of three professional associations. The five main areas that emerged from the data analysis were (a) authentic and relevant course materials that connect to practice, (b) the use of multimedia resources, (c) student creation of digital content individually and collaboratively, (d) students' reflection on learning, and (e) the instructor's explanation of the purpose of activities, technologies, and assessments in the online course. Additionally, award-winning faculty emphasized the importance of using data and evaluation practices and reflecting on course offerings in the development of an excellent online course. Award-wining faculty described expert online instructors as being experienced and comfortable in the online environment, using a wide range of strategies, being willing to learn, using data and analytics, and engaging in continuous improvement. The findings add to the literature on best practices and what constitutes excellence in online courses.

The purpose of this design and development case study is to provide an in-depth account of the needs analysis (through surveys and interviews), design, development and formative evaluation of the Citizen Science Cancer Curriculum (CSCC). The curriculum was developed as an online, self-paced educational program distributed as an Open Educational Resource using Creative Commons licensing. The instructional approach described in this design and development case study was informed by the Self-Determination Theory (SDT) framework. The case reflects a new frontier in the development of community stakeholder engagement models and describes how evidence-based instructional design practices and approaches (e.g., storytelling) can be used to support Citizen Scientists' interests, learning and motivation to engage in cancer-related research. Results from quantitative and qualitative analyses indicate that the CSCC supported Citizen Scientists' learning performance and motivation. More specifically, the use of storytelling as an instructional approach supported Citizen Scientists' psychological needs, especially relatedness and competence, which translated into their behavioral intentions to contribute to cancer-related research. We share context-specific challenges and opportunities in working with Citizen Scientists as well as with cancer researchers and clinicians during the design and development of the curriculum.

With the explosion of multimedia learning environments and the use of digital time-compression algorithms in common software and hardware, we need guidance on how to use this technology without sacrificing quality and learning outcomes. The purpose of the meta-analysis is to examine the existing empirical research literature to derive an overall integrated model for the use of digital time-compression algorithms in multimedia learning environments. We frame this research by coining the accelerated playback hypothesis, which posits that learning outcomes will not diminish with accelerated playback of multimedia learning materials until a threshold is reached. Systematically searching twelve academic databases and filtering the literature, we identified seven qualified manuscripts with k = 18 independent effect size comparisons using time-compression in the context of multimedia learning. The overall effect size for playback speed 1.4-1.5x is small and significant at g = -0.212 [95% CI = -0.378, -0.045]. The overall effect size for playback speed 1.8-2.0x is small and non-significant at g = -0.362 [95% CI = -0.743 to 0.019]. Discussion and implications for practice and research are provided.

The explosive growth of online learning in institutions of higher education has created a dire need for guidelines that instruct new and continuing online instructors about how best to teach in online spaces. The purpose of this exploratory study was to identify the roles of the online instructor and categorize critical competencies for online teaching based on a review of research and the perspectives of award-winning online faculty members. We interviewed eight award-winning online faculty members from across the United States. Based on interviews, it was found that online instructors assume five different roles: Facilitator, Course Designer, Content Manager, Subject Matter Expert, and Mentor. Common tasks of an online instructor course fell into two areas: Course Design or Teaching. This research has clear implications, not only for the literature research base, but for our institutions as well, as we continue to offer increasing numbers of effective online courses and programs to our students.

The purpose of this study was to examine the effects of gamification used in formal educational settings on student affective and behavioral outcomes. Using systematic procedures to identify and screen the manuscripts across 18 academic databases, we identified 13 studies with behavioral outcomes and 19 studies with affective outcomes employing gamification in educational settings. These manuscripts accounted for a total of N = 1974 (n = 987 in gamification, n = 987 in control) participants in the affective model, and N = 1596 (n = 760 in gamification, n = 836 in control) in the behavioral model. Employing random-effects models, we calculated two statistically significant medium overall effect sizes for affective outcomes at g = 0.574 [0.384, 0.764] and for behavioral outcomes at g = 0.740 [0.465, 1.014]. We also examined 14 different gamification design elements (e.g., leaderboards, badges, etc.) as moderators to pinpoint the conditions in which gamification may be effective. Additionally, we examined contextual elements as moderators, including the discipline, student level, and publication source. Publication bias was not identified as a threat to either the affective or behavioral model. We also provide a discussion of our findings, limitations, and suggestions for future research.

The purpose of this study is to examine core professional competencies for instructional designers through a job announcement analysis involving both qualitative and quantitative produces used on a qualitative data source. Using a conceptual framework as a guide, we extracted and examined a total of N = 1030 unique job announcements obtained from September to October 2019 from three popular job search databases: Glassdoor.com, Indeed.com and Monster.com. Using a systematic content analysis coding procedure, we coded the absence or presence of N = 185 competencies organized into knowledge, skill and ability statements (80 knowledge statements, 43 skill statements and 62 ability statements). These data were analysed using exploratory factor analysis models for dichotomously scored data, resulting in meaningful factors that are representative of these data. Our results highlight critical competencies for professional instructional designers in each domain, including "soft skills," "the ability to work with diverse stakeholders" and more technical competencies like "knowledge" of "video and audio authoring." The study provides a current snapshot of the knowledge, skills and abilities of instructional designers across settings. We provide a comprehensive discussion of our limitations, findings related to similar works, implications and suggestions for future research.

This study used the Technology Use and Perceptions Survey to explore whether there are differences reported by teachers (N = 1,287) from elementary, middle, and high schools from a single school district. A two-step data analysis process using multivariate analysis of variance and item-by-item analysis of variance was employed. We used our analyses to generate profiles for elementary, middle, and high school teachers and draw comparisons across these profiles in our discussion. In particular, high school teachers reported the lowest perception of technology's value and the most infrequent use of technology integration strategies even though they reported their students used technology more frequently. Elementary teachers reported the most frequent use of technology integration strategies and the lowest satisfaction with the access and support they receive. This study supports the need for more research to adequately explore the role of school levels as these differences could provide important insights.

In the past 20 years, institutions of higher education have made major investments in Learning Management Systems (LMSs). As institutions have integrated the LMS into campus culture, the potential of migrating to not only an upgraded version of the LMS, but also an entirely different LMS, has become a reality. This qualitative research study examines the perspectives of five stakeholders involved with the migration of an LMS at a major research institution in the southeastern United States. Using Lewin's (1947) Change Management Model and Enterprise Resource Planning (ERP) Model as analogies, this research seeks to understand the role and responsibilities of the various stakeholders, their decision-making, and the implications of the decisions on the migration process. Using Glaser and Strauss's (1967) constant comparative method and Charmaz's (2006) work related to grounded theory, four major categories emerged from our data: time as a catalyst for change, power of communication, compatibility of technologies, and faith in the system. The categories contribute to a preliminary model that may assist other institutions as they consider whether to migrate LMSs.

The use of 3D printing in science, technology, engineering and mathematics (STEM) learning is a promising way for integrated STEM education. This study examined the influence of 3D printing infused STEM integration on students' interest in STEM careers, which is essential for students to participate in STEM disciplines and future STEM careers. The participants included 26 teachers across six states in the United States and their 1455 students in primary and secondary classrooms. Teachers' lesson plans were analysed to examine the level of 3D printing and STEM integration. Students' interest in STEM careers was measured using a previously validated career interest scale. Cluster analysis and multiple regression analysis indicated that girls were more interested in empathetic STEM careers, whereas boys were more interested in analytic STEM careers. While 3D printing integration level was not a significant predictor, teachers' STEM integration level positively predicted students' interest in both analytic and empathetic STEM careers.

The purpose of this study was to examine the application of the multimedia and modality principles on cued-recall, recognition, and mental effort of college students with and without dyslexia. The study used a Multimedia (Image Present vs. Image Absent) × Modality (Narration vs. Onscreen Text) × Dyslexia (Dyslexia vs. Non-Dyslexia) 3-way factorial design with each independent variable serving as a between-subject condition. A total of N = 148 participants (73 with dyslexia and 75 without dyslexia) were recruited from five different institutions of higher education in the Southeastern United States and systematically assigned to one of four multimedia learning conditions. After assessing our data for statistical assumptions, we employed factorial Analysis of Variance (ANOVA) models on each dependent measure. Our findings show a reverse modality effect for students with dyslexia who performed better than their peers without dyslexia in Onscreen Text conditions. Although performance was better across groups and conditions when images were present, there were no significant interactions related to the multimedia condition. Similarly, there were no significant interactions related to mental effort even though learners with dyslexia exhibited high instructional efficiency in the Onscreen Text-Image Present condition while learners without dyslexia exhibited low task involvement in the Onscreen Text-Image Absent condition. Our results provide theoretical implications and important avenues for future research and practice as related to how multimedia learning influences students with dyslexia. We also suggest studies that could inform the eventual design of adaptive and personalized multimedia learning solutions for learners with dyslexia.

The purpose of this study was to investigate student motivation and achievement in music appreciation by comparing web-based and game-based online music learning environments. Undergraduate students (N = 132) from a public research university in the southeastern United States participated in the study. Based on the pretest-posttest control-group design, two groups of 66 students were randomly assigned to a control (web-based online instruction) or treatment group (game-based online instruction). Achievement was measured by using a multiple-choice pretest and posttest. The IMMS (Instructional Materials Motivation Survey) by Keller (2010) was administered to assess student motivation. Analysis showed that the students improved their achievement scores in both game-based and web-based online music learning environments. While there was no significant difference in student motivation between the two groups, the web-based online group significantly outperformed the game-based online group in student achievement. The results of the study indicated that minimizing extraneous multimedia learning materials might be crucial to improving student achievement in music appreciation. A full discussion is provided.

Background and context: Researchers have been looking into the complexity of computer science (CS) education and tried to apply rigorous and relevant educational research methods to understand and facilitate the learning experience of students. Objective: The purpose of this study was to explore college students' conceptions of learning CS to shed light on student learning activities, feelings, contexts, and beliefs about their learning. Method: Draw-a-picture technique was used as an emerging research technique in CS education. Using a modified coding checklist, we analyzed the drawings into 9 categories with 50 sub-categories. Findings: College students most frequently expressed computer programming as the learning activity by illustrating syntax and semantics of programming languages in the drawings. Problem-solving constructs like decomposition and abstraction were also recorded along with other tools like diagramming techniques. Gender and prior computer science experience were analyzed as moderators. Implications: The results provide a baseline for future research on the topic and preliminary evidence in using the method to discern student learning conceptions in CS.

The purpose of this research study was to examine the overall effect of adaptive learning systems deployed using artificial intelligence technology across a range of relevant variables (e.g., duration, student level, etc.). Following a systematic procedure, this meta-analysis examined literature from 18 academic databases and identified N = 45 independent studies utilizing AI-enabled adaptive learning. This meta-analysis examined the overall effect of AI-enabled adaptive learning systems on students' cognitive learning outcomes when compared with non-adaptive learning interventions and found that they have a medium to large positive effect size (g = 0.70). The effect was significantly moderated by publication type, origin of study, student classification level, student discipline, duration, and research design. In addition, all three adaptive sources (cognitive, affective, and behavioral) and adaptive targets (navigation and assessment) were significant moderators. The type of AI used in the adaptive engine did not moderate the effects. Implications for both practice and research are provided. [ABSTRACT FROM AUTHOR]

The purpose of this exploratory research study was to examine the roles instructional designers (IDs) play in the integration of generative Artificial Intelligence (GenAI) into their higher education institutions, and how they use GenAI technologies in their own professional practices. Data were collected from 15 participants in the United States (U.S.) in an ID role or with similar job titles (e.g., educational technologist). Using a general qualitative approach, semi-structured interviews were conducted in Zoom about IDs’ use and integration of GenAI. Our analysis resulted in three primary themes related to IDs’ integration of GenAI in online and blended education: (a) the use of GenAI for instructional design; (b) collaborative guidance for faculty integration of GenAI; and (c) training, resources, and guidelines on the integration of GenAI. A common thread through all the themes was IDs’ conscientious and cautious approach and ethical concerns about GenAI integration. We unpack these themes and discuss the implications of IDs in higher education integrating GenAI to meet organizational, faculty, and student needs. [ABSTRACT FROM AUTHOR]

Gamification research in educational settings has produced mixed results on student learning outcomes. Educational researchers and practitioners both struggle with identifying when, where, and how to use gamification design concepts. The present study provides findings from a meta-analysis that integrated the empirical, quantitative research on gamification in formal educational settings on student learning outcomes. This was achieved by examining the overall effect size, identifying which gamification design elements (e.g., badges) were used, and determining under what circumstances (e.g., engineering education) gamification works. The final corpus of data included 30 independent studies and associated effect sizes comparing gamification to non-gamification conditions while accounting for N = 3083 participants. The overall effect size using a random-effects model is g = 0.464 [0.244 to 0.684] in favor of the gamification condition, which is a small to medium effect size. We examined 14 different gamification design elements (e.g., leaderboards) and showed that each leads to different effects on student learning outcomes. Further, the type of publication (e.g., journal article), student classification (e.g., undergraduate), and subject area (e.g., mathematics) are also investigated as moderators. We provide a discussion of our findings, some recommendations for future research, and some brief closing remarks.

This study investigated the effects of multimedia and modality design principles using a learning intervention about Australia with a sample of college students and employing measures of learning outcomes, visual attention, satisfaction, and mental effort. Seventy-five college students were systematically assigned to one of four conditions: a) text with pictures, b) text without pictures, c) narration with pictures, or d) narration without pictures. No significant differences were found among the four groups in learning performance, satisfaction, or self-reported mental effort, and participants rarely focused their visual attention on the representational pictures provided in the intervention. Neither the multimedia nor the modality principles held true in this study. However, participants in narration environments focused significantly more visual attention on the "Next" button, a navigational aid included on all slides. This study contributes to the research on visual attention and navigational aids in multimedia learning, and it suggests such features may cause distractions, particularly when spoken text is provided without on-screen text. The paper also offers implications for the design of multimedia learning resources so as to improve learning for all students.

The purpose of this research was to examine college students' conceptions of learning computer science and approaches to learning computer science and to examine the relationships among these two important constructs and possible moderating factors. Student data (N = 193) were collected using the conceptions of learning computer science and the approaches to learning computer science surveys at one public research institution in the southeastern United States. Data were analyzed with descriptive statistics, Confirmatory Factor Analysis models, internal consistency reliability, Pearson correlations, stepwise multiple regression models, and Multivariate Analysis of Variance models. The results suggest that college students most favorably employ a deep strategy approach for learning computer science in which prior knowledge is activated and meaningful learning strategies are used. College students appear to be more extrinsically motivated to learn computer science than intrinsically. Higher level learning conceptions are associated with a deep strategy approach to learning (e.g., Seeing in a new way) whereas low-level conceptions are associated with a surface strategy (e.g., Memorizing) approach to learning. Male college students have slightly higher conceptions of programming than their female counterparts. The findings are discussed and both limitations and delimitations of the study are enumerated.

The flipped classroom instructional strategy is thought to be a good way to structure learning experiences to improve student learning outcomes. Many studies have been conducted to examine the effects of flipped classroom on student learning outcomes compared to the traditional classroom, but the results were inconclusive. The purpose of this study was to examine the overall effect of the flipped classroom instructional strategy on student learning outcomes in relation to a set of moderating variables including student levels, publication types, study durations, and subject area. This meta-analysis examined studies that compared classrooms that used the flipped classroom instructional strategy and classrooms that did not. Seventeen databases were searched to identify literature meeting our inclusion criteria and resulted in 55 publications with 115 effect size comparisons on cognitive student learning outcomes published between 2000 and 2016. Overall, we found a statistically significant effect size (g = 0.193; p < 0.001; with a 95% confidence interval of 0.113-0.274) in favor of the flipped classroom instructional strategy. The effect size data were normally distributed and exhibited statistically significant heterogeneity. The effect sizes were significantly moderated by subject area such as mathematics, science, social sciences, engineering, arts and humanities, health, and business. No evidence of publication bias was detected in these data. A full discussion of the findings and implications for educational practice and research were provided.

Numerous studies have been undertaken to design, develop, and provide validity evidence for using instruments to measure students' attitudes toward STEM (Science, Technology, Engineering, and Mathematics). This study presents validity evidence of scores produced from the S-STEM measurement tool and used to evaluate changes in attitudes during an educational intervention in a middle school robotics learning environment. All data were collected from middle school students who were involved in a school district-wide effort for integrating educational robotics into the classroom. Findings from this study provided not only internal structure validity evidence, but also criterion-related validity evidence of the proposed S-STEM tool use. In addition, measurement invariance results revealed that items in the S-STEM had equivalence in statistical properties of measurement across groups (e.g., grade level). The study provides further evidence that S-STEM survey is a powerful and useful tool to evaluate student attitude changes during STEM educational programs; offers suggestions for its future implementation; and presents other inspiring ideas for future STEM instrument development.

The purpose of this research is to document the design, development, and validation of the Electronic Learner Satisfaction Scale (eLSS). The eLSS is designed to be a parsimonious, flexible, objective, valid, and reliable tool for reporting learner satisfaction scores with self-paced e-learning environments for either research or practice. The tool uses a 9-item semantic differential scale format to collect data from learners. The sample of participants included N = 635 college students that participated in one of our research studies involving e-learning interventions. The data analyses included descriptive analysis, internal consistency reliability analysis, exploratory factor analyses (EFA), and correlation analysis. The findings demonstrated the eLSS is best described as a unidimensional factor structure explaining approximately 64% of the variability in these data with strong factor loadings and simple structure from the pattern matrix. The eLSS scores were found to significantly and positively correlate with learning performance measures as further evidence of construct validity. The eLSS is found to be a valid (face, content, and construct), and internally consistent measure for college students. The findings are discussed in light of the limitations of this study. Additionally, suggestions for the appropriate uses of the eLSS are provided.

Background and Context: The use of block-based programming environments is purported to be a good way to gently introduce novice computer programmers to computer programming. A small, but growing body of research examines the differences between block-based and text-based programming environments. Objective: Thus, the purpose of this study was to examine the overall effect of block-based versus text-based programming environments on both cognitive and affective student learning outcomes. Method: Five academic databases were searched to identify literature meeting our inclusion criteria and resulted in 13 publications with 52 effect size comparisons on both cognitive and affective outcomes. Findings: We found small effect size (g = 0.245; p = 0.137; with a 95% confidence interval of -0.078 to 0.567) in favor of block-based programming environments on cognitive outcomes, and a trivial effect size (g = 0.195, p = 0.429; with a 95% confidence interval of -0.289 to 0.678) on affective outcomes. Both effect size calculations were statistically insignificant using random effects models. The effect sizes were examined for moderating effects by education level, learning environment, and study duration. Some evidence of publication bias was detected in these data. Implications: More research is needed to examine the utility and efficacy of block-based programming environments for novice programmers. Future studies should account for hybrid programming environments using novel research methods.

Bichronous online learning is the intentional blending of asynchronous and synchronous online learning experiences. Twelve award-winning online instructors participated in interviews to discuss best practices they use, and benefits and challenges in bichronous online courses. When sharing best practices for bichronous online courses, online instructors explained how they combined best practices in asynchronous and synchronous online learning. Asynchronous online best practices included course design and structure, resources, and instructor presence; and synchronous online best practices focused on formats, activities, and content of synchronous sessions, and community-building. The best practices, benefits and challenges discussed in this paper have implications for instructors who currently teach in a bichronous online format or may be considering it in the future, and for instructional designers and administrators who work with faculty on offering courses in this modality. Based on the data, the intentional blending of synchronous and asynchronous components has a lot of potential to enhance students' online learning experiences. [ABSTRACT FROM AUTHOR]

This research examines student information and communication technology (ICT) literacy and its relationships to a student's socio-economic status (SES), gender, and ethnicity of middle school students. We recruited 5,990 students from 13 school districts across the state of Florida. Student participants completed the Student Tool for Technology Literacy (ST[superscript 2]L), a performance-based assessment of ICT literacy skills based on the 2008 National Educational Technology Standards for Students (NETS.S). Results show a digital divide between low and high SES, white and non-white, and female and male students on all measures of the ST[superscript 2]L. Specifically, high-SES, white, and female students outperformed their counterparts. The results provide compelling evidence of a digital divide within Florida schools. The article discusses the implications of the findings for practice and future research. (Contains 7 tables and 3 figures.)

This study explored the perceptions of principals involved in the hiring process of K-12 teachers in 11 counties in southeastern North Carolina. Forty-nine principals responded to a survey on ePortfolio use in the hiring process: the pros and cons, desirable artifacts, stage of use, preferred delivery method, and improvements that can increase their usage. We examined each of these questions and whether certain factors (prior use, technology skills, and years as a hiring agent) predict principals' ePortfolio use. Our findings suggest that ePortfolios provide improved and current information about teacher candidates that is easily accessible and organized. Collectively, this allows principals to assess teacher candidates' suitability for employment. Although there are problems associated with ePortfolio use during hiring, which are detailed below, the results suggest that principals most frequently use ePortfolios during the interview process, prefer delivery via a website address, and that prior use is the best predictor of future ePortfolio use. (Contains 6 tables.)

In the last decade, e-portfolios have moved to the forefront of teacher preparation programs across the United States. With its widespread use, faculty and administrators need to understand teacher candidates' perspectives to meet their needs. In the present study, the researchers gathered in-depth information from 244 students who were required to create e-portfolios for their academic program. The researchers asked students, using open-ended survey items, about the advantages, disadvantages, and obstacles they faced when creating and disseminating their e-portfolios. Additionally, each student described his or her most significant e-portfolio learning experience and how to make the process more meaningful. Overall, there were seven themes: increased scope, guidance, timing, alignment with standards, reflection and growth, organization of work, and the inaccessibility of the e-portfolio system to persons outside of the university. This article discusses findings as well as practical recommendations for e-portfolio integration and ideas for future research. (Contains 6 tables.)

The field of distance education is composed of a multiplicity of topics leading to a vast array of research literature. However, the research does not provide a chronological picture of the topics it addresses, making it difficult to develop an overview of the evolution and trends in the literature. To address this issue, a co-word analysis was performed on the abstracts of research articles found in two prominent North American research journals (N = 517), the "American Journal of Distance Education" and the "Journal of Distance Education," between 1987 and 2005. The analysis yielded underlying trends and themes for three different periods (pre-Web, emerging Web, and maturing Web). Additionally, similarity index analyses were conducted across time periods. The pre-Web era was characterized by the need for quality and development. The emerging Web era was characterized by the development of theory. The maturing Web era was characterized by interaction and the use of tools for communication. The results demonstrate that the North American distance education research literature is characterized by having few consistent and focused lines of inquiry. Conclusions are provided. (Contains 3 tables and 10 figures.)

With the explosive growth of e-portfolios in teacher preparation programs, it is essential for administration and other relevant stakeholders to understand the student perspective of e-portfolios' organizational uses. This article describes the validation of the modified Electronic Portfolio Student Perspective Instrument (EPSPI). The analysis includes descriptive analyses, exploratory factor analysis, and internal consistency reliability analyses. The article also reports the second major data collection effort involving preservice teachers (N = 224) in a southeastern public university. Results suggest that student perspectives toward e-portfolios are multidimensional, involving four distinct and highly internally consistent underlying constructs accounting for 69% of the cumulative variability: learning, assessment, visibility, and support. This research provides further evidence that the EPSPI is a reliable measurement system. Recommendations for future research are provided. (Contains 5 tables and 2 figures.)

This article provides an overview of the development and validation of the Student Tool for Technology Literacy (ST[superscript 2]L). Developing valid and reliable objective performance measures for monitoring technology literacy is important to all organizations charged with equipping students with the technology skills needed to successfully participate in and contribute to a digital and global society. The purpose of the ST[superscript 2]L is to measure student technology literacy for low-stakes purposes of reporting aggregated school results, curricular planning, and students' self-assessment of technology skills. This article reports the development procedures and results of the pilot test conducted with eighth grade students (N = 1,561) to validate the functioning of this online, interactive tool. Analyses focused on item difficulty and discrimination by ability groups, completion time analysis, internal consistency reliability, and construct validity. ST[superscript 2]L was found to be a sound assessment tool for the intended purpose of low-stakes assessment of technology literacy. (Contains 3 figures and 10 tables.)

One of the strongest instructional interventions documented in educational literature is the use of feedback to influence learning outcomes. However, there is lack of empirical research specifically pertaining to the use of multimedia in the feedback message. The purpose of this research was to test whether organizational pictures and modality as a feedback strategy had an effect on learner comprehension and satisfaction. The research design was a 2 Multimedia (Picture Present vs. Picture Absent) × 2 Modality (Narration vs. On-screen Text) × Trial (Trial 1 vs. Trial 2) with Multimedia and Modality serving as between-subject conditions and Trial serving as a repeated measure. One-hundred fifteen university students participated in the study. Findings show statistically significant increases in comprehension scores from Trial 1 to Trial 2 assessments for all four treatment conditions. Learners in the Picture present conditions were statistically more satisfied with the learning experience. Additionally, we used eye-tracking to verify the extent to which the pictures were used in the feedback message. A discussion and recommendations for future research and feedback design are provided.