This study examined middle school students' perceptions of an automated writing evaluation (AWE) system, . We summarize students' perceptions of MI Write's usability, usefulness, and desirability both quantitatively and qualitatively. We then estimate hierarchical entry regression models that account for district context, classroom climate, demographic factors (i.e., gender, special education status, limited English proficiency status, socioeconomic status, grade), students' writing-related beliefs and affect, and students' writing proficiency as predictors of students' perceptions. Controlling for districts, students reporting more optimal classroom climate also reported higher usability, usefulness, and desirability for MI Write. Also, model results revealed that eighth graders, students with limited English proficiency, and students of lower socioeconomic status perceived MI Write relatively more useable; students with lower socioeconomic status also perceived MI Write relatively more useful and desirable. Students who liked writing more and more strongly believed that writing is a recursive process viewed MI Write as more useable, useful, and desirable. Students with greater writing proficiency viewed MI Write as less useable and useful; writing proficiency was not related to desirability perceptions. We conclude with a discussion of implications and future directions.

The COVID-19 pandemic has forced universities and schools around the world to adopt online learning. Teachers may wonder if their students can attain satisfactory learning performance in an online learning environment without teachers' on-the-spot attention. In order to develop students' skills in programming, promote their enjoyment of learning and intention to learn to program, the researchers integrated two innovative teaching approaches, using online peer-facilitated learning and distributed pair programming, and investigated the effects of these on students' online learning performance. This study conducted an experiment that included 128 undergraduates from four class sections of Department of Finance. Thus, the experimental design in this research was a 2 (Peer-facilitated learning vs. non-peer-facilitated learning) × 2 (Distributed pair programming vs. non-distributed pair programming) factorial pretest/post-test design. The participants in this research mainly consisted of four classes of students from a non-computer or information department who took a compulsory course on programming design.' Both quantitative and qualitative data were collected in this study. According to the results, the peer-facilitated learning group exhibited significantly better development of programming skills, enjoyment of learning, and intention to learn, than the non-peer-facilitated learning group. However, expected effects of enhancing the learning of the students in this study who received the distributed pair programming were not found. The design of online pedagogy can be a reference for online educators. The implications of applying online peer-facilitated learning and distributed pair programming to support students' learning and the design of online programming courses are discussed.

The urgent shift to online distance teaching and learning during the Covid-19 pandemic presented teachers with unique pedagogical, technological, and psychological challenges. The aim of this study was to map the main positive and negative experiences of teachers during this transition, as well as to examine intra- and interpersonal factors that affected teachers' ability to cope effectively with the challenges of online distance teaching. We used a mixed-method approach that combined qualitative (interviews) and quantitative (questionnaires) analyses. The interviews were analyzed using a grounded theory approach, specifically a bottom-up analysis, which led to the identification of five primary categories reflecting teachers' main concerns in online distance teaching (i.e., social, emotional, cognitive, pedagogical, and system support. The two most prominent categories were pedagogy and emotions, illustrating their centrality in teachers' experiences. A regression analysis of the questionnaires' data revealed that the two main variables which predicted both positive and negative experiences in online distance teaching were self-efficacy and teachers' attitudes towards technology integration in teaching. Findings of this study allow formulation of guidelines to promote factors related to positive experiences in online distance teaching.

During COVID-19 pandemic the teachers were suddenly forced to change their teaching and use distance learning practices, and become innovative in their ways of teaching online. In the current study we sought to understand whether teachers considered themselves innovative and how this affected their distance learning self-efficacy, accountability, and distance learning teaching practices. Two hundred elementary and secondary school teachers from Israel were asked to fill in a questionnaire comprising the four abovementioned components. Findings indicated that it was teachers' self-innovativeness which had significantly influenced their distance learning self-efficacy, accountability, and distance learning teaching practices. Findings indicate that work experience directly affected self-innovativeness, and older, more experienced teachers perceived themselves as more innovative in adopting and using distance learning compared to less experienced ones. The second finding was that professional development affected distance learning teaching practices but had no effect on teachers' self-innovativeness. The study shows that increasing teachers' self-innovativeness may affect their self-efficacy and accountability and lead to better distance learning teaching practices. Therefore, it is suggested to change the focus of professional development programs to promoting teachers' self-innovativeness and encouraging them to create novel and tailored combinations of hybrid learning.

During the COVID-19-related school closures teachers and students were challenged to suddenly switch to digital teaching at a distance. In particular, the challenge was to organize high-quality teaching in which students stay on task. Familiarity with technology may have helped to master the situation. However, only few studies so far have examined the quality of digital distance teaching (e.g., cognitive activation) during school closures and its relation to students' learning (e.g., effort investment). Moreover, systematic research concerning the role of familiarity with technology-enhanced teaching and learning acquired during face-to-face teaching is yet lacking. In our study, we used data from 729 ninth graders to investigate how student-observed learning activities when using technology at a distance were related to students' effort in learning in two subjects (mathematics, German). In addition, we examined whether student-perceived cognitive activation mediated this relation. Finally, the sample provides the unique opportunity to examine the role of familiarity, as some of the classes had been randomly equipped with tablet computers one year before the school closures and thus had the opportunity to gain familiarity with using technology in the classroom. Results from structural equation models showed that student-observed learning activities were associated with students' learning effort in both subjects. Student-perceived cognitive activation mediated this association. Familiarity with face-to-face technology-enhanced teaching gained before the COVID-19 pandemic appeared to be less important for high-quality digital distance teaching. Thus, infrastructural measures, such as equipping schools with digital devices so that teachers and students can familiarize themselves with technology, do not seem to be decisive for high-quality digital (distance) teaching-at least in the case of short-term change from face-to-face to digital distance teaching, as was necessary during the COVID-19 pandemic.

Maintaining students' learning engagement was a challenge in emergency online education during the pandemic. In this study, we investigated the predictors (social interaction) and outcomes (self-directed study) of engagement in online learning during the first and second years of the COVID-19 pandemic. First-year Japanese university students ( = 1167) enrolled in online classes during 2020 and 2021 responded to a questionnaire measuring perceived opportunities for social interaction during online classes, engagement with online learning, and extracurricular self-directed study time. Multi-group path analysis revealed that social interaction during online classes exhibited a positive indirect effect on self-directed study time through emotional and behavioral engagement with online learning. The positive indirect effect was significant in both the first and second years of the pandemic. The results suggest that increasing the number of opportunities for social interaction during online classes may exhibit spillover effects on learning outside the online classroom.

Community and citizen science in online settings could be seen as a means for young people to engage with and contribute to authentic science. Yet, there is a limited understanding of who takes part in citizen science among young people, what they learn, and through which processes, particularly in online settings. In this exploratory study, we analysed 34 in-depth interviews and log files of young people aged 11-19 years old who took part in citizen science projects, hosted on the Zooniverse platform. Data analysis suggested that participation in online citizen science can bring environmental science learning benefits to young people, with some participants reporting evidence of agency with science, highlighted by taking action to do science in another context. Many participating youth exhibited substantial previous science experiences that helped them to take part and learn from citizen science projects. Considering findings from this study, we present a first working framework of how environmental science learning is enabled or hindered by certain types of participation, as a means to guide the design of online citizen science for young people. We recommend that the future project design, publicity and recruitment in online citizen science activities explicitly target the needs and interests of young people with diverse characteristics and competencies to truly open science to all.

During the COVID-19 pandemic, higher education institutions around the world were challenged to shift from traditional to distance teaching processes. This was not an easy task as educational institutions had to face many technology and human related challenges. The purpose of this paper is to present an approach that helps teachers to use remote conference tools (RCT) for a particular course more efficiently. The approach enables both teachers and students to be more effective in online education in general and during pandemics. The proposed approach leans on the Kano model and specifically focuses on evaluation of RCT features (RCTF) from students' and teachers' perspectives. Such evaluation enables development of recommendations for effective RCTF use. The approach was tested in three different case studies: Case 1 (computer and information science - software development; 39 students, 2 teachers), Case 2 (criminal justice and security - introduction to information systems; 130 students, 2 teachers), Case 3 (applied kinesiology - statistics; 44 students, 2 teachers). In all three cases, the results clearly demonstrated the benefits of the proposed approach and showed that the use of RCTF should be adapted to the specifics of each course where lectures and tutorials need to be considered separately.

Online teaching has been implemented in response to the COVID-19 pandemic. Nonetheless, teaching online consumes considerable time and adds pressure to teachers' daily lives. Teachers have to not only acquire technical skills but also provide engaging instruction online. Meanwhile, privacy breaches occasionally occur in online teaching. The objective of the current study is to analyze the factors underlying the continuance intention toward online teaching beyond the COVID-19 pandemic. We use the person-environment fit theory to develop the survey for investigation. An open-ended question appended to the survey helps to gather teachers' further thoughts on sustainable online teaching. The structural equation modeling reveals that teachers' technostress is associated with their privacy concerns and self-efficacy in delivering effective instruction amid online teaching. The multigroup analysis further demonstrates that technostress, self-efficacy and school support are related to the continuance intention to teach online for teachers at distinct teaching levels to different extents. The responses to the open-ended question reveal that teachers' preference for online instruction lies in wealthy teaching resources and flexibility. Students' learning performance and the effectiveness of assessments constitute a concern in conducting online teaching. The implications for policymakers and teachers are remarked upon at the end of this paper.

Creativity is one of the most essential skills for success in life in our dynamic, complex world. For instance, we are currently facing major problems with the COVID-19 pandemic, which requires creative thinking for solutions. To increase the pool of creative thinkers, we need tools that can assess and support people's creativity. With advances in technologies, as well as in computer and learning sciences, we can create such support tools. In this study, we investigated the effectiveness of a creativity-support system that we developed in the level editor of an educational game called . Our goal was to improve college students' creativity. Participants ( = 114) were randomly assigned to one of four conditions and instructed to create as many creative game levels as possible in about two hours. The four conditions included: (1) Inspirational - with supports that provided access to a website with example levels, a brainstorming tool, and a remote association activity; (2) Instructional - with supports that provided specific instructions to first design as many levels as possible, then pick four of the levels, and enhance them using a tool called SCAMPER; (3) Both - with both inspirational and instructional supports; and (4) No Support, which did not include any creativity supports. The major finding from this research was that the Both condition was significantly more effective than the other conditions in improving students' creativity measured by the creativity of the game levels created by the students. Implications of the findings, limitations, and future research are discussed.

This paper investigates the effect that participation in massive open online courses (MOOCs) ecosystem can have on workers' labour market outcomes, mainly employment retaining. We use primary data collected between 2015 and 2017 and obtained from two surveys (pre-course and follow-up questionnaires) sent to participants in six MOOCs. The treatment group is composed of individuals participating in MOOCs in 2015 and the control group is composed of individuals who enrolled in MOOCs for the first time in 2017. Using a differences-in-differences approach, we find that participation in MOOCs can improve workers' employment retaining but not their wages. The positive effect on employment retaining is homogeneous in different geographical and economic areas and tends to be higher for individuals who have participated in more MOOCs in the past.

In the information and knowledge society, where technology develops rapidly and penetrates deeply into our lives, the discussion about digital competence has become a hot topic today. After the emergence of the Coronavirus (Covid-19) and with its huge impact on the education industry, the concern about digital competence has reached a new height. This systematic literature review uses Web of science and Scopus as databases to store and analyze the existing research on digital competence in higher education settings. The purpose of this review is to provide the scholar community with a current overview of digital competence research from 2015 to 2021 in the context of higher education regarding the definition of digital competence, dimensions used to evaluate digital competence, research purposes, methodologies, and results and limitations. Major findings include that the majority of publications cited both research and EU policy in describing the definition of digital competence. The review indicates that most university students and teachers have a basic level of digital competence. Besides, the institutions of higher education are encouraged to focus on the development students and teachers' digital competence, create relevant learning strategies and use appropriate tools to improve the quality of education.

Amid the coronavirus outbreak, many countries are facing a dramatic situation in terms of the global economy and human social activities, including education. The shutdown of schools is affecting many students around the world, with face-to-face classes suspended. Many countries facing the disastrous situation imposed class suspension at an early stage of the coronavirus outbreak, and Asia was one of the earliest regions to implement live online learning. Despite previous research on online teaching and learning, students' readiness to participate in the real-time online learning implemented during the coronavirus outbreak is not yet well understood. This study explored several key factors in the research framework related to learning motivation, learning readiness and student's self-efficacy in participating in live online learning during the coronavirus outbreak, taking into account gender differences and differences among sub-degree (SD), undergraduate (UG) and postgraduate (PG) students. Technology readiness was used instead of conventional online/internet self-efficacy to determine students' live online learning readiness. The hypothetical model was validated using confirmatory factor analysis (CFA). The results revealed no statistically significant differences between males and females. On the other hand, the mean scores for PG students were higher than for UG and SD students based on the post hoc test. We argue that during the coronavirus outbreak, gender differences were reduced because students are forced to learn more initiatively. We also suggest that students studying at a higher education degree level may have higher expectations of their academic achievement and were significantly different in their online learning readiness. This study has important implications for educators in implementing live online learning, particularly for the design of teaching contexts for students from different educational levels. More virtual activities should be considered to enhance the motivation for students undertaking lower-level degrees, and encouragement of student-to-student interactions can be considered.

Growth mindset interventions foster students' beliefs that their abilities can grow through effort and appropriate strategies. However, not every student benefits from such interventions - yet research identifying which student factors support growth mindset interventions is sparse. In this study, we utilized machine learning methods to predict growth mindset effectiveness in a nationwide experiment in the U.S. with over 10,000 students. These methods enable analysis of arbitrarily-complex interactions between combinations of student-level predictor variables and intervention outcome, defined as the improvement in grade point average (GPA) during the transition to high school. We utilized two separate machine learning models: one to control for complex relationships between 51 student-level predictors and GPA, and one to predict the change in GPA due to the intervention. We analyzed the trained models to discover which features influenced model predictions most, finding that prior academic achievement, blocked navigations (attempting to navigate through the intervention software too quickly), self-reported reasons for learning, and race/ethnicity were the most important predictors in the model for predicting intervention effectiveness. As in previous research, we found that the intervention was most effective for students with prior low academic achievement. Unique to this study, we found that blocked navigations predicted an intervention effect as low as 0.185 GPA points (on a 0-4 scale) less than the mean. This was a notable negative prediction given that the mean intervention effect in our sample was just 0.026 GPA points, though few students (4.4%) experienced a substantial number of blocked navigation events. We also found that some minoritized students were predicted to benefit less (or even not at all) from the intervention. Our findings have implications for the design of computer-administered growth mindset interventions, especially in relation to students who experience procedural difficulties completing the intervention.

Despite the potential of learning analytics for personalized learning, it is seldom used to support collaborative learning particularly in face-to-face (F2F) learning contexts. This study uses learning analytics to develop a dashboard system that provides adaptive support for F2F collaborative argumentation (FCA). This study developed two dashboards for students and instructors, which enabled students to monitor their FCA process through adaptive feedback and helped the instructor provide adaptive support at the right time. The effectiveness of the dashboards was examined in a university class with 88 students (56 females, 32 males) for 4 weeks. The dashboards significantly improved the FCA process and outcomes, encouraging students to actively participate in FCA and create high-quality arguments. Students had a positive attitude toward the dashboard and perceived it as useful and easy to use. These findings indicate the usefulness of learning analytics dashboards in improving collaborative learning through adaptive feedback and support. Suggestions are provided on how to design dashboards for adaptive support in F2F learning contexts using learning analytics.

The use of lecture capture has been burgeoning in the higher education sector. Scholarly interest on the topic is also on an upward trajectory. Hence, the goal of this paper is to clarify the literature on the use of lecture capture in higher education through a systematic review, which involved 71 articles that came from Scopus and Education Resources Information Center (ERIC). The systematic review revealed that most research focused on university education in the US, the UK and Australia. The most studied Science, Technology, Engineering and Mathematics (STEM) subject area in the sample is Biological Sciences. In contrast, the most studied non-STEM subject area is Business/Economics/Management. In terms of methods, descriptive and exploratory research dominates the research landscape while causative evidence is relatively limited. The literature includes two overarching research streams: While one focuses on the benefits of lecture capture, the other focuses on its drawbacks. Apparently, the assumption among most students is that lecture capture is helpful for learning, and among staff is that it takes a toll on attendance. Future research needs to reconcile students' perception of lecture capture, instructors' perception of lecture capture, and the reality of lecture capture. On the practical front, students should be explicitly told about the benefits and the drawbacks of lecture capture. This would ensure that they make the most of the technology. Educators are urged to reflect on why students should be attending the face-to-face sessions, and thereafter also watch the recorded lectures.

While the hype around Massive Open Online Courses (MOOCs) has subsided in the past few years, such environments provide a rich opportunity to explore ongoing questions at the intersection of teaching, learning, and technology. This paper explores how a set of facilitation teams described enacting their learner-centered pedagogical aspirations through MOOC platforms. Drawing on in-depth interviews, we present a set of six facilitator actions: "giving up control," "distributing facilitation," "being live," "amplifying," "modeling," and "being explicit." We discuss these actions as emerging from the negotiation between existing pedagogical aspirations and the realities of a new medium, highlighting how they involve facilitators both stepping (making space for and foregrounding learner expertise and perspectives) and stepping (intervening and directing as a facilitator). This research contributes to the ongoing work of articulating the substance and specificity of teaching in learner-centered pedagogy and the persistent challenges of enacting that pedagogy in massive, online spaces.

Systematic reviews were conducted in the nineties and early 2000's on online learning research. However, there is no review examining the broader aspect of research themes in online learning in the last decade. This systematic review addresses this gap by examining 619 research articles on online learning published in twelve journals in the last decade. These studies were examined for publication trends and patterns, research themes, research methods, and research settings and compared with the research themes from the previous decades. While there has been a slight decrease in the number of studies on online learning in 2015 and 2016, it has then continued to increase in 2017 and 2018. The majority of the studies were quantitative in nature and were examined in higher education. Online learning research was categorized into twelve themes and a framework across learner, course and instructor, and organizational levels was developed. Online learner characteristics and online engagement were examined in a high number of studies and were consistent with three of the prior systematic reviews. However, there is still a need for more research on organization level topics such as leadership, policy, and management and access, culture, equity, inclusion, and ethics and also on online instructor characteristics.

Digitization and automation across all industries has resulted in improvements in efficiencies and effectiveness to systems and process, and the higher education sector is not immune. Online learning, e-learning, electronic teaching tools, and digital assessments are not innovations. However, there has been limited implementation of online invigilated examinations in many countries. This paper provides a brief background on online examinations, followed by the results of a systematic review on the topic to explore the challenges and opportunities. We follow on with an explication of results from thirty-six papers, exploring nine key themes: student perceptions, student performance, anxiety, cheating, staff perceptions, authentication and security, interface design, and technology issues. While the literature on online examinations is growing, there is still a dearth of discussion at the pedagogical and governance levels.

HyperDocs are interactive, digital teaching and learning materials created, disseminated, and remixed by educators. To date, HyperDocs have not been the subject of published, peer-reviewed research. To address this research gap, we engaged in exploratory, primarily qualitative research to systematically examine how and why teachers use HyperDocs. We used an online survey to gather data on educators' ( 261) uses of and perceptions regarding HyperDocs. Analysis suggested a wide range of definitions of, purposes for, and approaches to HyperDoc use, indicating that educators are adapting HyperDocs to their practice in myriad ways. Consistent with the openness and flexibility in finding, remixing, and using HyperDocs, educators identified a number of benefits of using these tools in their practice, including changes in student engagement and learning, shifts in instructional design and delivery, and changes in their own support and dispositions. Analysis of examples of HyperDocs shared by a subset of participants suggested some mismatch between rhetoric about HyperDocs and what was actually incorporated into them. We discuss these findings in relation to the work of educators and the future of research on HyperDocs and other crowdsourced teaching and learning initiatives.

In low- and middle-income countries (LMICs), e-learning for medical education may alleviate the burden of severe health worker shortages and deliver affordable access to high quality medical education. However, diverse challenges in infrastructure and adoption are encountered when implementing e-learning within medical education in particular. Understanding what constitutes successful e-learning is an important first step for determining its effectiveness. The objective of this study was to systematically review e-learning interventions for medical education in LMICs, focusing on their evaluation and assessment methods. Nine databases were searched for publications from January 2007 to June 2017. We included 52 studies with a total of 12,294 participants. Most e-learning interventions were pilot studies (73%), which mainly employed summative assessments of study participants (83%) and evaluated the e-learning intervention with questionnaires (45%). Study designs, evaluation and assessment methods showed considerable variation, as did the study quality, evaluation periods, outcome and effectiveness measures. Included studies mainly utilized subjective measures and custom-built evaluation frameworks, which resulted in both low comparability and poor validity. The majority of studies self-concluded that they had had an effective e-learning intervention, thus indicating potential benefits of e-learning for LMICs. However, MERSQI and NOS ratings revealed the low quality of the studies' evidence for comparability, evaluation instrument validity, study outcomes and participant blinding. Many e-learning interventions were small-scale and conducted as short-termed pilots. More rigorous evaluation methods for e-learning implementations in LMICs are needed to understand the strengths and shortcomings of e-learning for medical education in low-resource contexts. Valid and reliable evaluations are the foundation to guide and improve e-learning interventions, increase their sustainability, alleviate shortages in health care workers and improve the quality of medical care in LMICs.