focalinterest.net

Tag: Curriculum & Pedagogy

  • GenAI aligned closely with human scoring of students’ scientific inquiry understanding

    What the study found

    The study found that generative AI (AI that creates text or other outputs) can be used to score and give feedback on elementary students’ understanding of scientific inquiry with high agreement with human raters. The authors also report that the AI’s feedback was generally appropriate and often supported student agency, although some Korean wording was less clear.

    Why the authors say this matters

    The authors conclude that GenAI, when properly designed and prompted, can function as a dialogic partner for facilitating students’ epistemic understanding. They also say the study offers new pathways for using GenAI in formative assessment and teacher education, especially for helping students understand the nature of scientific inquiry.

    What the researchers tested

    The researchers used the Korean version of the Views About Scientific Inquiry for Elementary school students (VASI-E) with 560 responses from 80 fourth-grade students in Korea. They built ChatGPT-4o prompts for scoring and feedback based on established epistemic frameworks, then compared AI scoring with human raters and evaluated the feedback for learner-centered quality.

    What worked and what didn't

    GenAI scoring showed high agreement with human raters, with overall kappa (a measure of agreement) of 0.825 and item-level values from 0.606 to 0.923. The feedback was rated as generally appropriate, with an average score of 2.75 out of 3, and it was especially strong in promoting student agency through personalized and reflective guidance. Some Korean phrasing created clarity problems.

    What to keep in mind

    The abstract does not describe longer-term classroom outcomes or whether the system was tested beyond this one group of fourth-grade students in Korea. It also notes language-related challenges in Korean phrasing, which affected clarity.

    • GenAI scoring matched human raters closely overall (kappa = 0.825).
    • Agreement between AI and humans varied by item, with kappa values from 0.606 to 0.923.
    • AI-generated feedback was rated generally appropriate, averaging 2.75 out of 3.
    • The feedback was especially strong in supporting student agency.
    • Some Korean phrasing in the feedback reduced clarity.

  • K-3 teachers mostly use AI for preparation, not direct writing instruction

    What the study found

    The study found that most K-3 teachers used AI (artificial intelligence) tools, but they were mainly using them for their own professional tasks rather than directly with students' writing. Many teachers were also cautious about AI use in early writing instruction.

    Why the authors say this matters

    The authors conclude that early writing instruction needs clear expectations, scaffolded support, and developmentally appropriate guidance for AI use. They also suggest that balanced use should preserve student creativity and include critical conversations about AI-generated content.

    What the researchers tested

    The researchers used a mixed-methods design and surveyed South Carolina K-3 teachers. From a stratified random sample of 948 teachers, 107 completed a survey with multiple-choice, Likert-scale, and open-ended questions about AI use, benefits, and challenges.

    What worked and what didn't

    Eighty percent of responding teachers reported using AI tools. Reported uses included generating instructional materials, refining communication with families, designing visuals, and differentiating content; teachers said this saved about one to two hours per week of preparation time. Teachers also reported concerns about developmental readiness, overreliance on AI, loss of creativity, inaccurate or inappropriate output, bias, privacy, and academic integrity.

    What to keep in mind

    The available summary does not describe limitations beyond the response rate and the South Carolina sample. The findings are based on teacher self-reports, so they reflect teachers' perceptions and reported practices.

    • Most responding K-3 teachers reported using AI tools.
    • Teachers mainly used AI for preparation and communication tasks.
    • Reported time savings were usually one to two hours per week.
    • Teachers expressed concerns about readiness, creativity, bias, privacy, and academic integrity.
    • Many teachers wanted more training, peer examples, and guidance.

  • Teachers most often identified challenges during mathematise phases

    What the study found

    The study found that teachers' diagnostic competence in real-time mathematical modelling instruction was reflected in how often and how diversely they identified student challenges across modelling phases. This competence was most prominent during the mathematise phase, and least prominent during the interpret phase.

    Why the authors say this matters

    The authors conclude that the study makes a theoretical contribution by expanding the definition of teachers' diagnostic competence. They suggest it should include the frequency and diversity of identified challenges, as well as the diagnostic practices teachers use and the intentions behind those practices.

    What the researchers tested

    The researchers qualitatively analyzed nine observed lessons taught by five lower-secondary mathematics in-service teachers. They examined what challenges teachers identified during mathematical modelling tasks and what diagnostic practices they used to detect those challenges.

    What worked and what didn't

    Two factors stood out as markers of diagnostic competence: the frequency and diversity of challenges identified within each modelling phase. These were evident across all phases, but were strongest in the mathematise phase, significant in the understand simplify and mathematical work phases, and weakest in the interpret phase. The analysis also identified five distinct diagnostic practices used with different goals and timings during instruction.

    What to keep in mind

    The study is based on five teachers and nine observed lessons, so its scope is limited. The abstract does not describe additional limitations beyond this sample and setting.

    • The study examined teachers' diagnostic competence during real-time mathematical modelling instruction.
    • Diagnostic competence was defined as the ability to identify students' challenges.
    • Frequency and diversity of identified challenges were key indicators of diagnostic competence.
    • The mathematise phase showed the highest frequency and widest range of identified challenges.
    • Five diagnostic practices were identified, each used for different goals and timings.

  • Misconceptions in chemistry were linked to lower self-efficacy

    What the study found

    Students with more chemistry misconceptions reported lower organic chemistry self-efficacy, meaning lower confidence in their ability to do well in the course. Students retaking organic chemistry were also more likely to show misconceptions at the start of the semester.

    Why the authors say this matters

    The authors suggest that addressing common misconceptions early in the semester could support students' self-efficacy and improve course outcomes. They also conclude that organic chemistry instructors may benefit from explicit instruction on foundational chemistry concepts.

    What the researchers tested

    The study examined the relationship between university students' chemistry misconceptions and their organic chemistry self-efficacy during the first semester of the course. Students were surveyed using validated instruments aligned with NGSS, or Next Generation Science Standards, foundational chemistry concepts and established self-efficacy scales, along with demographic questions.

    What worked and what didn't

    The results showed a significant negative correlation between misconceptions and self-efficacy. The study also found that students retaking organic chemistry were more likely to have misconceptions at the beginning of the course.

    What to keep in mind

    The abstract does not describe detailed study size, setting, or other limitations. The findings are limited to the first semester of the course and to the relationships measured in this study.

    • Students with more chemistry misconceptions reported lower organic chemistry self-efficacy.
    • Students retaking organic chemistry were more likely to show misconceptions at the start of the course.
    • The study used validated surveys on foundational chemistry concepts and self-efficacy.
    • The authors suggest early instruction on misconceptions may support student confidence.

  • Narrative writing patterns differed by university context

    What the study found

    The study found that student narratives showed intermediate performance at both universities, with different linguistic patterns linked to writing assessment scores in each setting. The findings suggest that institutional context was associated with how narrative writing was patterned and evaluated.

    Why the authors say this matters

    The authors conclude that quantitative linguistic indicators can complement normative assessment, meaning scoring based on established standards. They also say the findings underscore the role of institutional context in writing development and support pedagogical strategies that combine automated assessment with qualitative analysis.

    What the researchers tested

    The researchers examined the relationship between writing performance, measured with the Early Writing Alert System (SISAT), and linguistic patterns in narratives from one public and one private university in northeastern Mexico. They analyzed 148 narratives produced over three academic periods using automated linguistic tools, Spearman correlations, and Kruskal–Wallis tests in a non-experimental, descriptive-comparative design with interpretive triangulation.

    What worked and what didn't

    At the public university, lexical richness and lexical density were positively correlated with SISAT scores, while greater text volume was negatively associated. At the private university, text length and diversity were positively related to scores, but excessive lexical density appeared counterproductive. No statistically significant differences were observed between the two universities or across periods.

    What to keep in mind

    The summary does not describe participant characteristics beyond the two universities or provide detail on the narratives beyond the corpus size and time span. The abstract also does not report additional limitations.

    • The study analyzed 148 student narratives from one public and one private university in northeastern Mexico.
    • Writing performance was assessed with SISAT, the Early Writing Alert System.
    • Linguistic patterns were linked to scores differently at the two universities.
    • No statistically significant differences were found between universities or across the three academic periods.
    • The authors say quantitative linguistic indicators can complement normative assessment.

  • Content knowledge shaped workshop participation for out-of-field physics teachers

    What the study found

    The study found that content knowledge was fundamental for effective participation in collaborative CoRe-design workshops. It also suggests that collaborative professional learning and development should be differentiated to support out-of-field teachers, meaning teachers assigned to teach a subject outside their main area of training.

    Why the authors say this matters

    The authors note that out-of-field physics teachers make up a growing share of New Zealand’s physics teaching workforce and receive limited targeted professional learning and development. The findings indicate that the study suggests better-tailored support may be needed for these teachers and their students.

    What the researchers tested

    The researchers used a mixed-method approach. They collected and inductively analysed content knowledge and self-efficacy tests, questionnaires, interviews, and workshop observations to explore factors affecting out-of-field physics teachers’ engagement and learning in collaborative CoRe-design workshops.

    What worked and what didn't

    The findings show that content knowledge supported effective participation in the workshops. The abstract also indicates that collaborative professional learning and development opportunities may require differentiation, suggesting that a one-size-fits-all approach was not adequate for all out-of-field teachers.

    What to keep in mind

    The summary does not describe specific limitations beyond the study’s focus on out-of-field physics teachers in collaborative CoRe-design workshops in New Zealand. It also does not provide detailed numerical results or compare different groups in the abstract.

    • Out-of-field physics teachers were the focus of the study.
    • Content knowledge was found to be fundamental for effective workshop participation.
    • The authors suggest collaborative professional learning may need to be differentiated.
    • The study used tests, questionnaires, interviews, and workshop observations.
    • The abstract does not report detailed numerical results.

  • DENEYAP workshops linked strong techno-philosophy with learner gains

    What the study found

    The study found that the DENEYAP Technology Workshops program was described as successful when leaders’ and instructional teams’ visions aligned and when the program had a strong techno-philosophy, meaning a clear view of how technology should be understood and taught. It also found that the program fostered learners’ interest and competence in techno-scientific thinking skills.

    Why the authors say this matters

    The authors conclude that nonformal learning can play a critical role in preparing the next generation for a technology-driven future. They suggest this happens through technology and design education grounded in a strong and rigorous techno-philosophical and techno-pedagogical design, meaning careful thinking about both the philosophy of technology and how it is taught.

    What the researchers tested

    This was a mixed-methods study of the DENEYAP Technology Workshops program, launched in 2017 by the T3 Foundation for 4th- to 9th-grade students. The researchers interviewed founders and program developers, analyzed lesson plans, and observed classrooms to examine the program’s curriculum and instructional methods.

    What worked and what didn't

    The findings indicate that collaboration with official and unofficial institutions brought important benefits, and that the empathizing stage of the design cycle, meaning the needs-analysis stage, was especially important. The study also identified areas for improvement: ongoing trainer professional development, infrastructure and material provision, and quality assurance in assessment practices, described here as the test stage of the design cycle.

    What to keep in mind

    The summary does not describe numerical outcome measures or comparative tests across different programs. The abstract also does not provide detailed limitations beyond noting areas that need improvement.

    • The program was linked to learners’ interest and competence in techno-scientific thinking skills.
    • Alignment between leaders’ and instructional teams’ visions was associated with success.
    • The empathizing, or needs-analysis, stage in the design cycle was described as crucial.
    • Collaboration with official and unofficial institutions was said to provide important benefits.
    • The abstract notes needs for stronger trainer development, infrastructure, and assessment quality assurance.

  • Teacher-related barriers hinder STEM curriculum integration

    What the study found

    The review found that integrating STEM education into curricula is affected by six main areas: systemic barriers, teacher challenges, student factors, curriculum issues, pedagogical gaps, and strategies and solutions. The authors identify teacher-related issues, especially limited professional development and limited interdisciplinary knowledge, as the most fundamental barriers.

    Why the authors say this matters

    The authors conclude that teacher empowerment is central to successful STEM integration. They also propose that aligning curricula with industry needs and Sustainable Development Goals (SDGs) may support more effective and inclusive STEM integration across different educational contexts.

    What the researchers tested

    The researchers conducted a systematic review using the PRISMA approach, selecting 28 peer-reviewed articles published between 2015 and 2025. They used qualitative content analysis to develop codes, categories, and themes from the reviewed studies.

    What worked and what didn't

    The review reports that teacher empowerment, robust professional development, pedagogical innovation, and strong policy support are part of the proposed solution framework. It also found that resource limitations and policy gaps were significant impediments, while teacher-related issues emerged as the most fundamental barriers.

    What to keep in mind

    This is a review article, so its findings depend on the studies it included. The abstract does not describe limitations beyond the review scope, but it does note that the proposed framework is intended as a generic and adaptable tool.

    • The review identified six themes affecting STEM integration in curricula.
    • Teacher challenges, including limited professional development and interdisciplinary knowledge, were the most fundamental barriers.
    • Resource limitations and policy gaps were also significant impediments.
    • The authors conclude that teacher empowerment is central to successful STEM integration.
    • The proposed framework emphasizes professional development, curriculum alignment with industry needs and SDGs, pedagogical innovation, and policy support.

  • AI feedback may not support text revision without process alignment

    What the study found

    The article argues that AI-based feedback can hinder rather than support learners’ revision when it is not aligned with how revision actually works. It identifies three tensions: timing of feedback, learner agency and motivation, and the need to connect revision to meaningful writing goals.

    Why the authors say this matters

    The authors suggest that aligning AI feedback with revision processes is important for supporting learners’ engagement with revising their own texts. They also conclude that the findings have implications for the design of AI feedback tools, writing instruction, and future empirical research.

    What the researchers tested

    The paper uses a theoretical analysis based on process-oriented writing research, which treats text revision as a sequence of interrelated sub-processes with cognitive, motivational, and strategic demands. It then analyzes two AI-based feedback tools, Khan Academy Writing Coach and FelloFish, to assess how their feedback practices fit those demands.

    What worked and what didn't

    The analysis found that the tools did not fully align with learners’ needs in three areas: feedback timing versus the need for critical distance from one’s own text, possible loss of agency and motivation when revision tasks are outsourced to AI, and weak connection between revision and broader writing purposes. The abstract does not report experimental performance outcomes or user trial results.

    What to keep in mind

    This is an analytical article, not a report of a classroom experiment or user study. The abstract does not describe sample size, participant characteristics, or empirical measurements, and limitations are not otherwise detailed in the available summary.

    • The article argues that AI-based feedback may hinder revision if it is not aligned with the revision process.
    • Three tensions are identified: timing, learner agency and motivation, and connection to meaningful writing goals.
    • The paper analyzes Khan Academy Writing Coach and FelloFish.
    • Revision is described as a sequence of interrelated sub-processes with cognitive, motivational, and strategic demands.
    • The abstract says implications are discussed for AI tool design, writing instruction, and future research.

  • Contextual STEM lessons improved some problem-solving and motivation measures

    What the study found

    The study found preliminary evidence that a culturally contextualized STEM intervention using the Engineering Design Process (a step-by-step approach to solving design problems) was associated with improvements in some problem-solving and motivation measures for fourth-grade students in Oman. The gains were not uniform across all measured outcomes.

    Why the authors say this matters

    The authors conclude that the findings support culturally responsive, practice-based STEM pedagogy and suggest it can align STEM learning with local realities in Oman. They also say the study provides initial insight into contextualized, performance-based assessments of students' cognitive and motivational development in primary STEM education.

    What the researchers tested

    The researchers used a quasi-experimental design with 118 fourth-grade students in Oman. Students received either a STEM-based instructional intervention or a traditional science curriculum, and the intervention used hands-on, inquiry-driven tasks tied to local environmental and cultural experiences.

    What worked and what didn't

    The intervention showed preliminary improvements in problem-solving dimensions of problem identification, planning, and production. It also showed improvements in motivational factors such as responsibility and engagement. No significant gains were observed in self-efficacy or peer collaboration.

    What to keep in mind

    The abstract describes the findings as preliminary, so the results are not presented as final. The summary does not provide additional limitations beyond noting that some outcomes improved while others did not.

    • A STEM intervention based on the Engineering Design Process was tested with 118 fourth-grade students in Oman.
    • The intervention used culturally contextualized tasks such as weather-resistant shelters, floating paper boats, chocolate molds for warm climates, and oil-spill cleanup solutions.
    • Preliminary improvements were seen in problem identification, planning, production, responsibility, and engagement.
    • No significant gains were found for self-efficacy or peer collaboration.
    • The authors say the study supports culturally responsive, practice-based STEM teaching and contextualized assessment.