Automated analysis of short responses in an interactive synthetic tutoring system for introductory physics

dc.citation.doi10.1103/PhysRevPhysEducRes.12.010122
dc.citation.issn2469-9896
dc.citation.issue1
dc.citation.jtitlePhysical Review Physics Education Research
dc.citation.spage16
dc.citation.volume12
dc.contributor.authorNakamura, Christopher M.
dc.contributor.authorMurphy, Sytil K.
dc.contributor.authorChristel, M. G.
dc.contributor.authorStevens, S. M.
dc.contributor.authorZollman, Dean A.
dc.contributor.authoreiddzollman
dc.contributor.kstateZollman, Dean A.
dc.date.accessioned2017-12-12T20:40:18Z
dc.date.available2017-12-12T20:40:18Z
dc.date.issued2016-03-16
dc.date.published2016
dc.descriptionCitation: Nakamura, C. M., Murphy, S. K., Christel, M. G., Stevens, S. M., & Zollman, D. A. (2016). Automated analysis of short responses in an interactive synthetic tutoring system for introductory physics. Physical Review Physics Education Research, 12(1), 16. doi:10.1103/PhysRevPhysEducRes.12.010122
dc.description.abstractComputer-automated assessment of students' text responses to short-answer questions represents an important enabling technology for online learning environments. We have investigated the use of machine learning to train computer models capable of automatically classifying short-answer responses and assessed the results. Our investigations are part of a project to develop and test an interactive learning environment designed to help students learn introductory physics concepts. The system is designed around an interactive video tutoring interface. We have analyzed 9 with about 150 responses or less. We observe for 4 of the 9 automated assessment with interrater agreement of 70% or better with the human rater. This level of agreement may represent a baseline for practical utility in instruction and indicates that the method warrants further investigation for use in this type of application. Our results also suggest strategies that may be useful for writing activities and questions that are more appropriate for automated assessment. These strategies include building activities that have relatively few conceptually distinct ways of perceiving the physical behavior of relatively few physical objects. Further success in this direction may allow us to promote interactivity and better provide feedback in online learning systems. These capabilities could enable our system to function more like a real tutor.
dc.identifier.urihttp://hdl.handle.net/2097/38453
dc.relation.urihttps://doi.org/10.1103/PhysRevPhysEducRes.12.010122
dc.rightsAttribution 3.0 Unported (CC BY 3.0)
dc.rights.urihttps://creativecommons.org/licenses/by/3.0/
dc.subjectStudents
dc.subjectSkills
dc.subjectQuestions
dc.subjectAgreement
dc.subjectComputer
dc.subjectVideo
dc.titleAutomated analysis of short responses in an interactive synthetic tutoring system for introductory physics
dc.typeArticle

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
PhysRevPhysEducRes.12.010122.pdf
Size:
644.21 KB
Format:
Adobe Portable Document Format