Bauer, Elisabeth ; Greisel, Martin ; Kuznetsov, Ilia ; Berndt, Markus ; Kollar, Ingo ; Dresel, Markus ; Fischer, Martin R. ; Fischer, Frank (2024)
Using natural language processing to support peer‐feedback in the age of artificial intelligence: A cross‐disciplinary framework and a research agenda.
In: British Journal of Educational Technology, 2023, 54 (5)
doi: 10.26083/tuprints-00024681
Artikel, Zweitveröffentlichung, Verlagsversion
 | Es ist eine neuere Version dieses Eintrags verfügbar. |
Kurzbeschreibung (Abstract)
Advancements in artificial intelligence are rapidly increasing. The new‐generation large language models, such as ChatGPT and GPT‐4, bear the potential to transform educational approaches, such as peer‐feedback. To investigate peer‐feedback at the intersection of natural language processing (NLP) and educational research, this paper suggests a cross‐disciplinary framework that aims to facilitate the development of NLP‐based adaptive measures for supporting peer‐feedback processes in digital learning environments. To conceptualize this process, we introduce a peer‐feedback process model, which describes learners' activities and textual products. Further, we introduce a terminological and procedural scheme that facilitates systematically deriving measures to foster the peer‐feedback process and how NLP may enhance the adaptivity of such learning support. Building on prior research on education and NLP, we apply this scheme to all learner activities of the peer‐feedback process model to exemplify a range of NLP‐based adaptive support measures. We also discuss the current challenges and suggest directions for future cross‐disciplinary research on the effectiveness and other dimensions of NLP‐based adaptive support for peer‐feedback. Building on our suggested framework, future research and collaborations at the intersection of education and NLP can innovate peer‐feedback in digital learning environments.
Practitioner notes
What is already known about this topic
• There is considerable research in educational science on peer‐feedback processes.
• Natural language processing facilitates the analysis of students' textual data.
• There is a lack of systematic orientation regarding which NLP techniques can be applied to which data to effectively support the peer‐feedback process.
What this paper adds
• A comprehensive overview model that describes the relevant activities and products in the peer‐feedback process.
• A terminological and procedural scheme for designing NLP‐based adaptive support measures.
• An application of this scheme to the peer‐feedback process results in exemplifying the use cases of how NLP may be employed to support each learner activity during peer‐feedback.
Implications for practice and/or policy
• To boost the effectiveness of their peer‐feedback scenarios, instructors and instructional designers should identify relevant leverage points, corresponding support measures, adaptation targets and automation goals based on theory and empirical findings.
• Management and IT departments of higher education institutions should strive to provide digital tools based on modern NLP models and integrate them into the respective learning management systems; those tools should help in translating the automation goals requested by their instructors into prediction targets, take relevant data as input and allow for evaluating the predictions.
| Typ des Eintrags: | Artikel |
|---|---|
| Erschienen: | 2024 |
| Autor(en): | Bauer, Elisabeth ; Greisel, Martin ; Kuznetsov, Ilia ; Berndt, Markus ; Kollar, Ingo ; Dresel, Markus ; Fischer, Martin R. ; Fischer, Frank |
| Art des Eintrags: | Zweitveröffentlichung |
| Titel: | Using natural language processing to support peer‐feedback in the age of artificial intelligence: A cross‐disciplinary framework and a research agenda |
| Sprache: | Englisch |
| Publikationsjahr: | 9 Februar 2024 |
| Ort: | Darmstadt |
| Publikationsdatum der Erstveröffentlichung: | 2023 |
| Ort der Erstveröffentlichung: | Oxford |
| Verlag: | John Wiley & Sons |
| Titel der Zeitschrift, Zeitung oder Schriftenreihe: | British Journal of Educational Technology |
| Jahrgang/Volume einer Zeitschrift: | 54 |
| (Heft-)Nummer: | 5 |
| DOI: | 10.26083/tuprints-00024681 |
| URL / URN: | https://tuprints.ulb.tu-darmstadt.de/24681 |
| Zugehörige Links: | |
| Herkunft: | Zweitveröffentlichung DeepGreen |
| Kurzbeschreibung (Abstract): | Advancements in artificial intelligence are rapidly increasing. The new‐generation large language models, such as ChatGPT and GPT‐4, bear the potential to transform educational approaches, such as peer‐feedback. To investigate peer‐feedback at the intersection of natural language processing (NLP) and educational research, this paper suggests a cross‐disciplinary framework that aims to facilitate the development of NLP‐based adaptive measures for supporting peer‐feedback processes in digital learning environments. To conceptualize this process, we introduce a peer‐feedback process model, which describes learners' activities and textual products. Further, we introduce a terminological and procedural scheme that facilitates systematically deriving measures to foster the peer‐feedback process and how NLP may enhance the adaptivity of such learning support. Building on prior research on education and NLP, we apply this scheme to all learner activities of the peer‐feedback process model to exemplify a range of NLP‐based adaptive support measures. We also discuss the current challenges and suggest directions for future cross‐disciplinary research on the effectiveness and other dimensions of NLP‐based adaptive support for peer‐feedback. Building on our suggested framework, future research and collaborations at the intersection of education and NLP can innovate peer‐feedback in digital learning environments. Practitioner notes What is already known about this topic • There is considerable research in educational science on peer‐feedback processes. • Natural language processing facilitates the analysis of students' textual data. • There is a lack of systematic orientation regarding which NLP techniques can be applied to which data to effectively support the peer‐feedback process. What this paper adds • A comprehensive overview model that describes the relevant activities and products in the peer‐feedback process. • A terminological and procedural scheme for designing NLP‐based adaptive support measures. • An application of this scheme to the peer‐feedback process results in exemplifying the use cases of how NLP may be employed to support each learner activity during peer‐feedback. Implications for practice and/or policy • To boost the effectiveness of their peer‐feedback scenarios, instructors and instructional designers should identify relevant leverage points, corresponding support measures, adaptation targets and automation goals based on theory and empirical findings. • Management and IT departments of higher education institutions should strive to provide digital tools based on modern NLP models and integrate them into the respective learning management systems; those tools should help in translating the automation goals requested by their instructors into prediction targets, take relevant data as input and allow for evaluating the predictions. |
| Freie Schlagworte: | adaptivity, artificial intelligence, digital learning, large language models, learner support, natural language processing, peer‐feedback |
| Status: | Verlagsversion |
| URN: | urn:nbn:de:tuda-tuprints-246814 |
| Sachgruppe der Dewey Dezimalklassifikatin (DDC): | 000 Allgemeines, Informatik, Informationswissenschaft > 004 Informatik 300 Sozialwissenschaften > 370 Erziehung, Schul- und Bildungswesen |
| Fachbereich(e)/-gebiet(e): | 20 Fachbereich Informatik 20 Fachbereich Informatik > Ubiquitäre Wissensverarbeitung Zentrale Einrichtungen Zentrale Einrichtungen > hessian.AI - Hessisches Zentrum für Künstliche Intelligenz |
| Hinterlegungsdatum: | 09 Feb 2024 13:54 |
| Letzte Änderung: | 05 Mär 2024 15:47 |
| PPN: | |
| Zugehörige Links: | |
| Export: | |
| Suche nach Titel in: | TUfind oder in Google |
Verfügbare Versionen dieses Eintrags
- Using natural language processing to support peer‐feedback in the age of artificial intelligence: A cross‐disciplinary framework and a research agenda. (deposited 09 Feb 2024 13:54) [Gegenwärtig angezeigt]
 |
Frage zum Eintrag |
Optionen (nur für Redakteure)
 |
Redaktionelle Details anzeigen |
Drucken
Impressum