The Development of Evaluative Expertise Through Working with Exemplars in Higher Education
DOI:
https://doi.org/10.22235/pe.v15i1.2658Keywords:
exemplar, assessment, higher education, feedback, self-assessmentAbstract
Evaluative expertise refers to the ability of a person to make quality judgments about some object of evaluation. In higher education, this ability must be developed by future graduates
to learn, develop good jobs, make decisions, and become responsible professionals. The copies, understood as samples of work carefully chosen to illustrate dimensions of quality and clarify the expectations of the evaluation, constitute a vehicle to develop evaluative expertise in students. This article discusses the conceptual bases of working with exemplars in the framework of formative assessment and its effect on professional training in higher education, based on a review of the literature on the subject. Some guiding principles for practice are proposed, and strategies for their implementation in feedback processes are analyzed, self-evaluation and co-evaluation based fundamentally on rubrics use.
Downloads
References
Ajjawi, R., Tai, J., Dawson, Ph., & Buod, D. (2018). Conceptualising evaluative judgment for sustainable assessment in higher education. En D. Boud, R. Ajjawi, P. Dawson & J. Tai (Eds.), Developing Evaluative Judgement in Higher Education: Assessment for knowing and producing quality work (pp. 7-17). Routledge.
Andrade, H. (2019). A Critical Review of Research on Student Self-Assessment. Frontiers in Education, 4(87), 1-13. https://doi.org/10.3389/feduc.2019.00087
Andrade, H., Du, Y., & Mycek, K. (2010). Rubric-referenced self-assessment and middle school students’ writing. Assessment in Education, 17(2), 199-214. https://doi.org/10.1080/09695941003696172
Andrade, H., Du, Y., & Wang, X. (2008). Putting rubrics to the test: The effect of a model, criteria generation, and rubric-referenced self-assessment on elementary school students’ writing. Educational Measurement: Issues and Practices, 27(2), 3-13. https://doi.org/10.1111/j.1745-3992.2008.00118.x
Arter, J., & McThige, J. (2001). Scoring Rubrics in the Classroom. Pearson Education.
Bacchus, R., Colvin, E., Knight, E., & Ritter, L. (2020). When rubrics aren’t enough: Exploring exemplars and student rubric co-construction. Journal of Curriculum and Pedagogy, 17(1), 48-61. https://doi.org/10.1080/15505170.2019.1627617
Bloxham, S., & Campbell, L. (2010). Generating dialogue in assessment feedback: exploring the use of interactive cover sheets. Assessment & Evaluation in Higher Education, 35(3), 291–300. https://doi.org/10.1080/02602931003650045
Brookhart, S., & Ruiz-Primo, M. (2018). Using feedback to improve learning. Routledge.
Brown, G., Andrade, H., & Chen, F. (2015). Accuracy in student self-assessment: directions and cautions for research. Assess. Educ., 22, 444–457. https://doi.org/10.1080/0969594X.2014.996523
Cañadas, L. (2020). Evaluación formativa en el contexto universitario: oportunidades y propuestas de actuación. Revista Digital de Investigación en Docencia Universitaria, 14(2), e1214.
Carless, D. (2015). La confianza: Facilitar el feedback dialógico. En D. Boud, & E. Molloy (Coords.), El feedback en educación superior y profesional comprenderlo y hacerlo bien (pp. 115-129). Narcea.
Carless, D., & Chan, K. (2016). Managing dialogic use of exemplars, Assessment & Evaluation in Higher Education, 42(6). https://doi.org/10.1080/02602938.2016.1211246
Carless, D., Chan, K., To, J., Lo, M., & Barrett, E. (2018). Developing students’ capacities for evaluative judgement through analysing exemplars. En D. Boud, R. Ajjawi, P. Dawson, & J. Tai (Eds.), Developing Evaluative Judgement in Higher Education: Assessment for knowing and producing quality work (pp. 108-116). Routledge.
Dawson, P. (2017). Assessment rubrics: towards clearer and more replicable design, research and practice. Assessment & Evaluation in Higher Education, 42, 347-360. https://doi.org/10.1080/02602938.2015.1111294
Dawson, P., Ajjawi, R., Boud, D., & Tai, J. (2018). Introduction: What is evaluative judgment? En D. Boud, R. Ajjawi, P. Dawson, & J. Tai (Eds.), Developing Evaluative Judgement in Higher Education: Assessment for knowing and producing quality work (pp. 1-4). Routledge.
Foster, G., & Marasco, T. L. (2007). Exemplars: Your best resource to improve student writing. Pembroke.
Gladovic, C., Hong-Meng Tai, J., & Dawson, P. (2021). Qualitative approaches to researching evaluative judgement in pedagogical activities: a case study. Assessment & Evaluation in Higher Education, 47(2), 231-244. https://doi.org/10.1080/02602938.2021.1901854
Handley, K., & Williams, L. (2011). From copying to learning: using exemplars to engage students with assessment criteria and feedback. Assessment & Evaluation in Higher Education, 36(1), 95–108. https://doi.org/10.1080/02602930903201669
Haughney, K., Wakeman, S., & Hart, L. (2020). Quality of Feedback in Higher Education: A Review of Literature. Educ. Sci., 10(60), 1-15. https://doi.org/10.3390/educsci10030060
Hendry, G., & Anderson J. (2013). Helping students understand the standards of work expected in an essay: using exemplars in mathematics pre-service education classes. Assessment & Evaluation in Higher Education, 38(6), 754-768. https://doi.org/10.1080/02602938.2012.703998
Hendry, G., Armstrong, S., & Bromberger, N. (2012). Implementing standards-based assessment effectively: incorporating discussion of exemplars into classroom teaching. Assessment & Evaluation in Higher Education, 37(2), 149- 161. https://doi.org/10.1080/02602938.2010.515014
Hendry, G., Bromberger, N., & Armstrong, S. (2011). Constructive guidance and feedback for learning: the usefulness of exemplars, marking sheets and different types of feedback in a first year law subject. Assessment & Evaluation in Higher Education, 36(1), 1-11. https://doi.org/10.1080/02602930903128904
Ibarra-Sáiz, M. S., Rodríguez-Gómez, G., & Boud, D. (2020). Developing student competence through peer assessment: the role of feedback, self-regulation and evaluative judgement. Higher Education, 80, 137-156. https://doi.org/10.1007/s10734-019-00469-2
Kilgour, P., Northcote, M., Williams, A., & Kilgour, A. (2019). A plan for the co-construction and collaborative use of rubrics for student learning. Assessment & Evaluation in Higher Education, 45(1), 140-153. https://doi.org/10.1080/02602938.2019.1614523
Lipnevich, A., McCallen, L., Miles, K., & Smith, J. (2013). Mind the gap! Students' use of exemplars and detailed rubrics as formative assessment. Instructional Science, 42(4), 539-559. https://doi.org/10.1007/s11251-013-9299-9
Mertler, C. A. (2000). Designing scoring rubrics for your classroom. Practical assessment, research, and evaluation, 7(25), 1-9. https://doi.org/10.7275/gcy8-0w24
Naidoo, O., Tai, J., & Penman, R. (2020). Preparing students for the future through developing evaluative judgement. The Clinical Teacher, 18(2), 1-6. https://doi.org/10.1111/tct.13268
Newlyn, D. (2013). Providing Exemplars in the Learning Environment: The Case for and against. Universal Journal of Educational Research, 1(1), 26-32. https://doi.org/10.13189/ujer.2013.010104
Nicol, D. (2010). From monologue to dialogue: improving written feedback processes in mass higher education. Assessment & Evaluation in Higher Education, 35(5), 501-517. https://doi.org/10.1080/02602931003786559
Orsmond, P., Merry, S., & Reiling, K. (2005). Biology students’ utilization of tutors’ formative feedback: a qualitative interview study. Assessment and Evaluation in Higher Education, 30(4), 369-386. https://doi.org/10.1080/02602930500099177
Roblyer, M. D., & Wiencke, W. R. (2003). Design and use of a rubric to assess and encourage interactive qualities in distance courses. The American journal of distance education, 17(2), 77-98. https://doi.org/10.1207/S15389286AJDE1702_2
Ross, J., Rolheiser, C., & Hogaboam-Gray, A. (1999). Effects of self-evaluation training on narrative writing. Assessing Writing, 6(1), 107-132. https://doi.org/10.1016/S1075-2935(99)00003-3
Sadler, R. (1983). Evaluation and the improvement of academic learning. Journal of Higher Education,54, 60-79. https://doi.org/10.1007/BF00117714
Sadler, R. (1989). Formative assessment and the design of instructional systems. Instructional Science, 18, 119-144. https://doi.org/10.1007/BF00117714
Sadler, R. (2002). Ah! … so that's ‘quality’. En P. Schwartz, & G. Webb (Eds.), Assessment: case studies, experience and practice from higher education (pp. 130-136). Kogan Page.
Sadler, R. (2010). Beyond feedback: developing student capability in complex appraisal. Assessment & Evaluation in Higher Education, 35(5), 535-550. https://doi.org/10.1080/02602930903541015
Sadler, D. (2017). Academic achievement standards and quality assurance. Quality in Higher Education, 23(2), 81-99. https://doi.org/10.1080/13538322.2017.1356614
Smyth, P., & Carless, D. (2020). Theorising how teachers manage the use of exemplars: Towards mediated learning from exemplars. Assessment & Evaluation in Higher Education, 46(3), 393-406. https://doi.org/10.1080/02602938.2020.1781785
Tai, J., Ajjawi, R., Boud, D., Dawson, Ph., & Panadero, E. (2018). Developing evaluative judgement: enabling students to make decisions about the quality of work. High. Educ., 76, 467–481. https://doi.org/10.1007/s10734-017-0220-3
Tam, A. (2020). Undergraduate students’ perceptions of and responses to exemplar-based dialogic feedback. Assessment & Evaluation in Higher Education, 46(2), 269-285. https://doi.org/0.1080/02602938.2020.1772957
To, J., & Carless, D. (2015). Making productive use of exemplars: Peer discussion and teacher guidance for positive transfer of strategies. Journal of Further and Higher Education, 40(6), 746-764. https://doi.org/10.1080/0309877X.2015.1014317
Valle, C., Andrade, H., Palma, M., & Hefferen, J. (2016). Applications of peer assessment and self-assessment in music. Music Educators Journal, 102(4), 41-49. https://doi.org/10.1177/0027432116644652
Van der Kleij, F., Adie, L., & Cumming, J. (2019). A meta-review of the student role in feedback. International Journal of Educational Research, 98, 303-323. https://doi.org/10.1016/j.ijer.2019.09.005
Villarroel, V., & Bruna, D. (2019). ¿Evaluamos lo que realmente importa? El desafío de la evaluación auténtica en educación superior. Calidad en la educación, 50, 492-509. https://doi.org/10.31619/caledu.n50.729
Zachary, B., Chen, F., & Andrade, H. (2012, octubre 19). Student self-assessment in middle school mathematics: A pilot study. Presentado en NERA Conference Proceedings 2012, Nueva York, NY. https://opencommons.uconn.edu/cgi/viewcontent.cgi?article=1004&context=nera_2012
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 Páginas de Educación
This work is licensed under a Creative Commons Attribution 4.0 International License.
- The authors will retain their copyrights and guarantee the journal the right of first publication of their work, which will be simultaneously subject to the Creative Commons Recognition License that allows third parties to share the work provided that its author is indicated and Your first publication in this journal.
- Authors may adopt other non-exclusive license agreements for the distribution of the version of the published work provided that the initial publication in this journal is indicated.
- Authors are allowed and recommended to disseminate their work through the Internet after the publication process, which can produce interesting exchanges and increase citations of the published work. (See The effect of open access).
