Towards a Paradigm Change in Group and Peer Assessment in Software Engineering Education

Paul Vossen; Suraj Ajit

doi:10.1109/cseet49119.2020.9206197

Towards a Paradigm Change in Group and Peer Assessment in Software Engineering Education

Paul Vossen^*, Suraj Ajit^*

^*Corresponding author for this work

Computing

Research output: Contribution to Book/Report › Conference Contribution › peer-review

Abstract

Conventional approaches to group and peer assessment are invariably based on highly questionable assumptions about educational measurement and how to weight and aggregate multiple scores into an overall judgement of outcome and performance. In this paper, we propose an alternative ap-proach based on a sound theory of educational scoring and rating. Our approach is particularly relevant for software engineering education where group projects with multiple types of outcomes are used to assess individual students. We will also present recent progress with two experimental tools incorporating our novel approach and compare the latter with some well-known tools based on conventional ap-proaches. We will focus on explaining the reasons for and benefits of adopting this paradigm changing approach to group-peer marking.

Original language	English
Title of host publication	Proceedings of the 32nd IEEE International Conference on Software Engineering Education & Training (CSEE&T 2020)
Publisher	IEEE
Pages	1-10
Number of pages	10
ISBN (Electronic)	978-1-7281-6807-4
ISBN (Print)	978-1-7281-6807-4, 978-1-7281-6808-1
DOIs	https://doi.org/10.1109/cseet49119.2020.9206197
Publication status	Published - 14 Oct 2020
Event	32nd IEEE International Conference on Software Engineering Education & Training (CSEE&T 2020) - Germany, Munich, Germany Duration: 9 Nov 2020 → 12 Nov 2020 https://ase.in.tum.de/cseet2020/

Publication series

Name	2020 IEEE 32nd Conference on Software Engineering Education and Training (CSEE&T)

Conference

Conference	32nd IEEE International Conference on Software Engineering Education & Training (CSEE&T 2020)
Country/Territory	Germany
City	Munich
Period	9/11/20 → 12/11/20
Internet address	https://ase.in.tum.de/cseet2020/

Keywords

Group-peer marketing
Peer assessment
Educational judgement
Bounded scale
Arithmetic mean
Quasi-arithmetic means
Scoring rules
Scoring models
Scoring theory

Access to Document

10.1109/cseet49119.2020.9206197

Cite this

Vossen, P., & Ajit, S. (2020). Towards a Paradigm Change in Group and Peer Assessment in Software Engineering Education. In Proceedings of the 32nd IEEE International Conference on Software Engineering Education & Training (CSEE&T 2020) (pp. 1-10). (2020 IEEE 32nd Conference on Software Engineering Education and Training (CSEE&T)). IEEE. https://doi.org/10.1109/cseet49119.2020.9206197

@inproceedings{9a3557e5d7a6400f9ad5c5a10840c57d,

title = "Towards a Paradigm Change in Group and Peer Assessment in Software Engineering Education",

abstract = "Conventional approaches to group and peer assessment are invariably based on highly questionable assumptions about educational measurement and how to weight and aggregate multiple scores into an overall judgement of outcome and performance. In this paper, we propose an alternative ap-proach based on a sound theory of educational scoring and rating. Our approach is particularly relevant for software engineering education where group projects with multiple types of outcomes are used to assess individual students. We will also present recent progress with two experimental tools incorporating our novel approach and compare the latter with some well-known tools based on conventional ap-proaches. We will focus on explaining the reasons for and benefits of adopting this paradigm changing approach to group-peer marking.",

keywords = "Group-peer marketing, Peer assessment, Educational judgement, Bounded scale, Arithmetic mean, Quasi-arithmetic means, Scoring rules, Scoring models, Scoring theory",

author = "Paul Vossen and Suraj Ajit",

year = "2020",

month = oct,

day = "14",

doi = "10.1109/cseet49119.2020.9206197",

language = "English",

isbn = "978-1-7281-6807-4",

series = "2020 IEEE 32nd Conference on Software Engineering Education and Training (CSEE&T)",

publisher = "IEEE",

pages = "1--10",

booktitle = "Proceedings of the 32nd IEEE International Conference on Software Engineering Education & Training (CSEE&T 2020)",

note = "32nd IEEE International Conference on Software Engineering Education & Training (CSEE&T 2020) ; Conference date: 09-11-2020 Through 12-11-2020",

url = "https://ase.in.tum.de/cseet2020/",

}

Vossen, P & Ajit, S 2020, Towards a Paradigm Change in Group and Peer Assessment in Software Engineering Education. in Proceedings of the 32nd IEEE International Conference on Software Engineering Education & Training (CSEE&T 2020). 2020 IEEE 32nd Conference on Software Engineering Education and Training (CSEE&T), IEEE, pp. 1-10, 32nd IEEE International Conference on Software Engineering Education & Training (CSEE&T 2020), Munich, Germany, 9/11/20. https://doi.org/10.1109/cseet49119.2020.9206197

Towards a Paradigm Change in Group and Peer Assessment in Software Engineering Education. / Vossen, Paul; Ajit, Suraj.
Proceedings of the 32nd IEEE International Conference on Software Engineering Education & Training (CSEE&T 2020). IEEE, 2020. p. 1-10 (2020 IEEE 32nd Conference on Software Engineering Education and Training (CSEE&T)).

Research output: Contribution to Book/Report › Conference Contribution › peer-review

TY - GEN

T1 - Towards a Paradigm Change in Group and Peer Assessment in Software Engineering Education

AU - Vossen, Paul

AU - Ajit, Suraj

PY - 2020/10/14

Y1 - 2020/10/14

N2 - Conventional approaches to group and peer assessment are invariably based on highly questionable assumptions about educational measurement and how to weight and aggregate multiple scores into an overall judgement of outcome and performance. In this paper, we propose an alternative ap-proach based on a sound theory of educational scoring and rating. Our approach is particularly relevant for software engineering education where group projects with multiple types of outcomes are used to assess individual students. We will also present recent progress with two experimental tools incorporating our novel approach and compare the latter with some well-known tools based on conventional ap-proaches. We will focus on explaining the reasons for and benefits of adopting this paradigm changing approach to group-peer marking.

AB - Conventional approaches to group and peer assessment are invariably based on highly questionable assumptions about educational measurement and how to weight and aggregate multiple scores into an overall judgement of outcome and performance. In this paper, we propose an alternative ap-proach based on a sound theory of educational scoring and rating. Our approach is particularly relevant for software engineering education where group projects with multiple types of outcomes are used to assess individual students. We will also present recent progress with two experimental tools incorporating our novel approach and compare the latter with some well-known tools based on conventional ap-proaches. We will focus on explaining the reasons for and benefits of adopting this paradigm changing approach to group-peer marking.

KW - Group-peer marketing

KW - Peer assessment

KW - Educational judgement

KW - Bounded scale

KW - Arithmetic mean

KW - Quasi-arithmetic means

KW - Scoring rules

KW - Scoring models

KW - Scoring theory

UR - https://www.mendeley.com/catalogue/0f7357bd-ba6b-311f-96c2-ed56ae35055b/

U2 - 10.1109/cseet49119.2020.9206197

DO - 10.1109/cseet49119.2020.9206197

M3 - Conference Contribution

SN - 978-1-7281-6807-4

SN - 978-1-7281-6808-1

T3 - 2020 IEEE 32nd Conference on Software Engineering Education and Training (CSEE&T)

SP - 1

EP - 10

BT - Proceedings of the 32nd IEEE International Conference on Software Engineering Education & Training (CSEE&T 2020)

PB - IEEE

T2 - 32nd IEEE International Conference on Software Engineering Education & Training (CSEE&T 2020)

Y2 - 9 November 2020 through 12 November 2020

ER -

Towards a Paradigm Change in Group and Peer Assessment in Software Engineering Education

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Dr Suraj Ajit

Authentic assessment of group work: issues, models and tools

Cite this

Towards a Paradigm Change in Group and Peer Assessment in Software Engineering Education

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Profiles

Dr Suraj Ajit

Activities

Authentic assessment of group work: issues, models and tools

Cite this