The Proceedings of the Information Systems Education Conference 2009: §4343    Home    Papers/Indices    prev (§4342)    Next (§4344)
Sun, Nov 8, 11:00 - 11:25, Crystal 4     Paper (refereed)
Recommended Citation: Scher, J M.  A Generalized Thurstonian Paired Comparison Multicriteria Heuristic Model for Peer Evaluation of Individual Performance on IS Team Projects.  In The Proceedings of the Information Systems Education Conference 2009, v 26 (Washington DC): §4343. ISSN: 1542-7382. (A later version appears in Information Systems Education Journal 8(23). ISSN: 1545-679X.)
 
Recipient of Meritorious Paper Award
 
CDpic

A Generalized Thurstonian Paired Comparison Multicriteria Heuristic Model for Peer Evaluation of Individual Performance on IS Team Projects

thumb
Refereed9 pages
Julian M. Scher    [a1] [a2]
Department of Information Systems, College of Computing Sciences
New Jersey Institute of Technology    [u1] [u2]
Newark, New Jersey, USA    [c1] [c2]

Information Systems instructors are generally encouraged to introduce team projects into their pedagogy, with a consequential issue of objectively evaluating the performance of each individual team member. The concept of "freeloading" is well-known for team projects, and for this, and other reasons, a peer review process of team members, by team members, is often advocated. We propose an objective heuristic model for obtaining a scale of individual performance, based upon a generalization of Thurstone's Law of Comparative Judgment, where pair wise comparisons of team member’s performance are elicited with regard to various criteria, and we demonstrate how a scale may be obtained to objectively rate the individual members of each team. A numerical example is provided to illustrate our Generalized Thurstone model’s heuristic methodologies.

Keywords: Thurstone, paired comparison, team projects, peer evaluation, multi-criteria, individual performance

Read this refereed paper in Adobe Portable Document (PDF) format. (9 pages, 354 K bytes)
Preview this refereed paper in Plain Text (TXT) format. (20 K bytes)

CDpic
Comments and corrections to
webmaster@isedj.org