SUPPORT/EXTENSION MATERIAL
EVALUATION MODELS, PARADIGMS AND PRINCIPLES
EVALUATION TOOLS



Support material and references relating to evaluation of educational technology are burgeoning. It is clearly beyond the scope of this handbook to provide a comprehensive list. However, you may find some of the following online resources helpful.


Evaluation Models, Paradigms and Principles

There are a number of ways of conceptualising aspects of evaluation, some of which are presented on the following websites.

http://coe.sdsu.edu/eet/Admin/TOC/start.htm
The online Encyclopedia of Educational Technology contains an outline of Kirkpatrick's (Kirkpatrick, 1994) four levels of evaluation: reactions, learning, transfer and results. Text and graphics are used to present the concepts in an accessible and appealing way.

http://itech1.coe.uga.edu/ITevaluation/models.html
Detailed descriptions of various evaluation models are provided on this University of Georgia website.
Objectives-Based Evaluation Model
Experimental Evaluation Model
Qualitative Evaluation Model
Connoisseurship Evaluation Model
Responsive Evaluation Model
Multiple Methods Evaluation Model

http://www2.deakin.edu.au/dcad/ITEvaluation/Paradigms2.asp
One of the seminal texts on the nature and evolution of evaluation practice is Fourth Generation Evaluation by (Guba & Lincoln, 1989). The four generations of evaluation articulated by them are briefly summarised on this website. Two other useful paradigms for evaluation practice, action research and clinical supervision, are also summarised here.

http://www.cstudies.ubc.ca/facdev/services/senate.html
The Centre for Teaching and Academic Growth at the University of British Colombia provides a website with the following general information.


Evaluation Tools

http://mime1.marc.gatech.edu/MM_Tools/evaluation.html
Georgia Tech Research Institute has provided a website that contains a number of evaluation tools suitable for use at various stages of a project. The following templates are available for gathering both quantitative and qualitative data:

Evaluation Matrix

Anecdotal Record Form

Expert Review Checklist

Focus Group Protocol

Formative Review Log

Implementation Log

Interview Protocol

Questionnaire

User Interface Rating Form

 

http://www.monash.edu.au/informatics/TechME/evaluati.htm#Evaluation%20
An overview of evaluation is presented on this website. Formative and summative evaluation methods are briefly described and links are provided to a number of evaluation tools. While it relates specifically to medical education, a number of aspects are applicable to other discipline areas.

http://iet.open.ac.uk/plum/evaluation/plum.html
This website, produced by the Institute for Educational Technology at the Open University, UK, provides information about different types of evaluation findings, formative and summative evaluation processes and data collection methods. A number of pro-forma documents are available to help facilitate recording of evaluation data.

http://www.clt.uts.edu.au/contentssfs.html
The Centre for Learning and Teaching at UTS has produced an evaluation guide for their teaching staff. It offers a comprehensive approach to evaluation and contains information about data collection processes. Proformas are provided for several of the techniques described. A questionnaire item bank is also a useful feature.