SUPPORT/EXTENSION MATERIAL |
Support material and references relating to evaluation of educational technology are burgeoning. It is clearly beyond the scope of this handbook to provide a comprehensive list. However, you may find some of the following online resources helpful.
Evaluation Models, Paradigms and Principles
There are a number of ways of conceptualising aspects of evaluation, some of which are presented on the following websites.
http://coe.sdsu.edu/eet/Admin/TOC/start.htm
The online Encyclopedia of Educational Technology
contains an outline of Kirkpatrick's (Kirkpatrick, 1994) four levels of evaluation:
reactions, learning, transfer and results. Text and graphics are used to present
the concepts in an accessible and appealing way.
http://itech1.coe.uga.edu/ITevaluation/models.html
Detailed descriptions of various evaluation
models are provided on this University of Georgia website.
Objectives-Based Evaluation Model
Experimental Evaluation Model
Qualitative Evaluation Model
Connoisseurship Evaluation Model
Responsive Evaluation Model
Multiple Methods Evaluation Model
http://www2.deakin.edu.au/dcad/ITEvaluation/Paradigms2.asp
One of the seminal texts on the nature and evolution
of evaluation practice is Fourth Generation Evaluation by (Guba &
Lincoln, 1989). The four generations of evaluation articulated by them are briefly
summarised on this website. Two other useful paradigms for evaluation practice,
action research and clinical supervision, are also summarised here.
http://www.cstudies.ubc.ca/facdev/services/senate.html
The Centre for Teaching and Academic Growth
at the University of British Colombia provides a website with the following
general information.
http://mime1.marc.gatech.edu/MM_Tools/evaluation.html
Georgia Tech Research Institute has provided a
website that contains a number of evaluation tools suitable for use
at various stages of a project. The following templates are available
for gathering both quantitative and qualitative data:
|
Evaluation Matrix |
Anecdotal Record Form |
|
Expert Review Checklist |
Focus Group Protocol |
|
Formative Review Log |
Implementation Log |
|
Interview Protocol |
Questionnaire |
|
User Interface Rating Form |
http://www.monash.edu.au/informatics/TechME/evaluati.htm#Evaluation%20
An
overview of evaluation is presented on this website. Formative and summative
evaluation methods are briefly described and links are provided to a number
of evaluation tools. While it relates specifically to medical education, a number
of aspects are applicable to other discipline areas.
http://iet.open.ac.uk/plum/evaluation/plum.html
This
website, produced by the Institute for Educational Technology at the Open University,
UK, provides information about different types of evaluation findings, formative
and summative evaluation processes and data collection methods. A number of
pro-forma documents are available to help facilitate recording of evaluation
data.
http://www.clt.uts.edu.au/contentssfs.html
The
Centre for Learning and Teaching at UTS has produced an evaluation guide for
their teaching staff. It offers a comprehensive approach to evaluation and contains
information about data collection processes. Proformas are provided for several
of the techniques described. A questionnaire item bank is also a useful feature.