Developing a Loans Service
Evaluation Methodologies for the Use of Loans
The evaluation of loans boxes and the quantitative assessment of their use is important for the successful development of a loans service at both the formative and summative evaluation stages.
Formative evaluation can include the following processes;
- Consultation by means of one to one interviews and focus groups with teachers, community groups or other relevant parties (such as faith groups for faith loans)
- Questionnaires and evaluation forms for teachers and pupils
- Observation of loans being used in the classroom
- Development of pilot boxes and associated handling sessions
Summative evaluation can include;
- Consultation
- Questionnaires and evaluation forms for teachers and pupils
- Observation
At all stages of the process, the educational effectiveness of loans can be assessed in relation to generic learning outcomes as defined within the ‘Inspiring Learning for All’ methodology. These are as follows;
- Knowledge and understanding
- Skills
- Values and attitudes
- Behaviour and progression
- Inspiration, enjoyment and creativity
In order to obtain data in relation to the generic learning outcomes, teachers can be asked to indicate relevant examples of pupil progress against a wide range of categories linked to GLOs. This information can be processed and analysed by relating categories to their corresponding GLO. The categories used at Birmingham Museums and Art Gallery are outlined on the attached sample evaluation form, but can of course be modified in accordance with the specific needs of particular topics or sites.
GLO data which is collected using this method can then be used to help to set targets for the future in terms of the educational outcomes.
Teachers can also be asked to rate the quality of loans boxes and the service as a whole in relation to a range of categories. Those categories listed on the BM&AG evaluation form include the achievement of learning goals, the booking / collection / delivery of boxes, pupils’ enjoyment of the loans boxes and pupil progress in using the boxes. Data about which areas of the curriculum were served by the loans is also useful, along with information about how loans were used in a particular context and their impact on teachers’ level of confidence.
Teachers’ forms can also be used to provide the following data in terms of levels of usage;
- Numbers of children using the loans
- Numbers of teachers benefiting from using the loans
The number of schools using the service can also be analysed from general records to give a comprehensive picture of overall usage.
Download Evaulation Form in Word (36 KB) or Acrobat (28 KB) format.
Birmingham Museum and Art Gallery