The contextual evaluation framework: a prototype evaluation technique for e-Research

Thesis

The contextual evaluation framework (CEF) is a requirements engineering technique that incorporates a particular sociological orientation, Ethnomethodology, in the development of a rigorous and systematic approach for requirements elicitation. This qualitative approach examines how well a system may be aligned with the endogenous organisation of work within a community of practice. Assessing how well a system supports the knowledge, skills and practices that already exist within a community is equally as important as developing solutions that will eventually reconfigure those practices, create new ones and extend modes of collaboration. The aim of this thesis is to address the absence of a systematic approach to quasi-naturalistic prototype evaluation which may be useful to a broader community such as requirements engineers, computer scientists and others not familiar with the details of sociological approaches. Such an aim is in line with the ways in which prototype evaluation approaches, particularly in HCI, have successfully been disseminated throughout the computer science research community - with the provision of guidelines. Likewise, the CEF is conceived of to be implemented in a similar manner.

Its focus is on the analysis of a prototype’s relevance as a tool that is in some manner familiar to those who might use it. Specifically, professionals within a discipline share complex skills and knowledge where they learn to use similar tools, instruments and processes necessary for their work. Implicit in these social practices, practitioners gradually acquire the knowledge and skills necessary to become full members of a community of practice. In this way, the processes, objects and artefacts of practice come to possess specific meaning and significance. The CEF examines how this complex architecture of meaning is supported, constrained or transformed when using a prototype and makes possible an assessment of the ways in which participants interpret its usefulness and usability.

Authors: Eden, G

• Publication date: 2011
• Type of award: DPhil
• Level of award: Doctoral
• Awarding institution: Oxford University, UK
• Language: English
• Keywords: workplace studies; ethnomethodology; requirements engineering
• Subjects: Software engineering