Evaluating a Clinical Decision Support System: A basic field study approach
The overall evaluation framework would be based on the DECIDE concept,(2) which is:
- Determine goals of evaluation
- Explore specific questions
- Choose evaluation paradigm
- Identify practical issues
- Decide how to address ethical issues
- Evaluate, interpret and present data
The goals and questions of the evaluation will be based on the User Based Design Principles,(3) which are:
- Identify user strengths and weaknesses
- How to support users with their current tasks
- How to improve user experience in using the system
- Identify what the user wants
During the initial roll-out period, I was able to conduct a participatory field study for a period of four weeks, observing the different user groups in their interaction with the system as well as gathering more data via informal discussions and interviews. Notes were taken with pen and paper and also via my PDA.
The main thrust of the ethnography-based study was to observe the natural flow and interaction between the users, the technology and the environment and identify any issues that may inform future designs.
The information was gathered and interpreted using my knowledge of the clinical workflow, as well as using the input from the other main user groups. This was then used to describe the data acquired in detailed “thick” descriptions.
Page Updated: 17 May, 2017Tweet