WP6: Validity/reliability testing in a clinical environment
Aims
To test the construct validity and reliability of the proposed competence assessment procedure (CAP) for spinal anaesthesia in the clinical setting in two countries (Hungary and Ireland).
To apply CAP to examine the relationship between individual clinical/simulator (WP5) performances.
Start/finish date (overall duration)
September 08 - March 09
Role and tasks of partners involved
University of Pecs will coordinate the WP and perform the clinical testing in Hungary
CUH will carry out the clinical testing in Ireland
MedicVision will act as advisors having experience in developing curriculum-based interfaces
Working methods and techniques
The CAP will be applied to 42 anaesthetists with distinct (naïve, intermediate, expert) levels of experience (24 in Hungary and 18 in Ireland). Each participant will undergo the assessment on two occasions within a two week period. In addition to application of the CAP, two clinical assessors will evaluate participants' performance as is currently practiced. The CAP will be evaluated for construct validity and inter-rater reliability at each centre separately and for both centres conjointly.
As a secondary objective, at the Cork site, the relationship between the assessments of an individual's performance in clinical and simulated settings will be examined.
Expected outcomes/results
1. A WP report (in English and Hungarian) describing the performance result and conclusions arising from the study
2. The results of clinical testing will be correlated with those of WP 5 (simulator testing) and used for the development of the interface.
3. A manuscript will be submitted based on the study for publication in a peer review journal
4. A valid and reliable CAP for spinal anaesthesia amenable to use in a clinical setting.
Quality management tools
The study design, methodology, results and interpretation will be reviewed by the EAG. Approval of the Institutional Ethics Review Boards (Cork and Pecs) will be obtained prior to commencing.