TY - JOUR T1 - What is being assessed in the MRCGP oral examination? JF - British Journal of General Practice JO - Br J Gen Pract SP - 430 LP - 436 VL - 55 IS - 515 AU - Robin G Simpson AU - Karen D Ballard Y1 - 2005/06/01 UR - http://bjgp.org/content/55/515/430.abstract N2 - Background Oral examinations are a popular method of assessment within medicine, being capable of measuring candidates' ability to carry out tasks or develop skills (operational knowledge). One example of this is the oral examination for membership of the Royal College of General Practitioners (RCGP), which is designed to assess candidates' decision-making skills and the professional values that underpin these decisions. While the reliability of oral examinations has been investigated, to date, little is known about their ability to measure what they set out to measure (validity).Aim To investigate the content validity of the MRCGP oral examination, with particular focus on its ability to assess the process of decision-making.Design of study An evaluation of oral examination video recordings, using qualitative methods.Method The MRCGP oral examinations are video recorded as part of an ongoing quality assurance programme. Fifty of the recordings carried out in 2002 were selected randomly and analysed for content and dialogue patterns reflecting the assessment of the decision-making process.Results All examiners used the specified contexts outlined in the examination objectives to present candidates with dilemmas. The assessment of decision-making skills, however, was limited by a tendency among examiners to present the candidate with new, more complex dilemmas rather than giving them the opportunity to discuss the implications, make choices and ultimately, justify their decision. Moreover, while examiners frequently asked candidates questions relating to professional values, they rarely asked them to demonstrate how those values support their decisions.Conclusion In order that the benefits of oral examination can be fully realised, questions need to be structured in a way that encourages candidates to discuss all stages of the decision-making process. ER -