We have detected you are using Internet Explorer. To provide the best and most secure experience, please use a modern browser as we do not support Internet Explorer.

OSCE - How to appraise the evidence

10 May 2018 - Medcast Medical Education Team

“To believe or not to believe….?”

As doctors, we are called to practise in an increasingly regimented world, buttressed by a seemingly insurmountable massif of clinical guidelines, practice codes, system handbooks, procedural frameworks, decision algorithms…. the list goes on. Reaching the summit of the medical ‘evidence mountain’ can often seem like too much hard yakka. It’s much easier to assume that the guidebook is informed by good quality evidence. But how can we know for sure?

art and science of Critical Appraisal

The art and science of critically appraising research has been discussed at length in the literature – just google ‘critical appraisal’ and you are faced with 2.05 MILLION hits. To avoid reinventing the wheel I’ll take you to base camp and then challenge you to make your own climb up the summit.

Essentially there are only four questions you need to ask about anything anyone says about any aspect of medicine:

  1. Does the study have a clear focus? Or has it bitten off more than it can chew?
  2. Are the methods used to answer the question valid? Did the study on patient’s opinions actually use patient opinions to inform their results?
  3. Are the results important in general? Does the study on healthcare satisfaction based on whether patients are seated on the left-hand versus the right-hand side of the waiting room really matter?
  4. Are the results relevant to you? Does it apply to your patient, your practice or your population? The study on the effects of extreme sub zero temperatures on migraines in Antarctica may be interesting, but is it really relevant to your practice in tropical Queensland?
Appraising medical and health research

Medical and health research can be broadly categorised into quantitative and qualitative research; some are mixed. There are (more!) frameworks and algorithms available online to help you sift through how to analyse each type of research – for example, what does p-value mean? What is the significance of the odds ratio? How do you determine sensitivity and specificity? What is the level of bias? Was there triangulation of qualitative commentary? How was thematic analysis conducted?

practice makes perfect

The CASP website provides a comprehensive checklist to help you decide whether to believe or not to believe. These critical appraisal tools are designed to be used when reading the research articles on a variety of study designs. To practice your critical appraisal skills; find a relevant article, identify the appropriate tool and work your way through the appraisal steps.

Happy reading!

Medcast Medical Education Team
Medcast Medical Education Team

The Medcast medical education team is a group of highly experienced, practicing GPs, health professionals and medical writers.

Related Tags
Related Categories
Get Medcast Plus

Become a member and get unlimited access to 100s of hours of premium education.

Learn more
Latest News
The ABCDE of post resuscitation care

Following 10 minutes of CPR and two shocks for VT, Nadia shows signs of life. After the third rhythm check, with respiratory effort noted, the defib was disarmed using the COACHED sequence. What is the next step in determining the plan of care for Nadia?

5 mins READ
PODCAST: Addressing disease burden, risk factors and health behaviours in Australian males aged 18-44

Men’s Health Week is June 10 -16 2024. Listen in to this podcast to learn about what is impacting the health and wellbeing of Australian men and how we can support males to adopt healthy behaviours.

35 mins READ
Does Hafiz need a referral for allergy testing?

Hafiz, a 13-month-old, developed a rash and swelling around their mouth after eating peanut butter, displaying signs of a potential IgE-mediated food allergy. What are the next steps for Hafiz?

5 mins READ