Skip to Main Content

_Eastern Health Library Service_: Evidence-Based Practice

 

What is Evidence-Based Practice in Healthcare?

Evidence-Based Medicine (EBM) is a clinical practice approach for medical practitioners to make quality clinical decision making. Today, the approach of Evidence Based Practice (EBP) is not limited to medical and surgical practice but also applies to broader clinical fields in healthcare such as nursing, midwifery and allied health.

To achieve the best patient outcomes, evidence alone is not enough. Evidence-based practice (EBP) consists of the following 3 elements:

  • Clinical Expertise refers to the clinical knowledge and experience that helps make quality clinical judgement and decisions for providing the best individualised patient care.
  • Best Research Evidence refers to the best and latest evidence available in clinical research that provides the best answer for clinical questions and informing clinical decision making.
  • Patient Values and Preferences refers to the importance of a case-by-case approach that takes patients values and preferences towards clinical decision / treatment or intervention suggestions into account so as to achieve the best individualised patient outcomes.

       

Reference:

Sackett, D. L., Rosenberg, W. M., Gray, J. M., Haynes, R. B., & Richardson, W. S. (1996). Evidence based medicine: what it is and what it isn't. BMJ312(7023), 71-72.                                          

What are the benefits in general from Evidence-Based Practice in healthcare?

 

   Achieve the highest quality care and the best patient outcome

   Reduce healthcare costs

   Increase clinician empowerment and role satisfaction

   Reduce turnover rate

 

 

References:

Department of Health, Victorian Government. (2021). Implementing evidence-based practice fact sheet for clinicians. Access: https://www.health.vic.gov.au/patient-care/implementing-evidence-based-practice

Regional Office for Europe, World Health Organisation. (2017). Facilitating evidence-based practice in nursing and midwifery in the WHO European Region. Access WHO-EURO-2017-5314-45078-64291-eng.pdf

The EBP Process includes the following 5 steps:

  •  Ask

  •  Acquire

     

  •                               Appraise

      

  •       &  Apply and Assess

                               

Read the article below for an overview of the EBP process. Click on the orange tabs above to learn more about each step. From the tab of the last step, you will also be provided with an example of the whole EBP process in the context of palliative care in aged care setting.  

The process usually starts with the patient and with a clinical problem or question/concern arising out of patient care. You first have to construct a relevant and answerable question derived from the case.

How to build an answerable clinical question

Use PICOTT, a mnemonic for the key components of a clinical question, which can help to structure well-built answerable clinical question(s).

Learn more about                                                                                                                                 Learn more about

PICO stands for

Patient Problem

 

Intervention 

 

Comparison (optional)

 

Outcome

 
Type of Clinical Research Question Relevant Elements Example

Therapy / Intervention

 


Benefit & Risk Analysis / Prevention / Harm/ Aetiology

 


Diagnosis

 


Prognosis

P, I, C

 

 

 

P, I, O

 

 

 

P, I, C, O

 

 

P, O

Does a risk assessment checklist or score help to prevent falls compared to patient education alone on elderly patients during short-stay hospitalisation?


Does HPV vaccines bring protection to indigenous people in Japan outweigh its potential side-effects?

 


How accurate is a blood test comparing to a urine test for hCG results in earliest detection of pregnancy?


For adolescents with early detected Multiple sclerosiswhat is the likelihood of progressive supranuclear palsy?

 Check out how to formulate a PICO question via Ovid database

Specific type(s) of research provide better evidence for answering specific type(s) of clinical question. The research pyramid below shows the different level of evidence in terms of the type of research:

 

What are Systematic Reviews and Meta-analyses?

Cochrane. (2016, January 28). What are systematic reviews [video]. YouTube. https://youtu.be/egJlW4vkb1Y

Learn about the process of a Systematic Review and Meta-analysis from the Users Guides to the Medical Literature published by JAMAevidence

Learn about Meta-analysis in details from the literature: Haidich A. B. (2010). Meta-analysis in medical research. Hippokratia , 4(Suppl 1), pp.29-37.

Example of an systematic review and meta-analysis:
Rizos, E. C., Ntzani, E. E., Bika, E., Kostapanos, M. S., & Elisaf, M. S. (2012). Association between omega-3 fatty acid supplementation and risk of major cardiovascular disease events: a systematic review and meta-analysis. JAMA308(10), 1024-1033.

 

What are Randomised Controlled Trials?

Cochrane Austria. (2020, July 21). Randomised Controlled Trials [video]. YouTube. https://youtu.be/XvWmfLwC9XA

Learn about Randomised Controlled Trial from the literature: Akobeng, A.K. (2005). Understanding randomised controlled trials. Archives of Disease in Childhood, 90(8), pp. 840-844.

What are single randomised controlled trials compared to a gold standard?

a single blind study means the participants/patients do not know which group they have been assigned to. A "gold standard" basically means the RCTs that are truly randomised and double blind.

Example of a single-blind,randomised controlled trial article for answering Diagnosis type of clinical research question by a diagnostic study:

Hollis, C., Hall, C.L. & Guo, B. et. al..(2018). The impact of a computerised test of attention andactivity (QbTest) on diagnostic decision-making in children and young people with suspected attention deficit hyperactivity disorder: single-blind randomised controlled trial. Journal of Child Psychology and Psychiatry, 59(12), pp. 1298-1308. doi:10.1111/jcpp.12921.

 

What are Observational Studies?

Cochrane Austria. (2021, April 20). Observational Studies [video]. YouTube. https://www.youtube.be/BYc3zCqdlVs

Learn about the 3 main types of observational studies: Cohort Studies, Case-Control studies and Cross-Sectional Studies.

Song, J. W., & Chung, K. C. (2010). Observational studies: cohort and case-control studies.Plastic and reconstructive surgery, 126(6),pp. 2234-2242. https://doi.org/10.1097/PRS.0b013e3181f44abc

Examples of case scenarios can be found from the Evidence-Based Medicine Toolbox of the EBM Knowledge Translation Program.

  PICO / Type of Question-based Search Platforms

Step 1 Access to Cochrane Library

 

From Databases page

Click on

Cochrane Library
Step 2 Go to Advanced Search
Step 3 Select the "PICO" tab to start your search
Step 1 Access to Trip Medical Database

 

From Databases page

Click on

Trip Medical Database
Step 2 Select the "PICO" tab to enter your PICO
Step 1 Access to PubMed

 

From Databases page

Click on

PubMed @ Eastern Health

Step 2 Go to Clinical Queries

Step 3 Enter your PICO in the search box then choose the type of clinical question from the Filter pull down list before clicking search

Next, you will have to select the appropriate resources and search for the available evidence. This tab shows you some tips and tricks on how to conduct a search using academic databases.

Identify Key Concepts
Sources of the key concepts can be identified from your PICO and the answerable clinical question as well as your knowledge on your research topic.

Your answerable clinical question and PICO contains the key concepts of your research. Use those key concepts to start identifying related terms, synonyms (including variant spellings of medical terms) and related highly relevant concepts you would like to include in your search.

 

The following example shows you how to turn a PlCO and clinical question into a key concepts and related terms table:

Scenario

Ms. C, has been newly diagnosed with Type 2 diabetes and obesity. She is 45 years old and has a family history of diabetes.  She dosn't want to spend the rest of her life on drugs.  Her doctor Dr. K. thinks she may be able to control her diabetes with diet and exercise and refers Ms. C to a nutritional consultation to discuss a low-carbohydrate diet. Ms. C later on did a search on the internet and found that some government authorities recommend a low fat diet. Now she is confused and calls Dr. K. to ask him which diet is really better for keeping her off medication. Dr. K. told her that he needs to review the current evidence before getting back to her.

PICO

P - middle age female Type 2 diabetic patient with obesity

I - low carbohydrate diet

C - low fat diet

O - managing early-stage Type 2 diabetes without medication

Clinical Question / Research Question Is a low carbohydrate diet more effective than a low fat diet for managing Type 2 diabetes without medication?
key concepts type 2 diabetes obesity low fat diet low carbohydrate diet
related terms / synonyms   overweight   mediterranean diet

However, the key-concept and related-term table is not finalised at this stage. When you make use of the next tip to look up Subject Headings, you may find more related terms and concepts for your evidence-based research. Let's check out the next tip: Use Subject Headings to learn more.

Use Subject Headings
Subject headings are a controlled vocabulary or thesaurus used to index the key concepts of articles. Using Subject Headings in your search will enhance the effectiveness of your search and help to ensure retrieval of relevant articles.

Each bibliographic database has their own specific Subject Headings controlled vocabulary used to index the key concepts in articles. How Subject Headings are searched and applied will vary depending on the databases being used. The following table shows you the main bibliographic databases with examples of different subject headings used for describing the same search term.

Databases Subject Headings / Indexing Systems Example Term Subject heading used
PubMed, Cochrane Library, Medline, Ovid Nursing Database Medical Subject Headings (MeSH) low carbohydrate diet Diet, Carbohydrate-Restricted
APA PsycInfo APA Thesaurus of Psychological Index Terms low carbohydrate diet No subject heading for this but you can still search "low carbohydrate diet" as a keyword
Embase, Emcare EMTREE Subject Headings low carbohydrate diet low carbohydrate diet
CINAHL Complete CINAHL Subject Headings low carbohydrate diet Diet, Low Carbohydrate

 

The videos below provides guidance on how to apply Subject Headings in different platforms:

Platform Where to look up Subject Headings and/or how to apply Subject Headings in the specific platform
PubMed

  PubMed Subject Search: How it works (U.S. National Library of Medicine, 2020)

The Medical Subject Headings (MeSH) Lookup page

Cochrane Library

  Searching the Cochrane Library (including how to look up MeSH terms) (Cochrane Training, 2019)

Advanced Search: Medical terms (MeSH) tab

Ovid

Emcare, Medline, Embase, APA PsycInfo, Ovid Nursing Database

  Mapping terms with Subject Headings in Advanced Mode of Ovid platform - using Medline as an example (OvidWoltersKluwer, 2021)

These databases on the Ovid platform each use their own individual thesaurus. The Map Term to Subject Heading feature in Ovid will map your keyword to the most appropriate subject headings in the relevant thesaurus for the database selected.

EbscoHost: CINAHL Complete   Using the CINAHL/MeSH Subject Headings Feature in EBSCOhost (EBSCO, 2021)

To access the databases listed above, please visit our Databases page.

 

References:

Cochrane Training. (2019, May 14). Searching the Cochrane Library [Video]. Youtube. https://www.youtube.com/embed/HLD7w63rqB0?start=74

EBSCO. (2021, November 4). Using the CINAHL/MeSH Subject Headings Feature in EBSCOhost [Video]. EBSCO Connect. https://connect.ebsco.com/s/article/Using-the-CINAHL-MeSH-Headings-Feature-in-EBSCOhost-Tutorial?language=en_US

OvidWoltersKluwer. (2021, September 29). Mapping in Advanced Mode [Video]. YouTube. https://www.youtube.com/watch?v=3736KB9Udn

U.S. National Library of Medicine, (2020, November 30). PubMed Subject Search: How it works  [Video]. PubMed.gov, U.S. National Library of Medicine. https://www.nlm.nih.gov/oet/ed/pubmed/quicktours/topic_how_it_works/index.html?_gl=1*10vieks*_ga*OTc5Nzk1NjMwLjE2NDgxNzg5NzU.*_ga_7147EPK006*MTY0ODE4MjI2MS4yLjEuMTY0ODE4Mzk2OC4w*_ga_P1FPTH9PL4*MTY0ODE4MjI2MS4yLjEuMTY0ODE4Mzk2OC4w=

Apply Search Operators
Make use of Boolean operators - AND and OR - to combine key concepts and Subject Headings to build your search strategies for a narrower or broader search result.

The "OR" and "AND" operator

The "OR" operator

is used when searching for related terms or synonyms.

Search engine will interpret the query as

To search for any article that contains either one or both terms

low-carbohydrate diet

OR

Mediterranean diet

OR both of them

. When applying the "OR" operator, it will broaden your search. When building your search strategy, it is recommended that to start with applying "OR" operator to connect between the key concepts with their related terms or synonyms first.

. Then applying the "AND" operator which used to connect different key concepts and narrowing down the number of search results.

The "AND" operator

is used for connecting between different key concepts.

When using the AND operator it is recommended to initially combine only 2 key concepts so you can assess the number and contents of search results before adding additional search concepts.

Search engine will interpret the query as

To search for any article contains both terms only:

low-fat diet

And

Type 2 diabetes


Given the convenient design of most of the main research database platforms, in reality, you are usually able to do all of the following within a platform:
(1) search key terms individually;
(2) explore related terms by mapping with subject headings along the way; and
(3) apply the boolean operators "OR" and "AND" by reviewing the search history

 

The following examples from 2 major database platforms (Ovid platform and EBSCO platform) demonstrate how you can search, map to subject headings and combine terms from your search history:

Using Search History via Ovid platform

(applies to Medline, APA PsycInfo and Embase)

 

Using Search History via EBSCO platform

(applies to CINAHL Complete)

OvidWoltersKluwer. (2021, April 6). Ovid Help Mapping and Control Vocabulary [Video]. YouTube. www.youtube.com/watch?v=ihyY-gsGjDw


OvidWoltersKluwer. (2018, April 24). Advanced Search on the Ovid Platform [Video]. YouTube. https://youtu.be/409Ik8aLF5M

 

EBSCO Tutorials. (2019, February 28). Using the CINAHL/MeSH Headings Feature in EBSCOhost [Video]. YouTube. https://www.youtube.com/watch?v=eJJPp9yAIoA&t=3s


EBSCO Tutorials. (2022, Oct 05). Using the EBSCOhost Search History - Tutorial [Video]. YouTube. https://www.youtube.com/watch?v=pM0A5Gw-Trs

Apply Limits
A range of limits can be applied to your search strategy.  You may restrict your search, for example, to specific types of articles, and/or to articles published within a specific date range. Applying such limits to your search helps to ensure results that are current and limited to the types of research which are best for answering the type of clinical question you asked.
The following 2 examples of major database platforms (i.e.: Ovid platform and EBSCO platform) demonstrate how you can refine your search strategy by applying search limits:

Refining Search Strategy Limits via Ovid platform

(applies to Medline, PsyINFO and Embase) databases

 

Applied Search Limits via EBSCO platform

(applies to CINAHL Complete) database

OvidWoltersKluwer. (2016, May 28). Refining Search Strategy Limits Tutorial [Video]. YouTube. https://www.youtube.com/watch?v=TfPoX5wzdXY&t=85s

 

Please watch from 1 mins 25 sec

EBSCO Tutorials. (2022, September 8). CINAHL Databases - Advanced Searching Tutorial [Video]. YouTube. https://www.youtube.com/embed/MMNzR03--90

To appraise research articles, there are 3 overarching questions to keep in mind:

Check out the Research Design and Research Bias page
to learn about the research designs and
statistical measurements for assessing the risk
of bias.

The type of research-based folding tabs below brings
you to the lists of questions used for assessing the validity of
studies and Cochrane videos provide further explanation.

Check out the Critical Appraisal session to see which questions
to ask and watch the Cochrane videos for examples of how
the result can be examined and appraised based on the type
of research studies.

Check out the next tab: Step 4 & 5: Apply and Assess


Critical Appraisal (based on the five main Types of Research)

Various questions addressing different research design aspects and statistical measurements, can be used to assess the risk of bias and how precise the results are. Unfold the tabs below to view the list of questions and the Cochrane videos relevant to the different types of research.

Questions to determine the validity of a systematic review & meta analysis:

1. Did the review address a clinical question explicitly?

2. Were the selection criteria for articles stated clearly and are these criteria reproducible?

3. Were the relevant studies searched exhaustively? (a minimum of 3 academic databases is recommended and the cited references of each articles should also be checked)

4. Was the risk of bias of each collected study assessed?

5. Was the Confidence in Effect (95% CI) addressed?

 

The following video demonstrate how to critically appraise a systematic review and meta-analysis:                                 

Cochrane Common Mental Disorders. (2019, March 30). 2. Systematic reviews and meta analysis [video]. YouTube. https://www.youtube.com/watch?v=NijldKW32H4                                                                                                                                                                                                                                                                                                                                                                                          

 

How to read a forest plot - a meta-analysis of the results of research studies

The included studies are listed on the left. Each study is represented by a horizontal line with a square on top of the line.

The horizontal lines of individual studies represents the level of spread of data within a confidence interval (usually a 95% CI) for the individual studies. The wider the line is, the less precision the study has compared to those studies with a narrower 95% CI.

The square on each study's horizontal line represents the weight of each individual study. Studies with a higher weight usually have a larger square representing the effect size.

The middle line (also known as Line of Null Effect) represents there is no statistical and clinical difference between an intervention/exposure group and a control group.

The  horizontal line at the bottom represents the level of risk ratio. The studies presented closer to the left side from the middle line = a higher risk; the studies presented closer to the right side from the middle = a lower risk.

The left side area from the middle line reflects the collective research results showing evidence of benefit from implementing the intervention whereas the right side area reflects the collective research results that do not support evidence of benefit from the intervention for the patient group researched.

The diamond represents the overall estimate / the average of the results.

By looking at meta-analysis therefore, you can understand the whole picture of the collective research results, whether there is evidence to show an intervention is relatively beneficial compared to alternative practice(s) or not, and how well the sample size of individual studies is representative. This is why a systematic review with meta-analysis is better evidence compared to a systematic review alone.

 

Questions for Critical Appraisal of Randomised Controlled Trials (RCTs):

1. Were patients randomised?

2. Was group allocation concealed?

3. Were patients in the treatment and control groups similar with respect to known prognostic factors?

4. Were people in 5 important groups (patients, care givers, data collectors, adjudicators, data analysts) aware of the group allocation?

5. Was follow-up completed?

6. Was an intention-to-treat analysis performed?

7. Was the trial stopped early?

Cochrane Common Mental Disorders. (2019, March 30). 3. Randomised controlled trials [video]. YouTube. https://www.youtube.com/watch?v=FlQVQz5d02s

 

Question to assess the validity of a Cohort Study:

1. Was the sample of patients representative, defined clearly, and matched with the population group/patient problem in the PICO?

2. Were patients within groups similar with respect to known prognostic factors?

3. Was follow-up sufficiently completed?

4. Was an intention-to-treat analysis performed?

5. Did the study finish early or as planned?

6. Were the outcome criteria objective and unbiased? (Confidence in Effect (CI and P-value) and RR assessed?)

Cochrane Common Mental Disorders. (2019, March 30). 4. Cohort studies [video]. YouTube. https://www.youtube.com/watch?v=uK7hnthu130

 

Questions to assess the validity of a Case-control Study:

1. Was the sample of patients representative, defined clearly, and matched with the population group/patient problem in the PICO?

2. Were cases within groups similar with respect to known prognostic factors, how the cases were selected and the selection criteria?

3. Was follow-up sufficiently completed?

4. Was an intention-to-treat analysis performed?

5. Did the study finish early or as planned?

6. Were the outcome criteria objective and unbiased? (Confidence in Effect (CI and P-value) and RR assessed?)

Cochrane Common Mental Disorders. (2019, March 30). 5. Case control studies [video]. YouTube. https://www.youtube.com/embed/tmpy62VXtCs"

 

Questions to assess the validity of a Cross-sectional Study:

1. Was the sample of patients representative, defined clearly, and matched with the population group/patient problem in the PICO?

2. Were patient within groups / period of time chosen similar with respect to known prognostic factors?

3. Was follow-up sufficiently completed?

4. Was an intention-to-treat analysis performed?

5. Did the study finish early or as planned?

6. To what extent would the outcome be affected by chance?

Cochrane Common Mental Disorders. (2019, March 30). 6. Cross-sectional studies [video]. YouTube. https://www.youtube.com/watch?v=muGA7FKekaU


Toolbox:

Understanding clinical papers / Written by David Bowers, Allan House, David Owens & Bridgette Bewick (2013)

Guiding questions for Step 4: Apply

After reviewing the best available evidence, now it is time to ensure that results are highly related to and practical for your patient instead of just answering your clinical question in general. The following questions should be asked before deciding the treatment / intervention pathway which should bring the best patient outcome: 

Were the study patients similar to your patient?

Were all important patient outcomes / alternative treatments considered?

 Does the likely treatment / intervention benefits outweigh the potential harm, if any, in your patient's case?

Does the likely treatment / intervention conflict with your patient’s values and expectations?

Is the preferred treatment available in the health care system?

 

Guiding questions for Step 5: Assess

The final step of the EBP process is to assess your performance so that next time you could improve your evidence-based practice. The following questions can be used for guiding your reflection:

Was the clinical question well-built and answerable?

Was good evidence located effectively?

Was the evidence appraised effectively?

Is there evidence of new practice found in the literature? Would the new clinical practice potentially favour other patient outcomes and should be included in daily practice?

Was the diagnosis, treatment or intervention successfully applied?

Why did the patient not respond as well as expected to the treatment / intervention (if any?)

How could clinical decision making be improved?

A palliative care & aged care example of EBP process:

Informing care decisions with the best available evidence / CareSearch

Contact Us

 

  +61 3 9895 3200

  Submit your enquiry / feedback   (EHLS@easternhealth.org.au)

Suggest a purchase

  8.30 am - 5.00 pm Monday - Friday  (Closed weekends and public holidays)

                                                                                                                                         

 

 

 

aboriginal flag  torres strait islander flag 

Eastern Health Library Service acknowledges the Traditional Owners of the land on which we live and work, and we pay our respects to Elders past, present and emerging.

 

  Eastern Health Library strives to be an inclusive hospital library service.

 

 

 

© Eastern Health Library Service 2021-2023