Literature review
The validity, reliability, responsiveness and applicability of observation sedation-scoring instruments for use with adult patients in the emergency department: A systematic literature review

https://doi.org/10.1016/j.aenj.2014.07.001Get rights and content

Summary

Aim

This paper reports a systematic literature review examining the range of published observational sedation-scoring instruments available in the assessment, monitoring and titration of continuous intravenous sedation to critically ill adult patients in the Emergency Department, and the extent to which validity, reliability, responsiveness and applicability of the instruments has been addressed.

Background

Emergency nurses are increasingly responsible for the ongoing assessment, monitoring and titration of continuous intravenous sedation, in addition to analgesia for the critically ill adult patient. One method to optimise patient sedation is to use a validated observational sedation-scoring tool. It is not clear however what the optimal instrument available is for use in this clinical context.

Methods

A systematic literature review methodology was employed. A range of electronic databases were searched for the period 1946–2013. Search terms incorporated “sedation scale”, “sedation scoring system”, “measuring sedation”, and “sedation tool” and were used to retrieve relevant literature. In addition, manual searches were conducted and articles retrieved from those listed in key papers. Articles were assessed using the Critical Appraisal Skills Program (CASP) making sense of evidence tools.

Results

A total of 27 observational sedation-scoring instruments were identified. Sedation-scoring instruments can be categorised as linear or composite, the former being the most common. A wide variety of patient behaviours are used within the instruments to measure depth and quality of patient sedation. Typically sedation-scoring instruments incorporated three patient behaviours, which were then rated to generate a numerical score. The majority of the instruments have been subjected to validity and reliability testing, however few have been examined for responsiveness or applicability.

Conclusions

None of the 27 observational sedation-scoring instruments were designed or trialled within ED. The Richmond Agitation and Assessment Scale was identified as most suitable to be trialled prospectively within an Australian ED.

Introduction

Sedation is widely administered to patients in the emergency department (ED) for the purposes of optimising comfort and tolerance towards invasive procedures. Presently, two forms of sedation are practised within the ED: short-term and continuous. Short-term sedation, often delivered as a single or intermittent bolus dose, temporarily enables patients to briefly tolerate uncomfortable procedures, for example: relocation of dislocated joints, cardioversion and wound closure.1, 2, 3, 4 Continuous sedation, administered as an intravenous infusion, is used to intentionally sustain depression of a patient's awareness and reduce their response to necessary yet invasive procedures, for example endotracheal intubation and mechanical ventilation.

While the use of sedation in the ED is not new, emergency nurses are now increasingly responsible for the continuing assessment, monitoring and titration of sedation for critically ill patients,5 and for increasing lengths of time.6, 7 The initial resuscitation and subsequent care of critically ill patients is a core component of emergency nursing practice.8 While critical care was traditionally viewed as being delivered only in ICU, EDs provide critical care to a range of patient groups with increasing frequency and lengths of stay.6 Critically ill patients experiencing life-threatening illnesses or injuries require sedation in addition to analgesia and prevention of delirium; an emerging concept referred to as the ‘ICU Triad’.9 The use of sedation can be vital component in managing the critically ill patient,10, 11 yet when performed in the ED several unique challenges are encountered. Firstly, the unplanned and undifferentiated nature of the patients presenting to ED reduces the amount of time to assess and clinically evaluate the patient with any great depth afforded in elective or pre-planned circumstances.1, 12 Secondly, owing to the unpredictable time-sensitive nature of emergency patient presentations to the ED, sedation is often conducted and managed by emergency staff, who may have limited experience in dealing with sedation-related complications.13, 14, 15, 16 Thirdly, while individual patients respond differently to sedation and analgesia,17 critically ill patients experiencing life-threatening illnesses or injuries have limited physiological reserves to offset the potential side effects of sedation and analgesics.

While continuous intravenous sedation is important for critically ill patients, it can be harmful if not carefully monitored and balanced to the patient's needs.18 Over-sedation can lead to the development of hypotension, hypoventilation and hypothermia.12 Further, early deep sedation has been identified as a significant independent predictor of increased (8–10%) risk of death.19 Conversely, under-sedation can lead to increased levels of anxiety, agitation, unplanned self-extubation or violence towards staff.20, 21, 22 Emergency nurses are responsible for the ongoing care of critically ill sedated patients, frequently assessing, monitoring and titrating sedation as necessary. Within the ED, the Glasgow Coma Scale (GCS)23 is often relied upon to measure the critically ill patient's degree of consciousness whilst being sedated.24 Unconsciousness and amnesia (i.e. awareness and memory) are not however reliably observable endpoints by which to judge the depth and quality of sedation a critically ill patient may be experiencing.25 Further, the verbal response cannot be reliably assessed in an intubated patient. To support the titration and balancing of sedation in critically ill patients, validated observational sedation-scoring assessment instruments are needed.26, 27

Section snippets

Aims or the review

The systematic review aimed to identify and appraise the literature using the following questions:

  • (i)

    What observational sedation-scoring instruments are available for use by emergency nurses in assessing, monitoring and titrating continuous intravenous sedation for critically ill adult patients?

  • (ii)

    To what extent have the instruments been tested for validity, reliability, responsiveness and acceptability?

  • (iii)

    What observation sedation-scoring instruments would be suitable to be trialled prospectively

Methods

A systematic literature search was conducted using the following databases: CINAHL, EMBASE, Medline, ProQuest and Science Direct. The Cochrane Library and the National Institute of Clinical Excellence were also searched. The review was supplemented with a manual search of the relevant grey literature. The search covered the period from 1946 to 2013. No date or language restrictions were initially applied. Several search terms were used to identify potential studies concerning the testing of

Results

The database search identified 27 observational sedation-scoring instruments for assessing sedation in the critically ill adult patient. Of the sedation-scoring instruments identified, the majority (n = 11, 42%) were developed in the USA and predominantly (n = 24, 89%) tested in ICU environments. Sedation-scoring observation instruments can be divided into two groups: linear and composite. The majority (n = 17, 63%) of sedation-scoring instruments were linear, whereby sedation was evaluated along one

Evidence of validity, reliability, responsiveness and acceptability

Forty studies evaluating 27 adult observational sedation-scoring instruments were identified as being relevant for the purposes of this review. Methodology, sample and location varied little across all 40 studies (Table 2). Nearly all (n = 33, 83%) studies30, 36, 40, 41, 42, 44, 45, 46, 49, 50, 51, 52, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75 were based upon a convenience sample, with only five (13%) randomising patients.31, 76, 77 Of the 27 instruments,

Discussion

The results of this systematic literature review revealed 27 observational sedation-scoring instruments developed for use within critical care environments, all similar in form and format. No instruments were developed or examined within the ED environment that specifically assessed sedation in the critically ill patient. Managing sedation for the critically ill mechanically ventilated patient is highly complex, and requires advanced expertise, knowledge and skill.83 Use of sedation-scoring

Limitations

This systematic literature review has a number of limitations. Descriptions of the development and testing of the sedation-scoring instruments varies greatly in terms of quality and detail, which makes investigation and summary of issues of validity, reliability, responsiveness and applicability difficult. In addition, there may be unpublished instruments in use in clinical practice that have not been described in the literature, but have been subjected to rigorous but unreported testing. This

Conclusion

The use of observation sedation-scoring instruments is fundamental to improving the assessment, monitoring and administering of continuous intravenous sedation for critically ill patients’ needs. Sedation-scoring instruments are commonly used within the ICU environment to support nursing practice in optimising sedation, and in the detection and prevention of under- or over-sedation. Further, it has been demonstrated that the use of valid sedation-scoring instruments enhances nurse confidence,

Provenance and conflict of interest

The authors have no financial or other conflict of interest other than one of the author's (Associate Professor Margaret Fry) is also on the journal's international editorial advisory board. This paper was not commissioned.

Funding

This paper did not receive any funding from any source in relation to this research.

References (98)

  • C.S. Weaver et al.

    An assessment of the association of bispectral index with 2 clinical sedation scales for monitoring depth of procedural sedation

    Am J Emerg Med

    (2007)
  • J. Battaglia et al.

    Calming versus sedatie effects of intramuscular olanzapine in agitated patients

    Am J Emerg Med

    (2003)
  • M. Ryder-Lewis et al.

    Reliability of the Sedation-Agitation Scale between nurses and doctors

    Intensive Crit Care Nurs

    (2008)
  • M. Gill et al.

    Inter-rater reliability of Glasgow Coma Scale scores in the emergency department

    Ann Emerg Med

    (2004)
  • A. Nisbet et al.

    Comparison of selected sedatio scales for reporting opioid-induced sedation assessment

    Pain Manag Nurs

    (2009)
  • J. Guttormson et al.

    Factors influencing nurse sedation practices with mechanically ventilated patients: a U.S. national survey

    Intensive Crit Care Nurs

    (2010)
  • G. Teasdale et al.

    Assessment of coma and impaired consciousness

    Lancet

    (1974)
  • D. Elliott et al.

    Patient comfort in the intensive care unit: a multicentre, binational point prevalence study of analgesia, sedation and delirium management

    Crit Care Resusc

    (2013)
  • H.M. Soliman et al.

    Sedation and analgesic practice in the intensive care unit: the results of a European survey

    Br J Anaesth

    (2001)
  • J. Burton et al.

    Update on Emergency Department procedural sedation and analgesia

    Emerg Med Crit Care Rev

    (2006)
  • C. Hohl et al.

    Safety and clinical effectiveness of midazolam versus propofol for procedural sedation in the emergency department: a systematic review

    Acad Emerg Med

    (2008)
  • Emergency Nurses Association. Procedural sedation consensus statement. 2008 [cited 2010 August]; Available from:...
  • H. Nguyen et al.

    Critical care in the emergency department: a physiological assessment and outcome evaluation

    Acad Emerg Med

    (2000)
  • W. Varndell et al.

    Emergency nurses’ practices in assessing and monitoring continual intravenous sedation for critically ill adult patients: a retrospective audit “Are you sleeping comfortably? Then we shall begin”

    Aust Emerg Nurs J

    (2011)
  • M. Reade et al.

    Sedation and delirium in the intensive care unit

    N Engl J Med

    (2014)
  • A. Smally et al.

    Sedation in the emergency department

    Curr Opin Anaesthesiol

    (2007)
  • A. Hole et al.

    Sedation scoring

  • American College of Emergency Physicians

    Clinical policy: procedural sedation and analgesia in the emergency department

    Ann Emerg Med

    (2005)
  • R. Pino

    The nature of anaesthesia and procedural sedation outside of the operating room

    Curr Opin Anaesthesiol

    (2007)
  • S. Bhananka et al.

    Injury and liability associated with monitored anesthesia care: a closed claims analysis

    Anesthesiology

    (2006)
  • J. Metzner et al.

    The risk and safety of anesthesia at remote locations: the US closed claims analysis

    Curr Opin Anaesthesiol

    (2009)
  • R. Robbertze et al.

    Closed claims review of anesthesia for procedures outside the operating room

    Curr Opin Anaesthesiol

    (2006)
  • M. Ekstein et al.

    Monitored anaesthesia care in the elderly

    Drugs Aging

    (2008)
  • H. Reschreiter et al.

    Sedation practice in the intensive care unit: a UK national survey

    Crit Care

    (2008)
  • Y. Shehabi et al.

    Early intensive care sedation predicts long-term mortality in ventilated critically ill patients

    Am J Respir Crit Care Med

    (2012)
  • K. Curry et al.

    Characteristics associated with unplanned extubations in a surgical intensive care unit

    Am J Crit Care

    (2008)
  • J. Barr et al.

    Clinical practice guidelines for the management of pain, agitation, and delirium in adult patients in the Intensive Care Unit

    Crit Care Med

    (2013)
  • S. Weir et al.

    Experiences of intensive care nurses assessing sedation/agitation in critically ill patients

    Nurs Crit Care

    (2008)
  • R. Dawson

    Sedation assessment using the Ramsey scale

    Emerg Nurse

    (2010)
  • D. Hadzidiakos et al.

    Subjective assessment of depth of anaesthesia by experienced and inexperienced anaesthetists

    Eur J Anaesthesiol

    (2006)
  • R. Vesalis et al.

    Spectral edge frequency correlates with sedation level in ICU patients receiving i.v. midazolam [abstract]

    Anesthesiology

    (1989)
  • W. Varndell et al.

    Emergency nurses’ practices in assessing, monitoring and administering continuous intravenous sedation for the critically ill patient: preliminary qualitative findings

  • D. Moher et al.

    Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement

    Br Med J

    (2009)
  • J. Chase et al.

    Quantifying agitation in sedated ICU patients using digital imaging

    Comput Methods Programs Biomed

    (2004)
  • J. Devlin et al.

    Motor activity assessment scale: a valid and reliable sedation scale for use with mechanically ventilated patients in an adult surgical intensive care unit

    Crit Care Med

    (1999)
  • Eli Lilly and Company, Agitation calmness evaluation scale©, Eli Lilly and Company;...
  • Inova Health System, Inova sedation scale. Inova Health System;...
  • A.S.M. Laing

    The applicability of a new sedation scale for intensive care

    Intensive Crit Care Nurs

    (2002)
  • J. Luer

    Sedation and chemical relaxation in critical pulmonary illness: suggestions for patient assessment and drug monitoring

    AACN Clin Issues

    (1995)
  • Cited by (0)

    View full text