Titre :

A Tool for Evaluating Medication Alerting Systems: Development and Initial Assessment

Auteur(s) :

Zheng, W. Y. [Auteur]
Van Dort, B. [Auteur]
Marcilly, Romaric [Auteur]
METRICS : Evaluation des technologies de santé et des pratiques médicales - ULR 2694
Day, R. [Auteur]
Burke, R. [Auteur]
Shakib, S. [Auteur]
Ku, Y. [Auteur]
Reid-Anderson, H. [Auteur]
Baysari, M. [Auteur]

Titre de la revue :

JMIR Medical Informatics

Nom court de la revue :

JMIR Med Inform

Numéro :

9

Pagination :

e24022

Date de publication :

2021-07

ISSN :

2291-9694

Mot(s)-clé(s) en anglais :

medication alerts
decision support
human factors
assessment tool
usability flaws

Discipline(s) HAL :

Sciences du Vivant [q-bio]

Résumé en anglais : [en]

Background: It is well known that recommendations from electronic medication alerts are seldom accepted or acted on by users. Key factors affecting the effectiveness of medication alerts include system usability and alert ...
Lire la suite >Background: It is well known that recommendations from electronic medication alerts are seldom accepted or acted on by users. Key factors affecting the effectiveness of medication alerts include system usability and alert design. Thus, human factors principles that apply knowledge of human capabilities and limitations are increasingly used in the design of health technology to improve the usability of systems. Objective: This study aims to evaluate a newly developed evidence-based self-assessment tool that allows the valid and reliable evaluation of computerized medication alerting systems. This tool was developed to be used by hospital staff with detailed knowledge of their hospital’s computerized provider order entry system and alerts to identify and address potential system deficiencies. In this initial assessment, we aim to determine whether the items in the tool can measure compliance of medication alerting systems with human factors principles of design, the tool can be consistently used by multiple users to assess the same system, and the items are easy to understand and perceived to be useful for assessing medication alerting systems. Methods: The Tool for Evaluating Medication Alerting Systems (TEMAS) was developed based on human factors design principles and consisted of 66 items. In total, 18 staff members recruited across 6 hospitals used the TEMAS to assess their medication alerting systems. Data collected from participant assessments were used to evaluate the validity, reliability, and usability of the TEMAS. Validity was assessed by comparing the results of the TEMAS with those of prior in-house evaluations. Reliability was measured using Krippendorff α to determine agreement among assessors. A 7-item survey was used to determine usability. Results: The participants reported mostly negative (n=8) and neutral (n=7) perceptions of alerts in their medication alerting system. However, the validity of the TEMAS could not be directly tested, as participants were unaware of any results from prior in-house evaluations. The reliability of the TEMAS, as measured by Krippendorff α, was low to moderate (range 0.26-0.46); however, participant feedback suggests that individuals’ knowledge of the system varied according to their professional background. In terms of usability, 61% (11/18) of participants reported that the TEMAS items were generally easy to understand; however, participants suggested the revision of 22 items to improve clarity. Conclusions: This initial assessment of the TEMAS allowed the identification of its components that required modification to improve usability and usefulness. It also revealed that for the TEMAS to be effective in facilitating a comprehensive assessment of a medication alerting system, it should be completed by a multidisciplinary team of hospital staff from both clinical and technical backgrounds to maximize their knowledge of systems.Lire moins >

Langue :

Anglais

Audience :

Internationale

Vulgarisation :

Non

Établissement(s) :

Université de Lille
CHU Lille

Collections :

• METRICS : Evaluation des technologies de santé et des pratiques médicales - ULR 2694

Date de dépôt :

2023-11-15T06:12:26Z
2024-02-14T11:40:58Z