Preparing patients for hospital discharge requires multiple tasks that cross professional boundaries. Clinician’s roles may be ambiguous, and responsibility for a safe high-quality discharge is often diffused among the team rather than being defined as the core responsibility of a single member.^1-8 Without a shared understanding of patient resources and tasks involved in anticipatory planning, lapses in discharge preparation can occur, which places patients at increased risk for harm after hospitalization.^3-7 As a result, organizations like the Centers for Medicare & Medicaid Services (CMS) have called for team-based patient-centered discharge planning.⁸ Yet to develop more effective team-based discharge planning interventions, a more nuanced understanding of how healthcare teams work together is needed.^2,3,9

Shared mental models (SMMs) provide a useful theoretical framework and measurement approach for examining how interprofessional teams coordinate complex tasks like hospital discharge.^10-13 SMMs represent the team members’ collective understanding and organized knowledge of key elements needed for teams to perform effectively.^9-11 Validated questionnaires can be used to measure two key properties of SMMs: the degree to which team members have a similar understanding of the situation at hand (team SMM convergence) and to what extent this understanding is aligned with the patient (team-­patient SMM convergence).^10,11 Researchers have found that teams with higher-quality SMMs have a better understanding of what is happening and why, have clearer expectations of their roles and tasks, and can better predict what might happen next.^10,12 As a result, these teams more effectively coordinate actions and adapt to task demands even in cases of high complexity, uncertainty, and stress.^10-13 Prior studies examining healthcare teams in emergency departments,^14-16 critical care units,^17,18 and operating rooms¹⁹ suggest high-quality SMMs are needed to safely care for patients.¹³ Yet there has been limited evaluation of SMMs in general internal medicine, much less during hospital discharge.^9,13 The purpose of this study was to examine SMMs for a critical task of the inpatient team: developing a shared understanding of the patient’s readiness for hospital discharge.^20,21

Design

We used a cross-sectional survey design at a single Midwestern community hospital to determine inpatient care teams’ SMMs of patient hospital discharge readiness. This study is part of a larger mixed-methods evaluation of interprofessional hospital discharge teamwork in older adult patients at risk for a poor transition to home.⁹ Data were collected using questionnaires from patients and their team (nurse, coordinator, and physician) within 4 hours of the patient leaving the hospital. First, we measured the teams’ assessment, team convergence, and team-­patient convergence on patient readiness for discharge from the hospital. Then, after identifying relevant potential predictors from the literature, we developed regression models to predict the teams’ assessment, team convergence, and team-patient convergence of discharge readiness based on these variables. Our local institutional review board approved this study.

Sample and Participants

We used a convenience sampling approach to identify eligible discharge events consisting of the patient and care team.⁹ We focused on patients at high-risk for poor hospital-to-home transitions.^3,22 Eligible events included older patients (≥65 years) who were discharged home without home health or hospice services and admitted with a primary diagnosis of heart failure, acute myocardial infarction, hip replacement, knee replacement, pneumonia, or chronic obstructive pulmonary disease. Patient exclusion criteria included inability to complete study forms because of mental incapacity or a language barrier. Discharge team member inclusion criteria included the bedside nurse, attending physician, and coordinator (a unit-dedicated discharge nurse or social worker) caring for the patient participant at the time of hospital discharge. Each discharge team was unique: The same three individuals could not be included as a “team” for more than one discharge event, although individual members could be included as a part of other teams with a different set of individuals. Appendix A provides an enrollment flowchart.

Conceptual Framework

We applied the SMM conceptual framework to the context of hospital discharge. As shown in the Figure, SMMs are examined at the team level and contain the critical knowledge held by the team to be effective.^15,16 From a patient-centered perspective, patients are considered the expert on how ready they feel to be discharged home.^20,23,24 In this case, the SMM content is the discharge team members’ shared assessment of how ready the patient is for hospital discharge (Figure, B).¹⁰ Convergence is the degree of agreement among individual mental models.^10-13 In this study we examined two types of convergence: (1) team convergence, or the team members degree of agreement on the patient’s readiness for discharge (Figure, C), and (2) team-patient convergence, or the degree to which the team’s SMM aligns with the patient’s mental model (Figure, D).^10-13

Measures and Variables

Readiness for Hospital Discharge Scales/Short Form

We used parallel clinician and patient versions of the Readiness for Hospital Discharge Scale/Short Form (RHDS/SF)^25-28 to determine the teams’ assessment of discharge readiness, team SMM convergence, and team-patient SMM convergence.

The RHDS/SF scales are 8-item validated instruments that use a Likert scale (0 for not ready to 10 for totally ready) to assess the individual clinician’s or patient’s perceptions of how ready the patient is to be discharged.^20,25,27 The RHDS/SF instruments include four dimensions conceptualized as crucial to patient readiness for discharge and important to anticipatory planning: (1) Personal Status, physical-emotional state of the patient before discharge; (2) Knowledge, perceived adequacy of information needed to respond to common posthospitalization concerns/problems; (3) Coping Ability, perceived ability to self-manage health care needs; and (4) Expected Support, emotional-physical assistance available (Appendix B).^20,25,27 The RHDS/SF instruments’ results are calculated as a mean of item scores, with higher individual scores indicating the rater assessed the patient as being more ready for hospital discharge.²⁰ The RHDS/SF scales have undergone rigorous psychometric testing and are linked to patient outcomes (eg, readmissions, emergency room visits, patient coping difficulties after discharge, and patient-rated quality of preparation for posthospital care).^20,25-28 For example, predictive validity assessments for adult medical-surgical patients found lower Nurse-RHDS/SF scores are associated with a six- to ninefold increase in 30-day readmission risk.²⁰

Contextual Variables

We reviewed the literature to identify potential patient and system factors associated with adverse transitional care outcomes^1-8 and/or higher quality SMMs in other settings.^10-19 For example, patient characteristics included age, principal diagnosis, length of stay, number of comorbidities, and cognition impairment (using the Short Portable Mini Mental Status Questionnaire²⁹).^2,22,30 Examples of system factor include teamwork and communication quality^1-6 on day of discharge, as well as educational background and experience of clinicians on the team.^31-33 We adapted a validated survey using 7-point Likert scale questions to determine teamwork quality and communication quality during individual patent discharges.³³Appendix C provides descriptions of all variables.

Data Collection

Patient recruitment occurred from February to October 2017 in a single community hospital in Iowa.⁹ We identified potentially eligible events in collaboration with the unit charge nurses. Patients were screened 24 to 48 hours prior to anticipated day of discharge; those interested/eligible underwent informed consent procedures.⁹ We collected data from the patient and their corresponding bedside nurse, coordinator, and attending physician on the day of discharge. After the discharge order was placed and care instructions were provided, the patient completed a demographic survey, Short Portable Mini Mental Status Questionnaire, and the Patient-RHDS/SF. Individual team members completed a survey with the demographic information, their respective versions of RHDS/SF, and day-of-discharge teamwork-related questions. On average, the survey took clinicians less than 5 minutes to complete. We performed a chart review to determine additional patient characteristics such as principal diagnosis, length of stay, and number of comorbidities.

Data Analysis

Team Assessment of Patient Discharge Readiness

The teams’ shared assessment (SMM content) was determined by averaging the members’ individual scores on the Clinician-RHDS/SF.³⁴ Discharge events with higher team assessments indicated the team perceived the patient as being readier for hospital discharge. Guided by prior research, we examined the RHDS/SF scores as a continuous variable and as a four-level categorical variable of readiness: low (<7), moderate (7-7.9), high (8-8.9), and very high (9-10).²⁰

Team SMM Convergence

To determine the teams’ convergence on patient discharge readiness, we calculated an adjusted interrater agreement index (r*_wg(j))^35,36 for each team using the individual clinicians’ scores on the RHDS/SF. These convergence values were categorized into four agreement levels: low agreement (<0.7), moderate agreement (0.7-0.79), high agreement (0.8-0.89), and very high agreement (0.9-1). See Appendix D for the r*_wg(j) equation.^35,36

Team-Patient SMM Convergence

To determine the team-patient SMM convergence, we subtracted the team’s assessment of patient discharge readiness from the Patient-RHDS/SF score. We used a one-unit change on the RHDS/SF (1 point on the 0-10 scale) as a meaningful difference between the patient’s self-assessment and teams’ assessment on readiness for hospital discharge. This definition for divergence aligns with prior RHDS psychometric testing studies^20,27 and research examining convergence between patient and nurse assessments.²⁸ For example, Weiss and colleagues²⁷ found a 1-point decrease in the RN-RHDS/SF item mean was associated with a 45% increase in likelihood of postdischarge utilization (hospital readmission and emergency room department visits). Therefore, we defined convergence of team-patient SMMs (or similar patient and team scores) as those with an absolute difference score less than 1 point, whereas teams with low team-patient SMM convergence (or divergent patient and team scores) were defined as having an absolute difference score greater than 1 point.

Prediction Models

For the exploratory aim, we first examined the bivariate relationship between the outcome variables (discharge teams’ assessment of patient readiness, team convergence, and team-patient convergence) and the identified contextual variables. We also checked for potential collinearity among the explanatory variables. Then we used a linear stepwise regression procedure to identify factors associated with each continuous outcome variable. Due to the small sample size, we performed separate backward stepwise regression selection analyses for the three outcomes of interest. The candidate explanatory variables were evaluated using P < .20 for model entry. Final models were evaluated using leave-one-out cross validation. STATA (v.15.1, StataCorp; 2017) was used for analysis.

Sample

A total of 64 discharge events were included in this study. All discharge teams had a unique composition including 64 patients and varying combinations of 56 individual nurses (n = 27), physicians (n = 23), and coordinators (n = 6). Each event had three team members (ie, a nurse, a coordinator, and a physician) with no missing data. The majority of the 64 patient participants were White, retired, had a high school education, and lived in their own home with only one other person (Table 1).

Interprofessional Teams’ SMM of Readiness for Hospital Discharge

While the majority of teams perceived patients had high readiness for hospital discharge (mean, 8.5 out of 10; SD, 0.91), patients scores were nearly a full point lower (mean, 7.7; SD, 1.6; Table 2). The largest difference across categories was in the low-readiness category with 27% of patient scores falling into this category vs only 9.4% of discharge team mean scores. The mean SMM convergence of team perception of patients’ readiness for discharge was 0.90 (SD, 0.10); however, scores ranged from 0.66 (low agreement) to 1 (complete agreement). The average SMM team-patient convergence, or the discrepancy between the discharge team mean scores and the patient total scores across domains, was 1.16 (SD, 0.82). Of the 64 discharge events, 42.2% had similar team-patient perceptions of readiness for discharge, 9.4% had the patient reporting higher readiness for discharge than the team, and 48.4% had a team assessment rating of higher readiness for discharge than the patient’s self-assessment.

Prediction Models

In the exploratory analysis, we created individual linear regression models to predict the teams’ assessment, team convergence, and team-patient convergence for readiness of hospital discharge (Table 3; Appendix E). Factors associated with the teams’ assessment of discharge readiness included whether the patient was married and had less cognitive impairment, both of which were positively related to a higher-­rated readiness among teams. An important system factor was higher quality of communication among team members, which was positively associated with teams’ assessment of patient discharge readiness. In contrast, only patient factors—married patients and those with a principal diagnosis of heart failure—were associated with more convergent team SMMs. Team-patient convergence was positively associated with two patient factors: marital status (married) and fewer comorbidities. However, team-patient convergence was also associated with two system factors: teams with a bachelor’s level–trained nurse (compared with a nurse with an associate degree ) and teams reporting a higher quality of teamwork on day of discharge.

Our study applied novel approaches to explore the interprofessional teams’ understanding of discharge readiness, a concept known to be an important predictor of patient outcomes after discharge, including readmission.^20,28 We found that discharge teams frequently had poor quality SMMs of hospital discharge readiness. Despite having a discharge order and receiving home care instructions, one in four patients reported low readiness for hospital discharge. Additionally, discharge teams frequently overestimated patient’s readiness for hospital discharge. Misalignment on patient readiness for discharge occurred both within the discharge team (ie, low team convergence) and between patients and their care teams (ie, low team-patient convergence). The potential importance of this disagreement is substantiated by prior work suggesting that divergence in readiness ratings between nurses and patients are associated with postdischarge coping difficulties.²⁸

Previous readiness for discharge has been measured from the perspective of the patient,^20,21,27,28 nurse,^20,25-28 and physician,³⁷ yet rarely has the teams’ perspective been examined. We add to this literature by measuring the team’s perspective, as well as agreement between team and patient, on the individual patient’s readiness for discharge. Notably, we found that higher-quality communication is positively related to teams’ assessment of discharge readiness, with teams that reported higher quality teamwork having more convergent team-patient SMMs. Our results support many qualitative studies identifying communication and teamwork as major factors in teams’ effectiveness in discharge planning.^1-7,9 However, given the small sample size in this study, additional research is needed to further understand these relationships, as well as link SMMs to patient outcomes such as hospital readmission.

In an attempt to improve discharge planning, hospitals are increasingly assessing readiness for discharge as a low-intensity, low-cost intervention.^26,27 Yet, recent evidence suggests that readiness assessments alone have minimal impact on reducing hospital readmissions.²⁶ To be successful, these assessments likely depend on quality interprofessional communication and ensuring the patient’s voice is incorporated into the discharge decision process.²⁶ However, there have been few ways to effectively evaluate these types of team interventions.⁹ Measuring SMM properties holds promise for identifying specific team mechanisms that may influence the effectiveness and fidelity of interventions for team-based discharge planning. As our findings indicate, SMMs provide a theoretical and methodological basis for evaluating if readiness for discharge was team based (convergence among team members) and patient centered (convergence among team assessment and patient self-assessment). Researchers and improvement scientists can use the approach outlined to evaluate team-based patient-centered interventions for hospital discharge planning.⁹

This study provides a unique contribution to the growing work in the team science of SMMs.^9,10 We rigorously evaluated SMMs of key stakeholders (patients and their interprofessional team) in “real-time” clinical practice using a patient-centered assessment linked with postdischarge outcomes.^20,27,28 However, it is still unknown how much convergence is needed (and with whom) to safely discharge patients.¹³ Prior studies suggest highly convergent SMMs increase team performance when they are also accurate.^10-13 Convergence alone should not be sought because this may reflect groupthink or clinical inertia.^10,15 To improve discharge team performance over time,^10‑13 it is important to assess not only patient’s readiness on the day of discharge but also how prepared the patient actually was for the recovery period following acute care. In the larger mixed-methods study, we found that teams’ with more convergent SMMs on teamwork quality were associated with patient’s reported quality of transition 30-days after discharge.⁹ Together, these findings further highlight the importance of aligning patient and interprofessional team members perspectives during the discharge planning, as well as providing clinicians with regular feedback about patient’s postdischarge experiences and outcomes.

To optimize team performance, the discharge planning process must be considered from an interprofessional team perspective as it functions in real-world practice settings. There are increasing pressures to discharge patients “quicker and sicker,” to simplify and standardize clinical process, and to provide patient-centered care.^3,5-8 Without thoughtful interventions to facilitate communication during discharge planning, these pressures likely reinforce inaccurate assumptions regarding the work of fellow team members and force teams to think “fast” instead of “slow.”^38-40 One approach to overcome such barriers is to focus on building a high-quality interprofessional SMM around discharge readiness. For example, the RHDS/SF questions could be integrated into the electronic medical records, displayed on dashboards, and discussed regularly during discharge rounds. In particular, to strengthen the team’s SMM and quality of teamwork, together the staff can ask three practical questions (Appendix F): (1) Do we think the patient is ready for discharge? (2) To what extent do we all agree the patient is ready for discharge? (3) Does our assessment of discharge readiness match the patient’s? During this high-risk transition point, asking these questions might allow the team to move from thinking fast to thinking slowly so they can more effectively identify heuristics they may be using inaccurately, prevent blind spots, and move toward high reliability.^{10,13,18,38-40}

This study has limitations. First, events were recruited from patients with any of only six conditions at a single hospital. Other settings, patient condition types, or team compositions of other clinicians may differ in results. Second, in this study the SMM content was focused on readiness for hospital discharge among four key stakeholders. It is possible other SMM content needs to be shared among the interprofessional discharge team (eg, caregivers’ perspectives,^2,6-8 resource availability,^3-6 clinicians’ roles^4,9) or additional members should be included (eg, physical therapists, nursing assistants, home health consultants, or primary care clinicians). Although this study focused on a patient-centered outcome (Patient-RHDS/SF), we did not examine other important outcomes such as hospital readmission. Additionally, due to the small sample size, these results have limited generalizability and should be interpreted with caution. Last, we limited data collection to the day of hospital discharge; future studies might consider assessing discharge readiness throughout hospitalization.

Readying patients for hospital discharge is a time-sensitivehigh-risk task requiring multiple healthcare professionals to concurrently assess patient needs, formulate an anticipatory care plan, provide education, and arrange for postdischarge needs.^20,21 Despite this, few studies have analyzed teamwork aspects to understand how these transitions could be improved.⁹ By piloting SMM measurement and describing factors that affect SMMs, we provide a step toward identifying and evaluating strategies to assist interprofessional care teams in preparing patients for a safe, high-quality, patient-centered hospital discharge.

This work was presented at the Midwest Nursing Research Society’s 2018 Annual Research Conference in Cleveland, Ohio, as well as at AcademyHealth’s 2019 Annual Research Meeting in Washington, District of Columbia.

Preparing patients for hospital discharge requires multiple tasks that cross professional boundaries. Clinician’s roles may be ambiguous, and responsibility for a safe high-quality discharge is often diffused among the team rather than being defined as the core responsibility of a single member.^1-8 Without a shared understanding of patient resources and tasks involved in anticipatory planning, lapses in discharge preparation can occur, which places patients at increased risk for harm after hospitalization.^3-7 As a result, organizations like the Centers for Medicare & Medicaid Services (CMS) have called for team-based patient-centered discharge planning.⁸ Yet to develop more effective team-based discharge planning interventions, a more nuanced understanding of how healthcare teams work together is needed.^2,3,9

Shared mental models (SMMs) provide a useful theoretical framework and measurement approach for examining how interprofessional teams coordinate complex tasks like hospital discharge.^10-13 SMMs represent the team members’ collective understanding and organized knowledge of key elements needed for teams to perform effectively.^9-11 Validated questionnaires can be used to measure two key properties of SMMs: the degree to which team members have a similar understanding of the situation at hand (team SMM convergence) and to what extent this understanding is aligned with the patient (team-­patient SMM convergence).^10,11 Researchers have found that teams with higher-quality SMMs have a better understanding of what is happening and why, have clearer expectations of their roles and tasks, and can better predict what might happen next.^10,12 As a result, these teams more effectively coordinate actions and adapt to task demands even in cases of high complexity, uncertainty, and stress.^10-13 Prior studies examining healthcare teams in emergency departments,^14-16 critical care units,^17,18 and operating rooms¹⁹ suggest high-quality SMMs are needed to safely care for patients.¹³ Yet there has been limited evaluation of SMMs in general internal medicine, much less during hospital discharge.^9,13 The purpose of this study was to examine SMMs for a critical task of the inpatient team: developing a shared understanding of the patient’s readiness for hospital discharge.^20,21

Design

We used a cross-sectional survey design at a single Midwestern community hospital to determine inpatient care teams’ SMMs of patient hospital discharge readiness. This study is part of a larger mixed-methods evaluation of interprofessional hospital discharge teamwork in older adult patients at risk for a poor transition to home.⁹ Data were collected using questionnaires from patients and their team (nurse, coordinator, and physician) within 4 hours of the patient leaving the hospital. First, we measured the teams’ assessment, team convergence, and team-­patient convergence on patient readiness for discharge from the hospital. Then, after identifying relevant potential predictors from the literature, we developed regression models to predict the teams’ assessment, team convergence, and team-patient convergence of discharge readiness based on these variables. Our local institutional review board approved this study.

Sample and Participants

We used a convenience sampling approach to identify eligible discharge events consisting of the patient and care team.⁹ We focused on patients at high-risk for poor hospital-to-home transitions.^3,22 Eligible events included older patients (≥65 years) who were discharged home without home health or hospice services and admitted with a primary diagnosis of heart failure, acute myocardial infarction, hip replacement, knee replacement, pneumonia, or chronic obstructive pulmonary disease. Patient exclusion criteria included inability to complete study forms because of mental incapacity or a language barrier. Discharge team member inclusion criteria included the bedside nurse, attending physician, and coordinator (a unit-dedicated discharge nurse or social worker) caring for the patient participant at the time of hospital discharge. Each discharge team was unique: The same three individuals could not be included as a “team” for more than one discharge event, although individual members could be included as a part of other teams with a different set of individuals. Appendix A provides an enrollment flowchart.

Conceptual Framework

We applied the SMM conceptual framework to the context of hospital discharge. As shown in the Figure, SMMs are examined at the team level and contain the critical knowledge held by the team to be effective.^15,16 From a patient-centered perspective, patients are considered the expert on how ready they feel to be discharged home.^20,23,24 In this case, the SMM content is the discharge team members’ shared assessment of how ready the patient is for hospital discharge (Figure, B).¹⁰ Convergence is the degree of agreement among individual mental models.^10-13 In this study we examined two types of convergence: (1) team convergence, or the team members degree of agreement on the patient’s readiness for discharge (Figure, C), and (2) team-patient convergence, or the degree to which the team’s SMM aligns with the patient’s mental model (Figure, D).^10-13

Measures and Variables

Readiness for Hospital Discharge Scales/Short Form

We used parallel clinician and patient versions of the Readiness for Hospital Discharge Scale/Short Form (RHDS/SF)^25-28 to determine the teams’ assessment of discharge readiness, team SMM convergence, and team-patient SMM convergence.

The RHDS/SF scales are 8-item validated instruments that use a Likert scale (0 for not ready to 10 for totally ready) to assess the individual clinician’s or patient’s perceptions of how ready the patient is to be discharged.^20,25,27 The RHDS/SF instruments include four dimensions conceptualized as crucial to patient readiness for discharge and important to anticipatory planning: (1) Personal Status, physical-emotional state of the patient before discharge; (2) Knowledge, perceived adequacy of information needed to respond to common posthospitalization concerns/problems; (3) Coping Ability, perceived ability to self-manage health care needs; and (4) Expected Support, emotional-physical assistance available (Appendix B).^20,25,27 The RHDS/SF instruments’ results are calculated as a mean of item scores, with higher individual scores indicating the rater assessed the patient as being more ready for hospital discharge.²⁰ The RHDS/SF scales have undergone rigorous psychometric testing and are linked to patient outcomes (eg, readmissions, emergency room visits, patient coping difficulties after discharge, and patient-rated quality of preparation for posthospital care).^20,25-28 For example, predictive validity assessments for adult medical-surgical patients found lower Nurse-RHDS/SF scores are associated with a six- to ninefold increase in 30-day readmission risk.²⁰

Contextual Variables

We reviewed the literature to identify potential patient and system factors associated with adverse transitional care outcomes^1-8 and/or higher quality SMMs in other settings.^10-19 For example, patient characteristics included age, principal diagnosis, length of stay, number of comorbidities, and cognition impairment (using the Short Portable Mini Mental Status Questionnaire²⁹).^2,22,30 Examples of system factor include teamwork and communication quality^1-6 on day of discharge, as well as educational background and experience of clinicians on the team.^31-33 We adapted a validated survey using 7-point Likert scale questions to determine teamwork quality and communication quality during individual patent discharges.³³Appendix C provides descriptions of all variables.

Data Collection

Patient recruitment occurred from February to October 2017 in a single community hospital in Iowa.⁹ We identified potentially eligible events in collaboration with the unit charge nurses. Patients were screened 24 to 48 hours prior to anticipated day of discharge; those interested/eligible underwent informed consent procedures.⁹ We collected data from the patient and their corresponding bedside nurse, coordinator, and attending physician on the day of discharge. After the discharge order was placed and care instructions were provided, the patient completed a demographic survey, Short Portable Mini Mental Status Questionnaire, and the Patient-RHDS/SF. Individual team members completed a survey with the demographic information, their respective versions of RHDS/SF, and day-of-discharge teamwork-related questions. On average, the survey took clinicians less than 5 minutes to complete. We performed a chart review to determine additional patient characteristics such as principal diagnosis, length of stay, and number of comorbidities.

Data Analysis

Team Assessment of Patient Discharge Readiness

The teams’ shared assessment (SMM content) was determined by averaging the members’ individual scores on the Clinician-RHDS/SF.³⁴ Discharge events with higher team assessments indicated the team perceived the patient as being readier for hospital discharge. Guided by prior research, we examined the RHDS/SF scores as a continuous variable and as a four-level categorical variable of readiness: low (<7), moderate (7-7.9), high (8-8.9), and very high (9-10).²⁰

Team SMM Convergence

To determine the teams’ convergence on patient discharge readiness, we calculated an adjusted interrater agreement index (r*_wg(j))^35,36 for each team using the individual clinicians’ scores on the RHDS/SF. These convergence values were categorized into four agreement levels: low agreement (<0.7), moderate agreement (0.7-0.79), high agreement (0.8-0.89), and very high agreement (0.9-1). See Appendix D for the r*_wg(j) equation.^35,36

Team-Patient SMM Convergence

To determine the team-patient SMM convergence, we subtracted the team’s assessment of patient discharge readiness from the Patient-RHDS/SF score. We used a one-unit change on the RHDS/SF (1 point on the 0-10 scale) as a meaningful difference between the patient’s self-assessment and teams’ assessment on readiness for hospital discharge. This definition for divergence aligns with prior RHDS psychometric testing studies^20,27 and research examining convergence between patient and nurse assessments.²⁸ For example, Weiss and colleagues²⁷ found a 1-point decrease in the RN-RHDS/SF item mean was associated with a 45% increase in likelihood of postdischarge utilization (hospital readmission and emergency room department visits). Therefore, we defined convergence of team-patient SMMs (or similar patient and team scores) as those with an absolute difference score less than 1 point, whereas teams with low team-patient SMM convergence (or divergent patient and team scores) were defined as having an absolute difference score greater than 1 point.

Prediction Models

For the exploratory aim, we first examined the bivariate relationship between the outcome variables (discharge teams’ assessment of patient readiness, team convergence, and team-patient convergence) and the identified contextual variables. We also checked for potential collinearity among the explanatory variables. Then we used a linear stepwise regression procedure to identify factors associated with each continuous outcome variable. Due to the small sample size, we performed separate backward stepwise regression selection analyses for the three outcomes of interest. The candidate explanatory variables were evaluated using P < .20 for model entry. Final models were evaluated using leave-one-out cross validation. STATA (v.15.1, StataCorp; 2017) was used for analysis.

Sample

A total of 64 discharge events were included in this study. All discharge teams had a unique composition including 64 patients and varying combinations of 56 individual nurses (n = 27), physicians (n = 23), and coordinators (n = 6). Each event had three team members (ie, a nurse, a coordinator, and a physician) with no missing data. The majority of the 64 patient participants were White, retired, had a high school education, and lived in their own home with only one other person (Table 1).

Interprofessional Teams’ SMM of Readiness for Hospital Discharge

While the majority of teams perceived patients had high readiness for hospital discharge (mean, 8.5 out of 10; SD, 0.91), patients scores were nearly a full point lower (mean, 7.7; SD, 1.6; Table 2). The largest difference across categories was in the low-readiness category with 27% of patient scores falling into this category vs only 9.4% of discharge team mean scores. The mean SMM convergence of team perception of patients’ readiness for discharge was 0.90 (SD, 0.10); however, scores ranged from 0.66 (low agreement) to 1 (complete agreement). The average SMM team-patient convergence, or the discrepancy between the discharge team mean scores and the patient total scores across domains, was 1.16 (SD, 0.82). Of the 64 discharge events, 42.2% had similar team-patient perceptions of readiness for discharge, 9.4% had the patient reporting higher readiness for discharge than the team, and 48.4% had a team assessment rating of higher readiness for discharge than the patient’s self-assessment.

Prediction Models

In the exploratory analysis, we created individual linear regression models to predict the teams’ assessment, team convergence, and team-patient convergence for readiness of hospital discharge (Table 3; Appendix E). Factors associated with the teams’ assessment of discharge readiness included whether the patient was married and had less cognitive impairment, both of which were positively related to a higher-­rated readiness among teams. An important system factor was higher quality of communication among team members, which was positively associated with teams’ assessment of patient discharge readiness. In contrast, only patient factors—married patients and those with a principal diagnosis of heart failure—were associated with more convergent team SMMs. Team-patient convergence was positively associated with two patient factors: marital status (married) and fewer comorbidities. However, team-patient convergence was also associated with two system factors: teams with a bachelor’s level–trained nurse (compared with a nurse with an associate degree ) and teams reporting a higher quality of teamwork on day of discharge.

Our study applied novel approaches to explore the interprofessional teams’ understanding of discharge readiness, a concept known to be an important predictor of patient outcomes after discharge, including readmission.^20,28 We found that discharge teams frequently had poor quality SMMs of hospital discharge readiness. Despite having a discharge order and receiving home care instructions, one in four patients reported low readiness for hospital discharge. Additionally, discharge teams frequently overestimated patient’s readiness for hospital discharge. Misalignment on patient readiness for discharge occurred both within the discharge team (ie, low team convergence) and between patients and their care teams (ie, low team-patient convergence). The potential importance of this disagreement is substantiated by prior work suggesting that divergence in readiness ratings between nurses and patients are associated with postdischarge coping difficulties.²⁸

Previous readiness for discharge has been measured from the perspective of the patient,^20,21,27,28 nurse,^20,25-28 and physician,³⁷ yet rarely has the teams’ perspective been examined. We add to this literature by measuring the team’s perspective, as well as agreement between team and patient, on the individual patient’s readiness for discharge. Notably, we found that higher-quality communication is positively related to teams’ assessment of discharge readiness, with teams that reported higher quality teamwork having more convergent team-patient SMMs. Our results support many qualitative studies identifying communication and teamwork as major factors in teams’ effectiveness in discharge planning.^1-7,9 However, given the small sample size in this study, additional research is needed to further understand these relationships, as well as link SMMs to patient outcomes such as hospital readmission.

In an attempt to improve discharge planning, hospitals are increasingly assessing readiness for discharge as a low-intensity, low-cost intervention.^26,27 Yet, recent evidence suggests that readiness assessments alone have minimal impact on reducing hospital readmissions.²⁶ To be successful, these assessments likely depend on quality interprofessional communication and ensuring the patient’s voice is incorporated into the discharge decision process.²⁶ However, there have been few ways to effectively evaluate these types of team interventions.⁹ Measuring SMM properties holds promise for identifying specific team mechanisms that may influence the effectiveness and fidelity of interventions for team-based discharge planning. As our findings indicate, SMMs provide a theoretical and methodological basis for evaluating if readiness for discharge was team based (convergence among team members) and patient centered (convergence among team assessment and patient self-assessment). Researchers and improvement scientists can use the approach outlined to evaluate team-based patient-centered interventions for hospital discharge planning.⁹

This study provides a unique contribution to the growing work in the team science of SMMs.^9,10 We rigorously evaluated SMMs of key stakeholders (patients and their interprofessional team) in “real-time” clinical practice using a patient-centered assessment linked with postdischarge outcomes.^20,27,28 However, it is still unknown how much convergence is needed (and with whom) to safely discharge patients.¹³ Prior studies suggest highly convergent SMMs increase team performance when they are also accurate.^10-13 Convergence alone should not be sought because this may reflect groupthink or clinical inertia.^10,15 To improve discharge team performance over time,^10‑13 it is important to assess not only patient’s readiness on the day of discharge but also how prepared the patient actually was for the recovery period following acute care. In the larger mixed-methods study, we found that teams’ with more convergent SMMs on teamwork quality were associated with patient’s reported quality of transition 30-days after discharge.⁹ Together, these findings further highlight the importance of aligning patient and interprofessional team members perspectives during the discharge planning, as well as providing clinicians with regular feedback about patient’s postdischarge experiences and outcomes.

To optimize team performance, the discharge planning process must be considered from an interprofessional team perspective as it functions in real-world practice settings. There are increasing pressures to discharge patients “quicker and sicker,” to simplify and standardize clinical process, and to provide patient-centered care.^3,5-8 Without thoughtful interventions to facilitate communication during discharge planning, these pressures likely reinforce inaccurate assumptions regarding the work of fellow team members and force teams to think “fast” instead of “slow.”^38-40 One approach to overcome such barriers is to focus on building a high-quality interprofessional SMM around discharge readiness. For example, the RHDS/SF questions could be integrated into the electronic medical records, displayed on dashboards, and discussed regularly during discharge rounds. In particular, to strengthen the team’s SMM and quality of teamwork, together the staff can ask three practical questions (Appendix F): (1) Do we think the patient is ready for discharge? (2) To what extent do we all agree the patient is ready for discharge? (3) Does our assessment of discharge readiness match the patient’s? During this high-risk transition point, asking these questions might allow the team to move from thinking fast to thinking slowly so they can more effectively identify heuristics they may be using inaccurately, prevent blind spots, and move toward high reliability.^{10,13,18,38-40}

This study has limitations. First, events were recruited from patients with any of only six conditions at a single hospital. Other settings, patient condition types, or team compositions of other clinicians may differ in results. Second, in this study the SMM content was focused on readiness for hospital discharge among four key stakeholders. It is possible other SMM content needs to be shared among the interprofessional discharge team (eg, caregivers’ perspectives,^2,6-8 resource availability,^3-6 clinicians’ roles^4,9) or additional members should be included (eg, physical therapists, nursing assistants, home health consultants, or primary care clinicians). Although this study focused on a patient-centered outcome (Patient-RHDS/SF), we did not examine other important outcomes such as hospital readmission. Additionally, due to the small sample size, these results have limited generalizability and should be interpreted with caution. Last, we limited data collection to the day of hospital discharge; future studies might consider assessing discharge readiness throughout hospitalization.

Readying patients for hospital discharge is a time-sensitivehigh-risk task requiring multiple healthcare professionals to concurrently assess patient needs, formulate an anticipatory care plan, provide education, and arrange for postdischarge needs.^20,21 Despite this, few studies have analyzed teamwork aspects to understand how these transitions could be improved.⁹ By piloting SMM measurement and describing factors that affect SMMs, we provide a step toward identifying and evaluating strategies to assist interprofessional care teams in preparing patients for a safe, high-quality, patient-centered hospital discharge.

This work was presented at the Midwest Nursing Research Society’s 2018 Annual Research Conference in Cleveland, Ohio, as well as at AcademyHealth’s 2019 Annual Research Meeting in Washington, District of Columbia.

Preparing patients for hospital discharge requires multiple tasks that cross professional boundaries. Clinician’s roles may be ambiguous, and responsibility for a safe high-quality discharge is often diffused among the team rather than being defined as the core responsibility of a single member.^1-8 Without a shared understanding of patient resources and tasks involved in anticipatory planning, lapses in discharge preparation can occur, which places patients at increased risk for harm after hospitalization.^3-7 As a result, organizations like the Centers for Medicare & Medicaid Services (CMS) have called for team-based patient-centered discharge planning.⁸ Yet to develop more effective team-based discharge planning interventions, a more nuanced understanding of how healthcare teams work together is needed.^2,3,9

Shared mental models (SMMs) provide a useful theoretical framework and measurement approach for examining how interprofessional teams coordinate complex tasks like hospital discharge.^10-13 SMMs represent the team members’ collective understanding and organized knowledge of key elements needed for teams to perform effectively.^9-11 Validated questionnaires can be used to measure two key properties of SMMs: the degree to which team members have a similar understanding of the situation at hand (team SMM convergence) and to what extent this understanding is aligned with the patient (team-­patient SMM convergence).^10,11 Researchers have found that teams with higher-quality SMMs have a better understanding of what is happening and why, have clearer expectations of their roles and tasks, and can better predict what might happen next.^10,12 As a result, these teams more effectively coordinate actions and adapt to task demands even in cases of high complexity, uncertainty, and stress.^10-13 Prior studies examining healthcare teams in emergency departments,^14-16 critical care units,^17,18 and operating rooms¹⁹ suggest high-quality SMMs are needed to safely care for patients.¹³ Yet there has been limited evaluation of SMMs in general internal medicine, much less during hospital discharge.^9,13 The purpose of this study was to examine SMMs for a critical task of the inpatient team: developing a shared understanding of the patient’s readiness for hospital discharge.^20,21

Design

We used a cross-sectional survey design at a single Midwestern community hospital to determine inpatient care teams’ SMMs of patient hospital discharge readiness. This study is part of a larger mixed-methods evaluation of interprofessional hospital discharge teamwork in older adult patients at risk for a poor transition to home.⁹ Data were collected using questionnaires from patients and their team (nurse, coordinator, and physician) within 4 hours of the patient leaving the hospital. First, we measured the teams’ assessment, team convergence, and team-­patient convergence on patient readiness for discharge from the hospital. Then, after identifying relevant potential predictors from the literature, we developed regression models to predict the teams’ assessment, team convergence, and team-patient convergence of discharge readiness based on these variables. Our local institutional review board approved this study.

Sample and Participants

We used a convenience sampling approach to identify eligible discharge events consisting of the patient and care team.⁹ We focused on patients at high-risk for poor hospital-to-home transitions.^3,22 Eligible events included older patients (≥65 years) who were discharged home without home health or hospice services and admitted with a primary diagnosis of heart failure, acute myocardial infarction, hip replacement, knee replacement, pneumonia, or chronic obstructive pulmonary disease. Patient exclusion criteria included inability to complete study forms because of mental incapacity or a language barrier. Discharge team member inclusion criteria included the bedside nurse, attending physician, and coordinator (a unit-dedicated discharge nurse or social worker) caring for the patient participant at the time of hospital discharge. Each discharge team was unique: The same three individuals could not be included as a “team” for more than one discharge event, although individual members could be included as a part of other teams with a different set of individuals. Appendix A provides an enrollment flowchart.

Conceptual Framework

We applied the SMM conceptual framework to the context of hospital discharge. As shown in the Figure, SMMs are examined at the team level and contain the critical knowledge held by the team to be effective.^15,16 From a patient-centered perspective, patients are considered the expert on how ready they feel to be discharged home.^20,23,24 In this case, the SMM content is the discharge team members’ shared assessment of how ready the patient is for hospital discharge (Figure, B).¹⁰ Convergence is the degree of agreement among individual mental models.^10-13 In this study we examined two types of convergence: (1) team convergence, or the team members degree of agreement on the patient’s readiness for discharge (Figure, C), and (2) team-patient convergence, or the degree to which the team’s SMM aligns with the patient’s mental model (Figure, D).^10-13

Measures and Variables

Readiness for Hospital Discharge Scales/Short Form

We used parallel clinician and patient versions of the Readiness for Hospital Discharge Scale/Short Form (RHDS/SF)^25-28 to determine the teams’ assessment of discharge readiness, team SMM convergence, and team-patient SMM convergence.

The RHDS/SF scales are 8-item validated instruments that use a Likert scale (0 for not ready to 10 for totally ready) to assess the individual clinician’s or patient’s perceptions of how ready the patient is to be discharged.^20,25,27 The RHDS/SF instruments include four dimensions conceptualized as crucial to patient readiness for discharge and important to anticipatory planning: (1) Personal Status, physical-emotional state of the patient before discharge; (2) Knowledge, perceived adequacy of information needed to respond to common posthospitalization concerns/problems; (3) Coping Ability, perceived ability to self-manage health care needs; and (4) Expected Support, emotional-physical assistance available (Appendix B).^20,25,27 The RHDS/SF instruments’ results are calculated as a mean of item scores, with higher individual scores indicating the rater assessed the patient as being more ready for hospital discharge.²⁰ The RHDS/SF scales have undergone rigorous psychometric testing and are linked to patient outcomes (eg, readmissions, emergency room visits, patient coping difficulties after discharge, and patient-rated quality of preparation for posthospital care).^20,25-28 For example, predictive validity assessments for adult medical-surgical patients found lower Nurse-RHDS/SF scores are associated with a six- to ninefold increase in 30-day readmission risk.²⁰

Contextual Variables

We reviewed the literature to identify potential patient and system factors associated with adverse transitional care outcomes^1-8 and/or higher quality SMMs in other settings.^10-19 For example, patient characteristics included age, principal diagnosis, length of stay, number of comorbidities, and cognition impairment (using the Short Portable Mini Mental Status Questionnaire²⁹).^2,22,30 Examples of system factor include teamwork and communication quality^1-6 on day of discharge, as well as educational background and experience of clinicians on the team.^31-33 We adapted a validated survey using 7-point Likert scale questions to determine teamwork quality and communication quality during individual patent discharges.³³Appendix C provides descriptions of all variables.

Data Collection

Patient recruitment occurred from February to October 2017 in a single community hospital in Iowa.⁹ We identified potentially eligible events in collaboration with the unit charge nurses. Patients were screened 24 to 48 hours prior to anticipated day of discharge; those interested/eligible underwent informed consent procedures.⁹ We collected data from the patient and their corresponding bedside nurse, coordinator, and attending physician on the day of discharge. After the discharge order was placed and care instructions were provided, the patient completed a demographic survey, Short Portable Mini Mental Status Questionnaire, and the Patient-RHDS/SF. Individual team members completed a survey with the demographic information, their respective versions of RHDS/SF, and day-of-discharge teamwork-related questions. On average, the survey took clinicians less than 5 minutes to complete. We performed a chart review to determine additional patient characteristics such as principal diagnosis, length of stay, and number of comorbidities.

Data Analysis

Team Assessment of Patient Discharge Readiness

The teams’ shared assessment (SMM content) was determined by averaging the members’ individual scores on the Clinician-RHDS/SF.³⁴ Discharge events with higher team assessments indicated the team perceived the patient as being readier for hospital discharge. Guided by prior research, we examined the RHDS/SF scores as a continuous variable and as a four-level categorical variable of readiness: low (<7), moderate (7-7.9), high (8-8.9), and very high (9-10).²⁰

Team SMM Convergence

To determine the teams’ convergence on patient discharge readiness, we calculated an adjusted interrater agreement index (r*_wg(j))^35,36 for each team using the individual clinicians’ scores on the RHDS/SF. These convergence values were categorized into four agreement levels: low agreement (<0.7), moderate agreement (0.7-0.79), high agreement (0.8-0.89), and very high agreement (0.9-1). See Appendix D for the r*_wg(j) equation.^35,36

Team-Patient SMM Convergence

To determine the team-patient SMM convergence, we subtracted the team’s assessment of patient discharge readiness from the Patient-RHDS/SF score. We used a one-unit change on the RHDS/SF (1 point on the 0-10 scale) as a meaningful difference between the patient’s self-assessment and teams’ assessment on readiness for hospital discharge. This definition for divergence aligns with prior RHDS psychometric testing studies^20,27 and research examining convergence between patient and nurse assessments.²⁸ For example, Weiss and colleagues²⁷ found a 1-point decrease in the RN-RHDS/SF item mean was associated with a 45% increase in likelihood of postdischarge utilization (hospital readmission and emergency room department visits). Therefore, we defined convergence of team-patient SMMs (or similar patient and team scores) as those with an absolute difference score less than 1 point, whereas teams with low team-patient SMM convergence (or divergent patient and team scores) were defined as having an absolute difference score greater than 1 point.

Prediction Models

For the exploratory aim, we first examined the bivariate relationship between the outcome variables (discharge teams’ assessment of patient readiness, team convergence, and team-patient convergence) and the identified contextual variables. We also checked for potential collinearity among the explanatory variables. Then we used a linear stepwise regression procedure to identify factors associated with each continuous outcome variable. Due to the small sample size, we performed separate backward stepwise regression selection analyses for the three outcomes of interest. The candidate explanatory variables were evaluated using P < .20 for model entry. Final models were evaluated using leave-one-out cross validation. STATA (v.15.1, StataCorp; 2017) was used for analysis.

Sample

A total of 64 discharge events were included in this study. All discharge teams had a unique composition including 64 patients and varying combinations of 56 individual nurses (n = 27), physicians (n = 23), and coordinators (n = 6). Each event had three team members (ie, a nurse, a coordinator, and a physician) with no missing data. The majority of the 64 patient participants were White, retired, had a high school education, and lived in their own home with only one other person (Table 1).

Interprofessional Teams’ SMM of Readiness for Hospital Discharge

While the majority of teams perceived patients had high readiness for hospital discharge (mean, 8.5 out of 10; SD, 0.91), patients scores were nearly a full point lower (mean, 7.7; SD, 1.6; Table 2). The largest difference across categories was in the low-readiness category with 27% of patient scores falling into this category vs only 9.4% of discharge team mean scores. The mean SMM convergence of team perception of patients’ readiness for discharge was 0.90 (SD, 0.10); however, scores ranged from 0.66 (low agreement) to 1 (complete agreement). The average SMM team-patient convergence, or the discrepancy between the discharge team mean scores and the patient total scores across domains, was 1.16 (SD, 0.82). Of the 64 discharge events, 42.2% had similar team-patient perceptions of readiness for discharge, 9.4% had the patient reporting higher readiness for discharge than the team, and 48.4% had a team assessment rating of higher readiness for discharge than the patient’s self-assessment.

Prediction Models

In the exploratory analysis, we created individual linear regression models to predict the teams’ assessment, team convergence, and team-patient convergence for readiness of hospital discharge (Table 3; Appendix E). Factors associated with the teams’ assessment of discharge readiness included whether the patient was married and had less cognitive impairment, both of which were positively related to a higher-­rated readiness among teams. An important system factor was higher quality of communication among team members, which was positively associated with teams’ assessment of patient discharge readiness. In contrast, only patient factors—married patients and those with a principal diagnosis of heart failure—were associated with more convergent team SMMs. Team-patient convergence was positively associated with two patient factors: marital status (married) and fewer comorbidities. However, team-patient convergence was also associated with two system factors: teams with a bachelor’s level–trained nurse (compared with a nurse with an associate degree ) and teams reporting a higher quality of teamwork on day of discharge.

Our study applied novel approaches to explore the interprofessional teams’ understanding of discharge readiness, a concept known to be an important predictor of patient outcomes after discharge, including readmission.^20,28 We found that discharge teams frequently had poor quality SMMs of hospital discharge readiness. Despite having a discharge order and receiving home care instructions, one in four patients reported low readiness for hospital discharge. Additionally, discharge teams frequently overestimated patient’s readiness for hospital discharge. Misalignment on patient readiness for discharge occurred both within the discharge team (ie, low team convergence) and between patients and their care teams (ie, low team-patient convergence). The potential importance of this disagreement is substantiated by prior work suggesting that divergence in readiness ratings between nurses and patients are associated with postdischarge coping difficulties.²⁸

Previous readiness for discharge has been measured from the perspective of the patient,^20,21,27,28 nurse,^20,25-28 and physician,³⁷ yet rarely has the teams’ perspective been examined. We add to this literature by measuring the team’s perspective, as well as agreement between team and patient, on the individual patient’s readiness for discharge. Notably, we found that higher-quality communication is positively related to teams’ assessment of discharge readiness, with teams that reported higher quality teamwork having more convergent team-patient SMMs. Our results support many qualitative studies identifying communication and teamwork as major factors in teams’ effectiveness in discharge planning.^1-7,9 However, given the small sample size in this study, additional research is needed to further understand these relationships, as well as link SMMs to patient outcomes such as hospital readmission.

In an attempt to improve discharge planning, hospitals are increasingly assessing readiness for discharge as a low-intensity, low-cost intervention.^26,27 Yet, recent evidence suggests that readiness assessments alone have minimal impact on reducing hospital readmissions.²⁶ To be successful, these assessments likely depend on quality interprofessional communication and ensuring the patient’s voice is incorporated into the discharge decision process.²⁶ However, there have been few ways to effectively evaluate these types of team interventions.⁹ Measuring SMM properties holds promise for identifying specific team mechanisms that may influence the effectiveness and fidelity of interventions for team-based discharge planning. As our findings indicate, SMMs provide a theoretical and methodological basis for evaluating if readiness for discharge was team based (convergence among team members) and patient centered (convergence among team assessment and patient self-assessment). Researchers and improvement scientists can use the approach outlined to evaluate team-based patient-centered interventions for hospital discharge planning.⁹

This study provides a unique contribution to the growing work in the team science of SMMs.^9,10 We rigorously evaluated SMMs of key stakeholders (patients and their interprofessional team) in “real-time” clinical practice using a patient-centered assessment linked with postdischarge outcomes.^20,27,28 However, it is still unknown how much convergence is needed (and with whom) to safely discharge patients.¹³ Prior studies suggest highly convergent SMMs increase team performance when they are also accurate.^10-13 Convergence alone should not be sought because this may reflect groupthink or clinical inertia.^10,15 To improve discharge team performance over time,^10‑13 it is important to assess not only patient’s readiness on the day of discharge but also how prepared the patient actually was for the recovery period following acute care. In the larger mixed-methods study, we found that teams’ with more convergent SMMs on teamwork quality were associated with patient’s reported quality of transition 30-days after discharge.⁹ Together, these findings further highlight the importance of aligning patient and interprofessional team members perspectives during the discharge planning, as well as providing clinicians with regular feedback about patient’s postdischarge experiences and outcomes.

To optimize team performance, the discharge planning process must be considered from an interprofessional team perspective as it functions in real-world practice settings. There are increasing pressures to discharge patients “quicker and sicker,” to simplify and standardize clinical process, and to provide patient-centered care.^3,5-8 Without thoughtful interventions to facilitate communication during discharge planning, these pressures likely reinforce inaccurate assumptions regarding the work of fellow team members and force teams to think “fast” instead of “slow.”^38-40 One approach to overcome such barriers is to focus on building a high-quality interprofessional SMM around discharge readiness. For example, the RHDS/SF questions could be integrated into the electronic medical records, displayed on dashboards, and discussed regularly during discharge rounds. In particular, to strengthen the team’s SMM and quality of teamwork, together the staff can ask three practical questions (Appendix F): (1) Do we think the patient is ready for discharge? (2) To what extent do we all agree the patient is ready for discharge? (3) Does our assessment of discharge readiness match the patient’s? During this high-risk transition point, asking these questions might allow the team to move from thinking fast to thinking slowly so they can more effectively identify heuristics they may be using inaccurately, prevent blind spots, and move toward high reliability.^{10,13,18,38-40}

This study has limitations. First, events were recruited from patients with any of only six conditions at a single hospital. Other settings, patient condition types, or team compositions of other clinicians may differ in results. Second, in this study the SMM content was focused on readiness for hospital discharge among four key stakeholders. It is possible other SMM content needs to be shared among the interprofessional discharge team (eg, caregivers’ perspectives,^2,6-8 resource availability,^3-6 clinicians’ roles^4,9) or additional members should be included (eg, physical therapists, nursing assistants, home health consultants, or primary care clinicians). Although this study focused on a patient-centered outcome (Patient-RHDS/SF), we did not examine other important outcomes such as hospital readmission. Additionally, due to the small sample size, these results have limited generalizability and should be interpreted with caution. Last, we limited data collection to the day of hospital discharge; future studies might consider assessing discharge readiness throughout hospitalization.

Readying patients for hospital discharge is a time-sensitivehigh-risk task requiring multiple healthcare professionals to concurrently assess patient needs, formulate an anticipatory care plan, provide education, and arrange for postdischarge needs.^20,21 Despite this, few studies have analyzed teamwork aspects to understand how these transitions could be improved.⁹ By piloting SMM measurement and describing factors that affect SMMs, we provide a step toward identifying and evaluating strategies to assist interprofessional care teams in preparing patients for a safe, high-quality, patient-centered hospital discharge.

This work was presented at the Midwest Nursing Research Society’s 2018 Annual Research Conference in Cleveland, Ohio, as well as at AcademyHealth’s 2019 Annual Research Meeting in Washington, District of Columbia.

Continuous pulse oximetry monitoring (cSpO₂) in children with bronchiolitis is associated with increased rates of hospital admission, longer lengths of stay, more frequent treatment with supplemental oxygen, alarm fatigue, and higher hospital cost. There is no evidence that it improves clinical outcomes.^1-7 The safety of reducing cSpO₂ for stable bronchiolitis patients (ie, those who are clinically well and not requiring supplemental oxygen) has been assessed in quality improvement initiatives^8-10 and a randomized controlled trial.² These studies showed no increase in intensive care unit transfers, codes, or readmissions associated with reduced cSpO₂. Current national guidelines from the American Academy of Pediatrics⁵ and the Society of Hospital Medicine Choosing Wisely in Pediatric Hospital Medicine workgroup⁴ support limiting monitoring of children with bronchiolitis. Despite this, the practice of cSpO₂ in stable bronchiolitis patients off supplemental oxygen remains widespread.^11,12

Deimplementation, defined as reducing or stopping low-value or ineffective healthcare practices,^13,14 is a discrete focus area within implementation science. Deimplementation research involves the reduction of unnecessary and overused services for which there is potential for harm or no benefit.^15,16 In pediatrics, there are a number of potential targets for deimplementation,^4,17-20 including cSpO₂ for stable infants with bronchiolitis, but efforts to reduce low-value practices have met limited success to date. ^21,22

Implementation science offers rigorous methods for advancing the development and evaluation of strategies for deimplementation.²³ In particular, implementation science frameworks can facilitate our understanding of relevant contextual factors that may hinder or help efforts to deimplement low-value practices. To develop broadly applicable strategies to reduce monitoring overuse, it is important to understand the barriers, facilitators, and contextual factors (eg, clinical, political, interpersonal) that contribute to guideline-discordant cSpO₂ in hospitalized bronchiolitis patients. Further, the process by which one can develop a rigorous understanding of these factors and how they may impact deimplementation efforts could generalize to other scenarios in pediatrics where overuse remains an issue.

The goal of this study was to use semistructured interviews, informed by an established implementation science framework, specifically the Consolidated Framework for Implementation Research (CFIR),²⁴ to (1) identify barriers and facilitators to deimplementing unnecessary cSpO₂, and (2) develop strategies to deimplement cSpO₂ in a multicenter cohort of hospital-based clinician and administrative stakeholders.

Study Setting

This multicenter qualitative study using semistructured interviews took place within the Eliminating Monitor Overuse (EMO) SpO₂ study. The EMO SpO₂ study established rates of cSpO₂ in bronchiolitis patients not receiving supplemental oxygen or not receiving room air flow at 56 hospitals across the United States and in Canada from December 1, 2018, through March 31, 2019.¹² The study identified hospital-level risk-adjusted cSpO₂ rates ranging from 6% to 82%. A description of the EMO SpO₂ study methods²⁵ and its findings¹² have been published elsewhere.

Participants

We approached EMO study site principal investigators at 12 hospitals: the two highest- and two lowest-use hospitals within three hospital types (ie, freestanding children’s hospitals, children’s hospitals within large general hospitals, and community hospitals). We collaborated with the participating site principal investigators (n = 12), who were primarily hospitalist physicians in leadership roles, to recruit a purposive sample of additional stakeholders including bedside nurses (n = 12), hospitalist physicians (n = 15), respiratory therapists (n = 9), and hospital administrators (n = 8) to participate in semistructured interviews. Interviews were conducted until we achieved thematic saturation within each stakeholder group and within the high and low performing strata (total 56 interviews). Participants were asked to self-report basic demographic information (see Appendix, interview guide) as required by the study funder and to allow us to comment on the representativeness of the participant group.

Procedure

The interview guide was informed by the CFIR, a comprehensive framework detailing contextual factors that require consideration when planning for the implementation of a health service intervention. Table 1 details the CFIR domains with study-related examples. The interview guide (Appendix) provided limited clinical context apart from the age, diagnosis, and oxygen requirement for the population of interest to promote a broad array of responses and to avoid anchoring on specific clinical scenarios. Interviews were conducted by master’s degree or doctoral-level research coordinators with qualitative interviewing experience and supervised by a medical anthropologist and qualitative methods expert (F.K.B.). Prior to engaging in audio recorded phone interviews, the interviewer explained the risks and benefits of participating. Participants were compensated $50. Audio recordings were transcribed, deidentified, and uploaded to NVivo 12 Plus (QSR International) for data management.

The Institutional Review Boards of Children’s Hospital of Philadelphia, Pennsylvania, and the University of Pennsylvania in Philadelphia determined that the study met eligibility criteria for IRB exemption.

Data Analysis

Using an integrated approach to codebook development,²⁶ a priori codes were developed using constructs from the CFIR. Additional codes were added by the research team following a close reading of the first five transcripts.^27,28 Each code was defined, including decision rules for its application. Two research coordinators independently coded each transcript. Using the intercoder reliability function within NVivo, the coders established strong interrater reliability accordance scores (k > .8) by double coding 20% of the transcripts. Data were stratified by sites with low and high use of cSpO₂ to examine differences in barriers and facilitators to deimplementation. Each code was subcoded, summarized, and examined for patterns within and across participating disciplines, which yielded themes related to barriers and facilitators. We conducted member checking and reviewed our conclusions with a multidisciplinary group of clinical stakeholders (n = 13) to validate our analyses.

Barriers and facilitators to deimplementation were identified in multiple domains of the CFIR: outer setting, inner setting, characteristics of the individuals, and intervention characteristics (Table 1). Participants also suggested strategies to facilitate deimplementation in response to some identified barriers. See Table 2 for participant demographics and Table 3 for illustrative participant quotations.

Barriers

Outer Setting: Clinician Perceptions of Parental Discomfort With Discontinuing Monitoring

Participants mentioned parental preferences as a barrier to discontinuing cSpO₂, noting that parents seem to take comfort in watching the numbers on the monitor screen and are reluctant to have it withdrawn. Clinicians noted that parents sometimes put the monitor back on their child after a clinician removed it or have expressed concern that their unmonitored child was not receiving the same level of care as other patients who were being monitored. In these scenarios, clinicians reported they have found it helpful to educate caregivers about when cSpO₂ is and is not appropriate.

Inner Setting: Unclear or Nonexistent Guideline to Discontinue cSpO₂

Guidelines to discontinue cSpO₂ reportedly did not exist at all institutions. If a guideline did exist, lack of clarity or conflicting guidelines about when to use oxygen presented a barrier. Participants suggested that a clear guideline or additional oversight to ensure all clinicians are informed of the procedure for discontinuing cSpO₂ may help prevent miscommunication. Participants noted that their electronic health record (EHR) order sets commonly included cSpO₂ orders and that removing that option would facilitate deimplementation.

Inner Setting: Difficulty Educating All Staff

Participants noted difficulty with incorporating education about discontinuing cSpO₂ to all clinicians, particularly to those who are nightshift only or to rotating staff or trainees. This created barriers for frequent re-education because these staff are not familiar with the policies and procedures of the unit, which is crucial to developing a culture that supports the deimplementation of cSpO₂. Participants suggested that recurring education about procedures for discontinuing cSpO₂ should target trainees, new nurses, and overnight nurses. This would help to ensure that the guideline is uniformly followed.

Inner Setting: Culture of High cSpO₂ Use

Participants from high-use sites discussed a culture driven by readily available monitoring features or an expectation that monitoring indicates higher-quality care. Participants from low-use sites discussed increased cSpO₂ driven by clinicians who were accustomed to caring for higher-acuity patients, for whom continuous monitoring is likely appropriate, and were simultaneously caring for stable bronchiolitis patients.

Some suggested that visual cues would be useful to clinicians to sustain awareness about a cSpO₂ deimplementation guideline. It was also suggested that audit and feedback techniques like posting unit deimplementation statistics and creating a competition among units by posting unit performance could facilitate deimplementation. Additionally, some noted that visual aids in common spaces would be useful to remind clinicians and to engage caregivers about discontinuing cSpO₂.

Characteristics of Individuals: Clinician Discomfort Discontinuing cSpO₂

One frequently cited barrier across participants is that cSpO₂ provides “peace of mind” to alert clinicians to patients with low oxygen saturations that might otherwise be missed. Participants identified that clinician discomfort with reducing cSpO₂ may be driven by inexperienced clinicians less familiar with the bronchiolitis disease process, such as trainees, new nurses, or rotating clinicians unaccustomed to pediatric care. Trainees and new nurses were perceived as being more likely to work at night when there are fewer clinicians to provide patient care. Additionally, participants perceived that night shift clinicians favored cSpO₂ because they could measure vital signs without waking patients and families.

Clinicians discussed that discontinuing cSpO₂ would require alternative methods for assessing patient status, particularly for night shift nurses. Participants suggested strategies including changes to pulse oximetry assessment procedures to include more frequent “spot checks,” incorporation of assessments during sleep events (eg, naps) to ensure the patient does not experience desaturations during sleep, and training nurses to become more comfortable with suctioning patients. Suggestions also included education on the typical features of transient oxygen desaturations in otherwise stable patients with bronchiolitis² to bolster clinical confidence for clinicians unfamiliar with caring for bronchiolitis patients. Participants perceived that education about appropriate vs inappropriate use may help to empower clinicians to employ cSpO₂ appropriately.

Facilitators

Outer Setting: Standards and Evidence From Research, Professional Organizations, and Leaders in the Field

Many participants expressed the importance of consistent guidelines that are advocated by thought leaders in the field, supported by robust evidence, and consistent with approaches at peer hospitals. The more authoritative support a guideline has, the more comfortable people are adopting it and taking it seriously. Additionally, consistent education about guidelines was desired. Participants noted that all clinicians should be receiving education related to the American Academy of Pediatrics (AAP) Bronchiolitis and Choosing Wisely^® guidelines, ranging from a one-time update to annually. Continual updates and re-education sessions for clinicians who shared evidence about how cSpO₂ deimplementation could improve the quality of patient care by shortening hospital length of stay and lowering cost were suggested strategies.

Inner Setting: Leadership

Participants noted that successful deimplementation depends upon the presence of a champion or educator who will be able to lead the institutional charge in making practice change. This is typically an individual who is trusted at the institution, experienced in their field, or already doing implementation work. This could be either a single individual (champion) or a team. The most commonly noted clinician roles to engage in a leadership role or team were physicians and nurses.

Participants noted that a change in related clinical care pathways or EHR order sets would require cooperation from multiple clinical disciplines, administrators, and information technology leaders and explained that messaging and education about the value of the change would facilitate buy-in from those clinicians.

Inner Setting: EHR Support for Guidelines

Participants often endorsed the use of an order set within the EHR that supports guidelines and includes reminders to decrease cSpO₂. These reminders could come up when supplemental oxygen is discontinued or occur regularly throughout the patient’s stay to prompt the clinician to consider discontinuing cSpO₂.

Intervention Characteristics/Inner Setting: Clear Bronchiolitis Guidelines

The presence of a well-articulated hospital policy that delineates the appropriate and inappropriate use of cSpO₂ in bronchiolitis was mentioned as another facilitator of deimplementation.

Results of this qualitative study of stakeholders across hospitals with high and low cSpO₂ use illustrated the complexities involved with deimplementation of cSpO₂ in pediatric patients hospitalized with bronchiolitis. We identified numerous barriers spanning the CFIR constructs, including unclear or absent guidelines for stopping cSpO₂, clinician knowledge and comfort with bronchiolitis disease features, and unit culture. This suggests that multicomponent strategies that target various domains and a variety of stakeholders are needed to deimplement cSpO₂ use for stable bronchiolitis patients. Participants also identified facilitators, including clear cSpO₂ guidelines, supportive leaders and champions, and EHR modifications, that provide insight into strategies that may help sites reduce their use of cSpO₂. Additionally, participants also provided concrete, actionable suggestions for ways to reduce unnecessary monitoring that will be useful in informing promising deimplementation strategies for subsequent trials.

The importance of having specific and well-known guidelines from trusted sources, such as the AAP, about cSpO₂ and bronchiolitis treatment that are thoughtfully integrated in the EHR came through in multiple themes of our analysis. Prior studies on the effect of guidelines on clinical practice have suggested that rigorously designed guidelines can positively impact practice.²⁹ Participants also noted that cSpO₂ guidelines should be authoritative and that knowledge of guideline adoption by peer institutions was a facilitator of adoption. Usability issues negatively impact clinicians’ ability to follow guidelines.³⁰ Further, prior studies have demonstrated that EHR integration of guidelines can change practice.^31-33 Based on our findings, incorporating clear guidelines into commonly used formats, such as EHR order sets, could be an important deimplementation tool for cSpO₂ in stable bronchiolitis patients.

Education about and awareness of cSpO₂ guidelines was described as an important facilitator for appropriate cSpO₂ use and was suggested as a potential deimplementation strategy. Participants noted that educational need may vary by stakeholder group. For example, education may facilitate obtaining buy-in from hospital leaders, which is necessary to support changes to the EHR. Education incorporating information on the typical features of bronchiolitis and examples of appropriate and inappropriate cSpO₂ use was suggested for clinical team members. The limitations of education as a stand-alone deimplementation strategy were also noted, and participants highlighted challenges such as time needed for education and the need for ongoing education for rotating trainees. Inner and outer setting barriers, such as a perceived “culture of high pulse oximetryuse” and patient and family expectations, could also make education less effective as a stand-alone strategy. That—coupled with evidence that education and training alone are generally insufficient for producing reliable, sustained behavior change^34,35—suggests that a multifaceted approach will be important.

Our respondents consider parental perceptions and preference in their practice, which provides nuance to recent studies suggesting that parents prefer continuous monitors when their child is hospitalized with bronchiolitis. Chi et al described the impact of a brief educational intervention on parental preferences for monitoring children hospitalized for bronchiolitis.³⁶ This work suggests that educational interventions aimed at families should be considered in future (de)implementation studies because they may indirectly impact clinician behavior. Future studies should directly assess parental discomfort with discontinuing monitoring. Participants highlighted the link between knowledge and confidence in caring for typical bronchiolitis patients and monitoring practice, perceiving that less experienced clinicians are more likely to rely on cSpO₂. Participants at high-use sites emphasized the expectation that monitoring should occur during hospitalizations. This reflection is particularly pertinent for bronchiolitis, a disease characterized by frequent, self-resolving desaturations even after hospital discharge.³ This may reinforce a perceived need to capture and react to these desaturation events even though they are expected in bronchiolitis and can occur in healthy infants.³⁷ Some participants suggested that continuous monitoring be replaced with “nap tests” (ie, assessment for desaturations during a nap prior to discharge); however, like cSpO₂ in stable infants with bronchiolitis, this is another low-value practice. Otherwise healthy infants with mild to moderate disease are unlikely to subsequently worsen after showing signs of clinical improvement.³⁸ Nap tests are likely to lead to infants who are clinically improving being placed unnecessarily back on oxygen in reaction to the transient desaturations. Participants’ perception about the importance of cSpO₂ in bronchiolitis management, despite evidence suggesting it is a low-value practice, underscores the importance of not simply telling clinicians to stop cSpO₂. Employing strategies that replace continuous monitoring with another acceptable and feasible alternative (eg, regular clinician assessments including intermittent pulse oximetry checks) should be considered when planning for deimplementation.³⁹

Previous studies indicate that continuous monitoring can affect clinician decision-making, independent of other factors,^6,40 despite limited evidence that continuous monitors improve patient outcomes.^1-7 Studies have demonstrated noticeable increase in admissions based purely on pulse oximetry values,⁴⁰ with no evidence that this type of admission changes outcomes for bronchiolitis patients.⁶ One previous, single-center study identified inexperience as a potential driver for monitor use,⁴¹ and studies in adult populations have suggested that clinicians overestimate the value that continuous monitoring contributes to patient care,^42,43 which promotes guideline-discordant use. Our study provides novel insight into the issue of monitoring in bronchiolitis. Our results suggest that there is a need to shift organizational cultures around monitoring (which likely vary based on a range of factors) and that educational strategies addressing typical disease course, especially desaturations, in bronchiolitis will be an essential component in any deimplementation effort.

This study is strengthened by its sample of diverse stakeholder groups from multiple US health systems. Additionally, we interviewed individuals at sites with high cSpO₂ rates and at sites with low rates, as well as from community hospitals, children’s hospitals within general hospitals, and freestanding children’s hospitals, which allows us to understand barriers high-use sites encounter and facilitators of lower cSpO₂ rates at low-use sites. We also employed an interview approach informed by an established implementation science framework. Nonetheless, several limitations exist. First, participants at low-use sites did not necessarily have direct experience with a previous deimplementation effort to reduce cSpO₂. Additionally, participants were predominantly White and female; more diverse perspectives would strengthen confidence in the generalizability of our findings. While thematic saturation was achieved within each stakeholder group and within the high- and low-use strata, we interviewed fewer administrators and respiratory therapists relative to other stakeholder groups. Nevertheless, our conclusions were validated by our interdisciplinary stakeholder panel. As noted by participants, family preferences may influence clinician practice, and parents were not interviewed for this study. The information gleaned from the present study will inform the development of strategies to deimplement unnecessary cSpO₂ in pediatric hospitals, which we aim to rigorously evaluate in a future trial.

We identified barriers and facilitators to deimplementation of cSpO₂ for stable patients with bronchiolitis across children’s hospitals with high and low utilization of cSpO₂. These themes map to multiple CFIR domains and, along with participant-suggested strategies, can directly inform an approach to cSpO₂ deimplementation in a range of inpatient settings. Based on these data, future deimplementation efforts should focus on clear protocols for use and discontinuation of cSpO₂, EHR changes, and regular bronchiolitis education for hospital staff that emphasizes reducing unnecessary cSpO₂ utilization.

We acknowledge the NHLBI scientists who contributed their expertise to this project as part of the U01 Cooperative Agreement funding mechanism as federal employees conducting their official job duties: Lora Reineck, MD, MS, Karen Bienstock, MS, and Cheryl Boyce, PhD. We thank the Executive Council of the Pediatric Research in Inpatient Settings (PRIS) Network for their contributions to the early scientific development of this project. The Network assessed a Collaborative Support Fee for access to the hospitals and support of this project. We thank the PRIS Network collaborators for their major contributions to data collection measuring utilization to identify the hospitals we subsequently chose for this project. We thank Claire Bocage and the Mixed Methods Research Lab for major help in data management and data analysis.

Continuous pulse oximetry monitoring (cSpO₂) in children with bronchiolitis is associated with increased rates of hospital admission, longer lengths of stay, more frequent treatment with supplemental oxygen, alarm fatigue, and higher hospital cost. There is no evidence that it improves clinical outcomes.^1-7 The safety of reducing cSpO₂ for stable bronchiolitis patients (ie, those who are clinically well and not requiring supplemental oxygen) has been assessed in quality improvement initiatives^8-10 and a randomized controlled trial.² These studies showed no increase in intensive care unit transfers, codes, or readmissions associated with reduced cSpO₂. Current national guidelines from the American Academy of Pediatrics⁵ and the Society of Hospital Medicine Choosing Wisely in Pediatric Hospital Medicine workgroup⁴ support limiting monitoring of children with bronchiolitis. Despite this, the practice of cSpO₂ in stable bronchiolitis patients off supplemental oxygen remains widespread.^11,12

Deimplementation, defined as reducing or stopping low-value or ineffective healthcare practices,^13,14 is a discrete focus area within implementation science. Deimplementation research involves the reduction of unnecessary and overused services for which there is potential for harm or no benefit.^15,16 In pediatrics, there are a number of potential targets for deimplementation,^4,17-20 including cSpO₂ for stable infants with bronchiolitis, but efforts to reduce low-value practices have met limited success to date. ^21,22

Implementation science offers rigorous methods for advancing the development and evaluation of strategies for deimplementation.²³ In particular, implementation science frameworks can facilitate our understanding of relevant contextual factors that may hinder or help efforts to deimplement low-value practices. To develop broadly applicable strategies to reduce monitoring overuse, it is important to understand the barriers, facilitators, and contextual factors (eg, clinical, political, interpersonal) that contribute to guideline-discordant cSpO₂ in hospitalized bronchiolitis patients. Further, the process by which one can develop a rigorous understanding of these factors and how they may impact deimplementation efforts could generalize to other scenarios in pediatrics where overuse remains an issue.

The goal of this study was to use semistructured interviews, informed by an established implementation science framework, specifically the Consolidated Framework for Implementation Research (CFIR),²⁴ to (1) identify barriers and facilitators to deimplementing unnecessary cSpO₂, and (2) develop strategies to deimplement cSpO₂ in a multicenter cohort of hospital-based clinician and administrative stakeholders.

Study Setting

This multicenter qualitative study using semistructured interviews took place within the Eliminating Monitor Overuse (EMO) SpO₂ study. The EMO SpO₂ study established rates of cSpO₂ in bronchiolitis patients not receiving supplemental oxygen or not receiving room air flow at 56 hospitals across the United States and in Canada from December 1, 2018, through March 31, 2019.¹² The study identified hospital-level risk-adjusted cSpO₂ rates ranging from 6% to 82%. A description of the EMO SpO₂ study methods²⁵ and its findings¹² have been published elsewhere.

Participants

We approached EMO study site principal investigators at 12 hospitals: the two highest- and two lowest-use hospitals within three hospital types (ie, freestanding children’s hospitals, children’s hospitals within large general hospitals, and community hospitals). We collaborated with the participating site principal investigators (n = 12), who were primarily hospitalist physicians in leadership roles, to recruit a purposive sample of additional stakeholders including bedside nurses (n = 12), hospitalist physicians (n = 15), respiratory therapists (n = 9), and hospital administrators (n = 8) to participate in semistructured interviews. Interviews were conducted until we achieved thematic saturation within each stakeholder group and within the high and low performing strata (total 56 interviews). Participants were asked to self-report basic demographic information (see Appendix, interview guide) as required by the study funder and to allow us to comment on the representativeness of the participant group.

Procedure

The interview guide was informed by the CFIR, a comprehensive framework detailing contextual factors that require consideration when planning for the implementation of a health service intervention. Table 1 details the CFIR domains with study-related examples. The interview guide (Appendix) provided limited clinical context apart from the age, diagnosis, and oxygen requirement for the population of interest to promote a broad array of responses and to avoid anchoring on specific clinical scenarios. Interviews were conducted by master’s degree or doctoral-level research coordinators with qualitative interviewing experience and supervised by a medical anthropologist and qualitative methods expert (F.K.B.). Prior to engaging in audio recorded phone interviews, the interviewer explained the risks and benefits of participating. Participants were compensated $50. Audio recordings were transcribed, deidentified, and uploaded to NVivo 12 Plus (QSR International) for data management.

The Institutional Review Boards of Children’s Hospital of Philadelphia, Pennsylvania, and the University of Pennsylvania in Philadelphia determined that the study met eligibility criteria for IRB exemption.

Data Analysis

Using an integrated approach to codebook development,²⁶ a priori codes were developed using constructs from the CFIR. Additional codes were added by the research team following a close reading of the first five transcripts.^27,28 Each code was defined, including decision rules for its application. Two research coordinators independently coded each transcript. Using the intercoder reliability function within NVivo, the coders established strong interrater reliability accordance scores (k > .8) by double coding 20% of the transcripts. Data were stratified by sites with low and high use of cSpO₂ to examine differences in barriers and facilitators to deimplementation. Each code was subcoded, summarized, and examined for patterns within and across participating disciplines, which yielded themes related to barriers and facilitators. We conducted member checking and reviewed our conclusions with a multidisciplinary group of clinical stakeholders (n = 13) to validate our analyses.

Barriers and facilitators to deimplementation were identified in multiple domains of the CFIR: outer setting, inner setting, characteristics of the individuals, and intervention characteristics (Table 1). Participants also suggested strategies to facilitate deimplementation in response to some identified barriers. See Table 2 for participant demographics and Table 3 for illustrative participant quotations.

Barriers

Outer Setting: Clinician Perceptions of Parental Discomfort With Discontinuing Monitoring

Participants mentioned parental preferences as a barrier to discontinuing cSpO₂, noting that parents seem to take comfort in watching the numbers on the monitor screen and are reluctant to have it withdrawn. Clinicians noted that parents sometimes put the monitor back on their child after a clinician removed it or have expressed concern that their unmonitored child was not receiving the same level of care as other patients who were being monitored. In these scenarios, clinicians reported they have found it helpful to educate caregivers about when cSpO₂ is and is not appropriate.

Inner Setting: Unclear or Nonexistent Guideline to Discontinue cSpO₂

Guidelines to discontinue cSpO₂ reportedly did not exist at all institutions. If a guideline did exist, lack of clarity or conflicting guidelines about when to use oxygen presented a barrier. Participants suggested that a clear guideline or additional oversight to ensure all clinicians are informed of the procedure for discontinuing cSpO₂ may help prevent miscommunication. Participants noted that their electronic health record (EHR) order sets commonly included cSpO₂ orders and that removing that option would facilitate deimplementation.

Inner Setting: Difficulty Educating All Staff

Participants noted difficulty with incorporating education about discontinuing cSpO₂ to all clinicians, particularly to those who are nightshift only or to rotating staff or trainees. This created barriers for frequent re-education because these staff are not familiar with the policies and procedures of the unit, which is crucial to developing a culture that supports the deimplementation of cSpO₂. Participants suggested that recurring education about procedures for discontinuing cSpO₂ should target trainees, new nurses, and overnight nurses. This would help to ensure that the guideline is uniformly followed.

Inner Setting: Culture of High cSpO₂ Use

Participants from high-use sites discussed a culture driven by readily available monitoring features or an expectation that monitoring indicates higher-quality care. Participants from low-use sites discussed increased cSpO₂ driven by clinicians who were accustomed to caring for higher-acuity patients, for whom continuous monitoring is likely appropriate, and were simultaneously caring for stable bronchiolitis patients.

Some suggested that visual cues would be useful to clinicians to sustain awareness about a cSpO₂ deimplementation guideline. It was also suggested that audit and feedback techniques like posting unit deimplementation statistics and creating a competition among units by posting unit performance could facilitate deimplementation. Additionally, some noted that visual aids in common spaces would be useful to remind clinicians and to engage caregivers about discontinuing cSpO₂.

Characteristics of Individuals: Clinician Discomfort Discontinuing cSpO₂

One frequently cited barrier across participants is that cSpO₂ provides “peace of mind” to alert clinicians to patients with low oxygen saturations that might otherwise be missed. Participants identified that clinician discomfort with reducing cSpO₂ may be driven by inexperienced clinicians less familiar with the bronchiolitis disease process, such as trainees, new nurses, or rotating clinicians unaccustomed to pediatric care. Trainees and new nurses were perceived as being more likely to work at night when there are fewer clinicians to provide patient care. Additionally, participants perceived that night shift clinicians favored cSpO₂ because they could measure vital signs without waking patients and families.

Clinicians discussed that discontinuing cSpO₂ would require alternative methods for assessing patient status, particularly for night shift nurses. Participants suggested strategies including changes to pulse oximetry assessment procedures to include more frequent “spot checks,” incorporation of assessments during sleep events (eg, naps) to ensure the patient does not experience desaturations during sleep, and training nurses to become more comfortable with suctioning patients. Suggestions also included education on the typical features of transient oxygen desaturations in otherwise stable patients with bronchiolitis² to bolster clinical confidence for clinicians unfamiliar with caring for bronchiolitis patients. Participants perceived that education about appropriate vs inappropriate use may help to empower clinicians to employ cSpO₂ appropriately.

Facilitators

Outer Setting: Standards and Evidence From Research, Professional Organizations, and Leaders in the Field

Many participants expressed the importance of consistent guidelines that are advocated by thought leaders in the field, supported by robust evidence, and consistent with approaches at peer hospitals. The more authoritative support a guideline has, the more comfortable people are adopting it and taking it seriously. Additionally, consistent education about guidelines was desired. Participants noted that all clinicians should be receiving education related to the American Academy of Pediatrics (AAP) Bronchiolitis and Choosing Wisely^® guidelines, ranging from a one-time update to annually. Continual updates and re-education sessions for clinicians who shared evidence about how cSpO₂ deimplementation could improve the quality of patient care by shortening hospital length of stay and lowering cost were suggested strategies.

Inner Setting: Leadership

Participants noted that successful deimplementation depends upon the presence of a champion or educator who will be able to lead the institutional charge in making practice change. This is typically an individual who is trusted at the institution, experienced in their field, or already doing implementation work. This could be either a single individual (champion) or a team. The most commonly noted clinician roles to engage in a leadership role or team were physicians and nurses.

Participants noted that a change in related clinical care pathways or EHR order sets would require cooperation from multiple clinical disciplines, administrators, and information technology leaders and explained that messaging and education about the value of the change would facilitate buy-in from those clinicians.

Inner Setting: EHR Support for Guidelines

Participants often endorsed the use of an order set within the EHR that supports guidelines and includes reminders to decrease cSpO₂. These reminders could come up when supplemental oxygen is discontinued or occur regularly throughout the patient’s stay to prompt the clinician to consider discontinuing cSpO₂.

Intervention Characteristics/Inner Setting: Clear Bronchiolitis Guidelines

The presence of a well-articulated hospital policy that delineates the appropriate and inappropriate use of cSpO₂ in bronchiolitis was mentioned as another facilitator of deimplementation.

Results of this qualitative study of stakeholders across hospitals with high and low cSpO₂ use illustrated the complexities involved with deimplementation of cSpO₂ in pediatric patients hospitalized with bronchiolitis. We identified numerous barriers spanning the CFIR constructs, including unclear or absent guidelines for stopping cSpO₂, clinician knowledge and comfort with bronchiolitis disease features, and unit culture. This suggests that multicomponent strategies that target various domains and a variety of stakeholders are needed to deimplement cSpO₂ use for stable bronchiolitis patients. Participants also identified facilitators, including clear cSpO₂ guidelines, supportive leaders and champions, and EHR modifications, that provide insight into strategies that may help sites reduce their use of cSpO₂. Additionally, participants also provided concrete, actionable suggestions for ways to reduce unnecessary monitoring that will be useful in informing promising deimplementation strategies for subsequent trials.

The importance of having specific and well-known guidelines from trusted sources, such as the AAP, about cSpO₂ and bronchiolitis treatment that are thoughtfully integrated in the EHR came through in multiple themes of our analysis. Prior studies on the effect of guidelines on clinical practice have suggested that rigorously designed guidelines can positively impact practice.²⁹ Participants also noted that cSpO₂ guidelines should be authoritative and that knowledge of guideline adoption by peer institutions was a facilitator of adoption. Usability issues negatively impact clinicians’ ability to follow guidelines.³⁰ Further, prior studies have demonstrated that EHR integration of guidelines can change practice.^31-33 Based on our findings, incorporating clear guidelines into commonly used formats, such as EHR order sets, could be an important deimplementation tool for cSpO₂ in stable bronchiolitis patients.

Education about and awareness of cSpO₂ guidelines was described as an important facilitator for appropriate cSpO₂ use and was suggested as a potential deimplementation strategy. Participants noted that educational need may vary by stakeholder group. For example, education may facilitate obtaining buy-in from hospital leaders, which is necessary to support changes to the EHR. Education incorporating information on the typical features of bronchiolitis and examples of appropriate and inappropriate cSpO₂ use was suggested for clinical team members. The limitations of education as a stand-alone deimplementation strategy were also noted, and participants highlighted challenges such as time needed for education and the need for ongoing education for rotating trainees. Inner and outer setting barriers, such as a perceived “culture of high pulse oximetryuse” and patient and family expectations, could also make education less effective as a stand-alone strategy. That—coupled with evidence that education and training alone are generally insufficient for producing reliable, sustained behavior change^34,35—suggests that a multifaceted approach will be important.

Our respondents consider parental perceptions and preference in their practice, which provides nuance to recent studies suggesting that parents prefer continuous monitors when their child is hospitalized with bronchiolitis. Chi et al described the impact of a brief educational intervention on parental preferences for monitoring children hospitalized for bronchiolitis.³⁶ This work suggests that educational interventions aimed at families should be considered in future (de)implementation studies because they may indirectly impact clinician behavior. Future studies should directly assess parental discomfort with discontinuing monitoring. Participants highlighted the link between knowledge and confidence in caring for typical bronchiolitis patients and monitoring practice, perceiving that less experienced clinicians are more likely to rely on cSpO₂. Participants at high-use sites emphasized the expectation that monitoring should occur during hospitalizations. This reflection is particularly pertinent for bronchiolitis, a disease characterized by frequent, self-resolving desaturations even after hospital discharge.³ This may reinforce a perceived need to capture and react to these desaturation events even though they are expected in bronchiolitis and can occur in healthy infants.³⁷ Some participants suggested that continuous monitoring be replaced with “nap tests” (ie, assessment for desaturations during a nap prior to discharge); however, like cSpO₂ in stable infants with bronchiolitis, this is another low-value practice. Otherwise healthy infants with mild to moderate disease are unlikely to subsequently worsen after showing signs of clinical improvement.³⁸ Nap tests are likely to lead to infants who are clinically improving being placed unnecessarily back on oxygen in reaction to the transient desaturations. Participants’ perception about the importance of cSpO₂ in bronchiolitis management, despite evidence suggesting it is a low-value practice, underscores the importance of not simply telling clinicians to stop cSpO₂. Employing strategies that replace continuous monitoring with another acceptable and feasible alternative (eg, regular clinician assessments including intermittent pulse oximetry checks) should be considered when planning for deimplementation.³⁹

Previous studies indicate that continuous monitoring can affect clinician decision-making, independent of other factors,^6,40 despite limited evidence that continuous monitors improve patient outcomes.^1-7 Studies have demonstrated noticeable increase in admissions based purely on pulse oximetry values,⁴⁰ with no evidence that this type of admission changes outcomes for bronchiolitis patients.⁶ One previous, single-center study identified inexperience as a potential driver for monitor use,⁴¹ and studies in adult populations have suggested that clinicians overestimate the value that continuous monitoring contributes to patient care,^42,43 which promotes guideline-discordant use. Our study provides novel insight into the issue of monitoring in bronchiolitis. Our results suggest that there is a need to shift organizational cultures around monitoring (which likely vary based on a range of factors) and that educational strategies addressing typical disease course, especially desaturations, in bronchiolitis will be an essential component in any deimplementation effort.

This study is strengthened by its sample of diverse stakeholder groups from multiple US health systems. Additionally, we interviewed individuals at sites with high cSpO₂ rates and at sites with low rates, as well as from community hospitals, children’s hospitals within general hospitals, and freestanding children’s hospitals, which allows us to understand barriers high-use sites encounter and facilitators of lower cSpO₂ rates at low-use sites. We also employed an interview approach informed by an established implementation science framework. Nonetheless, several limitations exist. First, participants at low-use sites did not necessarily have direct experience with a previous deimplementation effort to reduce cSpO₂. Additionally, participants were predominantly White and female; more diverse perspectives would strengthen confidence in the generalizability of our findings. While thematic saturation was achieved within each stakeholder group and within the high- and low-use strata, we interviewed fewer administrators and respiratory therapists relative to other stakeholder groups. Nevertheless, our conclusions were validated by our interdisciplinary stakeholder panel. As noted by participants, family preferences may influence clinician practice, and parents were not interviewed for this study. The information gleaned from the present study will inform the development of strategies to deimplement unnecessary cSpO₂ in pediatric hospitals, which we aim to rigorously evaluate in a future trial.

We identified barriers and facilitators to deimplementation of cSpO₂ for stable patients with bronchiolitis across children’s hospitals with high and low utilization of cSpO₂. These themes map to multiple CFIR domains and, along with participant-suggested strategies, can directly inform an approach to cSpO₂ deimplementation in a range of inpatient settings. Based on these data, future deimplementation efforts should focus on clear protocols for use and discontinuation of cSpO₂, EHR changes, and regular bronchiolitis education for hospital staff that emphasizes reducing unnecessary cSpO₂ utilization.

We acknowledge the NHLBI scientists who contributed their expertise to this project as part of the U01 Cooperative Agreement funding mechanism as federal employees conducting their official job duties: Lora Reineck, MD, MS, Karen Bienstock, MS, and Cheryl Boyce, PhD. We thank the Executive Council of the Pediatric Research in Inpatient Settings (PRIS) Network for their contributions to the early scientific development of this project. The Network assessed a Collaborative Support Fee for access to the hospitals and support of this project. We thank the PRIS Network collaborators for their major contributions to data collection measuring utilization to identify the hospitals we subsequently chose for this project. We thank Claire Bocage and the Mixed Methods Research Lab for major help in data management and data analysis.

Continuous pulse oximetry monitoring (cSpO₂) in children with bronchiolitis is associated with increased rates of hospital admission, longer lengths of stay, more frequent treatment with supplemental oxygen, alarm fatigue, and higher hospital cost. There is no evidence that it improves clinical outcomes.^1-7 The safety of reducing cSpO₂ for stable bronchiolitis patients (ie, those who are clinically well and not requiring supplemental oxygen) has been assessed in quality improvement initiatives^8-10 and a randomized controlled trial.² These studies showed no increase in intensive care unit transfers, codes, or readmissions associated with reduced cSpO₂. Current national guidelines from the American Academy of Pediatrics⁵ and the Society of Hospital Medicine Choosing Wisely in Pediatric Hospital Medicine workgroup⁴ support limiting monitoring of children with bronchiolitis. Despite this, the practice of cSpO₂ in stable bronchiolitis patients off supplemental oxygen remains widespread.^11,12

Deimplementation, defined as reducing or stopping low-value or ineffective healthcare practices,^13,14 is a discrete focus area within implementation science. Deimplementation research involves the reduction of unnecessary and overused services for which there is potential for harm or no benefit.^15,16 In pediatrics, there are a number of potential targets for deimplementation,^4,17-20 including cSpO₂ for stable infants with bronchiolitis, but efforts to reduce low-value practices have met limited success to date. ^21,22

Implementation science offers rigorous methods for advancing the development and evaluation of strategies for deimplementation.²³ In particular, implementation science frameworks can facilitate our understanding of relevant contextual factors that may hinder or help efforts to deimplement low-value practices. To develop broadly applicable strategies to reduce monitoring overuse, it is important to understand the barriers, facilitators, and contextual factors (eg, clinical, political, interpersonal) that contribute to guideline-discordant cSpO₂ in hospitalized bronchiolitis patients. Further, the process by which one can develop a rigorous understanding of these factors and how they may impact deimplementation efforts could generalize to other scenarios in pediatrics where overuse remains an issue.

The goal of this study was to use semistructured interviews, informed by an established implementation science framework, specifically the Consolidated Framework for Implementation Research (CFIR),²⁴ to (1) identify barriers and facilitators to deimplementing unnecessary cSpO₂, and (2) develop strategies to deimplement cSpO₂ in a multicenter cohort of hospital-based clinician and administrative stakeholders.

Study Setting

This multicenter qualitative study using semistructured interviews took place within the Eliminating Monitor Overuse (EMO) SpO₂ study. The EMO SpO₂ study established rates of cSpO₂ in bronchiolitis patients not receiving supplemental oxygen or not receiving room air flow at 56 hospitals across the United States and in Canada from December 1, 2018, through March 31, 2019.¹² The study identified hospital-level risk-adjusted cSpO₂ rates ranging from 6% to 82%. A description of the EMO SpO₂ study methods²⁵ and its findings¹² have been published elsewhere.

Participants

We approached EMO study site principal investigators at 12 hospitals: the two highest- and two lowest-use hospitals within three hospital types (ie, freestanding children’s hospitals, children’s hospitals within large general hospitals, and community hospitals). We collaborated with the participating site principal investigators (n = 12), who were primarily hospitalist physicians in leadership roles, to recruit a purposive sample of additional stakeholders including bedside nurses (n = 12), hospitalist physicians (n = 15), respiratory therapists (n = 9), and hospital administrators (n = 8) to participate in semistructured interviews. Interviews were conducted until we achieved thematic saturation within each stakeholder group and within the high and low performing strata (total 56 interviews). Participants were asked to self-report basic demographic information (see Appendix, interview guide) as required by the study funder and to allow us to comment on the representativeness of the participant group.

Procedure

The interview guide was informed by the CFIR, a comprehensive framework detailing contextual factors that require consideration when planning for the implementation of a health service intervention. Table 1 details the CFIR domains with study-related examples. The interview guide (Appendix) provided limited clinical context apart from the age, diagnosis, and oxygen requirement for the population of interest to promote a broad array of responses and to avoid anchoring on specific clinical scenarios. Interviews were conducted by master’s degree or doctoral-level research coordinators with qualitative interviewing experience and supervised by a medical anthropologist and qualitative methods expert (F.K.B.). Prior to engaging in audio recorded phone interviews, the interviewer explained the risks and benefits of participating. Participants were compensated $50. Audio recordings were transcribed, deidentified, and uploaded to NVivo 12 Plus (QSR International) for data management.

The Institutional Review Boards of Children’s Hospital of Philadelphia, Pennsylvania, and the University of Pennsylvania in Philadelphia determined that the study met eligibility criteria for IRB exemption.

Data Analysis

Using an integrated approach to codebook development,²⁶ a priori codes were developed using constructs from the CFIR. Additional codes were added by the research team following a close reading of the first five transcripts.^27,28 Each code was defined, including decision rules for its application. Two research coordinators independently coded each transcript. Using the intercoder reliability function within NVivo, the coders established strong interrater reliability accordance scores (k > .8) by double coding 20% of the transcripts. Data were stratified by sites with low and high use of cSpO₂ to examine differences in barriers and facilitators to deimplementation. Each code was subcoded, summarized, and examined for patterns within and across participating disciplines, which yielded themes related to barriers and facilitators. We conducted member checking and reviewed our conclusions with a multidisciplinary group of clinical stakeholders (n = 13) to validate our analyses.

Barriers and facilitators to deimplementation were identified in multiple domains of the CFIR: outer setting, inner setting, characteristics of the individuals, and intervention characteristics (Table 1). Participants also suggested strategies to facilitate deimplementation in response to some identified barriers. See Table 2 for participant demographics and Table 3 for illustrative participant quotations.

Barriers

Outer Setting: Clinician Perceptions of Parental Discomfort With Discontinuing Monitoring

Participants mentioned parental preferences as a barrier to discontinuing cSpO₂, noting that parents seem to take comfort in watching the numbers on the monitor screen and are reluctant to have it withdrawn. Clinicians noted that parents sometimes put the monitor back on their child after a clinician removed it or have expressed concern that their unmonitored child was not receiving the same level of care as other patients who were being monitored. In these scenarios, clinicians reported they have found it helpful to educate caregivers about when cSpO₂ is and is not appropriate.

Inner Setting: Unclear or Nonexistent Guideline to Discontinue cSpO₂

Guidelines to discontinue cSpO₂ reportedly did not exist at all institutions. If a guideline did exist, lack of clarity or conflicting guidelines about when to use oxygen presented a barrier. Participants suggested that a clear guideline or additional oversight to ensure all clinicians are informed of the procedure for discontinuing cSpO₂ may help prevent miscommunication. Participants noted that their electronic health record (EHR) order sets commonly included cSpO₂ orders and that removing that option would facilitate deimplementation.

Inner Setting: Difficulty Educating All Staff

Participants noted difficulty with incorporating education about discontinuing cSpO₂ to all clinicians, particularly to those who are nightshift only or to rotating staff or trainees. This created barriers for frequent re-education because these staff are not familiar with the policies and procedures of the unit, which is crucial to developing a culture that supports the deimplementation of cSpO₂. Participants suggested that recurring education about procedures for discontinuing cSpO₂ should target trainees, new nurses, and overnight nurses. This would help to ensure that the guideline is uniformly followed.

Inner Setting: Culture of High cSpO₂ Use

Participants from high-use sites discussed a culture driven by readily available monitoring features or an expectation that monitoring indicates higher-quality care. Participants from low-use sites discussed increased cSpO₂ driven by clinicians who were accustomed to caring for higher-acuity patients, for whom continuous monitoring is likely appropriate, and were simultaneously caring for stable bronchiolitis patients.

Some suggested that visual cues would be useful to clinicians to sustain awareness about a cSpO₂ deimplementation guideline. It was also suggested that audit and feedback techniques like posting unit deimplementation statistics and creating a competition among units by posting unit performance could facilitate deimplementation. Additionally, some noted that visual aids in common spaces would be useful to remind clinicians and to engage caregivers about discontinuing cSpO₂.

Characteristics of Individuals: Clinician Discomfort Discontinuing cSpO₂

One frequently cited barrier across participants is that cSpO₂ provides “peace of mind” to alert clinicians to patients with low oxygen saturations that might otherwise be missed. Participants identified that clinician discomfort with reducing cSpO₂ may be driven by inexperienced clinicians less familiar with the bronchiolitis disease process, such as trainees, new nurses, or rotating clinicians unaccustomed to pediatric care. Trainees and new nurses were perceived as being more likely to work at night when there are fewer clinicians to provide patient care. Additionally, participants perceived that night shift clinicians favored cSpO₂ because they could measure vital signs without waking patients and families.

Clinicians discussed that discontinuing cSpO₂ would require alternative methods for assessing patient status, particularly for night shift nurses. Participants suggested strategies including changes to pulse oximetry assessment procedures to include more frequent “spot checks,” incorporation of assessments during sleep events (eg, naps) to ensure the patient does not experience desaturations during sleep, and training nurses to become more comfortable with suctioning patients. Suggestions also included education on the typical features of transient oxygen desaturations in otherwise stable patients with bronchiolitis² to bolster clinical confidence for clinicians unfamiliar with caring for bronchiolitis patients. Participants perceived that education about appropriate vs inappropriate use may help to empower clinicians to employ cSpO₂ appropriately.

Facilitators

Outer Setting: Standards and Evidence From Research, Professional Organizations, and Leaders in the Field

Many participants expressed the importance of consistent guidelines that are advocated by thought leaders in the field, supported by robust evidence, and consistent with approaches at peer hospitals. The more authoritative support a guideline has, the more comfortable people are adopting it and taking it seriously. Additionally, consistent education about guidelines was desired. Participants noted that all clinicians should be receiving education related to the American Academy of Pediatrics (AAP) Bronchiolitis and Choosing Wisely^® guidelines, ranging from a one-time update to annually. Continual updates and re-education sessions for clinicians who shared evidence about how cSpO₂ deimplementation could improve the quality of patient care by shortening hospital length of stay and lowering cost were suggested strategies.

Inner Setting: Leadership

Participants noted that successful deimplementation depends upon the presence of a champion or educator who will be able to lead the institutional charge in making practice change. This is typically an individual who is trusted at the institution, experienced in their field, or already doing implementation work. This could be either a single individual (champion) or a team. The most commonly noted clinician roles to engage in a leadership role or team were physicians and nurses.

Participants noted that a change in related clinical care pathways or EHR order sets would require cooperation from multiple clinical disciplines, administrators, and information technology leaders and explained that messaging and education about the value of the change would facilitate buy-in from those clinicians.

Inner Setting: EHR Support for Guidelines

Participants often endorsed the use of an order set within the EHR that supports guidelines and includes reminders to decrease cSpO₂. These reminders could come up when supplemental oxygen is discontinued or occur regularly throughout the patient’s stay to prompt the clinician to consider discontinuing cSpO₂.

Intervention Characteristics/Inner Setting: Clear Bronchiolitis Guidelines

The presence of a well-articulated hospital policy that delineates the appropriate and inappropriate use of cSpO₂ in bronchiolitis was mentioned as another facilitator of deimplementation.

Results of this qualitative study of stakeholders across hospitals with high and low cSpO₂ use illustrated the complexities involved with deimplementation of cSpO₂ in pediatric patients hospitalized with bronchiolitis. We identified numerous barriers spanning the CFIR constructs, including unclear or absent guidelines for stopping cSpO₂, clinician knowledge and comfort with bronchiolitis disease features, and unit culture. This suggests that multicomponent strategies that target various domains and a variety of stakeholders are needed to deimplement cSpO₂ use for stable bronchiolitis patients. Participants also identified facilitators, including clear cSpO₂ guidelines, supportive leaders and champions, and EHR modifications, that provide insight into strategies that may help sites reduce their use of cSpO₂. Additionally, participants also provided concrete, actionable suggestions for ways to reduce unnecessary monitoring that will be useful in informing promising deimplementation strategies for subsequent trials.

The importance of having specific and well-known guidelines from trusted sources, such as the AAP, about cSpO₂ and bronchiolitis treatment that are thoughtfully integrated in the EHR came through in multiple themes of our analysis. Prior studies on the effect of guidelines on clinical practice have suggested that rigorously designed guidelines can positively impact practice.²⁹ Participants also noted that cSpO₂ guidelines should be authoritative and that knowledge of guideline adoption by peer institutions was a facilitator of adoption. Usability issues negatively impact clinicians’ ability to follow guidelines.³⁰ Further, prior studies have demonstrated that EHR integration of guidelines can change practice.^31-33 Based on our findings, incorporating clear guidelines into commonly used formats, such as EHR order sets, could be an important deimplementation tool for cSpO₂ in stable bronchiolitis patients.

Education about and awareness of cSpO₂ guidelines was described as an important facilitator for appropriate cSpO₂ use and was suggested as a potential deimplementation strategy. Participants noted that educational need may vary by stakeholder group. For example, education may facilitate obtaining buy-in from hospital leaders, which is necessary to support changes to the EHR. Education incorporating information on the typical features of bronchiolitis and examples of appropriate and inappropriate cSpO₂ use was suggested for clinical team members. The limitations of education as a stand-alone deimplementation strategy were also noted, and participants highlighted challenges such as time needed for education and the need for ongoing education for rotating trainees. Inner and outer setting barriers, such as a perceived “culture of high pulse oximetryuse” and patient and family expectations, could also make education less effective as a stand-alone strategy. That—coupled with evidence that education and training alone are generally insufficient for producing reliable, sustained behavior change^34,35—suggests that a multifaceted approach will be important.

Our respondents consider parental perceptions and preference in their practice, which provides nuance to recent studies suggesting that parents prefer continuous monitors when their child is hospitalized with bronchiolitis. Chi et al described the impact of a brief educational intervention on parental preferences for monitoring children hospitalized for bronchiolitis.³⁶ This work suggests that educational interventions aimed at families should be considered in future (de)implementation studies because they may indirectly impact clinician behavior. Future studies should directly assess parental discomfort with discontinuing monitoring. Participants highlighted the link between knowledge and confidence in caring for typical bronchiolitis patients and monitoring practice, perceiving that less experienced clinicians are more likely to rely on cSpO₂. Participants at high-use sites emphasized the expectation that monitoring should occur during hospitalizations. This reflection is particularly pertinent for bronchiolitis, a disease characterized by frequent, self-resolving desaturations even after hospital discharge.³ This may reinforce a perceived need to capture and react to these desaturation events even though they are expected in bronchiolitis and can occur in healthy infants.³⁷ Some participants suggested that continuous monitoring be replaced with “nap tests” (ie, assessment for desaturations during a nap prior to discharge); however, like cSpO₂ in stable infants with bronchiolitis, this is another low-value practice. Otherwise healthy infants with mild to moderate disease are unlikely to subsequently worsen after showing signs of clinical improvement.³⁸ Nap tests are likely to lead to infants who are clinically improving being placed unnecessarily back on oxygen in reaction to the transient desaturations. Participants’ perception about the importance of cSpO₂ in bronchiolitis management, despite evidence suggesting it is a low-value practice, underscores the importance of not simply telling clinicians to stop cSpO₂. Employing strategies that replace continuous monitoring with another acceptable and feasible alternative (eg, regular clinician assessments including intermittent pulse oximetry checks) should be considered when planning for deimplementation.³⁹

Previous studies indicate that continuous monitoring can affect clinician decision-making, independent of other factors,^6,40 despite limited evidence that continuous monitors improve patient outcomes.^1-7 Studies have demonstrated noticeable increase in admissions based purely on pulse oximetry values,⁴⁰ with no evidence that this type of admission changes outcomes for bronchiolitis patients.⁶ One previous, single-center study identified inexperience as a potential driver for monitor use,⁴¹ and studies in adult populations have suggested that clinicians overestimate the value that continuous monitoring contributes to patient care,^42,43 which promotes guideline-discordant use. Our study provides novel insight into the issue of monitoring in bronchiolitis. Our results suggest that there is a need to shift organizational cultures around monitoring (which likely vary based on a range of factors) and that educational strategies addressing typical disease course, especially desaturations, in bronchiolitis will be an essential component in any deimplementation effort.

This study is strengthened by its sample of diverse stakeholder groups from multiple US health systems. Additionally, we interviewed individuals at sites with high cSpO₂ rates and at sites with low rates, as well as from community hospitals, children’s hospitals within general hospitals, and freestanding children’s hospitals, which allows us to understand barriers high-use sites encounter and facilitators of lower cSpO₂ rates at low-use sites. We also employed an interview approach informed by an established implementation science framework. Nonetheless, several limitations exist. First, participants at low-use sites did not necessarily have direct experience with a previous deimplementation effort to reduce cSpO₂. Additionally, participants were predominantly White and female; more diverse perspectives would strengthen confidence in the generalizability of our findings. While thematic saturation was achieved within each stakeholder group and within the high- and low-use strata, we interviewed fewer administrators and respiratory therapists relative to other stakeholder groups. Nevertheless, our conclusions were validated by our interdisciplinary stakeholder panel. As noted by participants, family preferences may influence clinician practice, and parents were not interviewed for this study. The information gleaned from the present study will inform the development of strategies to deimplement unnecessary cSpO₂ in pediatric hospitals, which we aim to rigorously evaluate in a future trial.

We identified barriers and facilitators to deimplementation of cSpO₂ for stable patients with bronchiolitis across children’s hospitals with high and low utilization of cSpO₂. These themes map to multiple CFIR domains and, along with participant-suggested strategies, can directly inform an approach to cSpO₂ deimplementation in a range of inpatient settings. Based on these data, future deimplementation efforts should focus on clear protocols for use and discontinuation of cSpO₂, EHR changes, and regular bronchiolitis education for hospital staff that emphasizes reducing unnecessary cSpO₂ utilization.

We acknowledge the NHLBI scientists who contributed their expertise to this project as part of the U01 Cooperative Agreement funding mechanism as federal employees conducting their official job duties: Lora Reineck, MD, MS, Karen Bienstock, MS, and Cheryl Boyce, PhD. We thank the Executive Council of the Pediatric Research in Inpatient Settings (PRIS) Network for their contributions to the early scientific development of this project. The Network assessed a Collaborative Support Fee for access to the hospitals and support of this project. We thank the PRIS Network collaborators for their major contributions to data collection measuring utilization to identify the hospitals we subsequently chose for this project. We thank Claire Bocage and the Mixed Methods Research Lab for major help in data management and data analysis.

Transitions from the hospital to the ambulatory setting are high-risk periods for patients in terms of adverse events, poor clinical outcomes, and readmission. Processes of care during care transitions are suboptimal, including poor communication among inpatient providers, patients, and ambulatory providers^1,2; suboptimal communication of postdischarge plans of care to patients and their ability to carry out these plans³; medication discrepancies and nonadherence after discharge⁴; and lack of timely follow-up with ambulatory providers.⁵ Healthcare organizations continue to struggle with the question of which interventions to implement and how best to implement them.

Interventions to improve care transitions typically focus on readmission rates, but some studies have focused on postdischarge adverse events, defined as injuries in the 30 days after discharge caused by medical management rather than underlying disease processes.² These adverse events cause psychological distress, out-of-pocket expenses, decreases in functional status, and caregiver burden. An estimated 20% of hospitalized patients suffer a postdischarge adverse event.^1,2 Approximately two-thirds of these may be preventable or ameliorable.

The advent of Accountable Care Organizations (ACOs), defined as “groups of doctors, hospitals, and other health care providers who come together voluntarily to give coordinated high quality care to their patients,” creates an opportunity for improvements in patient safety during care transitions.⁶ Another opportunity has been the advent of Patient-Centered Medical Homes (PCMH), consisting of patient-oriented, comprehensive, team-based primary care enhanced by health information technology and population-based disease management tools.^7,8 In theory, a hospital-PCMH collaboration within an ACO can improve transitional interventions since optimal communication and collaboration are more likely when both inpatient and primary care providers (PCPs) share infrastructure and are similarly incentivized. The objectives of this study were to design and implement a collaborative hospital-PCMH care transitions intervention within an ACO and evaluate its effects.

This study was a two-arm, single-blind (blinded outcomes assessor), stepped-wedge, multisite cluster-randomized clinical trial (NCT02130570) approved by the institutional review board of Partners HealthCare.

Study Design and Randomization

The study employed a “stepped-wedge” design, which is a cluster-randomized study design in which an intervention is sequentially rolled out to different groups at different, prespecified, randomly determined times.⁹ Each cluster (in this case, each primary care practice) served as its own control, while still allowing for adjustment for temporal trends. Originally, 18 practices participated, but one withdrew due to the low number of patients enrolled in the study, leaving 17 clusters and 16 sequences; see Figure 1 of Appendix 1 for a full description of the sample size and timeline for each cluster. Practices were not aware of this timeline until after recruitment.

Study Setting and Participants

Conducted within a large Pioneer ACO in Boston and funded by the Patient-Centered Outcomes Research Institute (PCORI), the Partners-PCORI Transitions Study was designed as a “real-world” quality improvement project. Potential participants were adult patients who were admitted to medical and surgical services of two large academic hospitals (Hospital A and Hospital B) affiliated with an ACO, who were likely to be discharged back to the community, and whose PCP belonged to a primary care practice that was affiliated with the ACO, agreed to participate, and were designated PCMHs or on their way to being designated by meeting certain criteria: electronic health record, patient portal, team-based care, practice redesign, care management, and identification of high-risk patients. See Study Protocol (Appendix 2) for detailed patient and primary care practice inclusion criteria.

Patient Enrollment

Study staff screened participants from a daily automated list of patients admitted the day before, using medical records to determine eligibility, which was then confirmed by the patient’s nurse. Exclusion criteria included likely discharge to a location other than home, being in police custody, lack of a telephone, being homeless, previous enrollment in the study, and being unable to communicate in English or Spanish. Allocation to study arm was concealed until the patient or proxy provided informed written consent. The research assistant administered questionnaires to all study subjects to assess potential confounders and functional status 1 month prior to admission (Medical Outcomes Study 12-Item Short Form Health Survey [SF-12]).¹⁰ Patients were recruited between March 2013 and October 2015.

Intervention

The intervention was based on a conceptual model of an ideal discharge¹¹ that we developed based on work by Naylor et al,¹² work by Coleman and Berenson,³ best practices in medication reconciliation and information transfer according to our own research,^13-15 the best examples of interventions to improve the discharge process,^12,16,17 and a systematic review of discharge interventions.¹⁸ Some of the factors necessary for an ideal care transition include complete, organized, and timely documentation of the patient’s hospital course and postdischarge plan; effective discharge planning; coordination of care among the patient’s providers; methods to ensure medication safety; advanced care planning in appropriate patients; and education and “coaching” of patients and their caregivers so they learn how to manage their conditions. The final multifaceted intervention addressed each component of the ideal discharge and included inpatient and outpatient components (Table 1 and Table 1 of Appendix 1).

Patient and Public Involvement in Research

As with all PCORI-funded studies, this study involved a patient-family advisory council (PFAC). Our PFAC included six recently hospitalized patients or caregivers of recently hospitalized patients. The PFAC participated in monthly meetings throughout the study period. They helped inform the research questions, including confirmation that the endpoints were patient centered, and provided valuable input for the design of the intervention and the patient-facing components of the data collection instruments. They also interviewed several patient participants in the study regarding their experiences with the intervention. Lastly, they helped develop plans for dissemination of study results to the public.¹⁹

We also formed a steering committee consisting of physician, nursing, pharmacy, information technology, and administrative leadership representing primary care, inpatient care, and transitional care at both hospitals and Partners Healthcare. PFAC members took turns participating in quarterly steering committee meetings.

Evolution of the Intervention and Implementation

The intervention was iteratively refined during the course of the study in response to input from the PFAC, steering committee, and members of the intervention team; cases of adverse events and readmissions from patients despite being in the intervention arm; exit interviews of patients who had recently completed the intervention; and informal feedback from inpatient and outpatient clinicians. For example, we learned that the more complicated a patient’s conditions are, the sooner the clinical team wanted them to be seen after discharge. However, these patients were also less likely to feel well enough to keep that appointment. Therefore, the timing of follow-up of appointments needed to be a negotiation among the inpatient team, the patient, any caregivers, and the outpatient provider. PFAC members also emphasized that patients wanted one person to trust and to be the “point person” during a complicated transition such as hospital discharge.

At the same time, the intervention components evolved because of factors outside our control (eg, resource limitations). In keeping with the real-world nature of the research, the aim was for the intervention to be internally supported because incentives were theoretically more aligned with improvement of care transitions under the ACO model. By design, the PCORI contract only paid for limited parts of the intervention, such as a nurse practitioner to act as the discharge advocate at one hospital, overtime costs of inpatient pharmacists, and project manager time to facilitate inpatient-outpatient provider communication. (See Table 1 of Appendix 1 for details about the modifications to the intervention.)

Lastly, in keeping with PCORI’s methodology standards for studies of complex interventions,²⁰ we strove to standardize the intervention by function across hospitals, units, and practices, while still allowing for local adaptation in the form. In other words, rather than specifying exactly how a task (eg, medication counseling) needed to be performed, the study design offered sites flexibility in how they implemented the task given their available personnel and institutional culture.

Intervention Fidelity

To determine the extent to which each patient in the intervention arm received each intervention component, a project manager unblinded to treatment arm reviewed the electronic medical record for documentation of each component implemented by providers (eg, inpatient pharmacists, outpatient nurses). Because each intervention component produced documentation, this provided an accurate assessment of intervention fidelity, ie, the extent to which the intervention was implemented as intended.

Outcome Assessment

Postdischarge Follow-up

Based on previous studies,^2,21 a trained research assistant attempted to contact all study subjects 30 days (±5 days) after discharge and administered a questionnaire to identify any new or worsening symptoms since discharge, any healthcare use since discharge, and functional status in the previous week. Follow-up questions used branching logic to determine the relationship of any new or worsening symptoms to medications or other aspects of medical management. Research assistants followed up any positive responses with directed medical record review for objective findings, diagnoses, treatments, and responses. If patients could not be reached after five attempts, the research assistant instead conducted a thorough review of the outpatient medical record alone for provider reports of any new or worsening symptoms noted during follow-up within the 30-day postdischarge period. Research assistants also reviewed laboratory test results in all patients for evidence of postdischarge renal failure, elevated liver function tests, or new/worsening anemia.

Hospital Readmissions

We measured nonelective hospital readmissions within 30 days of discharge using a combination of administrative data for hospitalizations within the ACO network plus patient report during the 30-day phone call for all other readmissions.²²

Adjudication of Outcomes

Adverse events and preventable adverse events: All cases of new or worsening symptoms or signs, along with all supporting documentation, were then presented to teams of two trained blinded physician adjudicators through application of methods established in previous studies.^4,21 Each of the two adjudicators independently reviewed the information, along with the medical record, and completed a standardized form to confirm or deny the presence of any adverse events (ie, patient injury due to medical management) and to classify the type of event (eg, adverse drug event, hospital-acquired infection, procedural complication, diagnostic or management error), the severity and duration of the event, and whether the event was preventable or ameliorable. The two adjudicators then met to resolve any differences in their findings and come to consensus.

Preventable readmissions: If patients were readmitted to either study hospital, we conducted an evaluation, based on previous studies,²³ to determine if and how the readmission could have been prevented including (a) a standardized patient and caregiver interview to identify possible problems with the transitions process and (b) an email questionnaire to the patient’s PCP and the inpatient teams who cared for the patient during the index admission and readmission regarding possible deficiencies with the transitions process. As with adverse event adjudications, two physician adjudicators worked independently to classify the preventability of the readmission and then met to come to consensus. Conflicts were resolved by a third adjudicator.

Analysis Plan

To evaluate the effects of the intervention on the primary outcome, the number of postdischarge adverse events per patient, we used multivariable Poisson regression, with study arm as the main predictor. A similar approach was used to evaluate the number of new or worsening postdischarge signs or symptoms and the number of preventable adverse events per patient. We used an intention-to-treat analysis: If a practice did not start the intervention when they were scheduled to, based on our randomization, we counted all patients in that practice admitted after that point as intervention patients. We adjusted for patient demographics, clinical characteristics, month, inpatient unit, and primary care practice as fixed effects. We clustered by PCP using general linear models. Intervention effects were expressed as both unadjusted and adjusted incidence rate ratios (IRRs). We also conducted a limited number of subgroup analyses, determined a priori, to determine whether the intervention was more effective in certain patient populations; we used interaction terms (intervention × subgroup) to determine the statistical significance of any effect modification.

To evaluate the effects of the intervention on nonelective readmissions and preventable readmissions, we used a similar approach, using multivariable logistic regression. Postdischarge functional status, adjusted for status prior to admission, was analyzed using multivariable linear regression and random effects by primary care practice. The general linear mixed model (GLIMMIX) procedure in the SAS 9.3 statistical package (SAS Institute) was used to carry out all analyses.

Power and Sample Size

We assumed a baseline rate of postdischarge adverse events of 0.30 per patient.²¹ We conservatively assumed an effect size of a change from 0.30 in the control group to 0.23 in the intervention group (a relative reduction of 22%, which was based on studies of preventability rates²³ and close to the minimum clinically important difference). Based on prior studies,^4,22 we assumed an intraclass correlation coefficient of 0.01 with an average cluster size of seven patients per PCP. Assuming a 10% loss to follow-up rate and an alpha of 0.05, we targeted a sample size of 1,800 patients to achieve 80% power, with one-third of the patients in the usual care arm and two-thirds in the intervention arm.

We enrolled 18 PCMH primary care practices to participate in the study, including 8 from Hospital A (out of 13 approached), 8 from Hospital B (out of 11), and 2 from other ACO practices (out of 9) (plus two pilot practices). Reasons for not participating included not having dedicated personnel to play the role of the responsible outpatient clinician, undergoing recent turn-over in practice leadership, and not having enough patients admitted to the two hospitals. One practice only enrolled 5 patients in the study and withdrew from participation, which left 17 practices.

Study Patients

We enrolled 1,679 patients (Figure 1). Reasons for nonenrollment included being unable to complete the screen prior to discharge, not meeting inclusion criteria or meeting exclusion criteria, being assigned to a pilot practice, and declining informed written consent. The baseline characteristics of enrolled patients are presented in Table 2. Differences between the two study arms were small. About 47% of the cohort was not reachable by phone after five attempts for the 30-day phone call, but only 69 (4.1%) were truly lost to follow-up because they were unreachable by phone and had no documentation in the electronic medical record in the 30-days after discharge.

Intervention Fidelity

The majority of patients did not receive most intervention components, even those components that were supposed to be delivered to all intervention patients (Table 3). A minority of patients were referred to visiting nurse services and to the home pharmacy program. However, 855 patients (87%) in the intervention arm received at least one intervention component.

Outcome Measures

The intervention was associated with a statistically significant reduction in several of the outcomes of interest, including the primary outcome, number of postdischarge adverse events (45% reduction), and new or worsening postdischarge signs or symptoms (22% reduction), as well as preventable postdischarge adverse events (58% reduction) (Table 4). There was a nonsignificant difference in functional status. There was no significant effect on total nonelective or on preventable readmission rates. When analyzed by type of adverse event, the intervention was associated with a reduction in adverse drug events and in procedural complications (Table 2 of Appendix 1). Of note, there was no significant difference in the proportion of patients with at least one adverse event whether the outcome was determined by phone call and medical record review (49%) or medical record review alone (51%) (P = .48).

In subgroup analyses, there was no evidence of effect modification by service, hospital, patient age, readmission risk, health literacy, or comorbidity score (Table 3 of Appendix 1). Table 4 of Appendix 1 provides examples of postdischarge adverse events seen in the usual care arm that might have been prevented in the intervention.

This intervention was associated with a reduction in postdischarge adverse events. The relative improvement in each outcome aligned with the hypothesized sensitivity to change: the smallest improvement was seen in new or worsening signs or symptoms, followed by postdischarge adverse events and then by preventable postdischarge adverse events. The intervention was not associated with a difference in readmissions. The lack of effect on hospital readmissions may have been caused by the low proportion of readmissions that are preventable, as well as low intervention fidelity and lack of resources to implement facets such as postdischarge coaching, an evidence-based intervention that was never adopted.^16,23 One lesson of this study is that it may be easier to reduce postdischarge injury (still an important outcome) than readmissions.

Putting this study in context, we should note that the literature on interventions to improve care transitions is mixed.¹⁸ While there are several reports of successful interventions, there are many reports of unsuccessful ones, often using similar components. Success is often the result of adequate resources and attention to myriad details regarding implementation.²⁴ The intervention in our study likely contributed to improvements in patient and caregiver engagement in the hospital, enhancements of communication between inpatient and outpatient clinicians, and implementation of pharmacist-led interventions to improve medication safety. Regarding the latter, several prior studies have shown the benefits of pharmacist interventions in decreasing postdischarge adverse drug events.^4,25,26 Therefore, even an intervention with incomplete intervention fidelity can reduce postdischarge adverse events, especially because adverse drug events make up the majority of adverse events.^1,2,21

Perhaps the biggest lesson we learned was regarding the limitations of the hospital-led ACO model to incentivize sufficient up-front investments in transitional care interventions. By design, we chose a real-world approach in which interventions were integrated with existing ACO efforts, which were paid for internally by the institution. As a result, many of the interventions had to be scaled back because of resource constraints. The ACO model theoretically incentivizes more integrated care, but this may not always be true in practice. Emerging evidence suggests that physician group–led ACOs are associated with lower costs and use compared with hospital-led ACOs, likely because of more aligned incentives in physician group–led ACOs to reduce use of inpatient care.^27,28

An unresolved question is whether the ideal implementation approach is to protect the time of existing clinical personnel to carry out transitional care tasks or to hire external personnel to do these tasks. We purposely spread the intervention over several clinician types to minimize the additional burden on any one of them, minimize additional costs, and play to each clinician’s expertise, but in retrospect, this may not have been the right approach. By providing additional personnel with dedicated time, interest, and training in care transitions, the intervention may be delivered with higher quantitative and qualitative fidelity, and it could create a single point of contact for patients, which was considered highly desirable by our PFAC.

This study has several limitations. A large proportion of patients (44%) were unavailable for postdischarge phone calls. However, we were able to perform medical record review for worsening signs (eg, lab abnormalities) and symptoms (as reported by patients’ providers) in the postdischarge period and adjudicate them for adverse events for all but 69 of these patients. Because all these patients had ACO-affiliated PCPs, we would expect most of their utilization to have been within the system and, therefore, to be present in the medical record. The proportion of patients with at least one adverse event did not vary by the method of follow-up, which suggests that this issue is an unlikely source of bias. Assessment of readmission was imperfect because we do not have statewide or national data. However, our combination of administrative data for Partners readmissions plus self-report for non-Partners readmission has been shown to be fairly complete in previous studies.²⁹ Adjudicators could not be fully blinded to intervention status due to the lack of blinding of admission date. We did not calculate a kappa value for interrater reliability of individual assessments of adverse events; rather, coming to consensus among the two adjudicators was part of the process. In only a handful of cases was a third adjudicator required. Lastly, this study was conducted at two academic medical centers and their affiliated primary care clinics, which potentially limits generalizability; however, the results are likely generalizable to other ACOs that include major academic medical centers.

In conclusion, in this real-world clinical trial, we designed, implemented, and iteratively refined a multifaceted intervention to improve care transitions within a hospital-based academic ACO. Evolution of the intervention components was the result of stakeholder input, experience with the intervention, and ACO resource constraints. The intervention reduced postdischarge adverse events. However, across the ACO network, intervention fidelity was low, and this may have contributed to the lack of effect on readmission rates. ACOs that implement interventions without hiring new personnel or protecting the time of existing personnel to conduct transitional tasks are likely to face the same challenges of low fidelity.

The authors would like to acknowledge the many people who worked on designing, implementing, and evaluating this intervention, including but not limited to: Natasha Isaac, Hilary Heyison, Jacqueline Minahan, Molly O’Reilly, Michelle Potter, Nailah Khoory, Maureen Fagan, David Bates, Laura Carr, Joseph Frolkis, Eric Weil, Jacqueline Somerville, Stephanie Ahmed, Marcy Bergeron, Jessica Smith, and Jane Millett. We would also like to thank the members of our Patient-Family Advisory Council: Maureen Fagan, Karen Spikes, Margie Hodges, Win Hodges, Aureldon Henderson, Dena Salzberg, and Kay Bander.

Transitions from the hospital to the ambulatory setting are high-risk periods for patients in terms of adverse events, poor clinical outcomes, and readmission. Processes of care during care transitions are suboptimal, including poor communication among inpatient providers, patients, and ambulatory providers^1,2; suboptimal communication of postdischarge plans of care to patients and their ability to carry out these plans³; medication discrepancies and nonadherence after discharge⁴; and lack of timely follow-up with ambulatory providers.⁵ Healthcare organizations continue to struggle with the question of which interventions to implement and how best to implement them.

Interventions to improve care transitions typically focus on readmission rates, but some studies have focused on postdischarge adverse events, defined as injuries in the 30 days after discharge caused by medical management rather than underlying disease processes.² These adverse events cause psychological distress, out-of-pocket expenses, decreases in functional status, and caregiver burden. An estimated 20% of hospitalized patients suffer a postdischarge adverse event.^1,2 Approximately two-thirds of these may be preventable or ameliorable.

The advent of Accountable Care Organizations (ACOs), defined as “groups of doctors, hospitals, and other health care providers who come together voluntarily to give coordinated high quality care to their patients,” creates an opportunity for improvements in patient safety during care transitions.⁶ Another opportunity has been the advent of Patient-Centered Medical Homes (PCMH), consisting of patient-oriented, comprehensive, team-based primary care enhanced by health information technology and population-based disease management tools.^7,8 In theory, a hospital-PCMH collaboration within an ACO can improve transitional interventions since optimal communication and collaboration are more likely when both inpatient and primary care providers (PCPs) share infrastructure and are similarly incentivized. The objectives of this study were to design and implement a collaborative hospital-PCMH care transitions intervention within an ACO and evaluate its effects.

This study was a two-arm, single-blind (blinded outcomes assessor), stepped-wedge, multisite cluster-randomized clinical trial (NCT02130570) approved by the institutional review board of Partners HealthCare.

Study Design and Randomization

The study employed a “stepped-wedge” design, which is a cluster-randomized study design in which an intervention is sequentially rolled out to different groups at different, prespecified, randomly determined times.⁹ Each cluster (in this case, each primary care practice) served as its own control, while still allowing for adjustment for temporal trends. Originally, 18 practices participated, but one withdrew due to the low number of patients enrolled in the study, leaving 17 clusters and 16 sequences; see Figure 1 of Appendix 1 for a full description of the sample size and timeline for each cluster. Practices were not aware of this timeline until after recruitment.

Study Setting and Participants

Conducted within a large Pioneer ACO in Boston and funded by the Patient-Centered Outcomes Research Institute (PCORI), the Partners-PCORI Transitions Study was designed as a “real-world” quality improvement project. Potential participants were adult patients who were admitted to medical and surgical services of two large academic hospitals (Hospital A and Hospital B) affiliated with an ACO, who were likely to be discharged back to the community, and whose PCP belonged to a primary care practice that was affiliated with the ACO, agreed to participate, and were designated PCMHs or on their way to being designated by meeting certain criteria: electronic health record, patient portal, team-based care, practice redesign, care management, and identification of high-risk patients. See Study Protocol (Appendix 2) for detailed patient and primary care practice inclusion criteria.

Patient Enrollment

Study staff screened participants from a daily automated list of patients admitted the day before, using medical records to determine eligibility, which was then confirmed by the patient’s nurse. Exclusion criteria included likely discharge to a location other than home, being in police custody, lack of a telephone, being homeless, previous enrollment in the study, and being unable to communicate in English or Spanish. Allocation to study arm was concealed until the patient or proxy provided informed written consent. The research assistant administered questionnaires to all study subjects to assess potential confounders and functional status 1 month prior to admission (Medical Outcomes Study 12-Item Short Form Health Survey [SF-12]).¹⁰ Patients were recruited between March 2013 and October 2015.

Intervention

The intervention was based on a conceptual model of an ideal discharge¹¹ that we developed based on work by Naylor et al,¹² work by Coleman and Berenson,³ best practices in medication reconciliation and information transfer according to our own research,^13-15 the best examples of interventions to improve the discharge process,^12,16,17 and a systematic review of discharge interventions.¹⁸ Some of the factors necessary for an ideal care transition include complete, organized, and timely documentation of the patient’s hospital course and postdischarge plan; effective discharge planning; coordination of care among the patient’s providers; methods to ensure medication safety; advanced care planning in appropriate patients; and education and “coaching” of patients and their caregivers so they learn how to manage their conditions. The final multifaceted intervention addressed each component of the ideal discharge and included inpatient and outpatient components (Table 1 and Table 1 of Appendix 1).

Patient and Public Involvement in Research

As with all PCORI-funded studies, this study involved a patient-family advisory council (PFAC). Our PFAC included six recently hospitalized patients or caregivers of recently hospitalized patients. The PFAC participated in monthly meetings throughout the study period. They helped inform the research questions, including confirmation that the endpoints were patient centered, and provided valuable input for the design of the intervention and the patient-facing components of the data collection instruments. They also interviewed several patient participants in the study regarding their experiences with the intervention. Lastly, they helped develop plans for dissemination of study results to the public.¹⁹

We also formed a steering committee consisting of physician, nursing, pharmacy, information technology, and administrative leadership representing primary care, inpatient care, and transitional care at both hospitals and Partners Healthcare. PFAC members took turns participating in quarterly steering committee meetings.

Evolution of the Intervention and Implementation

The intervention was iteratively refined during the course of the study in response to input from the PFAC, steering committee, and members of the intervention team; cases of adverse events and readmissions from patients despite being in the intervention arm; exit interviews of patients who had recently completed the intervention; and informal feedback from inpatient and outpatient clinicians. For example, we learned that the more complicated a patient’s conditions are, the sooner the clinical team wanted them to be seen after discharge. However, these patients were also less likely to feel well enough to keep that appointment. Therefore, the timing of follow-up of appointments needed to be a negotiation among the inpatient team, the patient, any caregivers, and the outpatient provider. PFAC members also emphasized that patients wanted one person to trust and to be the “point person” during a complicated transition such as hospital discharge.

At the same time, the intervention components evolved because of factors outside our control (eg, resource limitations). In keeping with the real-world nature of the research, the aim was for the intervention to be internally supported because incentives were theoretically more aligned with improvement of care transitions under the ACO model. By design, the PCORI contract only paid for limited parts of the intervention, such as a nurse practitioner to act as the discharge advocate at one hospital, overtime costs of inpatient pharmacists, and project manager time to facilitate inpatient-outpatient provider communication. (See Table 1 of Appendix 1 for details about the modifications to the intervention.)

Lastly, in keeping with PCORI’s methodology standards for studies of complex interventions,²⁰ we strove to standardize the intervention by function across hospitals, units, and practices, while still allowing for local adaptation in the form. In other words, rather than specifying exactly how a task (eg, medication counseling) needed to be performed, the study design offered sites flexibility in how they implemented the task given their available personnel and institutional culture.

Intervention Fidelity

To determine the extent to which each patient in the intervention arm received each intervention component, a project manager unblinded to treatment arm reviewed the electronic medical record for documentation of each component implemented by providers (eg, inpatient pharmacists, outpatient nurses). Because each intervention component produced documentation, this provided an accurate assessment of intervention fidelity, ie, the extent to which the intervention was implemented as intended.

Outcome Assessment

Postdischarge Follow-up

Based on previous studies,^2,21 a trained research assistant attempted to contact all study subjects 30 days (±5 days) after discharge and administered a questionnaire to identify any new or worsening symptoms since discharge, any healthcare use since discharge, and functional status in the previous week. Follow-up questions used branching logic to determine the relationship of any new or worsening symptoms to medications or other aspects of medical management. Research assistants followed up any positive responses with directed medical record review for objective findings, diagnoses, treatments, and responses. If patients could not be reached after five attempts, the research assistant instead conducted a thorough review of the outpatient medical record alone for provider reports of any new or worsening symptoms noted during follow-up within the 30-day postdischarge period. Research assistants also reviewed laboratory test results in all patients for evidence of postdischarge renal failure, elevated liver function tests, or new/worsening anemia.

Hospital Readmissions

We measured nonelective hospital readmissions within 30 days of discharge using a combination of administrative data for hospitalizations within the ACO network plus patient report during the 30-day phone call for all other readmissions.²²

Adjudication of Outcomes

Adverse events and preventable adverse events: All cases of new or worsening symptoms or signs, along with all supporting documentation, were then presented to teams of two trained blinded physician adjudicators through application of methods established in previous studies.^4,21 Each of the two adjudicators independently reviewed the information, along with the medical record, and completed a standardized form to confirm or deny the presence of any adverse events (ie, patient injury due to medical management) and to classify the type of event (eg, adverse drug event, hospital-acquired infection, procedural complication, diagnostic or management error), the severity and duration of the event, and whether the event was preventable or ameliorable. The two adjudicators then met to resolve any differences in their findings and come to consensus.

Preventable readmissions: If patients were readmitted to either study hospital, we conducted an evaluation, based on previous studies,²³ to determine if and how the readmission could have been prevented including (a) a standardized patient and caregiver interview to identify possible problems with the transitions process and (b) an email questionnaire to the patient’s PCP and the inpatient teams who cared for the patient during the index admission and readmission regarding possible deficiencies with the transitions process. As with adverse event adjudications, two physician adjudicators worked independently to classify the preventability of the readmission and then met to come to consensus. Conflicts were resolved by a third adjudicator.

Analysis Plan

To evaluate the effects of the intervention on the primary outcome, the number of postdischarge adverse events per patient, we used multivariable Poisson regression, with study arm as the main predictor. A similar approach was used to evaluate the number of new or worsening postdischarge signs or symptoms and the number of preventable adverse events per patient. We used an intention-to-treat analysis: If a practice did not start the intervention when they were scheduled to, based on our randomization, we counted all patients in that practice admitted after that point as intervention patients. We adjusted for patient demographics, clinical characteristics, month, inpatient unit, and primary care practice as fixed effects. We clustered by PCP using general linear models. Intervention effects were expressed as both unadjusted and adjusted incidence rate ratios (IRRs). We also conducted a limited number of subgroup analyses, determined a priori, to determine whether the intervention was more effective in certain patient populations; we used interaction terms (intervention × subgroup) to determine the statistical significance of any effect modification.

To evaluate the effects of the intervention on nonelective readmissions and preventable readmissions, we used a similar approach, using multivariable logistic regression. Postdischarge functional status, adjusted for status prior to admission, was analyzed using multivariable linear regression and random effects by primary care practice. The general linear mixed model (GLIMMIX) procedure in the SAS 9.3 statistical package (SAS Institute) was used to carry out all analyses.

Power and Sample Size

We assumed a baseline rate of postdischarge adverse events of 0.30 per patient.²¹ We conservatively assumed an effect size of a change from 0.30 in the control group to 0.23 in the intervention group (a relative reduction of 22%, which was based on studies of preventability rates²³ and close to the minimum clinically important difference). Based on prior studies,^4,22 we assumed an intraclass correlation coefficient of 0.01 with an average cluster size of seven patients per PCP. Assuming a 10% loss to follow-up rate and an alpha of 0.05, we targeted a sample size of 1,800 patients to achieve 80% power, with one-third of the patients in the usual care arm and two-thirds in the intervention arm.

We enrolled 18 PCMH primary care practices to participate in the study, including 8 from Hospital A (out of 13 approached), 8 from Hospital B (out of 11), and 2 from other ACO practices (out of 9) (plus two pilot practices). Reasons for not participating included not having dedicated personnel to play the role of the responsible outpatient clinician, undergoing recent turn-over in practice leadership, and not having enough patients admitted to the two hospitals. One practice only enrolled 5 patients in the study and withdrew from participation, which left 17 practices.

Study Patients

We enrolled 1,679 patients (Figure 1). Reasons for nonenrollment included being unable to complete the screen prior to discharge, not meeting inclusion criteria or meeting exclusion criteria, being assigned to a pilot practice, and declining informed written consent. The baseline characteristics of enrolled patients are presented in Table 2. Differences between the two study arms were small. About 47% of the cohort was not reachable by phone after five attempts for the 30-day phone call, but only 69 (4.1%) were truly lost to follow-up because they were unreachable by phone and had no documentation in the electronic medical record in the 30-days after discharge.

Intervention Fidelity

The majority of patients did not receive most intervention components, even those components that were supposed to be delivered to all intervention patients (Table 3). A minority of patients were referred to visiting nurse services and to the home pharmacy program. However, 855 patients (87%) in the intervention arm received at least one intervention component.

Outcome Measures

The intervention was associated with a statistically significant reduction in several of the outcomes of interest, including the primary outcome, number of postdischarge adverse events (45% reduction), and new or worsening postdischarge signs or symptoms (22% reduction), as well as preventable postdischarge adverse events (58% reduction) (Table 4). There was a nonsignificant difference in functional status. There was no significant effect on total nonelective or on preventable readmission rates. When analyzed by type of adverse event, the intervention was associated with a reduction in adverse drug events and in procedural complications (Table 2 of Appendix 1). Of note, there was no significant difference in the proportion of patients with at least one adverse event whether the outcome was determined by phone call and medical record review (49%) or medical record review alone (51%) (P = .48).

In subgroup analyses, there was no evidence of effect modification by service, hospital, patient age, readmission risk, health literacy, or comorbidity score (Table 3 of Appendix 1). Table 4 of Appendix 1 provides examples of postdischarge adverse events seen in the usual care arm that might have been prevented in the intervention.

This intervention was associated with a reduction in postdischarge adverse events. The relative improvement in each outcome aligned with the hypothesized sensitivity to change: the smallest improvement was seen in new or worsening signs or symptoms, followed by postdischarge adverse events and then by preventable postdischarge adverse events. The intervention was not associated with a difference in readmissions. The lack of effect on hospital readmissions may have been caused by the low proportion of readmissions that are preventable, as well as low intervention fidelity and lack of resources to implement facets such as postdischarge coaching, an evidence-based intervention that was never adopted.^16,23 One lesson of this study is that it may be easier to reduce postdischarge injury (still an important outcome) than readmissions.

Putting this study in context, we should note that the literature on interventions to improve care transitions is mixed.¹⁸ While there are several reports of successful interventions, there are many reports of unsuccessful ones, often using similar components. Success is often the result of adequate resources and attention to myriad details regarding implementation.²⁴ The intervention in our study likely contributed to improvements in patient and caregiver engagement in the hospital, enhancements of communication between inpatient and outpatient clinicians, and implementation of pharmacist-led interventions to improve medication safety. Regarding the latter, several prior studies have shown the benefits of pharmacist interventions in decreasing postdischarge adverse drug events.^4,25,26 Therefore, even an intervention with incomplete intervention fidelity can reduce postdischarge adverse events, especially because adverse drug events make up the majority of adverse events.^1,2,21

Perhaps the biggest lesson we learned was regarding the limitations of the hospital-led ACO model to incentivize sufficient up-front investments in transitional care interventions. By design, we chose a real-world approach in which interventions were integrated with existing ACO efforts, which were paid for internally by the institution. As a result, many of the interventions had to be scaled back because of resource constraints. The ACO model theoretically incentivizes more integrated care, but this may not always be true in practice. Emerging evidence suggests that physician group–led ACOs are associated with lower costs and use compared with hospital-led ACOs, likely because of more aligned incentives in physician group–led ACOs to reduce use of inpatient care.^27,28

An unresolved question is whether the ideal implementation approach is to protect the time of existing clinical personnel to carry out transitional care tasks or to hire external personnel to do these tasks. We purposely spread the intervention over several clinician types to minimize the additional burden on any one of them, minimize additional costs, and play to each clinician’s expertise, but in retrospect, this may not have been the right approach. By providing additional personnel with dedicated time, interest, and training in care transitions, the intervention may be delivered with higher quantitative and qualitative fidelity, and it could create a single point of contact for patients, which was considered highly desirable by our PFAC.

This study has several limitations. A large proportion of patients (44%) were unavailable for postdischarge phone calls. However, we were able to perform medical record review for worsening signs (eg, lab abnormalities) and symptoms (as reported by patients’ providers) in the postdischarge period and adjudicate them for adverse events for all but 69 of these patients. Because all these patients had ACO-affiliated PCPs, we would expect most of their utilization to have been within the system and, therefore, to be present in the medical record. The proportion of patients with at least one adverse event did not vary by the method of follow-up, which suggests that this issue is an unlikely source of bias. Assessment of readmission was imperfect because we do not have statewide or national data. However, our combination of administrative data for Partners readmissions plus self-report for non-Partners readmission has been shown to be fairly complete in previous studies.²⁹ Adjudicators could not be fully blinded to intervention status due to the lack of blinding of admission date. We did not calculate a kappa value for interrater reliability of individual assessments of adverse events; rather, coming to consensus among the two adjudicators was part of the process. In only a handful of cases was a third adjudicator required. Lastly, this study was conducted at two academic medical centers and their affiliated primary care clinics, which potentially limits generalizability; however, the results are likely generalizable to other ACOs that include major academic medical centers.

In conclusion, in this real-world clinical trial, we designed, implemented, and iteratively refined a multifaceted intervention to improve care transitions within a hospital-based academic ACO. Evolution of the intervention components was the result of stakeholder input, experience with the intervention, and ACO resource constraints. The intervention reduced postdischarge adverse events. However, across the ACO network, intervention fidelity was low, and this may have contributed to the lack of effect on readmission rates. ACOs that implement interventions without hiring new personnel or protecting the time of existing personnel to conduct transitional tasks are likely to face the same challenges of low fidelity.

The authors would like to acknowledge the many people who worked on designing, implementing, and evaluating this intervention, including but not limited to: Natasha Isaac, Hilary Heyison, Jacqueline Minahan, Molly O’Reilly, Michelle Potter, Nailah Khoory, Maureen Fagan, David Bates, Laura Carr, Joseph Frolkis, Eric Weil, Jacqueline Somerville, Stephanie Ahmed, Marcy Bergeron, Jessica Smith, and Jane Millett. We would also like to thank the members of our Patient-Family Advisory Council: Maureen Fagan, Karen Spikes, Margie Hodges, Win Hodges, Aureldon Henderson, Dena Salzberg, and Kay Bander.

Transitions from the hospital to the ambulatory setting are high-risk periods for patients in terms of adverse events, poor clinical outcomes, and readmission. Processes of care during care transitions are suboptimal, including poor communication among inpatient providers, patients, and ambulatory providers^1,2; suboptimal communication of postdischarge plans of care to patients and their ability to carry out these plans³; medication discrepancies and nonadherence after discharge⁴; and lack of timely follow-up with ambulatory providers.⁵ Healthcare organizations continue to struggle with the question of which interventions to implement and how best to implement them.

Interventions to improve care transitions typically focus on readmission rates, but some studies have focused on postdischarge adverse events, defined as injuries in the 30 days after discharge caused by medical management rather than underlying disease processes.² These adverse events cause psychological distress, out-of-pocket expenses, decreases in functional status, and caregiver burden. An estimated 20% of hospitalized patients suffer a postdischarge adverse event.^1,2 Approximately two-thirds of these may be preventable or ameliorable.

The advent of Accountable Care Organizations (ACOs), defined as “groups of doctors, hospitals, and other health care providers who come together voluntarily to give coordinated high quality care to their patients,” creates an opportunity for improvements in patient safety during care transitions.⁶ Another opportunity has been the advent of Patient-Centered Medical Homes (PCMH), consisting of patient-oriented, comprehensive, team-based primary care enhanced by health information technology and population-based disease management tools.^7,8 In theory, a hospital-PCMH collaboration within an ACO can improve transitional interventions since optimal communication and collaboration are more likely when both inpatient and primary care providers (PCPs) share infrastructure and are similarly incentivized. The objectives of this study were to design and implement a collaborative hospital-PCMH care transitions intervention within an ACO and evaluate its effects.

This study was a two-arm, single-blind (blinded outcomes assessor), stepped-wedge, multisite cluster-randomized clinical trial (NCT02130570) approved by the institutional review board of Partners HealthCare.

Study Design and Randomization

The study employed a “stepped-wedge” design, which is a cluster-randomized study design in which an intervention is sequentially rolled out to different groups at different, prespecified, randomly determined times.⁹ Each cluster (in this case, each primary care practice) served as its own control, while still allowing for adjustment for temporal trends. Originally, 18 practices participated, but one withdrew due to the low number of patients enrolled in the study, leaving 17 clusters and 16 sequences; see Figure 1 of Appendix 1 for a full description of the sample size and timeline for each cluster. Practices were not aware of this timeline until after recruitment.

Study Setting and Participants

Conducted within a large Pioneer ACO in Boston and funded by the Patient-Centered Outcomes Research Institute (PCORI), the Partners-PCORI Transitions Study was designed as a “real-world” quality improvement project. Potential participants were adult patients who were admitted to medical and surgical services of two large academic hospitals (Hospital A and Hospital B) affiliated with an ACO, who were likely to be discharged back to the community, and whose PCP belonged to a primary care practice that was affiliated with the ACO, agreed to participate, and were designated PCMHs or on their way to being designated by meeting certain criteria: electronic health record, patient portal, team-based care, practice redesign, care management, and identification of high-risk patients. See Study Protocol (Appendix 2) for detailed patient and primary care practice inclusion criteria.

Patient Enrollment

Study staff screened participants from a daily automated list of patients admitted the day before, using medical records to determine eligibility, which was then confirmed by the patient’s nurse. Exclusion criteria included likely discharge to a location other than home, being in police custody, lack of a telephone, being homeless, previous enrollment in the study, and being unable to communicate in English or Spanish. Allocation to study arm was concealed until the patient or proxy provided informed written consent. The research assistant administered questionnaires to all study subjects to assess potential confounders and functional status 1 month prior to admission (Medical Outcomes Study 12-Item Short Form Health Survey [SF-12]).¹⁰ Patients were recruited between March 2013 and October 2015.

Intervention

The intervention was based on a conceptual model of an ideal discharge¹¹ that we developed based on work by Naylor et al,¹² work by Coleman and Berenson,³ best practices in medication reconciliation and information transfer according to our own research,^13-15 the best examples of interventions to improve the discharge process,^12,16,17 and a systematic review of discharge interventions.¹⁸ Some of the factors necessary for an ideal care transition include complete, organized, and timely documentation of the patient’s hospital course and postdischarge plan; effective discharge planning; coordination of care among the patient’s providers; methods to ensure medication safety; advanced care planning in appropriate patients; and education and “coaching” of patients and their caregivers so they learn how to manage their conditions. The final multifaceted intervention addressed each component of the ideal discharge and included inpatient and outpatient components (Table 1 and Table 1 of Appendix 1).

Patient and Public Involvement in Research

As with all PCORI-funded studies, this study involved a patient-family advisory council (PFAC). Our PFAC included six recently hospitalized patients or caregivers of recently hospitalized patients. The PFAC participated in monthly meetings throughout the study period. They helped inform the research questions, including confirmation that the endpoints were patient centered, and provided valuable input for the design of the intervention and the patient-facing components of the data collection instruments. They also interviewed several patient participants in the study regarding their experiences with the intervention. Lastly, they helped develop plans for dissemination of study results to the public.¹⁹

We also formed a steering committee consisting of physician, nursing, pharmacy, information technology, and administrative leadership representing primary care, inpatient care, and transitional care at both hospitals and Partners Healthcare. PFAC members took turns participating in quarterly steering committee meetings.

Evolution of the Intervention and Implementation

The intervention was iteratively refined during the course of the study in response to input from the PFAC, steering committee, and members of the intervention team; cases of adverse events and readmissions from patients despite being in the intervention arm; exit interviews of patients who had recently completed the intervention; and informal feedback from inpatient and outpatient clinicians. For example, we learned that the more complicated a patient’s conditions are, the sooner the clinical team wanted them to be seen after discharge. However, these patients were also less likely to feel well enough to keep that appointment. Therefore, the timing of follow-up of appointments needed to be a negotiation among the inpatient team, the patient, any caregivers, and the outpatient provider. PFAC members also emphasized that patients wanted one person to trust and to be the “point person” during a complicated transition such as hospital discharge.

At the same time, the intervention components evolved because of factors outside our control (eg, resource limitations). In keeping with the real-world nature of the research, the aim was for the intervention to be internally supported because incentives were theoretically more aligned with improvement of care transitions under the ACO model. By design, the PCORI contract only paid for limited parts of the intervention, such as a nurse practitioner to act as the discharge advocate at one hospital, overtime costs of inpatient pharmacists, and project manager time to facilitate inpatient-outpatient provider communication. (See Table 1 of Appendix 1 for details about the modifications to the intervention.)

Lastly, in keeping with PCORI’s methodology standards for studies of complex interventions,²⁰ we strove to standardize the intervention by function across hospitals, units, and practices, while still allowing for local adaptation in the form. In other words, rather than specifying exactly how a task (eg, medication counseling) needed to be performed, the study design offered sites flexibility in how they implemented the task given their available personnel and institutional culture.

Intervention Fidelity

To determine the extent to which each patient in the intervention arm received each intervention component, a project manager unblinded to treatment arm reviewed the electronic medical record for documentation of each component implemented by providers (eg, inpatient pharmacists, outpatient nurses). Because each intervention component produced documentation, this provided an accurate assessment of intervention fidelity, ie, the extent to which the intervention was implemented as intended.

Outcome Assessment

Postdischarge Follow-up

Based on previous studies,^2,21 a trained research assistant attempted to contact all study subjects 30 days (±5 days) after discharge and administered a questionnaire to identify any new or worsening symptoms since discharge, any healthcare use since discharge, and functional status in the previous week. Follow-up questions used branching logic to determine the relationship of any new or worsening symptoms to medications or other aspects of medical management. Research assistants followed up any positive responses with directed medical record review for objective findings, diagnoses, treatments, and responses. If patients could not be reached after five attempts, the research assistant instead conducted a thorough review of the outpatient medical record alone for provider reports of any new or worsening symptoms noted during follow-up within the 30-day postdischarge period. Research assistants also reviewed laboratory test results in all patients for evidence of postdischarge renal failure, elevated liver function tests, or new/worsening anemia.

Hospital Readmissions

We measured nonelective hospital readmissions within 30 days of discharge using a combination of administrative data for hospitalizations within the ACO network plus patient report during the 30-day phone call for all other readmissions.²²

Adjudication of Outcomes

Adverse events and preventable adverse events: All cases of new or worsening symptoms or signs, along with all supporting documentation, were then presented to teams of two trained blinded physician adjudicators through application of methods established in previous studies.^4,21 Each of the two adjudicators independently reviewed the information, along with the medical record, and completed a standardized form to confirm or deny the presence of any adverse events (ie, patient injury due to medical management) and to classify the type of event (eg, adverse drug event, hospital-acquired infection, procedural complication, diagnostic or management error), the severity and duration of the event, and whether the event was preventable or ameliorable. The two adjudicators then met to resolve any differences in their findings and come to consensus.

Preventable readmissions: If patients were readmitted to either study hospital, we conducted an evaluation, based on previous studies,²³ to determine if and how the readmission could have been prevented including (a) a standardized patient and caregiver interview to identify possible problems with the transitions process and (b) an email questionnaire to the patient’s PCP and the inpatient teams who cared for the patient during the index admission and readmission regarding possible deficiencies with the transitions process. As with adverse event adjudications, two physician adjudicators worked independently to classify the preventability of the readmission and then met to come to consensus. Conflicts were resolved by a third adjudicator.

Analysis Plan

To evaluate the effects of the intervention on the primary outcome, the number of postdischarge adverse events per patient, we used multivariable Poisson regression, with study arm as the main predictor. A similar approach was used to evaluate the number of new or worsening postdischarge signs or symptoms and the number of preventable adverse events per patient. We used an intention-to-treat analysis: If a practice did not start the intervention when they were scheduled to, based on our randomization, we counted all patients in that practice admitted after that point as intervention patients. We adjusted for patient demographics, clinical characteristics, month, inpatient unit, and primary care practice as fixed effects. We clustered by PCP using general linear models. Intervention effects were expressed as both unadjusted and adjusted incidence rate ratios (IRRs). We also conducted a limited number of subgroup analyses, determined a priori, to determine whether the intervention was more effective in certain patient populations; we used interaction terms (intervention × subgroup) to determine the statistical significance of any effect modification.

To evaluate the effects of the intervention on nonelective readmissions and preventable readmissions, we used a similar approach, using multivariable logistic regression. Postdischarge functional status, adjusted for status prior to admission, was analyzed using multivariable linear regression and random effects by primary care practice. The general linear mixed model (GLIMMIX) procedure in the SAS 9.3 statistical package (SAS Institute) was used to carry out all analyses.

Power and Sample Size

We assumed a baseline rate of postdischarge adverse events of 0.30 per patient.²¹ We conservatively assumed an effect size of a change from 0.30 in the control group to 0.23 in the intervention group (a relative reduction of 22%, which was based on studies of preventability rates²³ and close to the minimum clinically important difference). Based on prior studies,^4,22 we assumed an intraclass correlation coefficient of 0.01 with an average cluster size of seven patients per PCP. Assuming a 10% loss to follow-up rate and an alpha of 0.05, we targeted a sample size of 1,800 patients to achieve 80% power, with one-third of the patients in the usual care arm and two-thirds in the intervention arm.

We enrolled 18 PCMH primary care practices to participate in the study, including 8 from Hospital A (out of 13 approached), 8 from Hospital B (out of 11), and 2 from other ACO practices (out of 9) (plus two pilot practices). Reasons for not participating included not having dedicated personnel to play the role of the responsible outpatient clinician, undergoing recent turn-over in practice leadership, and not having enough patients admitted to the two hospitals. One practice only enrolled 5 patients in the study and withdrew from participation, which left 17 practices.

Study Patients

We enrolled 1,679 patients (Figure 1). Reasons for nonenrollment included being unable to complete the screen prior to discharge, not meeting inclusion criteria or meeting exclusion criteria, being assigned to a pilot practice, and declining informed written consent. The baseline characteristics of enrolled patients are presented in Table 2. Differences between the two study arms were small. About 47% of the cohort was not reachable by phone after five attempts for the 30-day phone call, but only 69 (4.1%) were truly lost to follow-up because they were unreachable by phone and had no documentation in the electronic medical record in the 30-days after discharge.

Intervention Fidelity

The majority of patients did not receive most intervention components, even those components that were supposed to be delivered to all intervention patients (Table 3). A minority of patients were referred to visiting nurse services and to the home pharmacy program. However, 855 patients (87%) in the intervention arm received at least one intervention component.

Outcome Measures

The intervention was associated with a statistically significant reduction in several of the outcomes of interest, including the primary outcome, number of postdischarge adverse events (45% reduction), and new or worsening postdischarge signs or symptoms (22% reduction), as well as preventable postdischarge adverse events (58% reduction) (Table 4). There was a nonsignificant difference in functional status. There was no significant effect on total nonelective or on preventable readmission rates. When analyzed by type of adverse event, the intervention was associated with a reduction in adverse drug events and in procedural complications (Table 2 of Appendix 1). Of note, there was no significant difference in the proportion of patients with at least one adverse event whether the outcome was determined by phone call and medical record review (49%) or medical record review alone (51%) (P = .48).

In subgroup analyses, there was no evidence of effect modification by service, hospital, patient age, readmission risk, health literacy, or comorbidity score (Table 3 of Appendix 1). Table 4 of Appendix 1 provides examples of postdischarge adverse events seen in the usual care arm that might have been prevented in the intervention.

This intervention was associated with a reduction in postdischarge adverse events. The relative improvement in each outcome aligned with the hypothesized sensitivity to change: the smallest improvement was seen in new or worsening signs or symptoms, followed by postdischarge adverse events and then by preventable postdischarge adverse events. The intervention was not associated with a difference in readmissions. The lack of effect on hospital readmissions may have been caused by the low proportion of readmissions that are preventable, as well as low intervention fidelity and lack of resources to implement facets such as postdischarge coaching, an evidence-based intervention that was never adopted.^16,23 One lesson of this study is that it may be easier to reduce postdischarge injury (still an important outcome) than readmissions.

Putting this study in context, we should note that the literature on interventions to improve care transitions is mixed.¹⁸ While there are several reports of successful interventions, there are many reports of unsuccessful ones, often using similar components. Success is often the result of adequate resources and attention to myriad details regarding implementation.²⁴ The intervention in our study likely contributed to improvements in patient and caregiver engagement in the hospital, enhancements of communication between inpatient and outpatient clinicians, and implementation of pharmacist-led interventions to improve medication safety. Regarding the latter, several prior studies have shown the benefits of pharmacist interventions in decreasing postdischarge adverse drug events.^4,25,26 Therefore, even an intervention with incomplete intervention fidelity can reduce postdischarge adverse events, especially because adverse drug events make up the majority of adverse events.^1,2,21

Perhaps the biggest lesson we learned was regarding the limitations of the hospital-led ACO model to incentivize sufficient up-front investments in transitional care interventions. By design, we chose a real-world approach in which interventions were integrated with existing ACO efforts, which were paid for internally by the institution. As a result, many of the interventions had to be scaled back because of resource constraints. The ACO model theoretically incentivizes more integrated care, but this may not always be true in practice. Emerging evidence suggests that physician group–led ACOs are associated with lower costs and use compared with hospital-led ACOs, likely because of more aligned incentives in physician group–led ACOs to reduce use of inpatient care.^27,28

An unresolved question is whether the ideal implementation approach is to protect the time of existing clinical personnel to carry out transitional care tasks or to hire external personnel to do these tasks. We purposely spread the intervention over several clinician types to minimize the additional burden on any one of them, minimize additional costs, and play to each clinician’s expertise, but in retrospect, this may not have been the right approach. By providing additional personnel with dedicated time, interest, and training in care transitions, the intervention may be delivered with higher quantitative and qualitative fidelity, and it could create a single point of contact for patients, which was considered highly desirable by our PFAC.

This study has several limitations. A large proportion of patients (44%) were unavailable for postdischarge phone calls. However, we were able to perform medical record review for worsening signs (eg, lab abnormalities) and symptoms (as reported by patients’ providers) in the postdischarge period and adjudicate them for adverse events for all but 69 of these patients. Because all these patients had ACO-affiliated PCPs, we would expect most of their utilization to have been within the system and, therefore, to be present in the medical record. The proportion of patients with at least one adverse event did not vary by the method of follow-up, which suggests that this issue is an unlikely source of bias. Assessment of readmission was imperfect because we do not have statewide or national data. However, our combination of administrative data for Partners readmissions plus self-report for non-Partners readmission has been shown to be fairly complete in previous studies.²⁹ Adjudicators could not be fully blinded to intervention status due to the lack of blinding of admission date. We did not calculate a kappa value for interrater reliability of individual assessments of adverse events; rather, coming to consensus among the two adjudicators was part of the process. In only a handful of cases was a third adjudicator required. Lastly, this study was conducted at two academic medical centers and their affiliated primary care clinics, which potentially limits generalizability; however, the results are likely generalizable to other ACOs that include major academic medical centers.

In conclusion, in this real-world clinical trial, we designed, implemented, and iteratively refined a multifaceted intervention to improve care transitions within a hospital-based academic ACO. Evolution of the intervention components was the result of stakeholder input, experience with the intervention, and ACO resource constraints. The intervention reduced postdischarge adverse events. However, across the ACO network, intervention fidelity was low, and this may have contributed to the lack of effect on readmission rates. ACOs that implement interventions without hiring new personnel or protecting the time of existing personnel to conduct transitional tasks are likely to face the same challenges of low fidelity.

The authors would like to acknowledge the many people who worked on designing, implementing, and evaluating this intervention, including but not limited to: Natasha Isaac, Hilary Heyison, Jacqueline Minahan, Molly O’Reilly, Michelle Potter, Nailah Khoory, Maureen Fagan, David Bates, Laura Carr, Joseph Frolkis, Eric Weil, Jacqueline Somerville, Stephanie Ahmed, Marcy Bergeron, Jessica Smith, and Jane Millett. We would also like to thank the members of our Patient-Family Advisory Council: Maureen Fagan, Karen Spikes, Margie Hodges, Win Hodges, Aureldon Henderson, Dena Salzberg, and Kay Bander.

Parts of three linked studies investigating increased levels of anticoagulation in hospitalized COVID-19 patients have been “paused” because of futility and safety concerns, a statement from the U.S. National Heart, Lung, and Blood Institute (NHLBI) confirms.

The trials involved are the REMAP-CAP, ACTIV-4, and ATTACC studies.

All three trials have paused enrollment of critically ill COVID-19 patients requiring intensive care unit support for whom therapeutic doses of anticoagulation drugs did not reduce the need for organ support, the NHLBI statement notes.

The statement also says that a potential for harm in this subgroup could not be excluded, noting that increased bleeding is a known complication of full-dose anticoagulation. The trials are working urgently to undertake additional analyses, which will be made available as soon as possible.   

The three clinical trial platforms are working together to test the effects of full therapeutic doses of anticoagulants vs. lower prophylactic doses in COVID-19 patients.

Informed by the deliberations of the data safety monitoring boards of these trials, all of the trial sites have paused enrollment of the most critically ill hospitalized patients with COVID-19. 

Enrollment continues in the trials for moderately ill hospitalized COVID-19 patients, the statement notes.  

“Whether the use of full-dose compared to low-dose anticoagulants leads to better outcomes in hospitalized patients with less COVID-19 severe disease remains a very important question,” the NHLBI statement says.

Patients who require full dose anticoagulants for another medical indication are not included in these trials.

The statement explains that COVID-19 is associated with significant inflammation and clinical and pathologic evidence of widespread blood clots. These trials were launched because clinicians have observed that many patients ill with COVID-19, including those who have died from the disease, formed blood clots throughout their bodies, even in their smallest blood vessels. This unusual clotting can cause multiple health complications, including lung failure, myocardial infarction, and stroke. 

The three trials are the result of a collaboration between major international partners. The trials include: the Randomized, Embedded, Multi-factorial Adaptive Platform Trial for Community-Acquired Pneumonia (REMAP-CAP) Therapeutic Anticoagulation; Accelerating COVID-19 Therapeutic Interventions and Vaccines-4 (ACTIV-4) Antithrombotics Inpatient; and Antithrombotic Therapy to Ameliorate Complications of COVID-19 (ATTACC).

The trials, which span four continents, have the common goal of assessing the benefit of full doses of anticoagulants to treat moderately ill or critically ill adults hospitalized for COVID-19, compared with a lower dose often used to prevent blood clots in hospitalized patients.

In the United States, the ACTIV-4 trial is being led by a collaborative effort involving a number of universities, including the University of Pittsburgh and New York University.  

The trials are supported by multiple international funding organizations including the National Institutes of Health, Canadian Institutes of Health Research, the National Institute for Health Research (UK), the National Health and Medical Research Council (Australia), and the PREPARE and RECOVER consortia (European Union).

A version of this story first appeared on Medscape.com.

Parts of three linked studies investigating increased levels of anticoagulation in hospitalized COVID-19 patients have been “paused” because of futility and safety concerns, a statement from the U.S. National Heart, Lung, and Blood Institute (NHLBI) confirms.

The trials involved are the REMAP-CAP, ACTIV-4, and ATTACC studies.

All three trials have paused enrollment of critically ill COVID-19 patients requiring intensive care unit support for whom therapeutic doses of anticoagulation drugs did not reduce the need for organ support, the NHLBI statement notes.

The statement also says that a potential for harm in this subgroup could not be excluded, noting that increased bleeding is a known complication of full-dose anticoagulation. The trials are working urgently to undertake additional analyses, which will be made available as soon as possible.   

The three clinical trial platforms are working together to test the effects of full therapeutic doses of anticoagulants vs. lower prophylactic doses in COVID-19 patients.

Informed by the deliberations of the data safety monitoring boards of these trials, all of the trial sites have paused enrollment of the most critically ill hospitalized patients with COVID-19. 

Enrollment continues in the trials for moderately ill hospitalized COVID-19 patients, the statement notes.  

“Whether the use of full-dose compared to low-dose anticoagulants leads to better outcomes in hospitalized patients with less COVID-19 severe disease remains a very important question,” the NHLBI statement says.

Patients who require full dose anticoagulants for another medical indication are not included in these trials.

The statement explains that COVID-19 is associated with significant inflammation and clinical and pathologic evidence of widespread blood clots. These trials were launched because clinicians have observed that many patients ill with COVID-19, including those who have died from the disease, formed blood clots throughout their bodies, even in their smallest blood vessels. This unusual clotting can cause multiple health complications, including lung failure, myocardial infarction, and stroke. 

The three trials are the result of a collaboration between major international partners. The trials include: the Randomized, Embedded, Multi-factorial Adaptive Platform Trial for Community-Acquired Pneumonia (REMAP-CAP) Therapeutic Anticoagulation; Accelerating COVID-19 Therapeutic Interventions and Vaccines-4 (ACTIV-4) Antithrombotics Inpatient; and Antithrombotic Therapy to Ameliorate Complications of COVID-19 (ATTACC).

The trials, which span four continents, have the common goal of assessing the benefit of full doses of anticoagulants to treat moderately ill or critically ill adults hospitalized for COVID-19, compared with a lower dose often used to prevent blood clots in hospitalized patients.

In the United States, the ACTIV-4 trial is being led by a collaborative effort involving a number of universities, including the University of Pittsburgh and New York University.  

The trials are supported by multiple international funding organizations including the National Institutes of Health, Canadian Institutes of Health Research, the National Institute for Health Research (UK), the National Health and Medical Research Council (Australia), and the PREPARE and RECOVER consortia (European Union).

A version of this story first appeared on Medscape.com.

Parts of three linked studies investigating increased levels of anticoagulation in hospitalized COVID-19 patients have been “paused” because of futility and safety concerns, a statement from the U.S. National Heart, Lung, and Blood Institute (NHLBI) confirms.

The trials involved are the REMAP-CAP, ACTIV-4, and ATTACC studies.

All three trials have paused enrollment of critically ill COVID-19 patients requiring intensive care unit support for whom therapeutic doses of anticoagulation drugs did not reduce the need for organ support, the NHLBI statement notes.

The statement also says that a potential for harm in this subgroup could not be excluded, noting that increased bleeding is a known complication of full-dose anticoagulation. The trials are working urgently to undertake additional analyses, which will be made available as soon as possible.   

The three clinical trial platforms are working together to test the effects of full therapeutic doses of anticoagulants vs. lower prophylactic doses in COVID-19 patients.

Informed by the deliberations of the data safety monitoring boards of these trials, all of the trial sites have paused enrollment of the most critically ill hospitalized patients with COVID-19. 

Enrollment continues in the trials for moderately ill hospitalized COVID-19 patients, the statement notes.  

“Whether the use of full-dose compared to low-dose anticoagulants leads to better outcomes in hospitalized patients with less COVID-19 severe disease remains a very important question,” the NHLBI statement says.

Patients who require full dose anticoagulants for another medical indication are not included in these trials.

The statement explains that COVID-19 is associated with significant inflammation and clinical and pathologic evidence of widespread blood clots. These trials were launched because clinicians have observed that many patients ill with COVID-19, including those who have died from the disease, formed blood clots throughout their bodies, even in their smallest blood vessels. This unusual clotting can cause multiple health complications, including lung failure, myocardial infarction, and stroke. 

The three trials are the result of a collaboration between major international partners. The trials include: the Randomized, Embedded, Multi-factorial Adaptive Platform Trial for Community-Acquired Pneumonia (REMAP-CAP) Therapeutic Anticoagulation; Accelerating COVID-19 Therapeutic Interventions and Vaccines-4 (ACTIV-4) Antithrombotics Inpatient; and Antithrombotic Therapy to Ameliorate Complications of COVID-19 (ATTACC).

The trials, which span four continents, have the common goal of assessing the benefit of full doses of anticoagulants to treat moderately ill or critically ill adults hospitalized for COVID-19, compared with a lower dose often used to prevent blood clots in hospitalized patients.

In the United States, the ACTIV-4 trial is being led by a collaborative effort involving a number of universities, including the University of Pittsburgh and New York University.  

The trials are supported by multiple international funding organizations including the National Institutes of Health, Canadian Institutes of Health Research, the National Institute for Health Research (UK), the National Health and Medical Research Council (Australia), and the PREPARE and RECOVER consortia (European Union).

A version of this story first appeared on Medscape.com.

Among women with type 2 endometrial cancer, diagnostic hysteroscopy may not be associated with increased odds of positive peritoneal cytology at the time of surgical staging or with decreased survival, according to a retrospective study of 127 patients.

Compared with another diagnostic method, dilation and curettage, hysteroscopy “might present equal safety” in this patient population, a researcher said at the meeting sponsored by AAGL, held virtually this year.
 

Possible associations between cytology and procedures

Prior research has found that positive peritoneal cytology may correlate with greater likelihood of death among patients with endometrial cancer, and researchers have wondered whether pressure on the uterine cavity during hysteroscopy increases the presence of positive peritoneal cytology. “According to some systematic reviews ... it seems that it does,” said study author Luiz Brito, MD, PhD, associate professor of obstetrics and gynecology at the University of Campinas in Brazil.

Nevertheless, research suggests that “most of the time hysteroscopy does not have a powerful impact on the prognosis of these patients,” he said.

Studies have tended to focus on patients with type 1 endometrial cancer, however. Type 2 endometrial cancer, which is more aggressive, “is scarcely studied,” Dr. Brito said. One retrospective study that focused on type 2 endometrial cancer included 140 patients. Among patients who underwent hysteroscopy, 30% had positive cytology. In comparison, 12% of patients in the curettage group had positive cytology. But the difference in disease-specific survival between groups was not statistically significant, and about 33% of the patients in each group developed a recurrence.

To examine associations between diagnostic methods and outcomes in another group of patients with type 2 endometrial cancer, Dr. Brito and colleagues analyzed data from a hospital registry in Brazil.

The database included 1,183 patients with endometrial cancer between 2002 and 2017, including 235 patients with type 2 endometrial cancer. After excluding patients with synchronous tumor and those who did not undergo surgery or did not have peritoneal cytology performed, 127 patients remained for the analysis. The study included follow-up to December 2019.

The researchers compared the prevalence of positive peritoneal cytology among 43 patients who underwent hysteroscopy with that among 84 patients who underwent curettage. The groups had similar baseline characteristics.

Positive peritoneal cytology was more common in the curettage group than in the hysteroscopy group (10.7% vs. 4.6%), although the difference was not statistically significant. Lymphovascular invasion and advanced surgical staging were more common in the curettage group.

In a multivariate analysis, older age and advanced cancer staging were the only factors associated with decreased disease-free survival. Age, advanced cancer staging, and vascular invasion were associated with decreased disease-specific survival.

The researchers also had considered factors such as peritoneal cytology, diagnostic method, age of menarche, menopause time, parity, comorbidities, smoking status, body mass index, abnormal uterine bleeding, histological type, and adjuvant treatment.

A limitation of the study is that it relied on data from a public health system that often has long wait times for diagnosis and treatment, Dr. Brito noted.
 

Some doctors may forgo cytology

The available research raises questions about the role and relevance of peritoneal cytology in caring for patients with endometrial cancer, René Pareja, MD, a gynecologic oncologist at Instituto Nacional de Cancerología, Bogotá, Colombia, said in a discussion following the presentation.

Peritoneal cytology has not been part of endometrial cancer staging since 2009, Dr. Pareja said. Still, guidelines recommend that surgeons collect cytology during surgical staging, with the idea that the results could inform adjuvant treatment decisions.

“Peritoneal cytology is recommended in the guidelines, but there are no recommendations on how to proceed if it is positive,” Dr. Pareja said. “While some gynecologic oncologists continue to take cytology during endometrial cancer staging, some have stopped doing so. And in Colombia, most of us are not performing pelvic cytology.”

Although some studies indicate that hysteroscopy may increase the rate of positive cytology, positive cytology may not be associated with worse oncological outcomes independent of other risk factors for recurrence, said Dr. Pareja.

So far, studies have been retrospective. Furthermore, the sensitivity and specificity of pelvic cytology tests are not 100%. “Should we continue performing pelvic cytology given the results of this and other studies?” Dr. Pareja asked.

Despite limited knowledge about this variable, physicians may want to be aware if a patient has positive cytology, Dr. Brito suggested. “At least it will give us some red flags so we can be attentive to these patients.”

If researchers were to design a prospective study that incorporates hysteroscopic variables, it could provide more complete answers about the relationship between hysteroscopy and peritoneal cytology and clarify the importance of positive cytology, Dr. Brito said.

Dr. Brito had no relevant disclosures. Dr. Pareja disclosed consulting for Johnson & Johnson.

[email protected]

SOURCE: Oliveira Brito LG et al. J Minim Invasive Gynecol. 2020 Nov. doi: 10.1016/j.jmig.2020.08.356.

Among women with type 2 endometrial cancer, diagnostic hysteroscopy may not be associated with increased odds of positive peritoneal cytology at the time of surgical staging or with decreased survival, according to a retrospective study of 127 patients.

Compared with another diagnostic method, dilation and curettage, hysteroscopy “might present equal safety” in this patient population, a researcher said at the meeting sponsored by AAGL, held virtually this year.
 

Possible associations between cytology and procedures

Prior research has found that positive peritoneal cytology may correlate with greater likelihood of death among patients with endometrial cancer, and researchers have wondered whether pressure on the uterine cavity during hysteroscopy increases the presence of positive peritoneal cytology. “According to some systematic reviews ... it seems that it does,” said study author Luiz Brito, MD, PhD, associate professor of obstetrics and gynecology at the University of Campinas in Brazil.

Nevertheless, research suggests that “most of the time hysteroscopy does not have a powerful impact on the prognosis of these patients,” he said.

Studies have tended to focus on patients with type 1 endometrial cancer, however. Type 2 endometrial cancer, which is more aggressive, “is scarcely studied,” Dr. Brito said. One retrospective study that focused on type 2 endometrial cancer included 140 patients. Among patients who underwent hysteroscopy, 30% had positive cytology. In comparison, 12% of patients in the curettage group had positive cytology. But the difference in disease-specific survival between groups was not statistically significant, and about 33% of the patients in each group developed a recurrence.

To examine associations between diagnostic methods and outcomes in another group of patients with type 2 endometrial cancer, Dr. Brito and colleagues analyzed data from a hospital registry in Brazil.

The database included 1,183 patients with endometrial cancer between 2002 and 2017, including 235 patients with type 2 endometrial cancer. After excluding patients with synchronous tumor and those who did not undergo surgery or did not have peritoneal cytology performed, 127 patients remained for the analysis. The study included follow-up to December 2019.

The researchers compared the prevalence of positive peritoneal cytology among 43 patients who underwent hysteroscopy with that among 84 patients who underwent curettage. The groups had similar baseline characteristics.

Positive peritoneal cytology was more common in the curettage group than in the hysteroscopy group (10.7% vs. 4.6%), although the difference was not statistically significant. Lymphovascular invasion and advanced surgical staging were more common in the curettage group.

In a multivariate analysis, older age and advanced cancer staging were the only factors associated with decreased disease-free survival. Age, advanced cancer staging, and vascular invasion were associated with decreased disease-specific survival.

The researchers also had considered factors such as peritoneal cytology, diagnostic method, age of menarche, menopause time, parity, comorbidities, smoking status, body mass index, abnormal uterine bleeding, histological type, and adjuvant treatment.

A limitation of the study is that it relied on data from a public health system that often has long wait times for diagnosis and treatment, Dr. Brito noted.
 

Some doctors may forgo cytology

The available research raises questions about the role and relevance of peritoneal cytology in caring for patients with endometrial cancer, René Pareja, MD, a gynecologic oncologist at Instituto Nacional de Cancerología, Bogotá, Colombia, said in a discussion following the presentation.

Peritoneal cytology has not been part of endometrial cancer staging since 2009, Dr. Pareja said. Still, guidelines recommend that surgeons collect cytology during surgical staging, with the idea that the results could inform adjuvant treatment decisions.

“Peritoneal cytology is recommended in the guidelines, but there are no recommendations on how to proceed if it is positive,” Dr. Pareja said. “While some gynecologic oncologists continue to take cytology during endometrial cancer staging, some have stopped doing so. And in Colombia, most of us are not performing pelvic cytology.”

Although some studies indicate that hysteroscopy may increase the rate of positive cytology, positive cytology may not be associated with worse oncological outcomes independent of other risk factors for recurrence, said Dr. Pareja.

So far, studies have been retrospective. Furthermore, the sensitivity and specificity of pelvic cytology tests are not 100%. “Should we continue performing pelvic cytology given the results of this and other studies?” Dr. Pareja asked.

Despite limited knowledge about this variable, physicians may want to be aware if a patient has positive cytology, Dr. Brito suggested. “At least it will give us some red flags so we can be attentive to these patients.”

If researchers were to design a prospective study that incorporates hysteroscopic variables, it could provide more complete answers about the relationship between hysteroscopy and peritoneal cytology and clarify the importance of positive cytology, Dr. Brito said.

Dr. Brito had no relevant disclosures. Dr. Pareja disclosed consulting for Johnson & Johnson.

[email protected]

SOURCE: Oliveira Brito LG et al. J Minim Invasive Gynecol. 2020 Nov. doi: 10.1016/j.jmig.2020.08.356.

Among women with type 2 endometrial cancer, diagnostic hysteroscopy may not be associated with increased odds of positive peritoneal cytology at the time of surgical staging or with decreased survival, according to a retrospective study of 127 patients.

Compared with another diagnostic method, dilation and curettage, hysteroscopy “might present equal safety” in this patient population, a researcher said at the meeting sponsored by AAGL, held virtually this year.
 

Possible associations between cytology and procedures

Prior research has found that positive peritoneal cytology may correlate with greater likelihood of death among patients with endometrial cancer, and researchers have wondered whether pressure on the uterine cavity during hysteroscopy increases the presence of positive peritoneal cytology. “According to some systematic reviews ... it seems that it does,” said study author Luiz Brito, MD, PhD, associate professor of obstetrics and gynecology at the University of Campinas in Brazil.

Nevertheless, research suggests that “most of the time hysteroscopy does not have a powerful impact on the prognosis of these patients,” he said.

Studies have tended to focus on patients with type 1 endometrial cancer, however. Type 2 endometrial cancer, which is more aggressive, “is scarcely studied,” Dr. Brito said. One retrospective study that focused on type 2 endometrial cancer included 140 patients. Among patients who underwent hysteroscopy, 30% had positive cytology. In comparison, 12% of patients in the curettage group had positive cytology. But the difference in disease-specific survival between groups was not statistically significant, and about 33% of the patients in each group developed a recurrence.

To examine associations between diagnostic methods and outcomes in another group of patients with type 2 endometrial cancer, Dr. Brito and colleagues analyzed data from a hospital registry in Brazil.

The database included 1,183 patients with endometrial cancer between 2002 and 2017, including 235 patients with type 2 endometrial cancer. After excluding patients with synchronous tumor and those who did not undergo surgery or did not have peritoneal cytology performed, 127 patients remained for the analysis. The study included follow-up to December 2019.

The researchers compared the prevalence of positive peritoneal cytology among 43 patients who underwent hysteroscopy with that among 84 patients who underwent curettage. The groups had similar baseline characteristics.

Positive peritoneal cytology was more common in the curettage group than in the hysteroscopy group (10.7% vs. 4.6%), although the difference was not statistically significant. Lymphovascular invasion and advanced surgical staging were more common in the curettage group.

In a multivariate analysis, older age and advanced cancer staging were the only factors associated with decreased disease-free survival. Age, advanced cancer staging, and vascular invasion were associated with decreased disease-specific survival.

The researchers also had considered factors such as peritoneal cytology, diagnostic method, age of menarche, menopause time, parity, comorbidities, smoking status, body mass index, abnormal uterine bleeding, histological type, and adjuvant treatment.

A limitation of the study is that it relied on data from a public health system that often has long wait times for diagnosis and treatment, Dr. Brito noted.
 

Some doctors may forgo cytology

The available research raises questions about the role and relevance of peritoneal cytology in caring for patients with endometrial cancer, René Pareja, MD, a gynecologic oncologist at Instituto Nacional de Cancerología, Bogotá, Colombia, said in a discussion following the presentation.

Peritoneal cytology has not been part of endometrial cancer staging since 2009, Dr. Pareja said. Still, guidelines recommend that surgeons collect cytology during surgical staging, with the idea that the results could inform adjuvant treatment decisions.

“Peritoneal cytology is recommended in the guidelines, but there are no recommendations on how to proceed if it is positive,” Dr. Pareja said. “While some gynecologic oncologists continue to take cytology during endometrial cancer staging, some have stopped doing so. And in Colombia, most of us are not performing pelvic cytology.”

Although some studies indicate that hysteroscopy may increase the rate of positive cytology, positive cytology may not be associated with worse oncological outcomes independent of other risk factors for recurrence, said Dr. Pareja.

So far, studies have been retrospective. Furthermore, the sensitivity and specificity of pelvic cytology tests are not 100%. “Should we continue performing pelvic cytology given the results of this and other studies?” Dr. Pareja asked.

Despite limited knowledge about this variable, physicians may want to be aware if a patient has positive cytology, Dr. Brito suggested. “At least it will give us some red flags so we can be attentive to these patients.”

If researchers were to design a prospective study that incorporates hysteroscopic variables, it could provide more complete answers about the relationship between hysteroscopy and peritoneal cytology and clarify the importance of positive cytology, Dr. Brito said.

Dr. Brito had no relevant disclosures. Dr. Pareja disclosed consulting for Johnson & Johnson.

[email protected]

SOURCE: Oliveira Brito LG et al. J Minim Invasive Gynecol. 2020 Nov. doi: 10.1016/j.jmig.2020.08.356.

Blinatumomab was superior to high-risk consolidation (HC) 3 chemotherapy in a phase 3 clinical trial among children with high-risk first-relapse acute lymphoblastic leukemia (ALL), according to Franco Locatelli, MD, PhD, Ospedale Pediatrico Bambino Gesú and Sapienza, Rome.

Blinatumomab constitutes a new standard of care because of superior event-free survival (EFS) and other comparative benefits, including fewer and less severe toxicities, he said in a presentation at theannual meeting of the American Society of Hematology, which was held virtually.

About 15% of children with B-cell precursor (BCP) ALL relapse after standard treatment. Prognosis depends largely on time from diagnosis to relapse and the site of relapse. After relapse, when a second morphological complete remission (M1 marrow) is achieved, most are candidates for allogeneic hematopoietic stem cell transplant (alloHSCT), Dr. Locatelli noted. Immuno-oncotherapy with blinatumomab, a bispecific T-cell–engager molecule, has been shown to be efficacious in children with relapsed/refractory BCP-ALL.

In the open-label, controlled trial, investigators randomized children with M1 (<5% blasts) or M2 (<25% and 5% or greater blasts) marrow 1:1 after induction therapy and cycles of HC1 and HC2 chemotherapy to a third consolidation course with blinatumomab (15 µg/m²/day for 4 weeks) or HC3 (dexamethasone, vincristine, daunorubicin, methotrexate, ifosfamide, PEG-asparaginase); intrathecal chemotherapy (methotrexate/cytarabine/prednisolone) was administered before treatment. Patients achieving a second complete morphological remission (M1 marrow) after blinatumomab or HC3 proceeded to alloHSCT. EFS was the primary endpoint (from randomization until relapse date or M2 marrow after a complete response [CR], failure to achieve CR at end of treatment, second malignancy, or death from any cause).

Investigators had enrolled 108 (54 received HC3; 54 received blinatumomab) out of a target of about 202 patients when the data-monitoring committee recommended termination because of blinatumomab benefit observed at the first interim analysis. Median age was around 5.5 years (1-17), with the mean time from first diagnosis to relapse at approximately 22 months.

Dr. Locatelli reported events for 18/54 (33.3%) in the blinatumomab arm and 31/54 (57.4%) in the HC3 arm, with a median EFS of “not reached” and 7.4 months, respectively. The risk of relapse with blinatumomab was reduced by 64% versus HC3 (hazard ratio, 0.36; 95% confidence interval, 0.19-0.66, P < .001). Overall survival (OS) favored blinatumomab over HC3, as well, with a hazard ratio of 0.43 (95% CI, 0.18-1.01). Minimal residual disease (MRD) remission (MRD < 10-4) was seen in 43/46 (93.5%) blinatumomab-randomized and 25/46 (54.3%) HC3-randomized patients.

Relapses occurred more often in the HC3 group (blinatumomab 13, 24%; HC3 29, 54%) overall, and at each of the assessments at 6 months, 12 months, and 24 months. Also, MRD remissions by PCR (polymerase chain reaction) were superior in the blinatumomab arm overall (90% versus 54%) and according to baseline MRD status with strikingly divergent rates in those with MRD greater than or equal to 104 at baseline (93% blinatumomab/24% HC3). Rates were relatively similar in patients with MRD less than 104 at baseline (85% blinatumomab/87% HC3).

Grade 3 or greater treatment-emergent adverse events were reported by 30/53 (57%) and 41/51 (80%) patients in the blinatumomab and HC3 groups, respectively, with several markedly lower in the blinatumomab group (neutropenia/neutrophil count decrease 17 versus 31; anemia 15 versus 41; febrile neutropenia 4 versus 26). As expected, grade 3 or greater neurologic events occurred more frequently with blinatumomab than with HC3 (48% versus 29%); no grade 3 or greater cytokine release syndrome events were reported.

Tallying the blinatumomab benefits (superior EFS and MRD negativity prior to alloHSCT, improved OS, fewer relapses, fewer and less severe toxicities), Dr. Locatelli concluded, “Blinatumomab constitutes a new standard of care in children with high-risk first-relapse ALL.”

In the postpresentation discussion, Dr. Locatelli underscored the blinatumomab benefit versus a third course of chemotherapy: “Monotherapy with blinatumomab was able to present a higher proportion of patients in CR2 who could proceed to transplant.”

Dr. Locatelli disclosed relationships with multiple companies.

SOURCE: Locatelli F et al. ASH 2020, Abstract 268.

Blinatumomab was superior to high-risk consolidation (HC) 3 chemotherapy in a phase 3 clinical trial among children with high-risk first-relapse acute lymphoblastic leukemia (ALL), according to Franco Locatelli, MD, PhD, Ospedale Pediatrico Bambino Gesú and Sapienza, Rome.

Blinatumomab constitutes a new standard of care because of superior event-free survival (EFS) and other comparative benefits, including fewer and less severe toxicities, he said in a presentation at theannual meeting of the American Society of Hematology, which was held virtually.

About 15% of children with B-cell precursor (BCP) ALL relapse after standard treatment. Prognosis depends largely on time from diagnosis to relapse and the site of relapse. After relapse, when a second morphological complete remission (M1 marrow) is achieved, most are candidates for allogeneic hematopoietic stem cell transplant (alloHSCT), Dr. Locatelli noted. Immuno-oncotherapy with blinatumomab, a bispecific T-cell–engager molecule, has been shown to be efficacious in children with relapsed/refractory BCP-ALL.

In the open-label, controlled trial, investigators randomized children with M1 (<5% blasts) or M2 (<25% and 5% or greater blasts) marrow 1:1 after induction therapy and cycles of HC1 and HC2 chemotherapy to a third consolidation course with blinatumomab (15 µg/m²/day for 4 weeks) or HC3 (dexamethasone, vincristine, daunorubicin, methotrexate, ifosfamide, PEG-asparaginase); intrathecal chemotherapy (methotrexate/cytarabine/prednisolone) was administered before treatment. Patients achieving a second complete morphological remission (M1 marrow) after blinatumomab or HC3 proceeded to alloHSCT. EFS was the primary endpoint (from randomization until relapse date or M2 marrow after a complete response [CR], failure to achieve CR at end of treatment, second malignancy, or death from any cause).

Investigators had enrolled 108 (54 received HC3; 54 received blinatumomab) out of a target of about 202 patients when the data-monitoring committee recommended termination because of blinatumomab benefit observed at the first interim analysis. Median age was around 5.5 years (1-17), with the mean time from first diagnosis to relapse at approximately 22 months.

Dr. Locatelli reported events for 18/54 (33.3%) in the blinatumomab arm and 31/54 (57.4%) in the HC3 arm, with a median EFS of “not reached” and 7.4 months, respectively. The risk of relapse with blinatumomab was reduced by 64% versus HC3 (hazard ratio, 0.36; 95% confidence interval, 0.19-0.66, P < .001). Overall survival (OS) favored blinatumomab over HC3, as well, with a hazard ratio of 0.43 (95% CI, 0.18-1.01). Minimal residual disease (MRD) remission (MRD < 10-4) was seen in 43/46 (93.5%) blinatumomab-randomized and 25/46 (54.3%) HC3-randomized patients.

Relapses occurred more often in the HC3 group (blinatumomab 13, 24%; HC3 29, 54%) overall, and at each of the assessments at 6 months, 12 months, and 24 months. Also, MRD remissions by PCR (polymerase chain reaction) were superior in the blinatumomab arm overall (90% versus 54%) and according to baseline MRD status with strikingly divergent rates in those with MRD greater than or equal to 104 at baseline (93% blinatumomab/24% HC3). Rates were relatively similar in patients with MRD less than 104 at baseline (85% blinatumomab/87% HC3).

Grade 3 or greater treatment-emergent adverse events were reported by 30/53 (57%) and 41/51 (80%) patients in the blinatumomab and HC3 groups, respectively, with several markedly lower in the blinatumomab group (neutropenia/neutrophil count decrease 17 versus 31; anemia 15 versus 41; febrile neutropenia 4 versus 26). As expected, grade 3 or greater neurologic events occurred more frequently with blinatumomab than with HC3 (48% versus 29%); no grade 3 or greater cytokine release syndrome events were reported.

Tallying the blinatumomab benefits (superior EFS and MRD negativity prior to alloHSCT, improved OS, fewer relapses, fewer and less severe toxicities), Dr. Locatelli concluded, “Blinatumomab constitutes a new standard of care in children with high-risk first-relapse ALL.”

In the postpresentation discussion, Dr. Locatelli underscored the blinatumomab benefit versus a third course of chemotherapy: “Monotherapy with blinatumomab was able to present a higher proportion of patients in CR2 who could proceed to transplant.”

Dr. Locatelli disclosed relationships with multiple companies.

SOURCE: Locatelli F et al. ASH 2020, Abstract 268.

Blinatumomab was superior to high-risk consolidation (HC) 3 chemotherapy in a phase 3 clinical trial among children with high-risk first-relapse acute lymphoblastic leukemia (ALL), according to Franco Locatelli, MD, PhD, Ospedale Pediatrico Bambino Gesú and Sapienza, Rome.

Blinatumomab constitutes a new standard of care because of superior event-free survival (EFS) and other comparative benefits, including fewer and less severe toxicities, he said in a presentation at theannual meeting of the American Society of Hematology, which was held virtually.

About 15% of children with B-cell precursor (BCP) ALL relapse after standard treatment. Prognosis depends largely on time from diagnosis to relapse and the site of relapse. After relapse, when a second morphological complete remission (M1 marrow) is achieved, most are candidates for allogeneic hematopoietic stem cell transplant (alloHSCT), Dr. Locatelli noted. Immuno-oncotherapy with blinatumomab, a bispecific T-cell–engager molecule, has been shown to be efficacious in children with relapsed/refractory BCP-ALL.

In the open-label, controlled trial, investigators randomized children with M1 (<5% blasts) or M2 (<25% and 5% or greater blasts) marrow 1:1 after induction therapy and cycles of HC1 and HC2 chemotherapy to a third consolidation course with blinatumomab (15 µg/m²/day for 4 weeks) or HC3 (dexamethasone, vincristine, daunorubicin, methotrexate, ifosfamide, PEG-asparaginase); intrathecal chemotherapy (methotrexate/cytarabine/prednisolone) was administered before treatment. Patients achieving a second complete morphological remission (M1 marrow) after blinatumomab or HC3 proceeded to alloHSCT. EFS was the primary endpoint (from randomization until relapse date or M2 marrow after a complete response [CR], failure to achieve CR at end of treatment, second malignancy, or death from any cause).

Investigators had enrolled 108 (54 received HC3; 54 received blinatumomab) out of a target of about 202 patients when the data-monitoring committee recommended termination because of blinatumomab benefit observed at the first interim analysis. Median age was around 5.5 years (1-17), with the mean time from first diagnosis to relapse at approximately 22 months.

Dr. Locatelli reported events for 18/54 (33.3%) in the blinatumomab arm and 31/54 (57.4%) in the HC3 arm, with a median EFS of “not reached” and 7.4 months, respectively. The risk of relapse with blinatumomab was reduced by 64% versus HC3 (hazard ratio, 0.36; 95% confidence interval, 0.19-0.66, P < .001). Overall survival (OS) favored blinatumomab over HC3, as well, with a hazard ratio of 0.43 (95% CI, 0.18-1.01). Minimal residual disease (MRD) remission (MRD < 10-4) was seen in 43/46 (93.5%) blinatumomab-randomized and 25/46 (54.3%) HC3-randomized patients.

Relapses occurred more often in the HC3 group (blinatumomab 13, 24%; HC3 29, 54%) overall, and at each of the assessments at 6 months, 12 months, and 24 months. Also, MRD remissions by PCR (polymerase chain reaction) were superior in the blinatumomab arm overall (90% versus 54%) and according to baseline MRD status with strikingly divergent rates in those with MRD greater than or equal to 104 at baseline (93% blinatumomab/24% HC3). Rates were relatively similar in patients with MRD less than 104 at baseline (85% blinatumomab/87% HC3).

Grade 3 or greater treatment-emergent adverse events were reported by 30/53 (57%) and 41/51 (80%) patients in the blinatumomab and HC3 groups, respectively, with several markedly lower in the blinatumomab group (neutropenia/neutrophil count decrease 17 versus 31; anemia 15 versus 41; febrile neutropenia 4 versus 26). As expected, grade 3 or greater neurologic events occurred more frequently with blinatumomab than with HC3 (48% versus 29%); no grade 3 or greater cytokine release syndrome events were reported.

Tallying the blinatumomab benefits (superior EFS and MRD negativity prior to alloHSCT, improved OS, fewer relapses, fewer and less severe toxicities), Dr. Locatelli concluded, “Blinatumomab constitutes a new standard of care in children with high-risk first-relapse ALL.”

In the postpresentation discussion, Dr. Locatelli underscored the blinatumomab benefit versus a third course of chemotherapy: “Monotherapy with blinatumomab was able to present a higher proportion of patients in CR2 who could proceed to transplant.”

Dr. Locatelli disclosed relationships with multiple companies.

SOURCE: Locatelli F et al. ASH 2020, Abstract 268.

Adults with inflammatory bowel disease were more likely to continue using vedolizumab, compared with anti–tumor necrosis factor (TNF) drugs over 3 years, based on data from a retrospective study of nearly 16,000 patients.

Patient persistence with prescribed therapy is essential to managing chronic inflammatory bowel disease (IBD), but data on the persistence of patients with treatments are limited, wrote Ulf Helwig, MD, of the Practice for Internal Medicine, Oldenburg, Germany, and colleagues. “With the advent of vedolizumab, physicians for the first time had the choice between biologicals with different modes of action,” they wrote.

In a study published in the Journal of Clinical Gastroenterology, the researchers used a national prescription database to identify 15,984 adults aged 18 years and older who were treatment-naive to biologics and received prescriptions between July 2014 and March 2017. Treatment persistence was defined as continuous treatment time of at least 90 days without prescription.

A total of 2,076 vedolizumab patients were matched with 2,076 adalimumab patients; 716 vedolizumab patients were matched with 716 golimumab patients; and 2,055 vedolizumab patients were matched with 2,055 infliximab patients.

Within 3 years after the first prescription, the overall persistence rates were 35.9% for vedolizumab, 27.8% for adalimumab, 20.7% for golimumab, and 29.8% for infliximab.

In matched-pair analysis, 35.2% of vedolizumab patients were persistent, compared with 28.9% of adalimumab patients over a 3-year period; the difference was statistically significant. In addition, 30.5% of vedolizumab patients persisted, compared with 25.4% of golimumab patients, also statistically significant. A matched-pair comparison between vedolizumab and infliximab (35.7% vs. 30.2%) was not statistically significant (P = 0.119).

In addition, vedolizumab patients were significantly less likely to discontinue therapy, compared with both adalimumab and golimumab patients, with hazard ratios of 0.86 and 0.60, respectively, in the matched pair analysis; discontinuation, compared with infliximab, was not statistically significant.

“Several reasons may account for significant rates of discontinuation reported for all biological treatments in IBD,” the researchers noted. “These comprise differences in health care systems in the concerned countries, including differences in availability of biologicals, access to reimbursed drugs, or different patient care settings,” they wrote.

The study findings were limited by several factors including the lack of data on specific IBD diagnoses, IBD severity, disease course, and dose escalation, they noted.

However, the study was strengthened by the large sample size and use of a real-world setting, they said.

“Further studies are needed to identify the reasons for persistence differences between vedolizumab and anti-TNF drugs,” they concluded.
 

Comparisons inform choices

“There are multiple biologic options for therapy of inflammatory bowel disease, and response to therapy tends to drop off over time in many patients for a variety of reasons including development of antibodies and escape from the mechanism of the action of the drug,” said Kim L. Isaacs, MD, of the University of North Carolina at Chapel Hill, in an interview.

“Intolerance or side effects of medication also may lead to discontinuation of therapy,” said Dr. Isaacs. “This trial looks at therapy discontinuation among four biologics used for inflammatory bowel disease over a 3-year period after initiation of therapy in patients who were previous biologically naive. Reasons for discontinuation cannot be assessed with this data set,” she noted. “There are very few comparative trials with the different biologic therapies in IBD. This trial is important because it compares the two distinct biologic mechanisms of action and continuation of therapy in biologically naive patients,” she said.

Dr. Isaacs said she was not surprised by the study findings. “Discontinuation of anti-TNF therapy was more common, compared to vedolizumab and golimumab. There was no statistical difference in terms of therapy discontinuation with infliximab,” she said. “In general, vedolizumab is felt to be less systemically immunosuppressant with targeting of white blood cell trafficking to the gut, whereas anti-TNF therapy is more systemically immunosuppressant and may be associated with more systemic side effects,” she explained.

The study design does not allow for comment on comparative efficacy, “although the findings are intriguing,” said Dr. Isaacs. “If the discontinuations were caused by lack of efficacy, the findings in this study may help in positioning biologic therapy in the biologic-naive patients,” she said.

The study is “a ‘real-world’ experiment that suggests there is a difference between different biologic therapies for inflammatory bowel disease,” said Dr. Isaacs. “More controlled comparative efficacy trials are needed that can look at reasons for drug discontinuation between different populations. To date, the VARSITY trial comparing vedolizumab to adalimumab in ulcerative colitis is the only published trial to do this,” she added.  

The study received no outside funding. Lead author Dr. Helwig disclosed lecture and consulting fees from AbbVie, Amgen, Biogen, Celltrion, Hexal, MSD, Ferring, Falk Foundation, Takeda, Mundipharma, Pfizer, Hospira, and Vifor Pharma. Dr. Isaacs disclosed serving on the Data and Safety Monitoring Board (DSMB) for Janssen.

Help your patients better understand their IBD treatment options by sharing AGA’s patient education, “Living with IBD,” in the AGA GI Patient Center at www.gastro.org/IBD. 

SOURCE: Helwig U et al. J Clin Gastroenterol. 2021 Jan. doi: 10.1097/MCG.0000000000001323

Story updated Jan. 5, 2021.

Adults with inflammatory bowel disease were more likely to continue using vedolizumab, compared with anti–tumor necrosis factor (TNF) drugs over 3 years, based on data from a retrospective study of nearly 16,000 patients.

Patient persistence with prescribed therapy is essential to managing chronic inflammatory bowel disease (IBD), but data on the persistence of patients with treatments are limited, wrote Ulf Helwig, MD, of the Practice for Internal Medicine, Oldenburg, Germany, and colleagues. “With the advent of vedolizumab, physicians for the first time had the choice between biologicals with different modes of action,” they wrote.

In a study published in the Journal of Clinical Gastroenterology, the researchers used a national prescription database to identify 15,984 adults aged 18 years and older who were treatment-naive to biologics and received prescriptions between July 2014 and March 2017. Treatment persistence was defined as continuous treatment time of at least 90 days without prescription.

A total of 2,076 vedolizumab patients were matched with 2,076 adalimumab patients; 716 vedolizumab patients were matched with 716 golimumab patients; and 2,055 vedolizumab patients were matched with 2,055 infliximab patients.

Within 3 years after the first prescription, the overall persistence rates were 35.9% for vedolizumab, 27.8% for adalimumab, 20.7% for golimumab, and 29.8% for infliximab.

In matched-pair analysis, 35.2% of vedolizumab patients were persistent, compared with 28.9% of adalimumab patients over a 3-year period; the difference was statistically significant. In addition, 30.5% of vedolizumab patients persisted, compared with 25.4% of golimumab patients, also statistically significant. A matched-pair comparison between vedolizumab and infliximab (35.7% vs. 30.2%) was not statistically significant (P = 0.119).

In addition, vedolizumab patients were significantly less likely to discontinue therapy, compared with both adalimumab and golimumab patients, with hazard ratios of 0.86 and 0.60, respectively, in the matched pair analysis; discontinuation, compared with infliximab, was not statistically significant.

“Several reasons may account for significant rates of discontinuation reported for all biological treatments in IBD,” the researchers noted. “These comprise differences in health care systems in the concerned countries, including differences in availability of biologicals, access to reimbursed drugs, or different patient care settings,” they wrote.

The study findings were limited by several factors including the lack of data on specific IBD diagnoses, IBD severity, disease course, and dose escalation, they noted.

However, the study was strengthened by the large sample size and use of a real-world setting, they said.

“Further studies are needed to identify the reasons for persistence differences between vedolizumab and anti-TNF drugs,” they concluded.
 

Comparisons inform choices

“There are multiple biologic options for therapy of inflammatory bowel disease, and response to therapy tends to drop off over time in many patients for a variety of reasons including development of antibodies and escape from the mechanism of the action of the drug,” said Kim L. Isaacs, MD, of the University of North Carolina at Chapel Hill, in an interview.

“Intolerance or side effects of medication also may lead to discontinuation of therapy,” said Dr. Isaacs. “This trial looks at therapy discontinuation among four biologics used for inflammatory bowel disease over a 3-year period after initiation of therapy in patients who were previous biologically naive. Reasons for discontinuation cannot be assessed with this data set,” she noted. “There are very few comparative trials with the different biologic therapies in IBD. This trial is important because it compares the two distinct biologic mechanisms of action and continuation of therapy in biologically naive patients,” she said.

Dr. Isaacs said she was not surprised by the study findings. “Discontinuation of anti-TNF therapy was more common, compared to vedolizumab and golimumab. There was no statistical difference in terms of therapy discontinuation with infliximab,” she said. “In general, vedolizumab is felt to be less systemically immunosuppressant with targeting of white blood cell trafficking to the gut, whereas anti-TNF therapy is more systemically immunosuppressant and may be associated with more systemic side effects,” she explained.

The study design does not allow for comment on comparative efficacy, “although the findings are intriguing,” said Dr. Isaacs. “If the discontinuations were caused by lack of efficacy, the findings in this study may help in positioning biologic therapy in the biologic-naive patients,” she said.

The study is “a ‘real-world’ experiment that suggests there is a difference between different biologic therapies for inflammatory bowel disease,” said Dr. Isaacs. “More controlled comparative efficacy trials are needed that can look at reasons for drug discontinuation between different populations. To date, the VARSITY trial comparing vedolizumab to adalimumab in ulcerative colitis is the only published trial to do this,” she added.  

The study received no outside funding. Lead author Dr. Helwig disclosed lecture and consulting fees from AbbVie, Amgen, Biogen, Celltrion, Hexal, MSD, Ferring, Falk Foundation, Takeda, Mundipharma, Pfizer, Hospira, and Vifor Pharma. Dr. Isaacs disclosed serving on the Data and Safety Monitoring Board (DSMB) for Janssen.

Help your patients better understand their IBD treatment options by sharing AGA’s patient education, “Living with IBD,” in the AGA GI Patient Center at www.gastro.org/IBD. 

SOURCE: Helwig U et al. J Clin Gastroenterol. 2021 Jan. doi: 10.1097/MCG.0000000000001323

Story updated Jan. 5, 2021.

Adults with inflammatory bowel disease were more likely to continue using vedolizumab, compared with anti–tumor necrosis factor (TNF) drugs over 3 years, based on data from a retrospective study of nearly 16,000 patients.

Patient persistence with prescribed therapy is essential to managing chronic inflammatory bowel disease (IBD), but data on the persistence of patients with treatments are limited, wrote Ulf Helwig, MD, of the Practice for Internal Medicine, Oldenburg, Germany, and colleagues. “With the advent of vedolizumab, physicians for the first time had the choice between biologicals with different modes of action,” they wrote.

In a study published in the Journal of Clinical Gastroenterology, the researchers used a national prescription database to identify 15,984 adults aged 18 years and older who were treatment-naive to biologics and received prescriptions between July 2014 and March 2017. Treatment persistence was defined as continuous treatment time of at least 90 days without prescription.

A total of 2,076 vedolizumab patients were matched with 2,076 adalimumab patients; 716 vedolizumab patients were matched with 716 golimumab patients; and 2,055 vedolizumab patients were matched with 2,055 infliximab patients.

Within 3 years after the first prescription, the overall persistence rates were 35.9% for vedolizumab, 27.8% for adalimumab, 20.7% for golimumab, and 29.8% for infliximab.

In matched-pair analysis, 35.2% of vedolizumab patients were persistent, compared with 28.9% of adalimumab patients over a 3-year period; the difference was statistically significant. In addition, 30.5% of vedolizumab patients persisted, compared with 25.4% of golimumab patients, also statistically significant. A matched-pair comparison between vedolizumab and infliximab (35.7% vs. 30.2%) was not statistically significant (P = 0.119).

In addition, vedolizumab patients were significantly less likely to discontinue therapy, compared with both adalimumab and golimumab patients, with hazard ratios of 0.86 and 0.60, respectively, in the matched pair analysis; discontinuation, compared with infliximab, was not statistically significant.

“Several reasons may account for significant rates of discontinuation reported for all biological treatments in IBD,” the researchers noted. “These comprise differences in health care systems in the concerned countries, including differences in availability of biologicals, access to reimbursed drugs, or different patient care settings,” they wrote.

The study findings were limited by several factors including the lack of data on specific IBD diagnoses, IBD severity, disease course, and dose escalation, they noted.

However, the study was strengthened by the large sample size and use of a real-world setting, they said.

“Further studies are needed to identify the reasons for persistence differences between vedolizumab and anti-TNF drugs,” they concluded.
 

Comparisons inform choices

“There are multiple biologic options for therapy of inflammatory bowel disease, and response to therapy tends to drop off over time in many patients for a variety of reasons including development of antibodies and escape from the mechanism of the action of the drug,” said Kim L. Isaacs, MD, of the University of North Carolina at Chapel Hill, in an interview.

“Intolerance or side effects of medication also may lead to discontinuation of therapy,” said Dr. Isaacs. “This trial looks at therapy discontinuation among four biologics used for inflammatory bowel disease over a 3-year period after initiation of therapy in patients who were previous biologically naive. Reasons for discontinuation cannot be assessed with this data set,” she noted. “There are very few comparative trials with the different biologic therapies in IBD. This trial is important because it compares the two distinct biologic mechanisms of action and continuation of therapy in biologically naive patients,” she said.

Dr. Isaacs said she was not surprised by the study findings. “Discontinuation of anti-TNF therapy was more common, compared to vedolizumab and golimumab. There was no statistical difference in terms of therapy discontinuation with infliximab,” she said. “In general, vedolizumab is felt to be less systemically immunosuppressant with targeting of white blood cell trafficking to the gut, whereas anti-TNF therapy is more systemically immunosuppressant and may be associated with more systemic side effects,” she explained.

The study design does not allow for comment on comparative efficacy, “although the findings are intriguing,” said Dr. Isaacs. “If the discontinuations were caused by lack of efficacy, the findings in this study may help in positioning biologic therapy in the biologic-naive patients,” she said.

The study is “a ‘real-world’ experiment that suggests there is a difference between different biologic therapies for inflammatory bowel disease,” said Dr. Isaacs. “More controlled comparative efficacy trials are needed that can look at reasons for drug discontinuation between different populations. To date, the VARSITY trial comparing vedolizumab to adalimumab in ulcerative colitis is the only published trial to do this,” she added.  

The study received no outside funding. Lead author Dr. Helwig disclosed lecture and consulting fees from AbbVie, Amgen, Biogen, Celltrion, Hexal, MSD, Ferring, Falk Foundation, Takeda, Mundipharma, Pfizer, Hospira, and Vifor Pharma. Dr. Isaacs disclosed serving on the Data and Safety Monitoring Board (DSMB) for Janssen.

Help your patients better understand their IBD treatment options by sharing AGA’s patient education, “Living with IBD,” in the AGA GI Patient Center at www.gastro.org/IBD. 

SOURCE: Helwig U et al. J Clin Gastroenterol. 2021 Jan. doi: 10.1097/MCG.0000000000001323

Story updated Jan. 5, 2021.

Widespread use of the MMR vaccine is not only crucial for protecting the community against infectious outbreaks, but also serves as the overall pacesetter for preventive services, said Sara M. Bode, MD and colleagues at Nationwide Children’s Hospital in Columbus.

CDC/Molly Kurnit, M.P.H.

As part of a bivariate logistic regression analysis, Dr. Bode and colleagues sought to evaluate changes in measles vaccination rates across 12 clinic sites of the Nationwide Children’s Hospital pediatric primary care network in Columbus among 23,534 children aged 16 months. The study period targeted the time between April and May 2020, when clinic access and appointment attendance declined following the start of the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) pandemic, until the June-to-August 2020 time period, when clinical care was allowed to return.

The need for the study was prompted by Centers for Disease Control and Prevention reporting on a state-specific precipitous decline in MMR vaccination rates shortly after the onset of COVID-19 in May 2020. Citing the results of one study, such reductions in vaccination have raised concerns over the possibility of a measles resurgence, noted Dr. Bode and associates.
 

MMR vaccination rates begin to drop with onset of COVID-19 pandemic.

From March 2017 to March 2020, the average rate of MMR vaccination in 16-month-olds was 72%. It subsequently decreased to 67% from April to May 2020, and then dropped further to 62% during the period June to August, 2020 (P = .001). Those without insurance were less likely to be vaccinated than were those carrying private insurance or Medicaid. Hispanic and Asian Americans were more likely than were White and Black patients (85% and 90% vs. 69% and 67%, respectively) to have been vaccinated.

Among patients who had not attended a preventive care visit after 12 months of age, the proportion who received vaccines declined during the same time periods, from 10% before the pandemic to 6% at the start of the pandemic and 3% during the summer months of 2020.

“Given the baseline low vaccination rates even before the pandemic and the subsequent decline, we face a critical need to improve timely vaccination and provide catch-up opportunities” in areas with the highest incidence of COVID-19, observed Dr. Bode and colleagues.

Innovative approaches are needed to encourage families to seek preventive care.

In response, the researchers announced the implementation of new community-based vaccination approaches in Ohio, including pop-up vaccine clinics, mobile clinics, and school-based clinics to provide families, who are reluctant to visit health care facilities over COVID-19 related concerns, with safe alternatives. “We believe that it is critical to develop innovative approaches to have families return for preventive care,” they added.

In a separate interview, Herschel Lessin, MD, a private practice pediatrician in Poughkeepsie, N.Y., noted: “This study confirms the anecdotal experience of pediatricians around the country, and our greatest fear that the pandemic will interfere with herd immunity of children for vaccine-preventable illness. Although the study was of urban offices with a primarily Medicaid population, I believe the results to be very worrisome should they prove to be generalizable to the country, as a whole. The significant reduction of well-child visits due to COVID-19 (and fear of COVID-19) seriously impaired the vaccination status of a standard required vaccine in a large population. What is even more worrisome is that the rates continued to fall even after the initial closure of many offices and well into their reopening, despite concerted efforts to try to catch up these missed visits and immunizations.”

Measles is an intensely contagious illness that has not been eradicated, as evidenced by the enormous measles outbreak stemming from Disneyland in 2014-2015, and again with the possible exposure of hundreds to an infected Disneyland visitor last fall, where coverage rates were even higher than in this study, added Dr. Lessin. “This phenomenon, unless forcefully remedied, could easily result in large outbreaks of other vaccine-preventable illness besides COVID-19,” he cautioned.

Dr. Bode and colleagues as well as Dr. Lessin had no conflicts of interest and no relevant financial disclosures.

SOURCE: Bode SM et al. Pediatrics. 2021. doi: 10.1542/peds.2020-035576.

Widespread use of the MMR vaccine is not only crucial for protecting the community against infectious outbreaks, but also serves as the overall pacesetter for preventive services, said Sara M. Bode, MD and colleagues at Nationwide Children’s Hospital in Columbus.

CDC/Molly Kurnit, M.P.H.

As part of a bivariate logistic regression analysis, Dr. Bode and colleagues sought to evaluate changes in measles vaccination rates across 12 clinic sites of the Nationwide Children’s Hospital pediatric primary care network in Columbus among 23,534 children aged 16 months. The study period targeted the time between April and May 2020, when clinic access and appointment attendance declined following the start of the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) pandemic, until the June-to-August 2020 time period, when clinical care was allowed to return.

The need for the study was prompted by Centers for Disease Control and Prevention reporting on a state-specific precipitous decline in MMR vaccination rates shortly after the onset of COVID-19 in May 2020. Citing the results of one study, such reductions in vaccination have raised concerns over the possibility of a measles resurgence, noted Dr. Bode and associates.
 

MMR vaccination rates begin to drop with onset of COVID-19 pandemic.

From March 2017 to March 2020, the average rate of MMR vaccination in 16-month-olds was 72%. It subsequently decreased to 67% from April to May 2020, and then dropped further to 62% during the period June to August, 2020 (P = .001). Those without insurance were less likely to be vaccinated than were those carrying private insurance or Medicaid. Hispanic and Asian Americans were more likely than were White and Black patients (85% and 90% vs. 69% and 67%, respectively) to have been vaccinated.

Among patients who had not attended a preventive care visit after 12 months of age, the proportion who received vaccines declined during the same time periods, from 10% before the pandemic to 6% at the start of the pandemic and 3% during the summer months of 2020.

“Given the baseline low vaccination rates even before the pandemic and the subsequent decline, we face a critical need to improve timely vaccination and provide catch-up opportunities” in areas with the highest incidence of COVID-19, observed Dr. Bode and colleagues.

Innovative approaches are needed to encourage families to seek preventive care.

In response, the researchers announced the implementation of new community-based vaccination approaches in Ohio, including pop-up vaccine clinics, mobile clinics, and school-based clinics to provide families, who are reluctant to visit health care facilities over COVID-19 related concerns, with safe alternatives. “We believe that it is critical to develop innovative approaches to have families return for preventive care,” they added.

In a separate interview, Herschel Lessin, MD, a private practice pediatrician in Poughkeepsie, N.Y., noted: “This study confirms the anecdotal experience of pediatricians around the country, and our greatest fear that the pandemic will interfere with herd immunity of children for vaccine-preventable illness. Although the study was of urban offices with a primarily Medicaid population, I believe the results to be very worrisome should they prove to be generalizable to the country, as a whole. The significant reduction of well-child visits due to COVID-19 (and fear of COVID-19) seriously impaired the vaccination status of a standard required vaccine in a large population. What is even more worrisome is that the rates continued to fall even after the initial closure of many offices and well into their reopening, despite concerted efforts to try to catch up these missed visits and immunizations.”

Measles is an intensely contagious illness that has not been eradicated, as evidenced by the enormous measles outbreak stemming from Disneyland in 2014-2015, and again with the possible exposure of hundreds to an infected Disneyland visitor last fall, where coverage rates were even higher than in this study, added Dr. Lessin. “This phenomenon, unless forcefully remedied, could easily result in large outbreaks of other vaccine-preventable illness besides COVID-19,” he cautioned.

Dr. Bode and colleagues as well as Dr. Lessin had no conflicts of interest and no relevant financial disclosures.

SOURCE: Bode SM et al. Pediatrics. 2021. doi: 10.1542/peds.2020-035576.

Widespread use of the MMR vaccine is not only crucial for protecting the community against infectious outbreaks, but also serves as the overall pacesetter for preventive services, said Sara M. Bode, MD and colleagues at Nationwide Children’s Hospital in Columbus.

CDC/Molly Kurnit, M.P.H.

As part of a bivariate logistic regression analysis, Dr. Bode and colleagues sought to evaluate changes in measles vaccination rates across 12 clinic sites of the Nationwide Children’s Hospital pediatric primary care network in Columbus among 23,534 children aged 16 months. The study period targeted the time between April and May 2020, when clinic access and appointment attendance declined following the start of the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) pandemic, until the June-to-August 2020 time period, when clinical care was allowed to return.

The need for the study was prompted by Centers for Disease Control and Prevention reporting on a state-specific precipitous decline in MMR vaccination rates shortly after the onset of COVID-19 in May 2020. Citing the results of one study, such reductions in vaccination have raised concerns over the possibility of a measles resurgence, noted Dr. Bode and associates.
 

MMR vaccination rates begin to drop with onset of COVID-19 pandemic.

From March 2017 to March 2020, the average rate of MMR vaccination in 16-month-olds was 72%. It subsequently decreased to 67% from April to May 2020, and then dropped further to 62% during the period June to August, 2020 (P = .001). Those without insurance were less likely to be vaccinated than were those carrying private insurance or Medicaid. Hispanic and Asian Americans were more likely than were White and Black patients (85% and 90% vs. 69% and 67%, respectively) to have been vaccinated.

Among patients who had not attended a preventive care visit after 12 months of age, the proportion who received vaccines declined during the same time periods, from 10% before the pandemic to 6% at the start of the pandemic and 3% during the summer months of 2020.

“Given the baseline low vaccination rates even before the pandemic and the subsequent decline, we face a critical need to improve timely vaccination and provide catch-up opportunities” in areas with the highest incidence of COVID-19, observed Dr. Bode and colleagues.

Innovative approaches are needed to encourage families to seek preventive care.

In response, the researchers announced the implementation of new community-based vaccination approaches in Ohio, including pop-up vaccine clinics, mobile clinics, and school-based clinics to provide families, who are reluctant to visit health care facilities over COVID-19 related concerns, with safe alternatives. “We believe that it is critical to develop innovative approaches to have families return for preventive care,” they added.

In a separate interview, Herschel Lessin, MD, a private practice pediatrician in Poughkeepsie, N.Y., noted: “This study confirms the anecdotal experience of pediatricians around the country, and our greatest fear that the pandemic will interfere with herd immunity of children for vaccine-preventable illness. Although the study was of urban offices with a primarily Medicaid population, I believe the results to be very worrisome should they prove to be generalizable to the country, as a whole. The significant reduction of well-child visits due to COVID-19 (and fear of COVID-19) seriously impaired the vaccination status of a standard required vaccine in a large population. What is even more worrisome is that the rates continued to fall even after the initial closure of many offices and well into their reopening, despite concerted efforts to try to catch up these missed visits and immunizations.”

Measles is an intensely contagious illness that has not been eradicated, as evidenced by the enormous measles outbreak stemming from Disneyland in 2014-2015, and again with the possible exposure of hundreds to an infected Disneyland visitor last fall, where coverage rates were even higher than in this study, added Dr. Lessin. “This phenomenon, unless forcefully remedied, could easily result in large outbreaks of other vaccine-preventable illness besides COVID-19,” he cautioned.

Dr. Bode and colleagues as well as Dr. Lessin had no conflicts of interest and no relevant financial disclosures.

SOURCE: Bode SM et al. Pediatrics. 2021. doi: 10.1542/peds.2020-035576.

For the seventh week out of the last eight, more new cases of COVID-19 in children were reported in the United States than any week before, according to a report from the American Academy of Pediatrics and the Children’s Hospital Association.

There were just over 182,000 new cases of COVID-19 in children during the week ending Dec. 17, topping the previous high of almost 179,000 set the previous week. That difference of about 3,000 cases, however, is the smallest weekly increase since Oct. 1 – a stretch of 11 weeks that has produced only one decline, based on data from the latest AAP/CHA weekly report.

As of Dec. 17, there had been over 1.8 million cases of COVID-19 in children, which represents 12.3% of all U.S. cases. For the week, 14% of all cases occurred in children, which was up slightly from 13.8% the week before (Dec. 10). The overall rate of coronavirus infection is now 2,420 cases per 100,000 children in the population, the AAP and CHA said.

A total of 30 states are above that national rate, with North Dakota the highest at 7,515 cases per 100,000 children, followed by South Dakota (5,618), Wyoming (5,157), Wisconsin (5,106), and Tennessee (4,994). Wyoming has the highest proportion of cases occurring in children at 20.8%, but that is down from 23.4% in mid-November, based on data collected by the AAP and CHA from the health department websites of 49 states (New York does not provide age distributions), the District of Columbia, New York City, Puerto Rico, and Guam.

In the last 2 weeks, however, the largest percent increases in new cases came in states with low-to-average rates of cumulative child infection. California, Connecticut, Delaware, Maine, Maryland, New Hampshire, and Vermont all saw increases of over 35% from Dec. 3 to Dec. 17, while the smallest increases occurred in Hawaii, North Dakota, and Wyoming, the AAP and CHA reported.

[email protected]

For the seventh week out of the last eight, more new cases of COVID-19 in children were reported in the United States than any week before, according to a report from the American Academy of Pediatrics and the Children’s Hospital Association.

There were just over 182,000 new cases of COVID-19 in children during the week ending Dec. 17, topping the previous high of almost 179,000 set the previous week. That difference of about 3,000 cases, however, is the smallest weekly increase since Oct. 1 – a stretch of 11 weeks that has produced only one decline, based on data from the latest AAP/CHA weekly report.

As of Dec. 17, there had been over 1.8 million cases of COVID-19 in children, which represents 12.3% of all U.S. cases. For the week, 14% of all cases occurred in children, which was up slightly from 13.8% the week before (Dec. 10). The overall rate of coronavirus infection is now 2,420 cases per 100,000 children in the population, the AAP and CHA said.

A total of 30 states are above that national rate, with North Dakota the highest at 7,515 cases per 100,000 children, followed by South Dakota (5,618), Wyoming (5,157), Wisconsin (5,106), and Tennessee (4,994). Wyoming has the highest proportion of cases occurring in children at 20.8%, but that is down from 23.4% in mid-November, based on data collected by the AAP and CHA from the health department websites of 49 states (New York does not provide age distributions), the District of Columbia, New York City, Puerto Rico, and Guam.

In the last 2 weeks, however, the largest percent increases in new cases came in states with low-to-average rates of cumulative child infection. California, Connecticut, Delaware, Maine, Maryland, New Hampshire, and Vermont all saw increases of over 35% from Dec. 3 to Dec. 17, while the smallest increases occurred in Hawaii, North Dakota, and Wyoming, the AAP and CHA reported.

[email protected]

For the seventh week out of the last eight, more new cases of COVID-19 in children were reported in the United States than any week before, according to a report from the American Academy of Pediatrics and the Children’s Hospital Association.

There were just over 182,000 new cases of COVID-19 in children during the week ending Dec. 17, topping the previous high of almost 179,000 set the previous week. That difference of about 3,000 cases, however, is the smallest weekly increase since Oct. 1 – a stretch of 11 weeks that has produced only one decline, based on data from the latest AAP/CHA weekly report.

As of Dec. 17, there had been over 1.8 million cases of COVID-19 in children, which represents 12.3% of all U.S. cases. For the week, 14% of all cases occurred in children, which was up slightly from 13.8% the week before (Dec. 10). The overall rate of coronavirus infection is now 2,420 cases per 100,000 children in the population, the AAP and CHA said.

A total of 30 states are above that national rate, with North Dakota the highest at 7,515 cases per 100,000 children, followed by South Dakota (5,618), Wyoming (5,157), Wisconsin (5,106), and Tennessee (4,994). Wyoming has the highest proportion of cases occurring in children at 20.8%, but that is down from 23.4% in mid-November, based on data collected by the AAP and CHA from the health department websites of 49 states (New York does not provide age distributions), the District of Columbia, New York City, Puerto Rico, and Guam.

In the last 2 weeks, however, the largest percent increases in new cases came in states with low-to-average rates of cumulative child infection. California, Connecticut, Delaware, Maine, Maryland, New Hampshire, and Vermont all saw increases of over 35% from Dec. 3 to Dec. 17, while the smallest increases occurred in Hawaii, North Dakota, and Wyoming, the AAP and CHA reported.

[email protected]

The majority of video content related to acne on the mobile app TikTok was presented by nonphysicians and had serious shortcomings, according to an analysis of the top 100 videos using a consumer health validation tool.

The popularity of TikTok among adolescents in particular has implications for the dissemination of acne information, as some teens become “skinfluencers” and receive sponsorship from skin care brands in exchange for social media promotion, wrote David X. Zheng, BA, of the department of dermatology, Case Western Reserve University, Cleveland, and colleagues.

“However, the quality of dermatologic information found on TikTok is largely unknown,” they said.

In a brief report published in Pediatric Dermatology, the researchers identified the top 100 videos on TikTok on May 1, 2020, that were tagged with “#acne.” The information on each video included date of upload, type and gender of the individual uploading the video, physician specialty if applicable, and video category. These top 100 videos had 13,470,501 likes and 64,775 comments over a 7.6-month time period.

The researchers used the DISCERN criteria, a validated 1-5 scale designed to assess consumer health information, to evaluate the video content, with 1 (having “serious” or “extensive shortcomings”) and 5 (having “minimal shortcomings.”)

Overall, the average quality rating of the TikTok acne videos was 2.03. A total of 9 videos were produced by board-certified physicians in the United States, with an average DISCERN score of 2.41.

“Analysis of the DISCERN criteria dimensions suggested that major shortcomings common to both physician and nonphysician uploaders included failure to cite information sources, discuss treatment risks, and provide support for shared decision-making,” the researchers said.

Approximately one-third (34%) of the videos fell into the treatment-product advertisement category, while 26% were personal anecdotes, 20% presented information related to acne, 13% featured home remedy treatments, and 7% were classified as “other.” The researchers also identified the top 200 “#acne” videos on TikTok once a week from May 8, 2020 to June 5, 2020, to determine the evolution of acne content on the app and found a turnover rate of 10.9% per week.

Based on the high turnover and low quality based on DISCERN ratings, the authors suggested that patients seeking acne information should “view acne-related TikTok videos with caution and consult evidence-based resources whenever possible.”

The study findings were limited by several factors including the small sample size of physicians uploading videos, lack of information about the number of nonphysician medical professionals who uploaded videos, and lack of information about the number of video views and country of origin, the researchers noted. However, the results highlight the need for dermatologists to be aware that patients, especially teens, may be using TikTok for acne information that may be of poor quality, they said.

“Conversely, we understand that social media can be a powerful tool for advancing health literacy,” the researchers noted. “Therefore, we also recommend that health care professionals engaging on TikTok create thorough and perhaps standardized educational videos regarding acne, as well as correct any acne-related misinformation that may be present,” they concluded.

The other authors of the study were from the departments of dermatology at Case Western Reserve, University Hospitals Cleveland, and Johns Hopkins University, Baltimore.

The study received no outside funding. The researchers had no financial conflicts to disclose.

SOURCE: Zheng DX et al. Pediatr Dermatol. 2020 Nov 28. doi: 10.1111/pde.14471.

The majority of video content related to acne on the mobile app TikTok was presented by nonphysicians and had serious shortcomings, according to an analysis of the top 100 videos using a consumer health validation tool.

The popularity of TikTok among adolescents in particular has implications for the dissemination of acne information, as some teens become “skinfluencers” and receive sponsorship from skin care brands in exchange for social media promotion, wrote David X. Zheng, BA, of the department of dermatology, Case Western Reserve University, Cleveland, and colleagues.

“However, the quality of dermatologic information found on TikTok is largely unknown,” they said.

In a brief report published in Pediatric Dermatology, the researchers identified the top 100 videos on TikTok on May 1, 2020, that were tagged with “#acne.” The information on each video included date of upload, type and gender of the individual uploading the video, physician specialty if applicable, and video category. These top 100 videos had 13,470,501 likes and 64,775 comments over a 7.6-month time period.

The researchers used the DISCERN criteria, a validated 1-5 scale designed to assess consumer health information, to evaluate the video content, with 1 (having “serious” or “extensive shortcomings”) and 5 (having “minimal shortcomings.”)

Overall, the average quality rating of the TikTok acne videos was 2.03. A total of 9 videos were produced by board-certified physicians in the United States, with an average DISCERN score of 2.41.

“Analysis of the DISCERN criteria dimensions suggested that major shortcomings common to both physician and nonphysician uploaders included failure to cite information sources, discuss treatment risks, and provide support for shared decision-making,” the researchers said.

Approximately one-third (34%) of the videos fell into the treatment-product advertisement category, while 26% were personal anecdotes, 20% presented information related to acne, 13% featured home remedy treatments, and 7% were classified as “other.” The researchers also identified the top 200 “#acne” videos on TikTok once a week from May 8, 2020 to June 5, 2020, to determine the evolution of acne content on the app and found a turnover rate of 10.9% per week.

Based on the high turnover and low quality based on DISCERN ratings, the authors suggested that patients seeking acne information should “view acne-related TikTok videos with caution and consult evidence-based resources whenever possible.”

The study findings were limited by several factors including the small sample size of physicians uploading videos, lack of information about the number of nonphysician medical professionals who uploaded videos, and lack of information about the number of video views and country of origin, the researchers noted. However, the results highlight the need for dermatologists to be aware that patients, especially teens, may be using TikTok for acne information that may be of poor quality, they said.

“Conversely, we understand that social media can be a powerful tool for advancing health literacy,” the researchers noted. “Therefore, we also recommend that health care professionals engaging on TikTok create thorough and perhaps standardized educational videos regarding acne, as well as correct any acne-related misinformation that may be present,” they concluded.

The other authors of the study were from the departments of dermatology at Case Western Reserve, University Hospitals Cleveland, and Johns Hopkins University, Baltimore.

The study received no outside funding. The researchers had no financial conflicts to disclose.

SOURCE: Zheng DX et al. Pediatr Dermatol. 2020 Nov 28. doi: 10.1111/pde.14471.

The majority of video content related to acne on the mobile app TikTok was presented by nonphysicians and had serious shortcomings, according to an analysis of the top 100 videos using a consumer health validation tool.

The popularity of TikTok among adolescents in particular has implications for the dissemination of acne information, as some teens become “skinfluencers” and receive sponsorship from skin care brands in exchange for social media promotion, wrote David X. Zheng, BA, of the department of dermatology, Case Western Reserve University, Cleveland, and colleagues.

“However, the quality of dermatologic information found on TikTok is largely unknown,” they said.

In a brief report published in Pediatric Dermatology, the researchers identified the top 100 videos on TikTok on May 1, 2020, that were tagged with “#acne.” The information on each video included date of upload, type and gender of the individual uploading the video, physician specialty if applicable, and video category. These top 100 videos had 13,470,501 likes and 64,775 comments over a 7.6-month time period.

The researchers used the DISCERN criteria, a validated 1-5 scale designed to assess consumer health information, to evaluate the video content, with 1 (having “serious” or “extensive shortcomings”) and 5 (having “minimal shortcomings.”)

Overall, the average quality rating of the TikTok acne videos was 2.03. A total of 9 videos were produced by board-certified physicians in the United States, with an average DISCERN score of 2.41.

“Analysis of the DISCERN criteria dimensions suggested that major shortcomings common to both physician and nonphysician uploaders included failure to cite information sources, discuss treatment risks, and provide support for shared decision-making,” the researchers said.

Approximately one-third (34%) of the videos fell into the treatment-product advertisement category, while 26% were personal anecdotes, 20% presented information related to acne, 13% featured home remedy treatments, and 7% were classified as “other.” The researchers also identified the top 200 “#acne” videos on TikTok once a week from May 8, 2020 to June 5, 2020, to determine the evolution of acne content on the app and found a turnover rate of 10.9% per week.

Based on the high turnover and low quality based on DISCERN ratings, the authors suggested that patients seeking acne information should “view acne-related TikTok videos with caution and consult evidence-based resources whenever possible.”

The study findings were limited by several factors including the small sample size of physicians uploading videos, lack of information about the number of nonphysician medical professionals who uploaded videos, and lack of information about the number of video views and country of origin, the researchers noted. However, the results highlight the need for dermatologists to be aware that patients, especially teens, may be using TikTok for acne information that may be of poor quality, they said.

“Conversely, we understand that social media can be a powerful tool for advancing health literacy,” the researchers noted. “Therefore, we also recommend that health care professionals engaging on TikTok create thorough and perhaps standardized educational videos regarding acne, as well as correct any acne-related misinformation that may be present,” they concluded.

The other authors of the study were from the departments of dermatology at Case Western Reserve, University Hospitals Cleveland, and Johns Hopkins University, Baltimore.

The study received no outside funding. The researchers had no financial conflicts to disclose.

SOURCE: Zheng DX et al. Pediatr Dermatol. 2020 Nov 28. doi: 10.1111/pde.14471.