User login
EAP makes drug available to MM patients
Photo by Linda Bartlett
A new expanded access program (EAP) will make daratumumab, an investigational anti-CD38 monoclonal antibody, available to patients with double-refractory multiple myeloma (MM).
The multicenter EAP is open to MM patients in the US who are 18 years of age or older.
Patients must be refractory to both a proteasome inhibitor (PI) and an immunomodulatory drug (IMiD) or have received 3 or more prior lines of therapy, including a PI and an IMiD.
In the US, EAPs are designed to make investigational medicines available for patients with serious or life-threatening illnesses who are ineligible for ongoing interventional trials and have exhausted currently available treatment options.
This EAP will make daratumumab available at up to 40 medical centers in the US while the drug’s Biologics License Application is under review by the US Food and Drug Administration (FDA).
Additional information about the EAP can be found on clinicaltrials.gov (NCT02477891). Janssen Research & Development, LLC, the company developing daratumumab, is collaborating with the Multiple Myeloma Research Foundation on this EAP.
About daratumumab
Daratumumab is a human IgG1k monoclonal antibody that binds with high affinity to the transmembrane ectoenzyme CD38 on the surface of MM cells.
Five phase 3 clinical studies with daratumumab in relapsed and frontline settings are currently ongoing. Additional studies are ongoing or planned to assess the drug’s potential in other malignant and pre-malignant diseases on which CD38 is expressed, such as smoldering myeloma and non-Hodgkin lymphoma.
On May 1, 2013, daratumumab received breakthrough designation from the FDA for the treatment of patients with MM who have received at least 3 prior lines of therapy, including a PI and an IMiD, or who are double refractory to a PI and an IMiD.
On June 5, 2015, Janssen announced it had initiated the rolling submission of its Biologics License Application for daratumumab to the FDA for the treatment of this set of MM patients. A rolling submission allows the company to submit portions of the regulatory application to the FDA as they are completed.
The regulatory submission for daratumumab will be primarily supported by data from the phase 2 MMY2002 (SIRIUS) study, the results of which were presented at the 2015 ASCO Annual Meeting.
The application will also be supported by data from 4 other studies, including the phase 1/2 GEN501 monotherapy study.
Photo by Linda Bartlett
A new expanded access program (EAP) will make daratumumab, an investigational anti-CD38 monoclonal antibody, available to patients with double-refractory multiple myeloma (MM).
The multicenter EAP is open to MM patients in the US who are 18 years of age or older.
Patients must be refractory to both a proteasome inhibitor (PI) and an immunomodulatory drug (IMiD) or have received 3 or more prior lines of therapy, including a PI and an IMiD.
In the US, EAPs are designed to make investigational medicines available for patients with serious or life-threatening illnesses who are ineligible for ongoing interventional trials and have exhausted currently available treatment options.
This EAP will make daratumumab available at up to 40 medical centers in the US while the drug’s Biologics License Application is under review by the US Food and Drug Administration (FDA).
Additional information about the EAP can be found on clinicaltrials.gov (NCT02477891). Janssen Research & Development, LLC, the company developing daratumumab, is collaborating with the Multiple Myeloma Research Foundation on this EAP.
About daratumumab
Daratumumab is a human IgG1k monoclonal antibody that binds with high affinity to the transmembrane ectoenzyme CD38 on the surface of MM cells.
Five phase 3 clinical studies with daratumumab in relapsed and frontline settings are currently ongoing. Additional studies are ongoing or planned to assess the drug’s potential in other malignant and pre-malignant diseases on which CD38 is expressed, such as smoldering myeloma and non-Hodgkin lymphoma.
On May 1, 2013, daratumumab received breakthrough designation from the FDA for the treatment of patients with MM who have received at least 3 prior lines of therapy, including a PI and an IMiD, or who are double refractory to a PI and an IMiD.
On June 5, 2015, Janssen announced it had initiated the rolling submission of its Biologics License Application for daratumumab to the FDA for the treatment of this set of MM patients. A rolling submission allows the company to submit portions of the regulatory application to the FDA as they are completed.
The regulatory submission for daratumumab will be primarily supported by data from the phase 2 MMY2002 (SIRIUS) study, the results of which were presented at the 2015 ASCO Annual Meeting.
The application will also be supported by data from 4 other studies, including the phase 1/2 GEN501 monotherapy study.
Photo by Linda Bartlett
A new expanded access program (EAP) will make daratumumab, an investigational anti-CD38 monoclonal antibody, available to patients with double-refractory multiple myeloma (MM).
The multicenter EAP is open to MM patients in the US who are 18 years of age or older.
Patients must be refractory to both a proteasome inhibitor (PI) and an immunomodulatory drug (IMiD) or have received 3 or more prior lines of therapy, including a PI and an IMiD.
In the US, EAPs are designed to make investigational medicines available for patients with serious or life-threatening illnesses who are ineligible for ongoing interventional trials and have exhausted currently available treatment options.
This EAP will make daratumumab available at up to 40 medical centers in the US while the drug’s Biologics License Application is under review by the US Food and Drug Administration (FDA).
Additional information about the EAP can be found on clinicaltrials.gov (NCT02477891). Janssen Research & Development, LLC, the company developing daratumumab, is collaborating with the Multiple Myeloma Research Foundation on this EAP.
About daratumumab
Daratumumab is a human IgG1k monoclonal antibody that binds with high affinity to the transmembrane ectoenzyme CD38 on the surface of MM cells.
Five phase 3 clinical studies with daratumumab in relapsed and frontline settings are currently ongoing. Additional studies are ongoing or planned to assess the drug’s potential in other malignant and pre-malignant diseases on which CD38 is expressed, such as smoldering myeloma and non-Hodgkin lymphoma.
On May 1, 2013, daratumumab received breakthrough designation from the FDA for the treatment of patients with MM who have received at least 3 prior lines of therapy, including a PI and an IMiD, or who are double refractory to a PI and an IMiD.
On June 5, 2015, Janssen announced it had initiated the rolling submission of its Biologics License Application for daratumumab to the FDA for the treatment of this set of MM patients. A rolling submission allows the company to submit portions of the regulatory application to the FDA as they are completed.
The regulatory submission for daratumumab will be primarily supported by data from the phase 2 MMY2002 (SIRIUS) study, the results of which were presented at the 2015 ASCO Annual Meeting.
The application will also be supported by data from 4 other studies, including the phase 1/2 GEN501 monotherapy study.
Telemetry Use for LOS and Cost Reduction
Inpatient hospital services are a major component of total US civilian noninstitutionalized healthcare expenses, accounting for 29.3% of spending in 2009[1] when the average cost per stay was $9700.[2] Telemetry monitoring, a widely used resource for the identification of life‐threatening arrhythmias, contributes to these costs. In 1998, Sivaram et al. estimated the cost per patient at $683; in 2010, Ivonye et al. published the cost difference between a telemetry bed and a nonmonitored bed in their inner‐city public teaching facility reached $800.[3, 4]
In 1991, the American College of Cardiology published guidelines for telemetry use, which were later revised by the American Heart Association in 2004.[5, 6] Notably, the guidelines are based on expert opinion and on research data in electrocardiography.[7] The guidelines divide patients into 3 classes based on clinical condition: recommending telemetry monitoring for almost all class I patients, stating possible benefit in class II patients, and discouraging cardiac monitoring for the low‐risk class III patients.[5, 6] The Choosing Wisely campaign, an initiative of the American Board of Internal Medicine and the Society of Hospital Medicine, highlights telemetry monitoring as 1 of the top 5 interventions that physicians and patients should question when determining tests and procedures.[8] Choosing Wisely suggests using a protocol to govern continuation of telemetry outside of the intensive care unit (ICU), as inappropriate monitoring increases care costs and may result in patient harm.[8] The Joint Commission 2014 National Patient Safety Goals notes that numerous alarm signals and the resulting noise and displayed information tends to desensitize staff and cause them to miss or ignore alarm signals or even disable them.[9]
Few studies have examined implementation methods for improved telemetry bed utilization. One study evaluated the impact of a multispecialty telemetry policy with enforcement by an outside cardiologist and nurse team, noting improved cardiac monitoring bed utilization and decreased academic hospital closure, which previously resulted in inability to accept new patients or procedure cancellation.[10] Another study provided an orientation handout discussed by the chief resident and telemetry indication reviews during multidisciplinary rounds 3 times a week.[11]
Our study is one the first to demonstrate a model for a hospitalist‐led approach to guide appropriate telemetry use. We investigated the impact of a multipronged approach to guide telemetry usage: (1) a hospitalist‐led, daily review of bed utilization during attending rounds, (2) a hospitalist attending‐driven, trainee‐focused education module on telemetry utilization, (3) quarterly feedback on telemetry bed utilization rates, and (4) financial incentives. We analyzed pre‐ and post‐evaluation results from the education module to measure impact on knowledge, skills, and attitudes. Additionally, we evaluated the effect of the intervention on length of stay (LOS) and bed utilization costs, while monitoring case mix index (CMI) and overall mortality.
METHODS
Setting
This study took place at Stanford Hospital and Clinics, a teaching academic center in Stanford, California. Stanford Hospital is a 444‐bed, urban medical center with 114 telemetry intermediate ICU beds, and 66 ICU beds. The 264 medicalsurgical beds lack telemetry monitoring, which can only be completed in the intermediate and full ICU. All patients on telemetry units receive both cardiac monitoring and increased nursing ratios. Transfer orders are placed in the electronic medical record to shift patients between care levels. Bed control attempts to transfer patients as soon as an open bed in the appropriate care level exists.
The study included all 5 housestaff inpatient general internal medicine wards teams (which excludes cardiology, pulmonary hypertension, hematology, oncology, and post‐transplant patients). Hospitalists and nonhospitalists attend on the wards for 1‐ to 2‐week blocks. Teaching teams are staffed by 1 to 2 medical students, 2 interns, 1 resident, and 1 attending. The university institutional review board notice of determination waived review for this study because it was classified as quality improvement.
Participants
Ten full‐ and part‐time hospitalist physicians participated in the standardized telemetry teaching. Fifty‐six of the approximately 80 medical students and housestaff on hospitalists' teams completed the educational evaluation. Both hospitalist and nonhospitalist teams participated in daily multidisciplinary rounds, focusing on barriers to discharge including telemetry use. Twelve nonhospitalists served on the wards during the intervention period. Hospitalists covered 72% of the internal medicine wards during the intervention period.
Study Design
We investigated the impact of a multipronged approach to guide telemetry usage from January 2013 to August 2013 (intervention period).
Hospitalist‐Led Daily Review of Bed Utilization
Hospitalists were encouraged to discuss the need of telemetry on daily attending rounds and review indications for telemetry while on service. Prior to starting a ward block, attendings were emailed the teaching module with a reminder to discuss the need for telemetry on attending rounds. Reminders to discuss telemetry utilization were also provided during every‐other‐week hospitalist meetings. Compliance of daily discussion was not tracked.
Hospitalist‐Driven, Trainee‐Focused, Education Module on Telemetry Utilization
The educational module was taught during teaching sessions only by the hospitalists. Trainees on nonhospitalist teams did not receive dedicated teaching about telemetry usage. The module was given to learners only once. The module was a 10‐slide, Microsoft PowerPoint (Microsoft Corp., Redmond, WA) presentation that reviewed the history of telemetry, the American College of Cardiology and the American Heart Association guidelines, the cost difference between telemetry and nonmonitored beds, and the perceived barriers to discontinuation. The presentation was accompanied by a pre‐ and post‐evaluation to elicit knowledge, skills, and attitudes of telemetry use (see Supporting Information, Appendix A, in the online version of this article). The pre‐ and post‐evaluations were created through consensus with a multidisciplinary, expert panel after reviewing the evidence‐based literature.
Quarterly Feedback on Telemetry Bed Utilization Rates
Hospital beduse and CMI data were obtained from the Stanford finance department for the intervention period and for the baseline period, which was the year prior to the study, January 1, 2012 to December 31, 2012. Hospital beduse data included the number of days patients were on telemetry units versus medicalsurgical units (nontelemetry units), differentiated by hospitalists and nonhospitalists. Cost savings were calculated by the Stanford finance department that used Stanford‐specific, internal cost accounting data to determine the impact of the intervention. These data were reviewed at hospitalist meetings on a quarterly basis. We also obtained the University Healthsystem Consortium mortality index (observed to expected) for the general internal medicine service during the baseline and intervention periods.
To measure sustainment of telemetry reduction in the postintervention period, we measured telemetry LOS from September 2014 to March 2015 (extension period).
Financial Incentives
Hospitalists were provided a $2000 bonus at the end of fiscal year 2013 if the group showed a decrease in telemetry bed use in comparison to the baseline period.
Statistical Analysis of Clinical Outcome Measures
Continuous outcomes were tested using 2‐tailed t tests. Comparison of continuous outcome included differences in telemetry and nontelemetry LOS and CMI. Pairwise comparisons were made for various time periods. A P value of <0.05 was considered statistically significant. Statistical analyses were performed using Stata 12.0 software (StataCorp, College Station, TX).
RESULTS
Clinical and Value Outcomes
Baseline (January 2012December 2012) Versus Intervention Period (January 2013August 2013)
LOS for telemetry beds was significantly reduced over the intervention period (2.75 days vs 2.13 days, P=0.005) for hospitalists. Notably, there was no significant difference in mean LOS between baseline and intervention periods for nontelemetry beds (2.84 days vs 2.72 days, P=0.32) for hospitalists. In comparison, for nonhospitalists, there was no difference in mean LOS for telemetry beds between baseline and intervention periods (2.75 days vs 2.46 days, P=0.33) and nontelemetry beds (2.64 days vs 2.89 days, P=0.26) (Table 1).
Baseline Period | Intervention Period | P Value | Extension Period | P Value | |
---|---|---|---|---|---|
| |||||
Length of stay | |||||
Hospitalists | |||||
Telemetry beds | 2.75 | 2.13 | 0.005 | 1.93 | 0.09 |
Nontelemetry beds | 2.84 | 2.72 | 0.324 | 2.44 | 0.21 |
Nonhospitalists | |||||
Telemetry beds | 2.75 | 2.46 | 0.331 | 2.22 | 0.43 |
Nontelemetry beds | 2.64 | 2.89 | 0.261 | 2.26 | 0.05 |
Case mix index | |||||
Hospitalists | 1.44 | 1.45 | 0.68 | 1.40 | 0.21 |
Nonhospitalists | 1.46 | 1.40 | 0.53 | 1.53 | 0.18 |
Costs of hospital stay were also reduced in the multipronged, hospitalist‐driven intervention group. Expenditures for telemetry beds were reduced by 22.5% over the intervention period for hospitalists (Table 2).
Baseline to Intervention Period | Intervention to Extension Period | |
---|---|---|
| ||
Hospitalists | ||
Telemetry beds | 22.55% | 9.55% |
Nontelemetry beds | 4.23% | 10.14% |
Nonhospitalists | ||
Telemetry beds | 10.55% | 9.89% |
Nontelemetry beds | 9.47% | 21.84% |
The mean CMI of the patient cohort managed by the hospitalists in the baseline and intervention periods was not significantly different (1.44 vs 1.45, P=0.68). The mean CMI of the patients managed by the nonhospitalists in the baseline and intervention periods was also not significantly different (1.46 vs 1.40, P=0.53) (Table 1). Mortality index during the baseline and intervention periods was not significantly different (0.770.22 vs 0.660.23, P=0.54), as during the intervention and extension periods (0.660.23 vs 0.650.15, P=0.95).
Intervention Period (January 2013August 2013) Versus Extension Period (September 2014‐March 2015)
The decreased telemetry LOS for hospitalists was sustained from the intervention period to the extension period, from 2.13 to 1.93 (P=0.09). There was no significant change in the nontelemetry LOS in the intervention period compared to the extension period (2.72 vs 2.44, P=0.21). There was no change in the telemetry LOS for nonhospitalists from the intervention period to the extension period (2.46 vs 2.22, P=0.43).
The mean CMI in the hospitalist group was not significantly different in the intervention period compared to the extension period (1.45 to 1.40, P=0.21). The mean CMI in the nonhospitalist group did not change from the intervention period to the extension period (1.40 vs 1.53, P=0.18) (Table 1).
Education Outcomes
Out of the 56 participants completing the education module and survey, 28.6% were medical students, 53.6% were interns, 12.5% were second‐year residents, and 5.4% were third‐year residents. Several findings were seen at baseline via pretest. In evaluating patterns of current telemetry use, 32.2% of participants reported evaluating the necessity of telemetry for patients on admission only, 26.3% during transitions of care, 5.1% after discharge plans were cemented, 33.1% on a daily basis, and 3.4% rarely. When asked which member of the care team was most likely to encourage use of appropriate telemetry, 20.8% identified another resident, 13.9% nursing, 37.5% attending physician, 20.8% self, 4.2% the team as a whole, and 2.8% as not any.
Figure 1 shows premodule results regarding the trainees perceived percentage of patient encounters during which a participant's team discussed their patient's need for telemetry.

In assessing perception of current telemetry utilization, 1.8% of participants thought 0% to 10% of patients were currently on telemetry, 19.6% thought 11% to 20%, 42.9% thought 21% to 31%, 30.4% thought 31% to 40%, and 3.6% thought 41% to 50%.
Two areas were assessed at both baseline and after the intervention: knowledge of indications of telemetry use and cost related to telemetry use. We saw increased awareness of cost‐saving actions. To assess current knowledge of the indications of proper telemetry use according to American Heart Association guidelines, participants were presented with a list of 5 patients with different clinical indications for telemetry use and asked which patient required telemetry the most. Of the participants, 54.5% identified the correct answer in the pretest and 61.8% identified the correct answer in the post‐test. To assess knowledge of the costs of telemetry relative to other patient care, participants were presented with a patient case and asked to identify the most and least cost‐saving actions to safely care for the patient. When asked to identify the most cost‐saving action, 20.3% identified the correct answer in the pretest and 61.0% identified the correct answer in the post‐test. Of those who answered incorrectly in the pretest, 51.1% answered correctly in the post‐test (P=0.002). When asked to identify the least cost‐saving action, 23.7% identified the correct answer in the pretest and 50.9% identified the correct answer in the posttest. Of those who answered incorrectly in the pretest, 60.0% answered correctly in the post‐test (P=0.003).
In the post‐test, when asked about the importance of appropriate telemetry usage in providing cost‐conscious care and assuring appropriate hospital resource management, 76.8% of participants found the need very important, 21.4% somewhat important, and 1.8% as not applicable. The most commonly perceived barriers impeding discontinuation of telemetry, as reported by participants via post‐test, were nursing desires and time. Figure 2 shows all perceived barriers.

DISCUSSION
Our study is one of the first to our knowledge to demonstrate reductions in telemetry LOS by a hospitalist intervention for telemetry utilization. Others[10, 11] have studied the impact of an orientation handout by chief residents or a multispecialty telemetry policy with enforcement by an outside cardiologist and nurse team. Dressler et al. later sustained a 70% reduction in telemetry use without adversely affecting patient safety, as assessed through numbers of rapid response activations, codes, and deaths, through integrating the AHA guidelines into their electronic ordering system.[12] However, our study has the advantage of the primary team, who knows the patient and clinical scenario best, driving the change during attending rounds. In an era where cost consciousness intersects the practice of medicine, any intervention in patient care that demonstrates cost savings without an adverse impact on patient care and resource utilization must be emphasized. This is particularly important in academic institutions, where residents and medical students are learning to integrate the principles of patient safety and quality improvement into their clinical practice.[13] We actually showed sustained telemetry LOS reductions into the extension period after our intervention. We believe this may be due to telemetry triage being integrated into our attending and resident rounding practices. Future work should include integration of telemetry triage into clinical decision support in the electronic medical record and multidisciplinary rounds to disseminate telemetry triage hospital‐wide in both the academic and community settings.
Our study also revealed that nearly half of participants were not aware of the criteria for appropriate utilization of telemetry before our intervention; in the preintervention period, there were many anecdotal and objective findings of inappropriate utilization of telemetry as well as prolonged continuation beyond the clinical needs in both the hospitalist and nonhospitalist group. For the hospitalist group (ie, the group receiving guideline‐based education on appropriate indications for telemetry utilization), there was an assessment of both appropriate usage and timely discontinuation of telemetry in the postintervention period, which we attribute in large part to adherence to the education provided to this group.
We were able to show increased knowledge of cost‐saving actions among trainees with our educational module. We believe it is imperative to educate our providers (physicians, nurses, case managers, and students within these disciplines) on the appropriate indications for telemetry use, not only to help with cost savings and resource availability (ie, allowing telemetry beds to be available for patients who need them most), but also to instill consistent expectations among our patients. For the hospitalist group (ie, the group receiving guideline‐based education on appropriate indications for telemetry utilization), there was an assessment of both appropriate usage and timely discontinuation of telemetry in the postintervention period, which we attribute in large part to adherence to the education provided to this group.
Additionally, we feel it is important to consider the impacts of inappropriate use of telemetry from a patient's perspective: it is physically restrictive/emnconvenient, alarms are disruptive, it can be a barrier for other treatments such as physical therapy, it may increase the time it takes for imaging studies, a nurse may be required to accompany patients on telemetry, and poses additional costs to their medical bill.
We believe our success is due to several strategies. First, at the start of the fiscal year when quality improvement metrics are established, this particular metric (improving the appropriate utilization and timely discontinuation of telemetry) was deemed important by all hospitalists, engendering group buy‐in prior to the intervention. Our hospitalists received a detailed and interactive tutorial session in person at the beginning of the study. This tutorial provided the hospitalists with a comprehensive understanding of the appropriate (and inappropriate) indications for telemetry monitoring, hence facilitating guideline‐directed utilization. Email reminders and the tutorial tool were provided each time a hospitalist attended on the wards, and hospitalists received a small financial incentive to comply with appropriate telemetry utilization.
Our study has several strengths. First, the time frame of our study was long enough (8 months) to allow consistent trends to emerge and to optimize exposure of housestaff and medical students to this quality‐improvement initiative. Second, our cost savings came from 2 factors, direct reduction of inappropriate telemetry use and reduction in length of stay, highlighting the dual impact of appropriate telemetry utilization on cost. The overall reductions in telemetry utilization for the intervention group were a result of both reductions in initial placement on telemetry for patients who did not meet criteria for such monitoring as well as timely discontinuation of telemetry during the patient's hospitalization. Third, our study demonstrates that physicians can be effective in driving appropriate telemetry usage by participating in the clinical decision making regarding necessity and educating providers, trainees/students, and patients on appropriate indications. Finally, we show sustainment of our intervention in the extension period, suggesting telemetry triage integration into rounding practice.
Our study has limitations as well. First, our sample size is relatively small at a single academic center. Second, due to complexities in our faculty scheduling, we were unable to completely randomize patients to a hospitalist versus nonhospitalist team. However, we believe that despite the inability to randomize, our study does show the benefit of a hospitalist attending to reduce telemetry LOS given there was no change in nonhospitalist telemetry LOS despite all of the other hospital‐wide interventions (multidisciplinary rounds, similar housestaff). Third, our study was limited in that the CMI was used as a proxy for patient complexity, and the mortality index was used as the overall marker of safety. Further studies should monitor frequency and outcomes of arrhythmic events of patients transferred from telemetry monitoring to medicalsurgical beds. Finally, as the intervention was multipronged, we are unable to determine which component led to the reductions in telemetry utilization. Each component, however, remains easily transferrable to outside institutions. We demonstrated both a reduction in initiation of telemetry as well as timely discontinuation; however, due to the complexity in capturing this accurately, we were unable to numerically quantify these individual outcomes.
Additionally, there were approximately 10 nonhospitalist attendings who also staffed the wards during the intervention time period of our study; these attendings did not undergo the telemetry tutorial/orientation. This difference, along with the Hawthorne effect for the hospitalist attendings, also likely contributed to the difference in outcomes between the 2 attending cohorts in the intervention period.
CONCLUSIONS
Our results demonstrate that a multipronged hospitalist‐driven intervention to improve appropriate use of telemetry reduces telemetry LOS and cost. Hence, we believe that targeted, education‐driven interventions with monitoring of progress can have demonstrable impacts on changing practice. Physicians will need to make trade‐offs in clinical practice to balance efficient resource utilization with the patient's evolving condition in the inpatient setting, the complexities of clinical workflow, and the patient's expectations.[14] Appropriate telemetry utilization is a prime example of what needs to be done well in the future for high‐value care.
Acknowledgements
The authors acknowledge the hospitalists who participated in the intervention: Jeffrey Chi, Willliam Daines, Sumbul Desai, Poonam Hosamani, John Kugler, Charles Liao, Errol Ozdalga, and Sang Hoon Woo. The authors also acknowledge Joan Hendershott in the Finance Department and Joseph Hopkins in the Quality Department.
Disclosures: All coauthors have seen and agree with the contents of the article; submission (aside from abstracts) was not under review by any other publication. The authors report no disclosures of financial support from, or equity positions in, manufacturers of drugs or products mentioned in the article.
- 2009. Statistical brief 355. 2012. Agency for Healthcare Research and Quality, Rockville, MD. , National health care expenses in the U.S. civilian noninstitutionalized population,
- Costs for hospital stays in the United States, 2010. Statistical brief 146. 2013. Agency for Healthcare Research and Quality, Rockville, MD. , ,
- Telemetry outside critical care units: patterns of utilization and influence on management decisions. Clin Cardiol. 1998;21(7):503–505. , ,
- Evaluation of telemetry utilization, policy, and outcomes in an inner‐city academic medical center. J Natl Med Assoc. 2010;102(7):598–604. , , , et al.
- Recommended guidelines for in‐hospital cardiac monitoring of adults for detection of arrhythmia. Emergency Cardiac Care Committee members. J Am Coll Cardiol. 1991;18(6):1431–1433. , ,
- Practice standards for electrocardiographic monitoring in hospital settings: an American Heart Association scientific statement from the Councils on Cardiovascular Nursing, Clinical Cardiology, and Cardiovascular Disease in the Young: endorsed by the International Society of Computerized Electrocardiology and the American Association of Critical‐Care Nurses. Circulation. 2004;110(17):2721–2746. , , , et al.
- Is telemetry overused? Is it as helpful as thought? Cleve Clin J Med. 2009;76(6):368–372. , , , , ,
- Society of Hospital Medicine. Adult Hospital Medicine. Five things physicians and patients should question. Available at: http://www.choosingwisely.org/societies/society‐of‐hospital‐medicine‐adult. Published February 21, 2013. Accessed October 5, 2014.
- Joint Commission on Accreditation of Healthcare Organizations. The Joint Commission announces 2014 national patient safety goal. Jt Comm Perspect. 2013;33(7):1–4.
- Optimizing telemetry utilization in an academic medical center. J Clin Outcomes Manage. 2008;15(9):435–440. , , , ,
- Improving utilization of telemetry in a university hospital. J Clin Outcomes Manage. 2005;12(10):519–522. ,
- Altering overuse of cardiac telemetry in non‐intensive care unit settings by hardwiring the use of American Heart Association guidelines. JAMA Intern Med. 2014;174:1852–1854. , , , ,
- "Innovation" institutes in academic health centers: enhancing value through leadership, education, engagement, and scholarship. Acad Med. 2014;89(9):1204–1206. , ,
- Controlling health costs: physician responses to patient expectations for medical care. J Gen Intern Med. 2014;29(9):1234–1241. , , , , ,
Inpatient hospital services are a major component of total US civilian noninstitutionalized healthcare expenses, accounting for 29.3% of spending in 2009[1] when the average cost per stay was $9700.[2] Telemetry monitoring, a widely used resource for the identification of life‐threatening arrhythmias, contributes to these costs. In 1998, Sivaram et al. estimated the cost per patient at $683; in 2010, Ivonye et al. published the cost difference between a telemetry bed and a nonmonitored bed in their inner‐city public teaching facility reached $800.[3, 4]
In 1991, the American College of Cardiology published guidelines for telemetry use, which were later revised by the American Heart Association in 2004.[5, 6] Notably, the guidelines are based on expert opinion and on research data in electrocardiography.[7] The guidelines divide patients into 3 classes based on clinical condition: recommending telemetry monitoring for almost all class I patients, stating possible benefit in class II patients, and discouraging cardiac monitoring for the low‐risk class III patients.[5, 6] The Choosing Wisely campaign, an initiative of the American Board of Internal Medicine and the Society of Hospital Medicine, highlights telemetry monitoring as 1 of the top 5 interventions that physicians and patients should question when determining tests and procedures.[8] Choosing Wisely suggests using a protocol to govern continuation of telemetry outside of the intensive care unit (ICU), as inappropriate monitoring increases care costs and may result in patient harm.[8] The Joint Commission 2014 National Patient Safety Goals notes that numerous alarm signals and the resulting noise and displayed information tends to desensitize staff and cause them to miss or ignore alarm signals or even disable them.[9]
Few studies have examined implementation methods for improved telemetry bed utilization. One study evaluated the impact of a multispecialty telemetry policy with enforcement by an outside cardiologist and nurse team, noting improved cardiac monitoring bed utilization and decreased academic hospital closure, which previously resulted in inability to accept new patients or procedure cancellation.[10] Another study provided an orientation handout discussed by the chief resident and telemetry indication reviews during multidisciplinary rounds 3 times a week.[11]
Our study is one the first to demonstrate a model for a hospitalist‐led approach to guide appropriate telemetry use. We investigated the impact of a multipronged approach to guide telemetry usage: (1) a hospitalist‐led, daily review of bed utilization during attending rounds, (2) a hospitalist attending‐driven, trainee‐focused education module on telemetry utilization, (3) quarterly feedback on telemetry bed utilization rates, and (4) financial incentives. We analyzed pre‐ and post‐evaluation results from the education module to measure impact on knowledge, skills, and attitudes. Additionally, we evaluated the effect of the intervention on length of stay (LOS) and bed utilization costs, while monitoring case mix index (CMI) and overall mortality.
METHODS
Setting
This study took place at Stanford Hospital and Clinics, a teaching academic center in Stanford, California. Stanford Hospital is a 444‐bed, urban medical center with 114 telemetry intermediate ICU beds, and 66 ICU beds. The 264 medicalsurgical beds lack telemetry monitoring, which can only be completed in the intermediate and full ICU. All patients on telemetry units receive both cardiac monitoring and increased nursing ratios. Transfer orders are placed in the electronic medical record to shift patients between care levels. Bed control attempts to transfer patients as soon as an open bed in the appropriate care level exists.
The study included all 5 housestaff inpatient general internal medicine wards teams (which excludes cardiology, pulmonary hypertension, hematology, oncology, and post‐transplant patients). Hospitalists and nonhospitalists attend on the wards for 1‐ to 2‐week blocks. Teaching teams are staffed by 1 to 2 medical students, 2 interns, 1 resident, and 1 attending. The university institutional review board notice of determination waived review for this study because it was classified as quality improvement.
Participants
Ten full‐ and part‐time hospitalist physicians participated in the standardized telemetry teaching. Fifty‐six of the approximately 80 medical students and housestaff on hospitalists' teams completed the educational evaluation. Both hospitalist and nonhospitalist teams participated in daily multidisciplinary rounds, focusing on barriers to discharge including telemetry use. Twelve nonhospitalists served on the wards during the intervention period. Hospitalists covered 72% of the internal medicine wards during the intervention period.
Study Design
We investigated the impact of a multipronged approach to guide telemetry usage from January 2013 to August 2013 (intervention period).
Hospitalist‐Led Daily Review of Bed Utilization
Hospitalists were encouraged to discuss the need of telemetry on daily attending rounds and review indications for telemetry while on service. Prior to starting a ward block, attendings were emailed the teaching module with a reminder to discuss the need for telemetry on attending rounds. Reminders to discuss telemetry utilization were also provided during every‐other‐week hospitalist meetings. Compliance of daily discussion was not tracked.
Hospitalist‐Driven, Trainee‐Focused, Education Module on Telemetry Utilization
The educational module was taught during teaching sessions only by the hospitalists. Trainees on nonhospitalist teams did not receive dedicated teaching about telemetry usage. The module was given to learners only once. The module was a 10‐slide, Microsoft PowerPoint (Microsoft Corp., Redmond, WA) presentation that reviewed the history of telemetry, the American College of Cardiology and the American Heart Association guidelines, the cost difference between telemetry and nonmonitored beds, and the perceived barriers to discontinuation. The presentation was accompanied by a pre‐ and post‐evaluation to elicit knowledge, skills, and attitudes of telemetry use (see Supporting Information, Appendix A, in the online version of this article). The pre‐ and post‐evaluations were created through consensus with a multidisciplinary, expert panel after reviewing the evidence‐based literature.
Quarterly Feedback on Telemetry Bed Utilization Rates
Hospital beduse and CMI data were obtained from the Stanford finance department for the intervention period and for the baseline period, which was the year prior to the study, January 1, 2012 to December 31, 2012. Hospital beduse data included the number of days patients were on telemetry units versus medicalsurgical units (nontelemetry units), differentiated by hospitalists and nonhospitalists. Cost savings were calculated by the Stanford finance department that used Stanford‐specific, internal cost accounting data to determine the impact of the intervention. These data were reviewed at hospitalist meetings on a quarterly basis. We also obtained the University Healthsystem Consortium mortality index (observed to expected) for the general internal medicine service during the baseline and intervention periods.
To measure sustainment of telemetry reduction in the postintervention period, we measured telemetry LOS from September 2014 to March 2015 (extension period).
Financial Incentives
Hospitalists were provided a $2000 bonus at the end of fiscal year 2013 if the group showed a decrease in telemetry bed use in comparison to the baseline period.
Statistical Analysis of Clinical Outcome Measures
Continuous outcomes were tested using 2‐tailed t tests. Comparison of continuous outcome included differences in telemetry and nontelemetry LOS and CMI. Pairwise comparisons were made for various time periods. A P value of <0.05 was considered statistically significant. Statistical analyses were performed using Stata 12.0 software (StataCorp, College Station, TX).
RESULTS
Clinical and Value Outcomes
Baseline (January 2012December 2012) Versus Intervention Period (January 2013August 2013)
LOS for telemetry beds was significantly reduced over the intervention period (2.75 days vs 2.13 days, P=0.005) for hospitalists. Notably, there was no significant difference in mean LOS between baseline and intervention periods for nontelemetry beds (2.84 days vs 2.72 days, P=0.32) for hospitalists. In comparison, for nonhospitalists, there was no difference in mean LOS for telemetry beds between baseline and intervention periods (2.75 days vs 2.46 days, P=0.33) and nontelemetry beds (2.64 days vs 2.89 days, P=0.26) (Table 1).
Baseline Period | Intervention Period | P Value | Extension Period | P Value | |
---|---|---|---|---|---|
| |||||
Length of stay | |||||
Hospitalists | |||||
Telemetry beds | 2.75 | 2.13 | 0.005 | 1.93 | 0.09 |
Nontelemetry beds | 2.84 | 2.72 | 0.324 | 2.44 | 0.21 |
Nonhospitalists | |||||
Telemetry beds | 2.75 | 2.46 | 0.331 | 2.22 | 0.43 |
Nontelemetry beds | 2.64 | 2.89 | 0.261 | 2.26 | 0.05 |
Case mix index | |||||
Hospitalists | 1.44 | 1.45 | 0.68 | 1.40 | 0.21 |
Nonhospitalists | 1.46 | 1.40 | 0.53 | 1.53 | 0.18 |
Costs of hospital stay were also reduced in the multipronged, hospitalist‐driven intervention group. Expenditures for telemetry beds were reduced by 22.5% over the intervention period for hospitalists (Table 2).
Baseline to Intervention Period | Intervention to Extension Period | |
---|---|---|
| ||
Hospitalists | ||
Telemetry beds | 22.55% | 9.55% |
Nontelemetry beds | 4.23% | 10.14% |
Nonhospitalists | ||
Telemetry beds | 10.55% | 9.89% |
Nontelemetry beds | 9.47% | 21.84% |
The mean CMI of the patient cohort managed by the hospitalists in the baseline and intervention periods was not significantly different (1.44 vs 1.45, P=0.68). The mean CMI of the patients managed by the nonhospitalists in the baseline and intervention periods was also not significantly different (1.46 vs 1.40, P=0.53) (Table 1). Mortality index during the baseline and intervention periods was not significantly different (0.770.22 vs 0.660.23, P=0.54), as during the intervention and extension periods (0.660.23 vs 0.650.15, P=0.95).
Intervention Period (January 2013August 2013) Versus Extension Period (September 2014‐March 2015)
The decreased telemetry LOS for hospitalists was sustained from the intervention period to the extension period, from 2.13 to 1.93 (P=0.09). There was no significant change in the nontelemetry LOS in the intervention period compared to the extension period (2.72 vs 2.44, P=0.21). There was no change in the telemetry LOS for nonhospitalists from the intervention period to the extension period (2.46 vs 2.22, P=0.43).
The mean CMI in the hospitalist group was not significantly different in the intervention period compared to the extension period (1.45 to 1.40, P=0.21). The mean CMI in the nonhospitalist group did not change from the intervention period to the extension period (1.40 vs 1.53, P=0.18) (Table 1).
Education Outcomes
Out of the 56 participants completing the education module and survey, 28.6% were medical students, 53.6% were interns, 12.5% were second‐year residents, and 5.4% were third‐year residents. Several findings were seen at baseline via pretest. In evaluating patterns of current telemetry use, 32.2% of participants reported evaluating the necessity of telemetry for patients on admission only, 26.3% during transitions of care, 5.1% after discharge plans were cemented, 33.1% on a daily basis, and 3.4% rarely. When asked which member of the care team was most likely to encourage use of appropriate telemetry, 20.8% identified another resident, 13.9% nursing, 37.5% attending physician, 20.8% self, 4.2% the team as a whole, and 2.8% as not any.
Figure 1 shows premodule results regarding the trainees perceived percentage of patient encounters during which a participant's team discussed their patient's need for telemetry.

In assessing perception of current telemetry utilization, 1.8% of participants thought 0% to 10% of patients were currently on telemetry, 19.6% thought 11% to 20%, 42.9% thought 21% to 31%, 30.4% thought 31% to 40%, and 3.6% thought 41% to 50%.
Two areas were assessed at both baseline and after the intervention: knowledge of indications of telemetry use and cost related to telemetry use. We saw increased awareness of cost‐saving actions. To assess current knowledge of the indications of proper telemetry use according to American Heart Association guidelines, participants were presented with a list of 5 patients with different clinical indications for telemetry use and asked which patient required telemetry the most. Of the participants, 54.5% identified the correct answer in the pretest and 61.8% identified the correct answer in the post‐test. To assess knowledge of the costs of telemetry relative to other patient care, participants were presented with a patient case and asked to identify the most and least cost‐saving actions to safely care for the patient. When asked to identify the most cost‐saving action, 20.3% identified the correct answer in the pretest and 61.0% identified the correct answer in the post‐test. Of those who answered incorrectly in the pretest, 51.1% answered correctly in the post‐test (P=0.002). When asked to identify the least cost‐saving action, 23.7% identified the correct answer in the pretest and 50.9% identified the correct answer in the posttest. Of those who answered incorrectly in the pretest, 60.0% answered correctly in the post‐test (P=0.003).
In the post‐test, when asked about the importance of appropriate telemetry usage in providing cost‐conscious care and assuring appropriate hospital resource management, 76.8% of participants found the need very important, 21.4% somewhat important, and 1.8% as not applicable. The most commonly perceived barriers impeding discontinuation of telemetry, as reported by participants via post‐test, were nursing desires and time. Figure 2 shows all perceived barriers.

DISCUSSION
Our study is one of the first to our knowledge to demonstrate reductions in telemetry LOS by a hospitalist intervention for telemetry utilization. Others[10, 11] have studied the impact of an orientation handout by chief residents or a multispecialty telemetry policy with enforcement by an outside cardiologist and nurse team. Dressler et al. later sustained a 70% reduction in telemetry use without adversely affecting patient safety, as assessed through numbers of rapid response activations, codes, and deaths, through integrating the AHA guidelines into their electronic ordering system.[12] However, our study has the advantage of the primary team, who knows the patient and clinical scenario best, driving the change during attending rounds. In an era where cost consciousness intersects the practice of medicine, any intervention in patient care that demonstrates cost savings without an adverse impact on patient care and resource utilization must be emphasized. This is particularly important in academic institutions, where residents and medical students are learning to integrate the principles of patient safety and quality improvement into their clinical practice.[13] We actually showed sustained telemetry LOS reductions into the extension period after our intervention. We believe this may be due to telemetry triage being integrated into our attending and resident rounding practices. Future work should include integration of telemetry triage into clinical decision support in the electronic medical record and multidisciplinary rounds to disseminate telemetry triage hospital‐wide in both the academic and community settings.
Our study also revealed that nearly half of participants were not aware of the criteria for appropriate utilization of telemetry before our intervention; in the preintervention period, there were many anecdotal and objective findings of inappropriate utilization of telemetry as well as prolonged continuation beyond the clinical needs in both the hospitalist and nonhospitalist group. For the hospitalist group (ie, the group receiving guideline‐based education on appropriate indications for telemetry utilization), there was an assessment of both appropriate usage and timely discontinuation of telemetry in the postintervention period, which we attribute in large part to adherence to the education provided to this group.
We were able to show increased knowledge of cost‐saving actions among trainees with our educational module. We believe it is imperative to educate our providers (physicians, nurses, case managers, and students within these disciplines) on the appropriate indications for telemetry use, not only to help with cost savings and resource availability (ie, allowing telemetry beds to be available for patients who need them most), but also to instill consistent expectations among our patients. For the hospitalist group (ie, the group receiving guideline‐based education on appropriate indications for telemetry utilization), there was an assessment of both appropriate usage and timely discontinuation of telemetry in the postintervention period, which we attribute in large part to adherence to the education provided to this group.
Additionally, we feel it is important to consider the impacts of inappropriate use of telemetry from a patient's perspective: it is physically restrictive/emnconvenient, alarms are disruptive, it can be a barrier for other treatments such as physical therapy, it may increase the time it takes for imaging studies, a nurse may be required to accompany patients on telemetry, and poses additional costs to their medical bill.
We believe our success is due to several strategies. First, at the start of the fiscal year when quality improvement metrics are established, this particular metric (improving the appropriate utilization and timely discontinuation of telemetry) was deemed important by all hospitalists, engendering group buy‐in prior to the intervention. Our hospitalists received a detailed and interactive tutorial session in person at the beginning of the study. This tutorial provided the hospitalists with a comprehensive understanding of the appropriate (and inappropriate) indications for telemetry monitoring, hence facilitating guideline‐directed utilization. Email reminders and the tutorial tool were provided each time a hospitalist attended on the wards, and hospitalists received a small financial incentive to comply with appropriate telemetry utilization.
Our study has several strengths. First, the time frame of our study was long enough (8 months) to allow consistent trends to emerge and to optimize exposure of housestaff and medical students to this quality‐improvement initiative. Second, our cost savings came from 2 factors, direct reduction of inappropriate telemetry use and reduction in length of stay, highlighting the dual impact of appropriate telemetry utilization on cost. The overall reductions in telemetry utilization for the intervention group were a result of both reductions in initial placement on telemetry for patients who did not meet criteria for such monitoring as well as timely discontinuation of telemetry during the patient's hospitalization. Third, our study demonstrates that physicians can be effective in driving appropriate telemetry usage by participating in the clinical decision making regarding necessity and educating providers, trainees/students, and patients on appropriate indications. Finally, we show sustainment of our intervention in the extension period, suggesting telemetry triage integration into rounding practice.
Our study has limitations as well. First, our sample size is relatively small at a single academic center. Second, due to complexities in our faculty scheduling, we were unable to completely randomize patients to a hospitalist versus nonhospitalist team. However, we believe that despite the inability to randomize, our study does show the benefit of a hospitalist attending to reduce telemetry LOS given there was no change in nonhospitalist telemetry LOS despite all of the other hospital‐wide interventions (multidisciplinary rounds, similar housestaff). Third, our study was limited in that the CMI was used as a proxy for patient complexity, and the mortality index was used as the overall marker of safety. Further studies should monitor frequency and outcomes of arrhythmic events of patients transferred from telemetry monitoring to medicalsurgical beds. Finally, as the intervention was multipronged, we are unable to determine which component led to the reductions in telemetry utilization. Each component, however, remains easily transferrable to outside institutions. We demonstrated both a reduction in initiation of telemetry as well as timely discontinuation; however, due to the complexity in capturing this accurately, we were unable to numerically quantify these individual outcomes.
Additionally, there were approximately 10 nonhospitalist attendings who also staffed the wards during the intervention time period of our study; these attendings did not undergo the telemetry tutorial/orientation. This difference, along with the Hawthorne effect for the hospitalist attendings, also likely contributed to the difference in outcomes between the 2 attending cohorts in the intervention period.
CONCLUSIONS
Our results demonstrate that a multipronged hospitalist‐driven intervention to improve appropriate use of telemetry reduces telemetry LOS and cost. Hence, we believe that targeted, education‐driven interventions with monitoring of progress can have demonstrable impacts on changing practice. Physicians will need to make trade‐offs in clinical practice to balance efficient resource utilization with the patient's evolving condition in the inpatient setting, the complexities of clinical workflow, and the patient's expectations.[14] Appropriate telemetry utilization is a prime example of what needs to be done well in the future for high‐value care.
Acknowledgements
The authors acknowledge the hospitalists who participated in the intervention: Jeffrey Chi, Willliam Daines, Sumbul Desai, Poonam Hosamani, John Kugler, Charles Liao, Errol Ozdalga, and Sang Hoon Woo. The authors also acknowledge Joan Hendershott in the Finance Department and Joseph Hopkins in the Quality Department.
Disclosures: All coauthors have seen and agree with the contents of the article; submission (aside from abstracts) was not under review by any other publication. The authors report no disclosures of financial support from, or equity positions in, manufacturers of drugs or products mentioned in the article.
Inpatient hospital services are a major component of total US civilian noninstitutionalized healthcare expenses, accounting for 29.3% of spending in 2009[1] when the average cost per stay was $9700.[2] Telemetry monitoring, a widely used resource for the identification of life‐threatening arrhythmias, contributes to these costs. In 1998, Sivaram et al. estimated the cost per patient at $683; in 2010, Ivonye et al. published the cost difference between a telemetry bed and a nonmonitored bed in their inner‐city public teaching facility reached $800.[3, 4]
In 1991, the American College of Cardiology published guidelines for telemetry use, which were later revised by the American Heart Association in 2004.[5, 6] Notably, the guidelines are based on expert opinion and on research data in electrocardiography.[7] The guidelines divide patients into 3 classes based on clinical condition: recommending telemetry monitoring for almost all class I patients, stating possible benefit in class II patients, and discouraging cardiac monitoring for the low‐risk class III patients.[5, 6] The Choosing Wisely campaign, an initiative of the American Board of Internal Medicine and the Society of Hospital Medicine, highlights telemetry monitoring as 1 of the top 5 interventions that physicians and patients should question when determining tests and procedures.[8] Choosing Wisely suggests using a protocol to govern continuation of telemetry outside of the intensive care unit (ICU), as inappropriate monitoring increases care costs and may result in patient harm.[8] The Joint Commission 2014 National Patient Safety Goals notes that numerous alarm signals and the resulting noise and displayed information tends to desensitize staff and cause them to miss or ignore alarm signals or even disable them.[9]
Few studies have examined implementation methods for improved telemetry bed utilization. One study evaluated the impact of a multispecialty telemetry policy with enforcement by an outside cardiologist and nurse team, noting improved cardiac monitoring bed utilization and decreased academic hospital closure, which previously resulted in inability to accept new patients or procedure cancellation.[10] Another study provided an orientation handout discussed by the chief resident and telemetry indication reviews during multidisciplinary rounds 3 times a week.[11]
Our study is one the first to demonstrate a model for a hospitalist‐led approach to guide appropriate telemetry use. We investigated the impact of a multipronged approach to guide telemetry usage: (1) a hospitalist‐led, daily review of bed utilization during attending rounds, (2) a hospitalist attending‐driven, trainee‐focused education module on telemetry utilization, (3) quarterly feedback on telemetry bed utilization rates, and (4) financial incentives. We analyzed pre‐ and post‐evaluation results from the education module to measure impact on knowledge, skills, and attitudes. Additionally, we evaluated the effect of the intervention on length of stay (LOS) and bed utilization costs, while monitoring case mix index (CMI) and overall mortality.
METHODS
Setting
This study took place at Stanford Hospital and Clinics, a teaching academic center in Stanford, California. Stanford Hospital is a 444‐bed, urban medical center with 114 telemetry intermediate ICU beds, and 66 ICU beds. The 264 medicalsurgical beds lack telemetry monitoring, which can only be completed in the intermediate and full ICU. All patients on telemetry units receive both cardiac monitoring and increased nursing ratios. Transfer orders are placed in the electronic medical record to shift patients between care levels. Bed control attempts to transfer patients as soon as an open bed in the appropriate care level exists.
The study included all 5 housestaff inpatient general internal medicine wards teams (which excludes cardiology, pulmonary hypertension, hematology, oncology, and post‐transplant patients). Hospitalists and nonhospitalists attend on the wards for 1‐ to 2‐week blocks. Teaching teams are staffed by 1 to 2 medical students, 2 interns, 1 resident, and 1 attending. The university institutional review board notice of determination waived review for this study because it was classified as quality improvement.
Participants
Ten full‐ and part‐time hospitalist physicians participated in the standardized telemetry teaching. Fifty‐six of the approximately 80 medical students and housestaff on hospitalists' teams completed the educational evaluation. Both hospitalist and nonhospitalist teams participated in daily multidisciplinary rounds, focusing on barriers to discharge including telemetry use. Twelve nonhospitalists served on the wards during the intervention period. Hospitalists covered 72% of the internal medicine wards during the intervention period.
Study Design
We investigated the impact of a multipronged approach to guide telemetry usage from January 2013 to August 2013 (intervention period).
Hospitalist‐Led Daily Review of Bed Utilization
Hospitalists were encouraged to discuss the need of telemetry on daily attending rounds and review indications for telemetry while on service. Prior to starting a ward block, attendings were emailed the teaching module with a reminder to discuss the need for telemetry on attending rounds. Reminders to discuss telemetry utilization were also provided during every‐other‐week hospitalist meetings. Compliance of daily discussion was not tracked.
Hospitalist‐Driven, Trainee‐Focused, Education Module on Telemetry Utilization
The educational module was taught during teaching sessions only by the hospitalists. Trainees on nonhospitalist teams did not receive dedicated teaching about telemetry usage. The module was given to learners only once. The module was a 10‐slide, Microsoft PowerPoint (Microsoft Corp., Redmond, WA) presentation that reviewed the history of telemetry, the American College of Cardiology and the American Heart Association guidelines, the cost difference between telemetry and nonmonitored beds, and the perceived barriers to discontinuation. The presentation was accompanied by a pre‐ and post‐evaluation to elicit knowledge, skills, and attitudes of telemetry use (see Supporting Information, Appendix A, in the online version of this article). The pre‐ and post‐evaluations were created through consensus with a multidisciplinary, expert panel after reviewing the evidence‐based literature.
Quarterly Feedback on Telemetry Bed Utilization Rates
Hospital beduse and CMI data were obtained from the Stanford finance department for the intervention period and for the baseline period, which was the year prior to the study, January 1, 2012 to December 31, 2012. Hospital beduse data included the number of days patients were on telemetry units versus medicalsurgical units (nontelemetry units), differentiated by hospitalists and nonhospitalists. Cost savings were calculated by the Stanford finance department that used Stanford‐specific, internal cost accounting data to determine the impact of the intervention. These data were reviewed at hospitalist meetings on a quarterly basis. We also obtained the University Healthsystem Consortium mortality index (observed to expected) for the general internal medicine service during the baseline and intervention periods.
To measure sustainment of telemetry reduction in the postintervention period, we measured telemetry LOS from September 2014 to March 2015 (extension period).
Financial Incentives
Hospitalists were provided a $2000 bonus at the end of fiscal year 2013 if the group showed a decrease in telemetry bed use in comparison to the baseline period.
Statistical Analysis of Clinical Outcome Measures
Continuous outcomes were tested using 2‐tailed t tests. Comparison of continuous outcome included differences in telemetry and nontelemetry LOS and CMI. Pairwise comparisons were made for various time periods. A P value of <0.05 was considered statistically significant. Statistical analyses were performed using Stata 12.0 software (StataCorp, College Station, TX).
RESULTS
Clinical and Value Outcomes
Baseline (January 2012December 2012) Versus Intervention Period (January 2013August 2013)
LOS for telemetry beds was significantly reduced over the intervention period (2.75 days vs 2.13 days, P=0.005) for hospitalists. Notably, there was no significant difference in mean LOS between baseline and intervention periods for nontelemetry beds (2.84 days vs 2.72 days, P=0.32) for hospitalists. In comparison, for nonhospitalists, there was no difference in mean LOS for telemetry beds between baseline and intervention periods (2.75 days vs 2.46 days, P=0.33) and nontelemetry beds (2.64 days vs 2.89 days, P=0.26) (Table 1).
Baseline Period | Intervention Period | P Value | Extension Period | P Value | |
---|---|---|---|---|---|
| |||||
Length of stay | |||||
Hospitalists | |||||
Telemetry beds | 2.75 | 2.13 | 0.005 | 1.93 | 0.09 |
Nontelemetry beds | 2.84 | 2.72 | 0.324 | 2.44 | 0.21 |
Nonhospitalists | |||||
Telemetry beds | 2.75 | 2.46 | 0.331 | 2.22 | 0.43 |
Nontelemetry beds | 2.64 | 2.89 | 0.261 | 2.26 | 0.05 |
Case mix index | |||||
Hospitalists | 1.44 | 1.45 | 0.68 | 1.40 | 0.21 |
Nonhospitalists | 1.46 | 1.40 | 0.53 | 1.53 | 0.18 |
Costs of hospital stay were also reduced in the multipronged, hospitalist‐driven intervention group. Expenditures for telemetry beds were reduced by 22.5% over the intervention period for hospitalists (Table 2).
Baseline to Intervention Period | Intervention to Extension Period | |
---|---|---|
| ||
Hospitalists | ||
Telemetry beds | 22.55% | 9.55% |
Nontelemetry beds | 4.23% | 10.14% |
Nonhospitalists | ||
Telemetry beds | 10.55% | 9.89% |
Nontelemetry beds | 9.47% | 21.84% |
The mean CMI of the patient cohort managed by the hospitalists in the baseline and intervention periods was not significantly different (1.44 vs 1.45, P=0.68). The mean CMI of the patients managed by the nonhospitalists in the baseline and intervention periods was also not significantly different (1.46 vs 1.40, P=0.53) (Table 1). Mortality index during the baseline and intervention periods was not significantly different (0.770.22 vs 0.660.23, P=0.54), as during the intervention and extension periods (0.660.23 vs 0.650.15, P=0.95).
Intervention Period (January 2013August 2013) Versus Extension Period (September 2014‐March 2015)
The decreased telemetry LOS for hospitalists was sustained from the intervention period to the extension period, from 2.13 to 1.93 (P=0.09). There was no significant change in the nontelemetry LOS in the intervention period compared to the extension period (2.72 vs 2.44, P=0.21). There was no change in the telemetry LOS for nonhospitalists from the intervention period to the extension period (2.46 vs 2.22, P=0.43).
The mean CMI in the hospitalist group was not significantly different in the intervention period compared to the extension period (1.45 to 1.40, P=0.21). The mean CMI in the nonhospitalist group did not change from the intervention period to the extension period (1.40 vs 1.53, P=0.18) (Table 1).
Education Outcomes
Out of the 56 participants completing the education module and survey, 28.6% were medical students, 53.6% were interns, 12.5% were second‐year residents, and 5.4% were third‐year residents. Several findings were seen at baseline via pretest. In evaluating patterns of current telemetry use, 32.2% of participants reported evaluating the necessity of telemetry for patients on admission only, 26.3% during transitions of care, 5.1% after discharge plans were cemented, 33.1% on a daily basis, and 3.4% rarely. When asked which member of the care team was most likely to encourage use of appropriate telemetry, 20.8% identified another resident, 13.9% nursing, 37.5% attending physician, 20.8% self, 4.2% the team as a whole, and 2.8% as not any.
Figure 1 shows premodule results regarding the trainees perceived percentage of patient encounters during which a participant's team discussed their patient's need for telemetry.

In assessing perception of current telemetry utilization, 1.8% of participants thought 0% to 10% of patients were currently on telemetry, 19.6% thought 11% to 20%, 42.9% thought 21% to 31%, 30.4% thought 31% to 40%, and 3.6% thought 41% to 50%.
Two areas were assessed at both baseline and after the intervention: knowledge of indications of telemetry use and cost related to telemetry use. We saw increased awareness of cost‐saving actions. To assess current knowledge of the indications of proper telemetry use according to American Heart Association guidelines, participants were presented with a list of 5 patients with different clinical indications for telemetry use and asked which patient required telemetry the most. Of the participants, 54.5% identified the correct answer in the pretest and 61.8% identified the correct answer in the post‐test. To assess knowledge of the costs of telemetry relative to other patient care, participants were presented with a patient case and asked to identify the most and least cost‐saving actions to safely care for the patient. When asked to identify the most cost‐saving action, 20.3% identified the correct answer in the pretest and 61.0% identified the correct answer in the post‐test. Of those who answered incorrectly in the pretest, 51.1% answered correctly in the post‐test (P=0.002). When asked to identify the least cost‐saving action, 23.7% identified the correct answer in the pretest and 50.9% identified the correct answer in the posttest. Of those who answered incorrectly in the pretest, 60.0% answered correctly in the post‐test (P=0.003).
In the post‐test, when asked about the importance of appropriate telemetry usage in providing cost‐conscious care and assuring appropriate hospital resource management, 76.8% of participants found the need very important, 21.4% somewhat important, and 1.8% as not applicable. The most commonly perceived barriers impeding discontinuation of telemetry, as reported by participants via post‐test, were nursing desires and time. Figure 2 shows all perceived barriers.

DISCUSSION
Our study is one of the first to our knowledge to demonstrate reductions in telemetry LOS by a hospitalist intervention for telemetry utilization. Others[10, 11] have studied the impact of an orientation handout by chief residents or a multispecialty telemetry policy with enforcement by an outside cardiologist and nurse team. Dressler et al. later sustained a 70% reduction in telemetry use without adversely affecting patient safety, as assessed through numbers of rapid response activations, codes, and deaths, through integrating the AHA guidelines into their electronic ordering system.[12] However, our study has the advantage of the primary team, who knows the patient and clinical scenario best, driving the change during attending rounds. In an era where cost consciousness intersects the practice of medicine, any intervention in patient care that demonstrates cost savings without an adverse impact on patient care and resource utilization must be emphasized. This is particularly important in academic institutions, where residents and medical students are learning to integrate the principles of patient safety and quality improvement into their clinical practice.[13] We actually showed sustained telemetry LOS reductions into the extension period after our intervention. We believe this may be due to telemetry triage being integrated into our attending and resident rounding practices. Future work should include integration of telemetry triage into clinical decision support in the electronic medical record and multidisciplinary rounds to disseminate telemetry triage hospital‐wide in both the academic and community settings.
Our study also revealed that nearly half of participants were not aware of the criteria for appropriate utilization of telemetry before our intervention; in the preintervention period, there were many anecdotal and objective findings of inappropriate utilization of telemetry as well as prolonged continuation beyond the clinical needs in both the hospitalist and nonhospitalist group. For the hospitalist group (ie, the group receiving guideline‐based education on appropriate indications for telemetry utilization), there was an assessment of both appropriate usage and timely discontinuation of telemetry in the postintervention period, which we attribute in large part to adherence to the education provided to this group.
We were able to show increased knowledge of cost‐saving actions among trainees with our educational module. We believe it is imperative to educate our providers (physicians, nurses, case managers, and students within these disciplines) on the appropriate indications for telemetry use, not only to help with cost savings and resource availability (ie, allowing telemetry beds to be available for patients who need them most), but also to instill consistent expectations among our patients. For the hospitalist group (ie, the group receiving guideline‐based education on appropriate indications for telemetry utilization), there was an assessment of both appropriate usage and timely discontinuation of telemetry in the postintervention period, which we attribute in large part to adherence to the education provided to this group.
Additionally, we feel it is important to consider the impacts of inappropriate use of telemetry from a patient's perspective: it is physically restrictive/emnconvenient, alarms are disruptive, it can be a barrier for other treatments such as physical therapy, it may increase the time it takes for imaging studies, a nurse may be required to accompany patients on telemetry, and poses additional costs to their medical bill.
We believe our success is due to several strategies. First, at the start of the fiscal year when quality improvement metrics are established, this particular metric (improving the appropriate utilization and timely discontinuation of telemetry) was deemed important by all hospitalists, engendering group buy‐in prior to the intervention. Our hospitalists received a detailed and interactive tutorial session in person at the beginning of the study. This tutorial provided the hospitalists with a comprehensive understanding of the appropriate (and inappropriate) indications for telemetry monitoring, hence facilitating guideline‐directed utilization. Email reminders and the tutorial tool were provided each time a hospitalist attended on the wards, and hospitalists received a small financial incentive to comply with appropriate telemetry utilization.
Our study has several strengths. First, the time frame of our study was long enough (8 months) to allow consistent trends to emerge and to optimize exposure of housestaff and medical students to this quality‐improvement initiative. Second, our cost savings came from 2 factors, direct reduction of inappropriate telemetry use and reduction in length of stay, highlighting the dual impact of appropriate telemetry utilization on cost. The overall reductions in telemetry utilization for the intervention group were a result of both reductions in initial placement on telemetry for patients who did not meet criteria for such monitoring as well as timely discontinuation of telemetry during the patient's hospitalization. Third, our study demonstrates that physicians can be effective in driving appropriate telemetry usage by participating in the clinical decision making regarding necessity and educating providers, trainees/students, and patients on appropriate indications. Finally, we show sustainment of our intervention in the extension period, suggesting telemetry triage integration into rounding practice.
Our study has limitations as well. First, our sample size is relatively small at a single academic center. Second, due to complexities in our faculty scheduling, we were unable to completely randomize patients to a hospitalist versus nonhospitalist team. However, we believe that despite the inability to randomize, our study does show the benefit of a hospitalist attending to reduce telemetry LOS given there was no change in nonhospitalist telemetry LOS despite all of the other hospital‐wide interventions (multidisciplinary rounds, similar housestaff). Third, our study was limited in that the CMI was used as a proxy for patient complexity, and the mortality index was used as the overall marker of safety. Further studies should monitor frequency and outcomes of arrhythmic events of patients transferred from telemetry monitoring to medicalsurgical beds. Finally, as the intervention was multipronged, we are unable to determine which component led to the reductions in telemetry utilization. Each component, however, remains easily transferrable to outside institutions. We demonstrated both a reduction in initiation of telemetry as well as timely discontinuation; however, due to the complexity in capturing this accurately, we were unable to numerically quantify these individual outcomes.
Additionally, there were approximately 10 nonhospitalist attendings who also staffed the wards during the intervention time period of our study; these attendings did not undergo the telemetry tutorial/orientation. This difference, along with the Hawthorne effect for the hospitalist attendings, also likely contributed to the difference in outcomes between the 2 attending cohorts in the intervention period.
CONCLUSIONS
Our results demonstrate that a multipronged hospitalist‐driven intervention to improve appropriate use of telemetry reduces telemetry LOS and cost. Hence, we believe that targeted, education‐driven interventions with monitoring of progress can have demonstrable impacts on changing practice. Physicians will need to make trade‐offs in clinical practice to balance efficient resource utilization with the patient's evolving condition in the inpatient setting, the complexities of clinical workflow, and the patient's expectations.[14] Appropriate telemetry utilization is a prime example of what needs to be done well in the future for high‐value care.
Acknowledgements
The authors acknowledge the hospitalists who participated in the intervention: Jeffrey Chi, Willliam Daines, Sumbul Desai, Poonam Hosamani, John Kugler, Charles Liao, Errol Ozdalga, and Sang Hoon Woo. The authors also acknowledge Joan Hendershott in the Finance Department and Joseph Hopkins in the Quality Department.
Disclosures: All coauthors have seen and agree with the contents of the article; submission (aside from abstracts) was not under review by any other publication. The authors report no disclosures of financial support from, or equity positions in, manufacturers of drugs or products mentioned in the article.
- 2009. Statistical brief 355. 2012. Agency for Healthcare Research and Quality, Rockville, MD. , National health care expenses in the U.S. civilian noninstitutionalized population,
- Costs for hospital stays in the United States, 2010. Statistical brief 146. 2013. Agency for Healthcare Research and Quality, Rockville, MD. , ,
- Telemetry outside critical care units: patterns of utilization and influence on management decisions. Clin Cardiol. 1998;21(7):503–505. , ,
- Evaluation of telemetry utilization, policy, and outcomes in an inner‐city academic medical center. J Natl Med Assoc. 2010;102(7):598–604. , , , et al.
- Recommended guidelines for in‐hospital cardiac monitoring of adults for detection of arrhythmia. Emergency Cardiac Care Committee members. J Am Coll Cardiol. 1991;18(6):1431–1433. , ,
- Practice standards for electrocardiographic monitoring in hospital settings: an American Heart Association scientific statement from the Councils on Cardiovascular Nursing, Clinical Cardiology, and Cardiovascular Disease in the Young: endorsed by the International Society of Computerized Electrocardiology and the American Association of Critical‐Care Nurses. Circulation. 2004;110(17):2721–2746. , , , et al.
- Is telemetry overused? Is it as helpful as thought? Cleve Clin J Med. 2009;76(6):368–372. , , , , ,
- Society of Hospital Medicine. Adult Hospital Medicine. Five things physicians and patients should question. Available at: http://www.choosingwisely.org/societies/society‐of‐hospital‐medicine‐adult. Published February 21, 2013. Accessed October 5, 2014.
- Joint Commission on Accreditation of Healthcare Organizations. The Joint Commission announces 2014 national patient safety goal. Jt Comm Perspect. 2013;33(7):1–4.
- Optimizing telemetry utilization in an academic medical center. J Clin Outcomes Manage. 2008;15(9):435–440. , , , ,
- Improving utilization of telemetry in a university hospital. J Clin Outcomes Manage. 2005;12(10):519–522. ,
- Altering overuse of cardiac telemetry in non‐intensive care unit settings by hardwiring the use of American Heart Association guidelines. JAMA Intern Med. 2014;174:1852–1854. , , , ,
- "Innovation" institutes in academic health centers: enhancing value through leadership, education, engagement, and scholarship. Acad Med. 2014;89(9):1204–1206. , ,
- Controlling health costs: physician responses to patient expectations for medical care. J Gen Intern Med. 2014;29(9):1234–1241. , , , , ,
- 2009. Statistical brief 355. 2012. Agency for Healthcare Research and Quality, Rockville, MD. , National health care expenses in the U.S. civilian noninstitutionalized population,
- Costs for hospital stays in the United States, 2010. Statistical brief 146. 2013. Agency for Healthcare Research and Quality, Rockville, MD. , ,
- Telemetry outside critical care units: patterns of utilization and influence on management decisions. Clin Cardiol. 1998;21(7):503–505. , ,
- Evaluation of telemetry utilization, policy, and outcomes in an inner‐city academic medical center. J Natl Med Assoc. 2010;102(7):598–604. , , , et al.
- Recommended guidelines for in‐hospital cardiac monitoring of adults for detection of arrhythmia. Emergency Cardiac Care Committee members. J Am Coll Cardiol. 1991;18(6):1431–1433. , ,
- Practice standards for electrocardiographic monitoring in hospital settings: an American Heart Association scientific statement from the Councils on Cardiovascular Nursing, Clinical Cardiology, and Cardiovascular Disease in the Young: endorsed by the International Society of Computerized Electrocardiology and the American Association of Critical‐Care Nurses. Circulation. 2004;110(17):2721–2746. , , , et al.
- Is telemetry overused? Is it as helpful as thought? Cleve Clin J Med. 2009;76(6):368–372. , , , , ,
- Society of Hospital Medicine. Adult Hospital Medicine. Five things physicians and patients should question. Available at: http://www.choosingwisely.org/societies/society‐of‐hospital‐medicine‐adult. Published February 21, 2013. Accessed October 5, 2014.
- Joint Commission on Accreditation of Healthcare Organizations. The Joint Commission announces 2014 national patient safety goal. Jt Comm Perspect. 2013;33(7):1–4.
- Optimizing telemetry utilization in an academic medical center. J Clin Outcomes Manage. 2008;15(9):435–440. , , , ,
- Improving utilization of telemetry in a university hospital. J Clin Outcomes Manage. 2005;12(10):519–522. ,
- Altering overuse of cardiac telemetry in non‐intensive care unit settings by hardwiring the use of American Heart Association guidelines. JAMA Intern Med. 2014;174:1852–1854. , , , ,
- "Innovation" institutes in academic health centers: enhancing value through leadership, education, engagement, and scholarship. Acad Med. 2014;89(9):1204–1206. , ,
- Controlling health costs: physician responses to patient expectations for medical care. J Gen Intern Med. 2014;29(9):1234–1241. , , , , ,
Planned Readmission Algorithm
The Centers for Medicare & Medicaid Services (CMS) publicly reports all‐cause risk‐standardized readmission rates after acute‐care hospitalization for acute myocardial infarction, pneumonia, heart failure, total hip and knee arthroplasty, chronic obstructive pulmonary disease, stroke, and for patients hospital‐wide.[1, 2, 3, 4, 5] Ideally, these measures should capture unplanned readmissions that arise from acute clinical events requiring urgent rehospitalization. Planned readmissions, which are scheduled admissions usually involving nonurgent procedures, may not be a signal of quality of care. Including planned readmissions in readmission quality measures could create a disincentive to provide appropriate care to patients who are scheduled for elective or necessary procedures unrelated to the quality of the prior admission. Accordingly, under contract to the CMS, we were asked to develop an algorithm to identify planned readmissions. A version of this algorithm is now incorporated into all publicly reported readmission measures.
Given the widespread use of the planned readmission algorithm in public reporting and its implications for hospital quality measurement and evaluation, the objective of this study was to describe the development process, and to validate and refine the algorithm by reviewing charts of readmitted patients.
METHODS
Algorithm Development
To create a planned readmission algorithm, we first defined planned. We determined that readmissions for obstetrical delivery, maintenance chemotherapy, major organ transplant, and rehabilitation should always be considered planned in the sense that they are desired and/or inevitable, even if not specifically planned on a certain date. Apart from these specific types of readmissions, we defined planned readmissions as nonacute readmissions for scheduled procedures, because the vast majority of planned admissions are related to procedures. We also defined readmissions for acute illness or for complications of care as unplanned for the purposes of a quality measure. Even if such readmissions included a potentially planned procedure, because complications of care represent an important dimension of quality that should not be excluded from outcome measurement, these admissions should not be removed from the measure outcome. This definition of planned readmissions does not imply that all unplanned readmissions are unexpected or avoidable. However, it has proven very difficult to reliably define avoidable readmissions, even by expert review of charts, and we did not attempt to do so here.[6, 7]
In the second stage, we operationalized this definition into an algorithm. We used the Agency for Healthcare Research and Quality's Clinical Classification Software (CCS) codes to group thousands of individual procedure and diagnosis International Classification of Disease, Ninth Revision, Clinical Modification (ICD‐9‐CM) codes into clinically coherent, mutually exclusive procedure CCS categories and mutually exclusive diagnosis CCS categories, respectively. Clinicians on the investigative team reviewed the procedure categories to identify those that are commonly planned and that would require inpatient admission. We also reviewed the diagnosis categories to identify acute diagnoses unlikely to accompany elective procedures. We then created a flow diagram through which every readmission could be run to determine whether it was planned or unplanned based on our categorizations of procedures and diagnoses (Figure 1, and Supporting Information, Appendix A, in the online version of this article). This version of the algorithm (v1.0) was submitted to the National Quality Forum (NQF) as part of the hospital‐wide readmission measure. The measure (NQR #1789) received endorsement in April 2012.

In the third stage of development, we posted the algorithm for 2 public comment periods and recruited 27 outside experts to review and refine the algorithm following a standardized, structured process (see Supporting Information, Appendix B, in the online version of this article). Because the measures publicly report and hold hospitals accountable for unplanned readmission rates, we felt it most important that the algorithm include as few planned readmissions in the reported, unplanned outcome as possible (ie, have high negative predictive value). Therefore, in equivocal situations in which experts felt procedure categories were equally often planned or unplanned, we added those procedures to the potentially planned list. We also solicited feedback from hospitals on algorithm performance during a confidential test run of the hospital‐wide readmission measure in the fall of 2012. Based on all of this feedback, we made a number of changes to the algorithm, which was then identified as v2.1. Version 2.1 of the algorithm was submitted to the NQF as part of the endorsement process for the acute myocardial infarction and heart failure readmission measures and was endorsed by the NQF in January 2013. The algorithm (v2.1) is now applied, adapted if necessary, to all publicly reported readmission measures.[8]
Algorithm Validation: Study Cohort
We recruited 2 hospital systems to participate in a chart validation study of the accuracy of the planned readmission algorithm (v2.1). Within these 2 health systems, we selected 7 hospitals with varying bed size, teaching status, and safety‐net status. Each included 1 large academic teaching hospital that serves as a regional referral center. For each hospital's index admissions, we applied the inclusion and exclusion criteria from the hospital‐wide readmission measure. Index admissions were included for patients age 65 years or older; enrolled in Medicare fee‐for‐service (FFS); discharged from a nonfederal, short‐stay, acute‐care hospital or critical access hospital; without an in‐hospital death; not transferred to another acute‐care facility; and enrolled in Part A Medicare for 1 year prior to discharge. We excluded index admissions for patients without at least 30 days postdischarge enrollment in FFS Medicare, discharged against medical advice, admitted for medical treatment of cancer or primary psychiatric disease, admitted to a Prospective Payment System‐exempt cancer hospital, or who died during the index hospitalization. In addition, for this study, we included only index admissions that were followed by a readmission to a hospital within the participating health system between July 1, 2011 and June 30, 2012. Institutional review board approval was obtained from each of the participating health systems, which granted waivers of signed informed consent and Health Insurance Portability and Accountability Act waivers.
Algorithm Validation: Sample Size Calculation
We determined a priori that the minimum acceptable positive predictive value, or proportion of all readmissions the algorithm labels planned that are truly planned, would be 60%, and the minimum acceptable negative predictive value, or proportion of all readmissions the algorithm labels as unplanned that are truly unplanned, would be 80%. We calculated the sample size required to be confident of these values 10% and determined we would need a total of 291 planned charts and 162 unplanned charts. We inflated these numbers by 20% to account for missing or unobtainable charts for a total of 550 charts. To achieve this sample size, we included all eligible readmissions from all participating hospitals that were categorized as planned. At the 5 smaller hospitals, we randomly selected an equal number of unplanned readmissions occurring at any hospital in its healthcare system. At the 2 largest hospitals, we randomly selected 50 unplanned readmissions occurring at any hospital in its healthcare system.
Algorithm Validation: Data Abstraction
We developed an abstraction tool, tested and refined it using sample charts, and built the final the tool into a secure, password‐protected Microsoft Access 2007 (Microsoft Corp., Redmond, WA) database (see Supporting Information, Appendix C, in the online version of this article). Experienced chart abstractors with RN or MD degrees from each hospital site participated in a 1‐hour training session to become familiar with reviewing medical charts, defining planned/unplanned readmissions, and the data abstraction process. For each readmission, we asked abstractors to review as needed: emergency department triage and physician notes, admission history and physical, operative report, discharge summary, and/or discharge summary from a prior admission. The abstractors verified the accuracy of the administrative billing data, including procedures and principal diagnosis. In addition, they abstracted the source of admission and dates of all major procedures. Then the abstractors provided their opinion and supporting rationale as to whether a readmission was planned or unplanned. They were not asked to determine whether the readmission was preventable. To determine the inter‐rater reliability of data abstraction, an independent abstractor at each health system recoded a random sample of 10% of the charts.
Statistical Analysis
To ensure that we had obtained a representative sample of charts, we identified the 10 most commonly planned procedures among cases identified as planned by the algorithm in the validation cohort and then compared this with planned cases nationally. To confirm the reliability of the abstraction process, we used the kappa statistic to determine the inter‐rater reliability of the determination of planned or unplanned status. Additionally, the full study team, including 5 practicing clinicians, reviewed the details of every chart abstraction in which the algorithm was found to have misclassified the readmission as planned or unplanned. In 11 cases we determined that the abstractor had misunderstood the definition of planned readmission (ie, not all direct admissions are necessarily planned) and we reclassified the chart review assignment accordingly.
We calculated sensitivity, specificity, positive predictive value, and negative predictive value of the algorithm for the validation cohort as a whole, weighted to account for the prevalence of planned readmissions as defined by the algorithm in the national data (7.8%). Weighting is necessary because we did not obtain a pure random sample, but rather selected a stratified sample that oversampled algorithm‐identified planned readmissions.[9] We also calculated these rates separately for large hospitals (>600 beds) and for small hospitals (600 beds).
Finally, we examined performance of the algorithm for individual procedures and diagnoses to determine whether any procedures or diagnoses should be added or removed from the algorithm. First, we reviewed the diagnoses, procedures, and brief narratives provided by the abstractors for all cases in which the algorithm misclassified the readmission as either planned or unplanned. Second, we calculated the positive predictive value for each procedure that had been flagged as planned by the algorithm, and reviewed all readmissions (correctly and incorrectly classified) in which procedures with low positive predictive value took place. We also calculated the frequency with which the procedure was the only qualifying procedure resulting in an accurate or inaccurate classification. Third, to identify changes that should be made to the lists of acute and nonacute diagnoses, we reviewed the principal diagnosis for all readmissions misclassified by the algorithm as either planned or unplanned, and examined the specific ICD‐9‐CM codes within each CCS group that were most commonly associated with misclassifications.
After determining the changes that should be made to the algorithm based on these analyses, we recalculated the sensitivity, specificity, positive predictive value, and negative predictive value of the proposed revised algorithm (v3.0). All analyses used SAS version 9.3 (SAS Institute, Cary, NC).
RESULTS
Study Cohort
Characteristics of participating hospitals are shown in Table 1. Hospitals represented in this sample ranged in size, teaching status, and safety net status, although all were nonprofit. We selected 663 readmissions for review, 363 planned and 300 unplanned. Overall we were able to select 80% of hospitals planned cases for review; the remainder occurred at hospitals outside the participating hospital system. Abstractors were able to locate and review 634 (96%) of the eligible charts (range, 86%100% per hospital). The kappa statistic for inter‐rater reliability was 0.83.
Description | Hospitals, N | Readmissions Selected for Review, N* | Readmissions Reviewed, N (% of Eligible) | Unplanned Readmissions Reviewed, N | Planned Readmissions Reviewed, N | % of Hospital's Planned Readmissions Reviewed* | |
---|---|---|---|---|---|---|---|
| |||||||
All hospitals | 7 | 663 | 634 (95.6) | 283 | 351 | 77.3 | |
No. of beds | >600 | 2 | 346 | 339 (98.0) | 116 | 223 | 84.5 |
>300600 | 2 | 190 | 173 (91.1) | 85 | 88 | 87.1 | |
<300 | 3 | 127 | 122 (96.0) | 82 | 40 | 44.9 | |
Ownership | Government | 0 | |||||
For profit | 0 | ||||||
Not for profit | 7 | 663 | 634 (95.6) | 283 | 351 | 77.3 | |
Teaching status | Teaching | 2 | 346 | 339 (98.0) | 116 | 223 | 84.5 |
Nonteaching | 5 | 317 | 295 (93.1) | 167 | 128 | 67.4 | |
Safety net status | Safety net | 2 | 346 | 339 (98.0) | 116 | 223 | 84.5 |
Nonsafety net | 5 | 317 | 295 (93.1) | 167 | 128 | 67.4 | |
Region | New England | 3 | 409 | 392 (95.8) | 155 | 237 | 85.9 |
South Central | 4 | 254 | 242 (95.3) | 128 | 114 | 64.0 |
The study sample included 57/67 (85%) of the procedure or condition categories on the potentially planned list. The most common procedure CCS categories among planned readmissions (v2.1) in the validation cohort were very similar to those in the national dataset (see Supporting Information, Appendix D, in the online version of this article). Of the top 20 most commonly planned procedure CCS categories in the validation set, all but 2, therapeutic radiology for cancer treatment (CCS 211) and peripheral vascular bypass (CCS 55), were among the top 20 most commonly planned procedure CCS categories in the national data.
Test Characteristics of Algorithm
The weighted test characteristics of the current algorithm (v2.1) are shown in Table 2. Overall, the algorithm correctly identified 266 readmissions as unplanned and 181 readmissions as planned, and misidentified 170 readmissions as planned and 15 as unplanned. Once weighted to account for the stratified sampling design, the overall prevalence of true planned readmissions was 8.9% of readmissions. The weighted sensitivity was 45.1% overall and was higher in large teaching centers than in smaller community hospitals. The weighted specificity was 95.9%. The positive predictive value was 51.6%, and the negative predictive value was 94.7%.
Cohort | Sensitivity | Specificity | Positive Predictive Value | Negative Predictive Value |
---|---|---|---|---|
Algorithm v2.1 | ||||
Full cohort | 45.1% | 95.9% | 51.6% | 94.7% |
Large hospitals | 50.9% | 96.1% | 53.8% | 95.6% |
Small hospitals | 40.2% | 95.5% | 47.7% | 94.0% |
Revised algorithm v3.0 | ||||
Full cohort | 49.8% | 96.5% | 58.7% | 94.5% |
Large hospitals | 57.1% | 96.8% | 63.0% | 95.9% |
Small hospitals | 42.6% | 95.9% | 52.6% | 93.9% |
Accuracy of Individual Diagnoses and Procedures
The positive predictive value of the algorithm for individual procedure categories varied widely, from 0% to 100% among procedures with at least 10 cases (Table 3). The procedure for which the algorithm was least accurate was CCS 211, therapeutic radiology for cancer treatment (0% positive predictive value). By contrast, maintenance chemotherapy (90%) and other therapeutic procedures, hemic and lymphatic system (100%) were most accurate. Common procedures with less than 50% positive predictive value (ie, that the algorithm commonly misclassified as planned) were diagnostic cardiac catheterization (25%); debridement of wound, infection, or burn (25%); amputation of lower extremity (29%); insertion, revision, replacement, removal of cardiac pacemaker or cardioverter/defibrillator (33%); and other hernia repair (43%). Of these, diagnostic cardiac catheterization and cardiac devices are the first and second most common procedures nationally, respectively.
Readmission Procedure CCS Code | Total Categorized as Planned by Algorithm, N | Verified as Planned by Chart Review, N | Positive Predictive Value |
---|---|---|---|
| |||
47 Diagnostic cardiac catheterization; coronary arteriography | 44 | 11 | 25% |
224 Cancer chemotherapy | 40 | 22 | 55% |
157 Amputation of lower extremity | 31 | 9 | 29% |
49 Other operating room heart procedures | 27 | 16 | 59% |
48 Insertion, revision, replacement, removal of cardiac pacemaker or cardioverter/defibrillator | 24 | 8 | 33% |
43 Heart valve procedures | 20 | 16 | 80% |
Maintenance chemotherapy (diagnosis CCS 45) | 20 | 18 | 90% |
78 Colorectal resection | 18 | 9 | 50% |
169 Debridement of wound, infection or burn | 16 | 4 | 25% |
84 Cholecystectomy and common duct exploration | 16 | 5 | 31% |
99 Other OR gastrointestinal therapeutic procedures | 16 | 8 | 50% |
158 Spinal fusion | 15 | 11 | 73% |
142 Partial excision bone | 14 | 10 | 71% |
86 Other hernia repair | 14 | 6 | 42% |
44 Coronary artery bypass graft | 13 | 10 | 77% |
67 Other therapeutic procedures, hemic and lymphatic system | 13 | 13 | 100% |
211 Therapeutic radiology for cancer treatment | 12 | 0 | 0% |
45 Percutaneous transluminal coronary angioplasty | 11 | 7 | 64% |
Total | 497 | 272 | 54.7% |
The readmissions with least abstractor agreement were those involving CCS 157 (amputation of lower extremity) and CCS 169 (debridement of wound, infection or burn). Readmissions for these procedures were nearly always performed as a consequence of acute worsening of chronic conditions such as osteomyelitis or ulceration. Abstractors were divided over whether these readmissions were appropriate to call planned.
Changes to the Algorithm
We determined that the accuracy of the algorithm would be improved by removing 2 procedure categories from the planned procedure list (therapeutic radiation [CCS 211] and cancer chemotherapy [CCS 224]), adding 1 diagnosis category to the acute diagnosis list (hypertension with complications [CCS 99]), and splitting 2 diagnosis condition categories into acute and nonacute ICD‐9‐CM codes (pancreatic disorders [CCS 149] and biliary tract disease [CCS 152]). Detailed rationales for each modification to the planned readmission algorithm are described in Table 4. We felt further examination of diagnostic cardiac catheterization and cardiac devices was warranted given their high frequency, despite low positive predictive value. We also elected not to alter the categorization of amputation or debridement because it was not easy to determine whether these admissions were planned or unplanned even with chart review. We plan further analyses of these procedure categories.
Action | Diagnosis or Procedure Category | Algorithm | Chart | N | Rationale for Change |
---|---|---|---|---|---|
| |||||
Remove from planned procedure list | Therapeutic radiation (CCS 211) | Accurate | The algorithm was inaccurate in every case. All therapeutic radiology during readmissions was performed because of acute illness (pain crisis, neurologic crisis) or because scheduled treatment occurred during an unplanned readmission. In national data, this ranks as the 25th most common planned procedure identified by the algorithm v2.1. | ||
Planned | Planned | 0 | |||
Unplanned | Unplanned | 0 | |||
Inaccurate | |||||
Unplanned | Planned | 0 | |||
Planned | Unplanned | 12 | |||
Cancer chemotherapy (CCS 224) | Accurate | Of the 22 correctly identified as planned, 18 (82%) would already have been categorized as planned because of a principal diagnosis of maintenance chemotherapy. Therefore, removing CCS 224 from the planned procedure list would only miss a small fraction of planned readmissions but would avoid a large number of misclassifications. In national data, this ranks as the 8th most common planned procedure identified by the algorithm v2.1. | |||
Planned | Planned | 22 | |||
Unplanned | Unplanned | 0 | |||
Inaccurate | |||||
Unplanned | Planned | 0 | |||
Planned | Unplanned | 18 | |||
Add to planned procedure list | None | The abstractors felt a planned readmission was missed by the algorithm in 15 cases. A handful of these cases were missed because the planned procedure was not on the current planned procedure list; however, those procedures (eg, abdominal paracentesis, colonoscopy, endoscopy) were nearly always unplanned overall and should therefore not be added as procedures that potentially qualify as an admission as planned. | |||
Remove from acute diagnosis list | None | The abstractors felt a planned readmission was missed by the algorithm in 15 cases. The relevant disqualifying acute diagnoses were much more often associated with unplanned readmissions in our dataset. | |||
Add to acute diagnosis list | Hypertension with complications (CCS 99) | Accurate | This CCS was associated with only 1 planned readmission (for elective nephrectomy, a very rare procedure). Every other time this CCS appeared in the dataset, it was associated with an unplanned readmission (12/13, 92%); 10 of those, however, were misclassified by the algorithm as planned because they were not excluded by diagnosis (91% error rate). Consequently, adding this CCS to the acute diagnosis list is likely to miss only a very small fraction of planned readmissions, while making the overall algorithm much more accurate. | ||
Planned | Planned | 1 | |||
Unplanned | Unplanned | 2 | |||
Inaccurate | |||||
Unplanned | Planned | 0 | |||
Planned | Unplanned | 10 | |||
Split diagnosis condition category into component ICD‐9 codes | Pancreatic disorders (CCS 152) | Accurate | ICD‐9 code 577.0 (acute pancreatitis) is the only acute code in this CCS. Acute pancreatitis was present in 2 cases that were misclassified as planned. Clinically, there is no situation in which a planned procedure would reasonably be performed in the setting of acute pancreatitis. Moving ICD‐9 code 577.0 to the acute list and leaving the rest of the ICD‐9 codes in CCS 152 on the nonacute list will enable the algorithm to continue to identify planned procedures for chronic pancreatitis. | ||
Planned | Planned | 0 | |||
Unplanned | Unplanned | 1 | |||
Inaccurate | |||||
Unplanned | Planned | 0 | |||
Planned | Unplanned | 2 | |||
Biliary tract disease (CCS 149) | Accurate | This CCS is a mix of acute and chronic diagnoses. Of 14 charts classified as planned with CCS 149 in the principal diagnosis field, 12 were misclassified (of which 10 were associated with cholecystectomy). Separating out the acute and nonacute diagnoses will increase the accuracy of the algorithm while still ensuring that planned cholecystectomies and other procedures can be identified. Of the ICD‐9 codes in CCS 149, the following will be added to the acute diagnosis list: 574.0, 574.3, 574.6, 574.8, 575.0, 575.12, 576.1. | |||
Planned | Planned | 2 | |||
Unplanned | Unplanned | 3 | |||
Inaccurate | |||||
Unplanned | Planned | 0 | |||
Planned | Unplanned | 12 | |||
Consider for change after additional study | Diagnostic cardiac catheterization (CCS 47) | Accurate | The algorithm misclassified as planned 25/38 (66%) unplanned readmissions in which diagnostic catheterizations were the only qualifying planned procedure. It also correctly identified 3/3 (100%) planned readmissions in which diagnostic cardiac catheterizations were the only qualifying planned procedure. This is the highest volume procedure in national data. | ||
Planned | Planned | 3* | |||
Unplanned | Unplanned | 13* | |||
Inaccurate | |||||
Unplanned | Planned | 0* | |||
Planned | Unplanned | 25* | |||
Insertion, revision, replacement, removal of cardiac pacemaker or cardioverter/defibrillator (CCS 48) | Accurate | The algorithm misclassified as planned 4/5 (80%) unplanned readmissions in which cardiac devices were the only qualifying procedure. However, it also correctly identified 7/8 (87.5%) planned readmissions in which cardiac devices were the only qualifying planned procedure. CCS 48 is the second most common planned procedure category nationally. | |||
Planned | Planned | 7 | |||
Unplanned | Unplanned | 1 | |||
Inaccurate | |||||
Unplanned | Planned | 1 | |||
Planned | Unplanned | 4 |
The revised algorithm (v3.0) had a weighted sensitivity of 49.8%, weighted specificity of 96.5%, positive predictive value of 58.7%, and negative predictive value of 94.5% (Table 2). In aggregate, these changes would increase the reported unplanned readmission rate from 16.0% to 16.1% in the hospital‐wide readmission measure, using 2011 to 2012 data, and would decrease the fraction of all readmissions considered planned from 7.8% to 7.2%.
DISCUSSION
We developed an algorithm based on administrative data that in its currently implemented form is very accurate at identifying unplanned readmissions, ensuring that readmissions included in publicly reported readmission measures are likely to be truly unplanned. However, nearly half of readmissions the algorithm classifies as planned are actually unplanned. That is, the algorithm is overcautious in excluding unplanned readmissions that could have counted as outcomes, particularly among admissions that include diagnostic cardiac catheterization or placement of cardiac devices (pacemakers, defibrillators). However, these errors only occur within the 7.8% of readmissions that are classified as planned and therefore do not affect overall readmission rates dramatically. A perfect algorithm would reclassify approximately half of these planned readmissions as unplanned, increasing the overall readmission rate by 0.6 percentage points.
On the other hand, the algorithm also only identifies approximately half of true planned readmissions as planned. Because the true prevalence of planned readmissions is low (approximately 9% of readmissions based on weighted chart review prevalence, or an absolute rate of 1.4%), this low sensitivity has a small effect on algorithm performance. Removing all true planned readmissions from the measure outcome would decrease the overall readmission rate by 0.8 percentage points, similar to the expected 0.6 percentage point increase that would result from better identifying unplanned readmissions; thus, a perfect algorithm would likely decrease the reported unplanned readmission rate by a net 0.2%. Overall, the existing algorithm appears to come close to the true prevalence of planned readmissions, despite inaccuracy on an individual‐case basis. The algorithm performed best at large hospitals, which are at greatest risk of being statistical outliers and of accruing penalties under the Hospital Readmissions Reduction Program.[10]
We identified several changes that marginally improved the performance of the algorithm by reducing the number of unplanned readmissions that are incorrectly removed from the measure, while avoiding the inappropriate inclusion of planned readmissions in the outcome. This revised algorithm, v3.0, was applied to public reporting of readmission rates at the end of 2014. Overall, implementing these changes increases the reported readmission rate very slightly. We also identified other procedures associated with high inaccuracy rates, removal of which would have larger impact on reporting rates, and which therefore merit further evaluation.
There are other potential methods of identifying planned readmissions. For instance, as of October 1, 2013, new administrative billing codes were created to allow hospitals to indicate that a patient was discharged with a planned acute‐care hospital inpatient readmission, without limitation as to when it will take place.[11] This code must be used at the time of the index admission to indicate that a future planned admission is expected, and was specified only to be used for neonates and patients with acute myocardial infarction. This approach, however, would omit planned readmissions that are not known to the initial discharging team, potentially missing planned readmissions. Conversely, some patients discharged with a plan for readmission may be unexpectedly readmitted for an unplanned reason. Given that the new codes were not available at the time we conducted the validation study, we were not able to determine how often the billing codes accurately identified planned readmissions. This would be an important area to consider for future study.
An alternative approach would be to create indicator codes to be applied at the time of readmission that would indicate whether that admission was planned or unplanned. Such a code would have the advantage of allowing each planned readmission to be flagged by the admitting clinicians at the time of admission rather than by an algorithm that inherently cannot be perfect. However, identifying planned readmissions at the time of readmission would also create opportunity for gaming and inconsistent application of definitions between hospitals; additional checks would need to be put in place to guard against these possibilities.
Our study has some limitations. We relied on the opinion of chart abstractors to determine whether a readmission was planned or unplanned; in a few cases, such as smoldering wounds that ultimately require surgical intervention, that determination is debatable. Abstractions were done at local institutions to minimize risks to patient privacy, and therefore we could not centrally verify determinations of planned status except by reviewing source of admission, dates of procedures, and narrative comments reported by the abstractors. Finally, we did not have sufficient volume of planned procedures to determine accuracy of the algorithm for less common procedure categories or individual procedures within categories.
In summary, we developed an algorithm to identify planned readmissions from administrative data that had high specificity and moderate sensitivity, and refined it based on chart validation. This algorithm is in use in public reporting of readmission measures to maximize the probability that the reported readmission rates represent truly unplanned readmissions.[12]
Disclosures: Financial supportThis work was performed under contract HHSM‐500‐2008‐0025I/HHSM‐500‐T0001, Modification No. 000008, titled Measure Instrument Development and Support, funded by the Centers for Medicare and Medicaid Services (CMS), an agency of the US Department of Health and Human Services. Drs. Horwitz and Ross are supported by the National Institute on Aging (K08 AG038336 and K08 AG032886, respectively) and by the American Federation for Aging Research through the Paul B. Beeson Career Development Award Program. Dr. Krumholz is supported by grant U01 HL105270‐05 (Center for Cardiovascular Outcomes Research at Yale University) from the National Heart, Lung, and Blood Institute. No funding source had any role in the study design; in the collection, analysis, and interpretation of data; or in the writing of the article. The CMS reviewed and approved the use of its data for this work and approved submission of the manuscript. All authors have completed the Unified Competing Interest form at
- Development, validation, and results of a measure of 30‐day readmission following hospitalization for pneumonia. J Hosp Med. 2011;6(3):142–150. , , , et al.
- An administrative claims measure suitable for profiling hospital performance based on 30‐day all‐cause readmission rates among patients with acute myocardial infarction. Circ Cardiovasc Qual Outcomes. 2011;4(2):243–252. , , , et al.
- An administrative claims measure suitable for profiling hospital performance on the basis of 30‐day all‐cause readmission rates among patients with heart failure. Circ Cardiovasc Qual Outcomes. 2008;1:29–37. , , , et al.
- http://www.qualitynet.org/dcs/ContentServer?c=Page161(supp10 l):S66–S75. , , , et al. Hospital‐level 30‐day all‐cause risk‐standardized readmission rate following elective primary total hip arthroplasty (THA) and/or total knee arthroplasty (TKA). Available at:
- A meta‐analysis of hospital 30‐day avoidable readmission rates. J Eval Clin Pract. 2011;18(6):1211–1218. , ,
- Proportion of hospital readmissions deemed avoidable: a systematic review. CMAJ. 2011;183(7):E391–E402. , , , ,
- 3(4):477–492. , , , et al. Centers for Medicare
- Characteristics of hospitals receiving penalties under the Hospital Readmissions Reduction Program. JAMA. 2013;309(4):342–343. ,
- Centers for Medicare and Medicaid Services. Inpatient Prospective Payment System/Long‐Term Care Hospital (IPPS/LTCH) final rule. Fed Regist. 2013;78:50533–50534.
- Massachusetts health reforms: uninsurance remains low, self‐reported health status improves as state prepares to tackle costs. Health Aff (Millwood). 2012;31(2):444–451. , ,
The Centers for Medicare & Medicaid Services (CMS) publicly reports all‐cause risk‐standardized readmission rates after acute‐care hospitalization for acute myocardial infarction, pneumonia, heart failure, total hip and knee arthroplasty, chronic obstructive pulmonary disease, stroke, and for patients hospital‐wide.[1, 2, 3, 4, 5] Ideally, these measures should capture unplanned readmissions that arise from acute clinical events requiring urgent rehospitalization. Planned readmissions, which are scheduled admissions usually involving nonurgent procedures, may not be a signal of quality of care. Including planned readmissions in readmission quality measures could create a disincentive to provide appropriate care to patients who are scheduled for elective or necessary procedures unrelated to the quality of the prior admission. Accordingly, under contract to the CMS, we were asked to develop an algorithm to identify planned readmissions. A version of this algorithm is now incorporated into all publicly reported readmission measures.
Given the widespread use of the planned readmission algorithm in public reporting and its implications for hospital quality measurement and evaluation, the objective of this study was to describe the development process, and to validate and refine the algorithm by reviewing charts of readmitted patients.
METHODS
Algorithm Development
To create a planned readmission algorithm, we first defined planned. We determined that readmissions for obstetrical delivery, maintenance chemotherapy, major organ transplant, and rehabilitation should always be considered planned in the sense that they are desired and/or inevitable, even if not specifically planned on a certain date. Apart from these specific types of readmissions, we defined planned readmissions as nonacute readmissions for scheduled procedures, because the vast majority of planned admissions are related to procedures. We also defined readmissions for acute illness or for complications of care as unplanned for the purposes of a quality measure. Even if such readmissions included a potentially planned procedure, because complications of care represent an important dimension of quality that should not be excluded from outcome measurement, these admissions should not be removed from the measure outcome. This definition of planned readmissions does not imply that all unplanned readmissions are unexpected or avoidable. However, it has proven very difficult to reliably define avoidable readmissions, even by expert review of charts, and we did not attempt to do so here.[6, 7]
In the second stage, we operationalized this definition into an algorithm. We used the Agency for Healthcare Research and Quality's Clinical Classification Software (CCS) codes to group thousands of individual procedure and diagnosis International Classification of Disease, Ninth Revision, Clinical Modification (ICD‐9‐CM) codes into clinically coherent, mutually exclusive procedure CCS categories and mutually exclusive diagnosis CCS categories, respectively. Clinicians on the investigative team reviewed the procedure categories to identify those that are commonly planned and that would require inpatient admission. We also reviewed the diagnosis categories to identify acute diagnoses unlikely to accompany elective procedures. We then created a flow diagram through which every readmission could be run to determine whether it was planned or unplanned based on our categorizations of procedures and diagnoses (Figure 1, and Supporting Information, Appendix A, in the online version of this article). This version of the algorithm (v1.0) was submitted to the National Quality Forum (NQF) as part of the hospital‐wide readmission measure. The measure (NQR #1789) received endorsement in April 2012.

In the third stage of development, we posted the algorithm for 2 public comment periods and recruited 27 outside experts to review and refine the algorithm following a standardized, structured process (see Supporting Information, Appendix B, in the online version of this article). Because the measures publicly report and hold hospitals accountable for unplanned readmission rates, we felt it most important that the algorithm include as few planned readmissions in the reported, unplanned outcome as possible (ie, have high negative predictive value). Therefore, in equivocal situations in which experts felt procedure categories were equally often planned or unplanned, we added those procedures to the potentially planned list. We also solicited feedback from hospitals on algorithm performance during a confidential test run of the hospital‐wide readmission measure in the fall of 2012. Based on all of this feedback, we made a number of changes to the algorithm, which was then identified as v2.1. Version 2.1 of the algorithm was submitted to the NQF as part of the endorsement process for the acute myocardial infarction and heart failure readmission measures and was endorsed by the NQF in January 2013. The algorithm (v2.1) is now applied, adapted if necessary, to all publicly reported readmission measures.[8]
Algorithm Validation: Study Cohort
We recruited 2 hospital systems to participate in a chart validation study of the accuracy of the planned readmission algorithm (v2.1). Within these 2 health systems, we selected 7 hospitals with varying bed size, teaching status, and safety‐net status. Each included 1 large academic teaching hospital that serves as a regional referral center. For each hospital's index admissions, we applied the inclusion and exclusion criteria from the hospital‐wide readmission measure. Index admissions were included for patients age 65 years or older; enrolled in Medicare fee‐for‐service (FFS); discharged from a nonfederal, short‐stay, acute‐care hospital or critical access hospital; without an in‐hospital death; not transferred to another acute‐care facility; and enrolled in Part A Medicare for 1 year prior to discharge. We excluded index admissions for patients without at least 30 days postdischarge enrollment in FFS Medicare, discharged against medical advice, admitted for medical treatment of cancer or primary psychiatric disease, admitted to a Prospective Payment System‐exempt cancer hospital, or who died during the index hospitalization. In addition, for this study, we included only index admissions that were followed by a readmission to a hospital within the participating health system between July 1, 2011 and June 30, 2012. Institutional review board approval was obtained from each of the participating health systems, which granted waivers of signed informed consent and Health Insurance Portability and Accountability Act waivers.
Algorithm Validation: Sample Size Calculation
We determined a priori that the minimum acceptable positive predictive value, or proportion of all readmissions the algorithm labels planned that are truly planned, would be 60%, and the minimum acceptable negative predictive value, or proportion of all readmissions the algorithm labels as unplanned that are truly unplanned, would be 80%. We calculated the sample size required to be confident of these values 10% and determined we would need a total of 291 planned charts and 162 unplanned charts. We inflated these numbers by 20% to account for missing or unobtainable charts for a total of 550 charts. To achieve this sample size, we included all eligible readmissions from all participating hospitals that were categorized as planned. At the 5 smaller hospitals, we randomly selected an equal number of unplanned readmissions occurring at any hospital in its healthcare system. At the 2 largest hospitals, we randomly selected 50 unplanned readmissions occurring at any hospital in its healthcare system.
Algorithm Validation: Data Abstraction
We developed an abstraction tool, tested and refined it using sample charts, and built the final the tool into a secure, password‐protected Microsoft Access 2007 (Microsoft Corp., Redmond, WA) database (see Supporting Information, Appendix C, in the online version of this article). Experienced chart abstractors with RN or MD degrees from each hospital site participated in a 1‐hour training session to become familiar with reviewing medical charts, defining planned/unplanned readmissions, and the data abstraction process. For each readmission, we asked abstractors to review as needed: emergency department triage and physician notes, admission history and physical, operative report, discharge summary, and/or discharge summary from a prior admission. The abstractors verified the accuracy of the administrative billing data, including procedures and principal diagnosis. In addition, they abstracted the source of admission and dates of all major procedures. Then the abstractors provided their opinion and supporting rationale as to whether a readmission was planned or unplanned. They were not asked to determine whether the readmission was preventable. To determine the inter‐rater reliability of data abstraction, an independent abstractor at each health system recoded a random sample of 10% of the charts.
Statistical Analysis
To ensure that we had obtained a representative sample of charts, we identified the 10 most commonly planned procedures among cases identified as planned by the algorithm in the validation cohort and then compared this with planned cases nationally. To confirm the reliability of the abstraction process, we used the kappa statistic to determine the inter‐rater reliability of the determination of planned or unplanned status. Additionally, the full study team, including 5 practicing clinicians, reviewed the details of every chart abstraction in which the algorithm was found to have misclassified the readmission as planned or unplanned. In 11 cases we determined that the abstractor had misunderstood the definition of planned readmission (ie, not all direct admissions are necessarily planned) and we reclassified the chart review assignment accordingly.
We calculated sensitivity, specificity, positive predictive value, and negative predictive value of the algorithm for the validation cohort as a whole, weighted to account for the prevalence of planned readmissions as defined by the algorithm in the national data (7.8%). Weighting is necessary because we did not obtain a pure random sample, but rather selected a stratified sample that oversampled algorithm‐identified planned readmissions.[9] We also calculated these rates separately for large hospitals (>600 beds) and for small hospitals (600 beds).
Finally, we examined performance of the algorithm for individual procedures and diagnoses to determine whether any procedures or diagnoses should be added or removed from the algorithm. First, we reviewed the diagnoses, procedures, and brief narratives provided by the abstractors for all cases in which the algorithm misclassified the readmission as either planned or unplanned. Second, we calculated the positive predictive value for each procedure that had been flagged as planned by the algorithm, and reviewed all readmissions (correctly and incorrectly classified) in which procedures with low positive predictive value took place. We also calculated the frequency with which the procedure was the only qualifying procedure resulting in an accurate or inaccurate classification. Third, to identify changes that should be made to the lists of acute and nonacute diagnoses, we reviewed the principal diagnosis for all readmissions misclassified by the algorithm as either planned or unplanned, and examined the specific ICD‐9‐CM codes within each CCS group that were most commonly associated with misclassifications.
After determining the changes that should be made to the algorithm based on these analyses, we recalculated the sensitivity, specificity, positive predictive value, and negative predictive value of the proposed revised algorithm (v3.0). All analyses used SAS version 9.3 (SAS Institute, Cary, NC).
RESULTS
Study Cohort
Characteristics of participating hospitals are shown in Table 1. Hospitals represented in this sample ranged in size, teaching status, and safety net status, although all were nonprofit. We selected 663 readmissions for review, 363 planned and 300 unplanned. Overall we were able to select 80% of hospitals planned cases for review; the remainder occurred at hospitals outside the participating hospital system. Abstractors were able to locate and review 634 (96%) of the eligible charts (range, 86%100% per hospital). The kappa statistic for inter‐rater reliability was 0.83.
Description | Hospitals, N | Readmissions Selected for Review, N* | Readmissions Reviewed, N (% of Eligible) | Unplanned Readmissions Reviewed, N | Planned Readmissions Reviewed, N | % of Hospital's Planned Readmissions Reviewed* | |
---|---|---|---|---|---|---|---|
| |||||||
All hospitals | 7 | 663 | 634 (95.6) | 283 | 351 | 77.3 | |
No. of beds | >600 | 2 | 346 | 339 (98.0) | 116 | 223 | 84.5 |
>300600 | 2 | 190 | 173 (91.1) | 85 | 88 | 87.1 | |
<300 | 3 | 127 | 122 (96.0) | 82 | 40 | 44.9 | |
Ownership | Government | 0 | |||||
For profit | 0 | ||||||
Not for profit | 7 | 663 | 634 (95.6) | 283 | 351 | 77.3 | |
Teaching status | Teaching | 2 | 346 | 339 (98.0) | 116 | 223 | 84.5 |
Nonteaching | 5 | 317 | 295 (93.1) | 167 | 128 | 67.4 | |
Safety net status | Safety net | 2 | 346 | 339 (98.0) | 116 | 223 | 84.5 |
Nonsafety net | 5 | 317 | 295 (93.1) | 167 | 128 | 67.4 | |
Region | New England | 3 | 409 | 392 (95.8) | 155 | 237 | 85.9 |
South Central | 4 | 254 | 242 (95.3) | 128 | 114 | 64.0 |
The study sample included 57/67 (85%) of the procedure or condition categories on the potentially planned list. The most common procedure CCS categories among planned readmissions (v2.1) in the validation cohort were very similar to those in the national dataset (see Supporting Information, Appendix D, in the online version of this article). Of the top 20 most commonly planned procedure CCS categories in the validation set, all but 2, therapeutic radiology for cancer treatment (CCS 211) and peripheral vascular bypass (CCS 55), were among the top 20 most commonly planned procedure CCS categories in the national data.
Test Characteristics of Algorithm
The weighted test characteristics of the current algorithm (v2.1) are shown in Table 2. Overall, the algorithm correctly identified 266 readmissions as unplanned and 181 readmissions as planned, and misidentified 170 readmissions as planned and 15 as unplanned. Once weighted to account for the stratified sampling design, the overall prevalence of true planned readmissions was 8.9% of readmissions. The weighted sensitivity was 45.1% overall and was higher in large teaching centers than in smaller community hospitals. The weighted specificity was 95.9%. The positive predictive value was 51.6%, and the negative predictive value was 94.7%.
Cohort | Sensitivity | Specificity | Positive Predictive Value | Negative Predictive Value |
---|---|---|---|---|
Algorithm v2.1 | ||||
Full cohort | 45.1% | 95.9% | 51.6% | 94.7% |
Large hospitals | 50.9% | 96.1% | 53.8% | 95.6% |
Small hospitals | 40.2% | 95.5% | 47.7% | 94.0% |
Revised algorithm v3.0 | ||||
Full cohort | 49.8% | 96.5% | 58.7% | 94.5% |
Large hospitals | 57.1% | 96.8% | 63.0% | 95.9% |
Small hospitals | 42.6% | 95.9% | 52.6% | 93.9% |
Accuracy of Individual Diagnoses and Procedures
The positive predictive value of the algorithm for individual procedure categories varied widely, from 0% to 100% among procedures with at least 10 cases (Table 3). The procedure for which the algorithm was least accurate was CCS 211, therapeutic radiology for cancer treatment (0% positive predictive value). By contrast, maintenance chemotherapy (90%) and other therapeutic procedures, hemic and lymphatic system (100%) were most accurate. Common procedures with less than 50% positive predictive value (ie, that the algorithm commonly misclassified as planned) were diagnostic cardiac catheterization (25%); debridement of wound, infection, or burn (25%); amputation of lower extremity (29%); insertion, revision, replacement, removal of cardiac pacemaker or cardioverter/defibrillator (33%); and other hernia repair (43%). Of these, diagnostic cardiac catheterization and cardiac devices are the first and second most common procedures nationally, respectively.
Readmission Procedure CCS Code | Total Categorized as Planned by Algorithm, N | Verified as Planned by Chart Review, N | Positive Predictive Value |
---|---|---|---|
| |||
47 Diagnostic cardiac catheterization; coronary arteriography | 44 | 11 | 25% |
224 Cancer chemotherapy | 40 | 22 | 55% |
157 Amputation of lower extremity | 31 | 9 | 29% |
49 Other operating room heart procedures | 27 | 16 | 59% |
48 Insertion, revision, replacement, removal of cardiac pacemaker or cardioverter/defibrillator | 24 | 8 | 33% |
43 Heart valve procedures | 20 | 16 | 80% |
Maintenance chemotherapy (diagnosis CCS 45) | 20 | 18 | 90% |
78 Colorectal resection | 18 | 9 | 50% |
169 Debridement of wound, infection or burn | 16 | 4 | 25% |
84 Cholecystectomy and common duct exploration | 16 | 5 | 31% |
99 Other OR gastrointestinal therapeutic procedures | 16 | 8 | 50% |
158 Spinal fusion | 15 | 11 | 73% |
142 Partial excision bone | 14 | 10 | 71% |
86 Other hernia repair | 14 | 6 | 42% |
44 Coronary artery bypass graft | 13 | 10 | 77% |
67 Other therapeutic procedures, hemic and lymphatic system | 13 | 13 | 100% |
211 Therapeutic radiology for cancer treatment | 12 | 0 | 0% |
45 Percutaneous transluminal coronary angioplasty | 11 | 7 | 64% |
Total | 497 | 272 | 54.7% |
The readmissions with least abstractor agreement were those involving CCS 157 (amputation of lower extremity) and CCS 169 (debridement of wound, infection or burn). Readmissions for these procedures were nearly always performed as a consequence of acute worsening of chronic conditions such as osteomyelitis or ulceration. Abstractors were divided over whether these readmissions were appropriate to call planned.
Changes to the Algorithm
We determined that the accuracy of the algorithm would be improved by removing 2 procedure categories from the planned procedure list (therapeutic radiation [CCS 211] and cancer chemotherapy [CCS 224]), adding 1 diagnosis category to the acute diagnosis list (hypertension with complications [CCS 99]), and splitting 2 diagnosis condition categories into acute and nonacute ICD‐9‐CM codes (pancreatic disorders [CCS 149] and biliary tract disease [CCS 152]). Detailed rationales for each modification to the planned readmission algorithm are described in Table 4. We felt further examination of diagnostic cardiac catheterization and cardiac devices was warranted given their high frequency, despite low positive predictive value. We also elected not to alter the categorization of amputation or debridement because it was not easy to determine whether these admissions were planned or unplanned even with chart review. We plan further analyses of these procedure categories.
Action | Diagnosis or Procedure Category | Algorithm | Chart | N | Rationale for Change |
---|---|---|---|---|---|
| |||||
Remove from planned procedure list | Therapeutic radiation (CCS 211) | Accurate | The algorithm was inaccurate in every case. All therapeutic radiology during readmissions was performed because of acute illness (pain crisis, neurologic crisis) or because scheduled treatment occurred during an unplanned readmission. In national data, this ranks as the 25th most common planned procedure identified by the algorithm v2.1. | ||
Planned | Planned | 0 | |||
Unplanned | Unplanned | 0 | |||
Inaccurate | |||||
Unplanned | Planned | 0 | |||
Planned | Unplanned | 12 | |||
Cancer chemotherapy (CCS 224) | Accurate | Of the 22 correctly identified as planned, 18 (82%) would already have been categorized as planned because of a principal diagnosis of maintenance chemotherapy. Therefore, removing CCS 224 from the planned procedure list would only miss a small fraction of planned readmissions but would avoid a large number of misclassifications. In national data, this ranks as the 8th most common planned procedure identified by the algorithm v2.1. | |||
Planned | Planned | 22 | |||
Unplanned | Unplanned | 0 | |||
Inaccurate | |||||
Unplanned | Planned | 0 | |||
Planned | Unplanned | 18 | |||
Add to planned procedure list | None | The abstractors felt a planned readmission was missed by the algorithm in 15 cases. A handful of these cases were missed because the planned procedure was not on the current planned procedure list; however, those procedures (eg, abdominal paracentesis, colonoscopy, endoscopy) were nearly always unplanned overall and should therefore not be added as procedures that potentially qualify as an admission as planned. | |||
Remove from acute diagnosis list | None | The abstractors felt a planned readmission was missed by the algorithm in 15 cases. The relevant disqualifying acute diagnoses were much more often associated with unplanned readmissions in our dataset. | |||
Add to acute diagnosis list | Hypertension with complications (CCS 99) | Accurate | This CCS was associated with only 1 planned readmission (for elective nephrectomy, a very rare procedure). Every other time this CCS appeared in the dataset, it was associated with an unplanned readmission (12/13, 92%); 10 of those, however, were misclassified by the algorithm as planned because they were not excluded by diagnosis (91% error rate). Consequently, adding this CCS to the acute diagnosis list is likely to miss only a very small fraction of planned readmissions, while making the overall algorithm much more accurate. | ||
Planned | Planned | 1 | |||
Unplanned | Unplanned | 2 | |||
Inaccurate | |||||
Unplanned | Planned | 0 | |||
Planned | Unplanned | 10 | |||
Split diagnosis condition category into component ICD‐9 codes | Pancreatic disorders (CCS 152) | Accurate | ICD‐9 code 577.0 (acute pancreatitis) is the only acute code in this CCS. Acute pancreatitis was present in 2 cases that were misclassified as planned. Clinically, there is no situation in which a planned procedure would reasonably be performed in the setting of acute pancreatitis. Moving ICD‐9 code 577.0 to the acute list and leaving the rest of the ICD‐9 codes in CCS 152 on the nonacute list will enable the algorithm to continue to identify planned procedures for chronic pancreatitis. | ||
Planned | Planned | 0 | |||
Unplanned | Unplanned | 1 | |||
Inaccurate | |||||
Unplanned | Planned | 0 | |||
Planned | Unplanned | 2 | |||
Biliary tract disease (CCS 149) | Accurate | This CCS is a mix of acute and chronic diagnoses. Of 14 charts classified as planned with CCS 149 in the principal diagnosis field, 12 were misclassified (of which 10 were associated with cholecystectomy). Separating out the acute and nonacute diagnoses will increase the accuracy of the algorithm while still ensuring that planned cholecystectomies and other procedures can be identified. Of the ICD‐9 codes in CCS 149, the following will be added to the acute diagnosis list: 574.0, 574.3, 574.6, 574.8, 575.0, 575.12, 576.1. | |||
Planned | Planned | 2 | |||
Unplanned | Unplanned | 3 | |||
Inaccurate | |||||
Unplanned | Planned | 0 | |||
Planned | Unplanned | 12 | |||
Consider for change after additional study | Diagnostic cardiac catheterization (CCS 47) | Accurate | The algorithm misclassified as planned 25/38 (66%) unplanned readmissions in which diagnostic catheterizations were the only qualifying planned procedure. It also correctly identified 3/3 (100%) planned readmissions in which diagnostic cardiac catheterizations were the only qualifying planned procedure. This is the highest volume procedure in national data. | ||
Planned | Planned | 3* | |||
Unplanned | Unplanned | 13* | |||
Inaccurate | |||||
Unplanned | Planned | 0* | |||
Planned | Unplanned | 25* | |||
Insertion, revision, replacement, removal of cardiac pacemaker or cardioverter/defibrillator (CCS 48) | Accurate | The algorithm misclassified as planned 4/5 (80%) unplanned readmissions in which cardiac devices were the only qualifying procedure. However, it also correctly identified 7/8 (87.5%) planned readmissions in which cardiac devices were the only qualifying planned procedure. CCS 48 is the second most common planned procedure category nationally. | |||
Planned | Planned | 7 | |||
Unplanned | Unplanned | 1 | |||
Inaccurate | |||||
Unplanned | Planned | 1 | |||
Planned | Unplanned | 4 |
The revised algorithm (v3.0) had a weighted sensitivity of 49.8%, weighted specificity of 96.5%, positive predictive value of 58.7%, and negative predictive value of 94.5% (Table 2). In aggregate, these changes would increase the reported unplanned readmission rate from 16.0% to 16.1% in the hospital‐wide readmission measure, using 2011 to 2012 data, and would decrease the fraction of all readmissions considered planned from 7.8% to 7.2%.
DISCUSSION
We developed an algorithm based on administrative data that in its currently implemented form is very accurate at identifying unplanned readmissions, ensuring that readmissions included in publicly reported readmission measures are likely to be truly unplanned. However, nearly half of readmissions the algorithm classifies as planned are actually unplanned. That is, the algorithm is overcautious in excluding unplanned readmissions that could have counted as outcomes, particularly among admissions that include diagnostic cardiac catheterization or placement of cardiac devices (pacemakers, defibrillators). However, these errors only occur within the 7.8% of readmissions that are classified as planned and therefore do not affect overall readmission rates dramatically. A perfect algorithm would reclassify approximately half of these planned readmissions as unplanned, increasing the overall readmission rate by 0.6 percentage points.
On the other hand, the algorithm also only identifies approximately half of true planned readmissions as planned. Because the true prevalence of planned readmissions is low (approximately 9% of readmissions based on weighted chart review prevalence, or an absolute rate of 1.4%), this low sensitivity has a small effect on algorithm performance. Removing all true planned readmissions from the measure outcome would decrease the overall readmission rate by 0.8 percentage points, similar to the expected 0.6 percentage point increase that would result from better identifying unplanned readmissions; thus, a perfect algorithm would likely decrease the reported unplanned readmission rate by a net 0.2%. Overall, the existing algorithm appears to come close to the true prevalence of planned readmissions, despite inaccuracy on an individual‐case basis. The algorithm performed best at large hospitals, which are at greatest risk of being statistical outliers and of accruing penalties under the Hospital Readmissions Reduction Program.[10]
We identified several changes that marginally improved the performance of the algorithm by reducing the number of unplanned readmissions that are incorrectly removed from the measure, while avoiding the inappropriate inclusion of planned readmissions in the outcome. This revised algorithm, v3.0, was applied to public reporting of readmission rates at the end of 2014. Overall, implementing these changes increases the reported readmission rate very slightly. We also identified other procedures associated with high inaccuracy rates, removal of which would have larger impact on reporting rates, and which therefore merit further evaluation.
There are other potential methods of identifying planned readmissions. For instance, as of October 1, 2013, new administrative billing codes were created to allow hospitals to indicate that a patient was discharged with a planned acute‐care hospital inpatient readmission, without limitation as to when it will take place.[11] This code must be used at the time of the index admission to indicate that a future planned admission is expected, and was specified only to be used for neonates and patients with acute myocardial infarction. This approach, however, would omit planned readmissions that are not known to the initial discharging team, potentially missing planned readmissions. Conversely, some patients discharged with a plan for readmission may be unexpectedly readmitted for an unplanned reason. Given that the new codes were not available at the time we conducted the validation study, we were not able to determine how often the billing codes accurately identified planned readmissions. This would be an important area to consider for future study.
An alternative approach would be to create indicator codes to be applied at the time of readmission that would indicate whether that admission was planned or unplanned. Such a code would have the advantage of allowing each planned readmission to be flagged by the admitting clinicians at the time of admission rather than by an algorithm that inherently cannot be perfect. However, identifying planned readmissions at the time of readmission would also create opportunity for gaming and inconsistent application of definitions between hospitals; additional checks would need to be put in place to guard against these possibilities.
Our study has some limitations. We relied on the opinion of chart abstractors to determine whether a readmission was planned or unplanned; in a few cases, such as smoldering wounds that ultimately require surgical intervention, that determination is debatable. Abstractions were done at local institutions to minimize risks to patient privacy, and therefore we could not centrally verify determinations of planned status except by reviewing source of admission, dates of procedures, and narrative comments reported by the abstractors. Finally, we did not have sufficient volume of planned procedures to determine accuracy of the algorithm for less common procedure categories or individual procedures within categories.
In summary, we developed an algorithm to identify planned readmissions from administrative data that had high specificity and moderate sensitivity, and refined it based on chart validation. This algorithm is in use in public reporting of readmission measures to maximize the probability that the reported readmission rates represent truly unplanned readmissions.[12]
Disclosures: Financial supportThis work was performed under contract HHSM‐500‐2008‐0025I/HHSM‐500‐T0001, Modification No. 000008, titled Measure Instrument Development and Support, funded by the Centers for Medicare and Medicaid Services (CMS), an agency of the US Department of Health and Human Services. Drs. Horwitz and Ross are supported by the National Institute on Aging (K08 AG038336 and K08 AG032886, respectively) and by the American Federation for Aging Research through the Paul B. Beeson Career Development Award Program. Dr. Krumholz is supported by grant U01 HL105270‐05 (Center for Cardiovascular Outcomes Research at Yale University) from the National Heart, Lung, and Blood Institute. No funding source had any role in the study design; in the collection, analysis, and interpretation of data; or in the writing of the article. The CMS reviewed and approved the use of its data for this work and approved submission of the manuscript. All authors have completed the Unified Competing Interest form at
The Centers for Medicare & Medicaid Services (CMS) publicly reports all‐cause risk‐standardized readmission rates after acute‐care hospitalization for acute myocardial infarction, pneumonia, heart failure, total hip and knee arthroplasty, chronic obstructive pulmonary disease, stroke, and for patients hospital‐wide.[1, 2, 3, 4, 5] Ideally, these measures should capture unplanned readmissions that arise from acute clinical events requiring urgent rehospitalization. Planned readmissions, which are scheduled admissions usually involving nonurgent procedures, may not be a signal of quality of care. Including planned readmissions in readmission quality measures could create a disincentive to provide appropriate care to patients who are scheduled for elective or necessary procedures unrelated to the quality of the prior admission. Accordingly, under contract to the CMS, we were asked to develop an algorithm to identify planned readmissions. A version of this algorithm is now incorporated into all publicly reported readmission measures.
Given the widespread use of the planned readmission algorithm in public reporting and its implications for hospital quality measurement and evaluation, the objective of this study was to describe the development process, and to validate and refine the algorithm by reviewing charts of readmitted patients.
METHODS
Algorithm Development
To create a planned readmission algorithm, we first defined planned. We determined that readmissions for obstetrical delivery, maintenance chemotherapy, major organ transplant, and rehabilitation should always be considered planned in the sense that they are desired and/or inevitable, even if not specifically planned on a certain date. Apart from these specific types of readmissions, we defined planned readmissions as nonacute readmissions for scheduled procedures, because the vast majority of planned admissions are related to procedures. We also defined readmissions for acute illness or for complications of care as unplanned for the purposes of a quality measure. Even if such readmissions included a potentially planned procedure, because complications of care represent an important dimension of quality that should not be excluded from outcome measurement, these admissions should not be removed from the measure outcome. This definition of planned readmissions does not imply that all unplanned readmissions are unexpected or avoidable. However, it has proven very difficult to reliably define avoidable readmissions, even by expert review of charts, and we did not attempt to do so here.[6, 7]
In the second stage, we operationalized this definition into an algorithm. We used the Agency for Healthcare Research and Quality's Clinical Classification Software (CCS) codes to group thousands of individual procedure and diagnosis International Classification of Disease, Ninth Revision, Clinical Modification (ICD‐9‐CM) codes into clinically coherent, mutually exclusive procedure CCS categories and mutually exclusive diagnosis CCS categories, respectively. Clinicians on the investigative team reviewed the procedure categories to identify those that are commonly planned and that would require inpatient admission. We also reviewed the diagnosis categories to identify acute diagnoses unlikely to accompany elective procedures. We then created a flow diagram through which every readmission could be run to determine whether it was planned or unplanned based on our categorizations of procedures and diagnoses (Figure 1, and Supporting Information, Appendix A, in the online version of this article). This version of the algorithm (v1.0) was submitted to the National Quality Forum (NQF) as part of the hospital‐wide readmission measure. The measure (NQR #1789) received endorsement in April 2012.

In the third stage of development, we posted the algorithm for 2 public comment periods and recruited 27 outside experts to review and refine the algorithm following a standardized, structured process (see Supporting Information, Appendix B, in the online version of this article). Because the measures publicly report and hold hospitals accountable for unplanned readmission rates, we felt it most important that the algorithm include as few planned readmissions in the reported, unplanned outcome as possible (ie, have high negative predictive value). Therefore, in equivocal situations in which experts felt procedure categories were equally often planned or unplanned, we added those procedures to the potentially planned list. We also solicited feedback from hospitals on algorithm performance during a confidential test run of the hospital‐wide readmission measure in the fall of 2012. Based on all of this feedback, we made a number of changes to the algorithm, which was then identified as v2.1. Version 2.1 of the algorithm was submitted to the NQF as part of the endorsement process for the acute myocardial infarction and heart failure readmission measures and was endorsed by the NQF in January 2013. The algorithm (v2.1) is now applied, adapted if necessary, to all publicly reported readmission measures.[8]
Algorithm Validation: Study Cohort
We recruited 2 hospital systems to participate in a chart validation study of the accuracy of the planned readmission algorithm (v2.1). Within these 2 health systems, we selected 7 hospitals with varying bed size, teaching status, and safety‐net status. Each included 1 large academic teaching hospital that serves as a regional referral center. For each hospital's index admissions, we applied the inclusion and exclusion criteria from the hospital‐wide readmission measure. Index admissions were included for patients age 65 years or older; enrolled in Medicare fee‐for‐service (FFS); discharged from a nonfederal, short‐stay, acute‐care hospital or critical access hospital; without an in‐hospital death; not transferred to another acute‐care facility; and enrolled in Part A Medicare for 1 year prior to discharge. We excluded index admissions for patients without at least 30 days postdischarge enrollment in FFS Medicare, discharged against medical advice, admitted for medical treatment of cancer or primary psychiatric disease, admitted to a Prospective Payment System‐exempt cancer hospital, or who died during the index hospitalization. In addition, for this study, we included only index admissions that were followed by a readmission to a hospital within the participating health system between July 1, 2011 and June 30, 2012. Institutional review board approval was obtained from each of the participating health systems, which granted waivers of signed informed consent and Health Insurance Portability and Accountability Act waivers.
Algorithm Validation: Sample Size Calculation
We determined a priori that the minimum acceptable positive predictive value, or proportion of all readmissions the algorithm labels planned that are truly planned, would be 60%, and the minimum acceptable negative predictive value, or proportion of all readmissions the algorithm labels as unplanned that are truly unplanned, would be 80%. We calculated the sample size required to be confident of these values 10% and determined we would need a total of 291 planned charts and 162 unplanned charts. We inflated these numbers by 20% to account for missing or unobtainable charts for a total of 550 charts. To achieve this sample size, we included all eligible readmissions from all participating hospitals that were categorized as planned. At the 5 smaller hospitals, we randomly selected an equal number of unplanned readmissions occurring at any hospital in its healthcare system. At the 2 largest hospitals, we randomly selected 50 unplanned readmissions occurring at any hospital in its healthcare system.
Algorithm Validation: Data Abstraction
We developed an abstraction tool, tested and refined it using sample charts, and built the final the tool into a secure, password‐protected Microsoft Access 2007 (Microsoft Corp., Redmond, WA) database (see Supporting Information, Appendix C, in the online version of this article). Experienced chart abstractors with RN or MD degrees from each hospital site participated in a 1‐hour training session to become familiar with reviewing medical charts, defining planned/unplanned readmissions, and the data abstraction process. For each readmission, we asked abstractors to review as needed: emergency department triage and physician notes, admission history and physical, operative report, discharge summary, and/or discharge summary from a prior admission. The abstractors verified the accuracy of the administrative billing data, including procedures and principal diagnosis. In addition, they abstracted the source of admission and dates of all major procedures. Then the abstractors provided their opinion and supporting rationale as to whether a readmission was planned or unplanned. They were not asked to determine whether the readmission was preventable. To determine the inter‐rater reliability of data abstraction, an independent abstractor at each health system recoded a random sample of 10% of the charts.
Statistical Analysis
To ensure that we had obtained a representative sample of charts, we identified the 10 most commonly planned procedures among cases identified as planned by the algorithm in the validation cohort and then compared this with planned cases nationally. To confirm the reliability of the abstraction process, we used the kappa statistic to determine the inter‐rater reliability of the determination of planned or unplanned status. Additionally, the full study team, including 5 practicing clinicians, reviewed the details of every chart abstraction in which the algorithm was found to have misclassified the readmission as planned or unplanned. In 11 cases we determined that the abstractor had misunderstood the definition of planned readmission (ie, not all direct admissions are necessarily planned) and we reclassified the chart review assignment accordingly.
We calculated sensitivity, specificity, positive predictive value, and negative predictive value of the algorithm for the validation cohort as a whole, weighted to account for the prevalence of planned readmissions as defined by the algorithm in the national data (7.8%). Weighting is necessary because we did not obtain a pure random sample, but rather selected a stratified sample that oversampled algorithm‐identified planned readmissions.[9] We also calculated these rates separately for large hospitals (>600 beds) and for small hospitals (600 beds).
Finally, we examined performance of the algorithm for individual procedures and diagnoses to determine whether any procedures or diagnoses should be added or removed from the algorithm. First, we reviewed the diagnoses, procedures, and brief narratives provided by the abstractors for all cases in which the algorithm misclassified the readmission as either planned or unplanned. Second, we calculated the positive predictive value for each procedure that had been flagged as planned by the algorithm, and reviewed all readmissions (correctly and incorrectly classified) in which procedures with low positive predictive value took place. We also calculated the frequency with which the procedure was the only qualifying procedure resulting in an accurate or inaccurate classification. Third, to identify changes that should be made to the lists of acute and nonacute diagnoses, we reviewed the principal diagnosis for all readmissions misclassified by the algorithm as either planned or unplanned, and examined the specific ICD‐9‐CM codes within each CCS group that were most commonly associated with misclassifications.
After determining the changes that should be made to the algorithm based on these analyses, we recalculated the sensitivity, specificity, positive predictive value, and negative predictive value of the proposed revised algorithm (v3.0). All analyses used SAS version 9.3 (SAS Institute, Cary, NC).
RESULTS
Study Cohort
Characteristics of participating hospitals are shown in Table 1. Hospitals represented in this sample ranged in size, teaching status, and safety net status, although all were nonprofit. We selected 663 readmissions for review, 363 planned and 300 unplanned. Overall we were able to select 80% of hospitals planned cases for review; the remainder occurred at hospitals outside the participating hospital system. Abstractors were able to locate and review 634 (96%) of the eligible charts (range, 86%100% per hospital). The kappa statistic for inter‐rater reliability was 0.83.
Description | Hospitals, N | Readmissions Selected for Review, N* | Readmissions Reviewed, N (% of Eligible) | Unplanned Readmissions Reviewed, N | Planned Readmissions Reviewed, N | % of Hospital's Planned Readmissions Reviewed* | |
---|---|---|---|---|---|---|---|
| |||||||
All hospitals | 7 | 663 | 634 (95.6) | 283 | 351 | 77.3 | |
No. of beds | >600 | 2 | 346 | 339 (98.0) | 116 | 223 | 84.5 |
>300600 | 2 | 190 | 173 (91.1) | 85 | 88 | 87.1 | |
<300 | 3 | 127 | 122 (96.0) | 82 | 40 | 44.9 | |
Ownership | Government | 0 | |||||
For profit | 0 | ||||||
Not for profit | 7 | 663 | 634 (95.6) | 283 | 351 | 77.3 | |
Teaching status | Teaching | 2 | 346 | 339 (98.0) | 116 | 223 | 84.5 |
Nonteaching | 5 | 317 | 295 (93.1) | 167 | 128 | 67.4 | |
Safety net status | Safety net | 2 | 346 | 339 (98.0) | 116 | 223 | 84.5 |
Nonsafety net | 5 | 317 | 295 (93.1) | 167 | 128 | 67.4 | |
Region | New England | 3 | 409 | 392 (95.8) | 155 | 237 | 85.9 |
South Central | 4 | 254 | 242 (95.3) | 128 | 114 | 64.0 |
The study sample included 57/67 (85%) of the procedure or condition categories on the potentially planned list. The most common procedure CCS categories among planned readmissions (v2.1) in the validation cohort were very similar to those in the national dataset (see Supporting Information, Appendix D, in the online version of this article). Of the top 20 most commonly planned procedure CCS categories in the validation set, all but 2, therapeutic radiology for cancer treatment (CCS 211) and peripheral vascular bypass (CCS 55), were among the top 20 most commonly planned procedure CCS categories in the national data.
Test Characteristics of Algorithm
The weighted test characteristics of the current algorithm (v2.1) are shown in Table 2. Overall, the algorithm correctly identified 266 readmissions as unplanned and 181 readmissions as planned, and misidentified 170 readmissions as planned and 15 as unplanned. Once weighted to account for the stratified sampling design, the overall prevalence of true planned readmissions was 8.9% of readmissions. The weighted sensitivity was 45.1% overall and was higher in large teaching centers than in smaller community hospitals. The weighted specificity was 95.9%. The positive predictive value was 51.6%, and the negative predictive value was 94.7%.
Cohort | Sensitivity | Specificity | Positive Predictive Value | Negative Predictive Value |
---|---|---|---|---|
Algorithm v2.1 | ||||
Full cohort | 45.1% | 95.9% | 51.6% | 94.7% |
Large hospitals | 50.9% | 96.1% | 53.8% | 95.6% |
Small hospitals | 40.2% | 95.5% | 47.7% | 94.0% |
Revised algorithm v3.0 | ||||
Full cohort | 49.8% | 96.5% | 58.7% | 94.5% |
Large hospitals | 57.1% | 96.8% | 63.0% | 95.9% |
Small hospitals | 42.6% | 95.9% | 52.6% | 93.9% |
Accuracy of Individual Diagnoses and Procedures
The positive predictive value of the algorithm for individual procedure categories varied widely, from 0% to 100% among procedures with at least 10 cases (Table 3). The procedure for which the algorithm was least accurate was CCS 211, therapeutic radiology for cancer treatment (0% positive predictive value). By contrast, maintenance chemotherapy (90%) and other therapeutic procedures, hemic and lymphatic system (100%) were most accurate. Common procedures with less than 50% positive predictive value (ie, that the algorithm commonly misclassified as planned) were diagnostic cardiac catheterization (25%); debridement of wound, infection, or burn (25%); amputation of lower extremity (29%); insertion, revision, replacement, removal of cardiac pacemaker or cardioverter/defibrillator (33%); and other hernia repair (43%). Of these, diagnostic cardiac catheterization and cardiac devices are the first and second most common procedures nationally, respectively.
Readmission Procedure CCS Code | Total Categorized as Planned by Algorithm, N | Verified as Planned by Chart Review, N | Positive Predictive Value |
---|---|---|---|
| |||
47 Diagnostic cardiac catheterization; coronary arteriography | 44 | 11 | 25% |
224 Cancer chemotherapy | 40 | 22 | 55% |
157 Amputation of lower extremity | 31 | 9 | 29% |
49 Other operating room heart procedures | 27 | 16 | 59% |
48 Insertion, revision, replacement, removal of cardiac pacemaker or cardioverter/defibrillator | 24 | 8 | 33% |
43 Heart valve procedures | 20 | 16 | 80% |
Maintenance chemotherapy (diagnosis CCS 45) | 20 | 18 | 90% |
78 Colorectal resection | 18 | 9 | 50% |
169 Debridement of wound, infection or burn | 16 | 4 | 25% |
84 Cholecystectomy and common duct exploration | 16 | 5 | 31% |
99 Other OR gastrointestinal therapeutic procedures | 16 | 8 | 50% |
158 Spinal fusion | 15 | 11 | 73% |
142 Partial excision bone | 14 | 10 | 71% |
86 Other hernia repair | 14 | 6 | 42% |
44 Coronary artery bypass graft | 13 | 10 | 77% |
67 Other therapeutic procedures, hemic and lymphatic system | 13 | 13 | 100% |
211 Therapeutic radiology for cancer treatment | 12 | 0 | 0% |
45 Percutaneous transluminal coronary angioplasty | 11 | 7 | 64% |
Total | 497 | 272 | 54.7% |
The readmissions with least abstractor agreement were those involving CCS 157 (amputation of lower extremity) and CCS 169 (debridement of wound, infection or burn). Readmissions for these procedures were nearly always performed as a consequence of acute worsening of chronic conditions such as osteomyelitis or ulceration. Abstractors were divided over whether these readmissions were appropriate to call planned.
Changes to the Algorithm
We determined that the accuracy of the algorithm would be improved by removing 2 procedure categories from the planned procedure list (therapeutic radiation [CCS 211] and cancer chemotherapy [CCS 224]), adding 1 diagnosis category to the acute diagnosis list (hypertension with complications [CCS 99]), and splitting 2 diagnosis condition categories into acute and nonacute ICD‐9‐CM codes (pancreatic disorders [CCS 149] and biliary tract disease [CCS 152]). Detailed rationales for each modification to the planned readmission algorithm are described in Table 4. We felt further examination of diagnostic cardiac catheterization and cardiac devices was warranted given their high frequency, despite low positive predictive value. We also elected not to alter the categorization of amputation or debridement because it was not easy to determine whether these admissions were planned or unplanned even with chart review. We plan further analyses of these procedure categories.
Action | Diagnosis or Procedure Category | Algorithm | Chart | N | Rationale for Change |
---|---|---|---|---|---|
| |||||
Remove from planned procedure list | Therapeutic radiation (CCS 211) | Accurate | The algorithm was inaccurate in every case. All therapeutic radiology during readmissions was performed because of acute illness (pain crisis, neurologic crisis) or because scheduled treatment occurred during an unplanned readmission. In national data, this ranks as the 25th most common planned procedure identified by the algorithm v2.1. | ||
Planned | Planned | 0 | |||
Unplanned | Unplanned | 0 | |||
Inaccurate | |||||
Unplanned | Planned | 0 | |||
Planned | Unplanned | 12 | |||
Cancer chemotherapy (CCS 224) | Accurate | Of the 22 correctly identified as planned, 18 (82%) would already have been categorized as planned because of a principal diagnosis of maintenance chemotherapy. Therefore, removing CCS 224 from the planned procedure list would only miss a small fraction of planned readmissions but would avoid a large number of misclassifications. In national data, this ranks as the 8th most common planned procedure identified by the algorithm v2.1. | |||
Planned | Planned | 22 | |||
Unplanned | Unplanned | 0 | |||
Inaccurate | |||||
Unplanned | Planned | 0 | |||
Planned | Unplanned | 18 | |||
Add to planned procedure list | None | The abstractors felt a planned readmission was missed by the algorithm in 15 cases. A handful of these cases were missed because the planned procedure was not on the current planned procedure list; however, those procedures (eg, abdominal paracentesis, colonoscopy, endoscopy) were nearly always unplanned overall and should therefore not be added as procedures that potentially qualify as an admission as planned. | |||
Remove from acute diagnosis list | None | The abstractors felt a planned readmission was missed by the algorithm in 15 cases. The relevant disqualifying acute diagnoses were much more often associated with unplanned readmissions in our dataset. | |||
Add to acute diagnosis list | Hypertension with complications (CCS 99) | Accurate | This CCS was associated with only 1 planned readmission (for elective nephrectomy, a very rare procedure). Every other time this CCS appeared in the dataset, it was associated with an unplanned readmission (12/13, 92%); 10 of those, however, were misclassified by the algorithm as planned because they were not excluded by diagnosis (91% error rate). Consequently, adding this CCS to the acute diagnosis list is likely to miss only a very small fraction of planned readmissions, while making the overall algorithm much more accurate. | ||
Planned | Planned | 1 | |||
Unplanned | Unplanned | 2 | |||
Inaccurate | |||||
Unplanned | Planned | 0 | |||
Planned | Unplanned | 10 | |||
Split diagnosis condition category into component ICD‐9 codes | Pancreatic disorders (CCS 152) | Accurate | ICD‐9 code 577.0 (acute pancreatitis) is the only acute code in this CCS. Acute pancreatitis was present in 2 cases that were misclassified as planned. Clinically, there is no situation in which a planned procedure would reasonably be performed in the setting of acute pancreatitis. Moving ICD‐9 code 577.0 to the acute list and leaving the rest of the ICD‐9 codes in CCS 152 on the nonacute list will enable the algorithm to continue to identify planned procedures for chronic pancreatitis. | ||
Planned | Planned | 0 | |||
Unplanned | Unplanned | 1 | |||
Inaccurate | |||||
Unplanned | Planned | 0 | |||
Planned | Unplanned | 2 | |||
Biliary tract disease (CCS 149) | Accurate | This CCS is a mix of acute and chronic diagnoses. Of 14 charts classified as planned with CCS 149 in the principal diagnosis field, 12 were misclassified (of which 10 were associated with cholecystectomy). Separating out the acute and nonacute diagnoses will increase the accuracy of the algorithm while still ensuring that planned cholecystectomies and other procedures can be identified. Of the ICD‐9 codes in CCS 149, the following will be added to the acute diagnosis list: 574.0, 574.3, 574.6, 574.8, 575.0, 575.12, 576.1. | |||
Planned | Planned | 2 | |||
Unplanned | Unplanned | 3 | |||
Inaccurate | |||||
Unplanned | Planned | 0 | |||
Planned | Unplanned | 12 | |||
Consider for change after additional study | Diagnostic cardiac catheterization (CCS 47) | Accurate | The algorithm misclassified as planned 25/38 (66%) unplanned readmissions in which diagnostic catheterizations were the only qualifying planned procedure. It also correctly identified 3/3 (100%) planned readmissions in which diagnostic cardiac catheterizations were the only qualifying planned procedure. This is the highest volume procedure in national data. | ||
Planned | Planned | 3* | |||
Unplanned | Unplanned | 13* | |||
Inaccurate | |||||
Unplanned | Planned | 0* | |||
Planned | Unplanned | 25* | |||
Insertion, revision, replacement, removal of cardiac pacemaker or cardioverter/defibrillator (CCS 48) | Accurate | The algorithm misclassified as planned 4/5 (80%) unplanned readmissions in which cardiac devices were the only qualifying procedure. However, it also correctly identified 7/8 (87.5%) planned readmissions in which cardiac devices were the only qualifying planned procedure. CCS 48 is the second most common planned procedure category nationally. | |||
Planned | Planned | 7 | |||
Unplanned | Unplanned | 1 | |||
Inaccurate | |||||
Unplanned | Planned | 1 | |||
Planned | Unplanned | 4 |
The revised algorithm (v3.0) had a weighted sensitivity of 49.8%, weighted specificity of 96.5%, positive predictive value of 58.7%, and negative predictive value of 94.5% (Table 2). In aggregate, these changes would increase the reported unplanned readmission rate from 16.0% to 16.1% in the hospital‐wide readmission measure, using 2011 to 2012 data, and would decrease the fraction of all readmissions considered planned from 7.8% to 7.2%.
DISCUSSION
We developed an algorithm based on administrative data that in its currently implemented form is very accurate at identifying unplanned readmissions, ensuring that readmissions included in publicly reported readmission measures are likely to be truly unplanned. However, nearly half of readmissions the algorithm classifies as planned are actually unplanned. That is, the algorithm is overcautious in excluding unplanned readmissions that could have counted as outcomes, particularly among admissions that include diagnostic cardiac catheterization or placement of cardiac devices (pacemakers, defibrillators). However, these errors only occur within the 7.8% of readmissions that are classified as planned and therefore do not affect overall readmission rates dramatically. A perfect algorithm would reclassify approximately half of these planned readmissions as unplanned, increasing the overall readmission rate by 0.6 percentage points.
On the other hand, the algorithm also only identifies approximately half of true planned readmissions as planned. Because the true prevalence of planned readmissions is low (approximately 9% of readmissions based on weighted chart review prevalence, or an absolute rate of 1.4%), this low sensitivity has a small effect on algorithm performance. Removing all true planned readmissions from the measure outcome would decrease the overall readmission rate by 0.8 percentage points, similar to the expected 0.6 percentage point increase that would result from better identifying unplanned readmissions; thus, a perfect algorithm would likely decrease the reported unplanned readmission rate by a net 0.2%. Overall, the existing algorithm appears to come close to the true prevalence of planned readmissions, despite inaccuracy on an individual‐case basis. The algorithm performed best at large hospitals, which are at greatest risk of being statistical outliers and of accruing penalties under the Hospital Readmissions Reduction Program.[10]
We identified several changes that marginally improved the performance of the algorithm by reducing the number of unplanned readmissions that are incorrectly removed from the measure, while avoiding the inappropriate inclusion of planned readmissions in the outcome. This revised algorithm, v3.0, was applied to public reporting of readmission rates at the end of 2014. Overall, implementing these changes increases the reported readmission rate very slightly. We also identified other procedures associated with high inaccuracy rates, removal of which would have larger impact on reporting rates, and which therefore merit further evaluation.
There are other potential methods of identifying planned readmissions. For instance, as of October 1, 2013, new administrative billing codes were created to allow hospitals to indicate that a patient was discharged with a planned acute‐care hospital inpatient readmission, without limitation as to when it will take place.[11] This code must be used at the time of the index admission to indicate that a future planned admission is expected, and was specified only to be used for neonates and patients with acute myocardial infarction. This approach, however, would omit planned readmissions that are not known to the initial discharging team, potentially missing planned readmissions. Conversely, some patients discharged with a plan for readmission may be unexpectedly readmitted for an unplanned reason. Given that the new codes were not available at the time we conducted the validation study, we were not able to determine how often the billing codes accurately identified planned readmissions. This would be an important area to consider for future study.
An alternative approach would be to create indicator codes to be applied at the time of readmission that would indicate whether that admission was planned or unplanned. Such a code would have the advantage of allowing each planned readmission to be flagged by the admitting clinicians at the time of admission rather than by an algorithm that inherently cannot be perfect. However, identifying planned readmissions at the time of readmission would also create opportunity for gaming and inconsistent application of definitions between hospitals; additional checks would need to be put in place to guard against these possibilities.
Our study has some limitations. We relied on the opinion of chart abstractors to determine whether a readmission was planned or unplanned; in a few cases, such as smoldering wounds that ultimately require surgical intervention, that determination is debatable. Abstractions were done at local institutions to minimize risks to patient privacy, and therefore we could not centrally verify determinations of planned status except by reviewing source of admission, dates of procedures, and narrative comments reported by the abstractors. Finally, we did not have sufficient volume of planned procedures to determine accuracy of the algorithm for less common procedure categories or individual procedures within categories.
In summary, we developed an algorithm to identify planned readmissions from administrative data that had high specificity and moderate sensitivity, and refined it based on chart validation. This algorithm is in use in public reporting of readmission measures to maximize the probability that the reported readmission rates represent truly unplanned readmissions.[12]
Disclosures: Financial supportThis work was performed under contract HHSM‐500‐2008‐0025I/HHSM‐500‐T0001, Modification No. 000008, titled Measure Instrument Development and Support, funded by the Centers for Medicare and Medicaid Services (CMS), an agency of the US Department of Health and Human Services. Drs. Horwitz and Ross are supported by the National Institute on Aging (K08 AG038336 and K08 AG032886, respectively) and by the American Federation for Aging Research through the Paul B. Beeson Career Development Award Program. Dr. Krumholz is supported by grant U01 HL105270‐05 (Center for Cardiovascular Outcomes Research at Yale University) from the National Heart, Lung, and Blood Institute. No funding source had any role in the study design; in the collection, analysis, and interpretation of data; or in the writing of the article. The CMS reviewed and approved the use of its data for this work and approved submission of the manuscript. All authors have completed the Unified Competing Interest form at
- Development, validation, and results of a measure of 30‐day readmission following hospitalization for pneumonia. J Hosp Med. 2011;6(3):142–150. , , , et al.
- An administrative claims measure suitable for profiling hospital performance based on 30‐day all‐cause readmission rates among patients with acute myocardial infarction. Circ Cardiovasc Qual Outcomes. 2011;4(2):243–252. , , , et al.
- An administrative claims measure suitable for profiling hospital performance on the basis of 30‐day all‐cause readmission rates among patients with heart failure. Circ Cardiovasc Qual Outcomes. 2008;1:29–37. , , , et al.
- http://www.qualitynet.org/dcs/ContentServer?c=Page161(supp10 l):S66–S75. , , , et al. Hospital‐level 30‐day all‐cause risk‐standardized readmission rate following elective primary total hip arthroplasty (THA) and/or total knee arthroplasty (TKA). Available at:
- A meta‐analysis of hospital 30‐day avoidable readmission rates. J Eval Clin Pract. 2011;18(6):1211–1218. , ,
- Proportion of hospital readmissions deemed avoidable: a systematic review. CMAJ. 2011;183(7):E391–E402. , , , ,
- 3(4):477–492. , , , et al. Centers for Medicare
- Characteristics of hospitals receiving penalties under the Hospital Readmissions Reduction Program. JAMA. 2013;309(4):342–343. ,
- Centers for Medicare and Medicaid Services. Inpatient Prospective Payment System/Long‐Term Care Hospital (IPPS/LTCH) final rule. Fed Regist. 2013;78:50533–50534.
- Massachusetts health reforms: uninsurance remains low, self‐reported health status improves as state prepares to tackle costs. Health Aff (Millwood). 2012;31(2):444–451. , ,
- Development, validation, and results of a measure of 30‐day readmission following hospitalization for pneumonia. J Hosp Med. 2011;6(3):142–150. , , , et al.
- An administrative claims measure suitable for profiling hospital performance based on 30‐day all‐cause readmission rates among patients with acute myocardial infarction. Circ Cardiovasc Qual Outcomes. 2011;4(2):243–252. , , , et al.
- An administrative claims measure suitable for profiling hospital performance on the basis of 30‐day all‐cause readmission rates among patients with heart failure. Circ Cardiovasc Qual Outcomes. 2008;1:29–37. , , , et al.
- http://www.qualitynet.org/dcs/ContentServer?c=Page161(supp10 l):S66–S75. , , , et al. Hospital‐level 30‐day all‐cause risk‐standardized readmission rate following elective primary total hip arthroplasty (THA) and/or total knee arthroplasty (TKA). Available at:
- A meta‐analysis of hospital 30‐day avoidable readmission rates. J Eval Clin Pract. 2011;18(6):1211–1218. , ,
- Proportion of hospital readmissions deemed avoidable: a systematic review. CMAJ. 2011;183(7):E391–E402. , , , ,
- 3(4):477–492. , , , et al. Centers for Medicare
- Characteristics of hospitals receiving penalties under the Hospital Readmissions Reduction Program. JAMA. 2013;309(4):342–343. ,
- Centers for Medicare and Medicaid Services. Inpatient Prospective Payment System/Long‐Term Care Hospital (IPPS/LTCH) final rule. Fed Regist. 2013;78:50533–50534.
- Massachusetts health reforms: uninsurance remains low, self‐reported health status improves as state prepares to tackle costs. Health Aff (Millwood). 2012;31(2):444–451. , ,
© 2015 Society of Hospital Medicine
Manage Your Dermatology Practice: Offering a Mix of Treatments for Acne and Rosacea
Combination therapy may be essential to treat acne and rosacea and minimize any negative aftereffects. Dr. Gary Goldenberg discusses the options for combination therapy including topical and oral prescription therapies as well as procedures and over-the-counter therapy. Patients also should be counseled on minimizing triggers.
Combination therapy may be essential to treat acne and rosacea and minimize any negative aftereffects. Dr. Gary Goldenberg discusses the options for combination therapy including topical and oral prescription therapies as well as procedures and over-the-counter therapy. Patients also should be counseled on minimizing triggers.
Combination therapy may be essential to treat acne and rosacea and minimize any negative aftereffects. Dr. Gary Goldenberg discusses the options for combination therapy including topical and oral prescription therapies as well as procedures and over-the-counter therapy. Patients also should be counseled on minimizing triggers.
CUDC-907 passes early hurdle in heavily pretreated lymphoma, myeloma
VIENNA – The investigational dual HDAC and Pi3K inhibitor CUDC-907 was reasonably tolerated and clinically active in a phase I study of relapsed or refractory lymphomas and multiple myeloma.
Among 44 patients evaluable for response, 7 had objective responses (16%).
Two complete and four partial responses occurred in 10 evaluable patients with diffuse large B-cell lymphoma (DLBCL).
One partial response was reported in 12 evaluable patients with Hodgkin lymphoma.
Stable disease was the best response in 4 of 6 evaluable patients with multiple myeloma and 11 of 16 patients with other lymphomas, Dr. Yasuhiro Oki reported at the annual congress of the European Hematology Association.
The first-in-human trial enrolled 57 patients with lymphoma (DLBCL, Hodgkin, Burkitt, follicular, gray zone, lymphoplasmacytic, mantle cell, marginal zone, and small lymphocytic) or multiple myeloma that was refractory to or relapsed after at least two prior regimens.
The median number of prior regimens was 5 (range 2-10), including prior histone deacetylase (HDAC) inhibitors in 11% and prior phosphatidylinositol 3-kinase (Pi3K) inhibitors in 9%.
The 3+3 design tested three different once-daily dosing schedules for the oral small molecule: 30 mg and 60 mg, 5 days on and 2 days off (5/2) 60 mg, and intermittent twice- or thrice-weekly at 60 mg, 90 mg, 120 mg, and 150 mg. The safety and efficacy data are from the completed dose escalation and ongoing expansion stages of the phase I trial with CUDC-907 administered as monotherapy.
Median treatment duration in the DLBCL group was 3 months, with treatment ongoing in some patients beyond 2 years. Long-term responders have included three patients with transformed follicular lymphoma (t-FL)/DLBCL, one with so-called triple-hit status involving translocations/rearrangements of MYC, BCL-2, and BCL-6 genes, according to Dr. Oki of University of Texas MD Anderson Cancer Center in Houston.
The patient with Hodgkin lymphoma who responded had failed four prior therapies, but experienced a 42% reduction in tumor size on imaging by cycle two and a partial response to 60 mg 5/2 CUDC-907 by cycle six.
At least one adverse event (AE) occurred in 50 of the 57 patients, but AEs have been reversible with standard interventions, dose holds, or dose reductions, he added.
The most common grade 3/4 AEs reported in two or more patients were diarrhea, hyperglycemia, fatigue, thrombocytopenia, and decreased neutrophils.
Four dose-limiting toxicities occurred in three patients: grade 3 diarrhea in the 60-mg once-daily and 150-mg thrice-weekly dose groups and grade 4 hyperglycemia in the 60-mg once-daily and 150-mg twice-weekly dose groups.
“The 5/2 60-mg and thrice-weekly 120-mg dosing was found to be reasonably tolerated while still achieving objective responses,” Dr. Oki noted in the poster.
The ongoing expansion phase is evaluating CUDC-907 at the recommended phase II doses of 60 mg 5/2 and 120 mg thrice-weekly in patients with relapsed refractory DLBCL, Hodgkin lymphoma, and multiple myeloma.
The trial is currently enrolling patients with DLBCL for treatment with CUDC-907 monotherapy and in combination with standard-dose rituximab.
Phase II testing of CUDC-907 in combination with rituximab in relapsed/refractory DLBCL is projected to start at the earliest in fourth-quarter 2015, according to the authors.
CUDC-907 (60 mg 5/2 and 120 mg three times weekly) is also being evaluated in advanced or relapsed solid tumors in an ongoing phase I trial.
On Twitter@pwendl
VIENNA – The investigational dual HDAC and Pi3K inhibitor CUDC-907 was reasonably tolerated and clinically active in a phase I study of relapsed or refractory lymphomas and multiple myeloma.
Among 44 patients evaluable for response, 7 had objective responses (16%).
Two complete and four partial responses occurred in 10 evaluable patients with diffuse large B-cell lymphoma (DLBCL).
One partial response was reported in 12 evaluable patients with Hodgkin lymphoma.
Stable disease was the best response in 4 of 6 evaluable patients with multiple myeloma and 11 of 16 patients with other lymphomas, Dr. Yasuhiro Oki reported at the annual congress of the European Hematology Association.
The first-in-human trial enrolled 57 patients with lymphoma (DLBCL, Hodgkin, Burkitt, follicular, gray zone, lymphoplasmacytic, mantle cell, marginal zone, and small lymphocytic) or multiple myeloma that was refractory to or relapsed after at least two prior regimens.
The median number of prior regimens was 5 (range 2-10), including prior histone deacetylase (HDAC) inhibitors in 11% and prior phosphatidylinositol 3-kinase (Pi3K) inhibitors in 9%.
The 3+3 design tested three different once-daily dosing schedules for the oral small molecule: 30 mg and 60 mg, 5 days on and 2 days off (5/2) 60 mg, and intermittent twice- or thrice-weekly at 60 mg, 90 mg, 120 mg, and 150 mg. The safety and efficacy data are from the completed dose escalation and ongoing expansion stages of the phase I trial with CUDC-907 administered as monotherapy.
Median treatment duration in the DLBCL group was 3 months, with treatment ongoing in some patients beyond 2 years. Long-term responders have included three patients with transformed follicular lymphoma (t-FL)/DLBCL, one with so-called triple-hit status involving translocations/rearrangements of MYC, BCL-2, and BCL-6 genes, according to Dr. Oki of University of Texas MD Anderson Cancer Center in Houston.
The patient with Hodgkin lymphoma who responded had failed four prior therapies, but experienced a 42% reduction in tumor size on imaging by cycle two and a partial response to 60 mg 5/2 CUDC-907 by cycle six.
At least one adverse event (AE) occurred in 50 of the 57 patients, but AEs have been reversible with standard interventions, dose holds, or dose reductions, he added.
The most common grade 3/4 AEs reported in two or more patients were diarrhea, hyperglycemia, fatigue, thrombocytopenia, and decreased neutrophils.
Four dose-limiting toxicities occurred in three patients: grade 3 diarrhea in the 60-mg once-daily and 150-mg thrice-weekly dose groups and grade 4 hyperglycemia in the 60-mg once-daily and 150-mg twice-weekly dose groups.
“The 5/2 60-mg and thrice-weekly 120-mg dosing was found to be reasonably tolerated while still achieving objective responses,” Dr. Oki noted in the poster.
The ongoing expansion phase is evaluating CUDC-907 at the recommended phase II doses of 60 mg 5/2 and 120 mg thrice-weekly in patients with relapsed refractory DLBCL, Hodgkin lymphoma, and multiple myeloma.
The trial is currently enrolling patients with DLBCL for treatment with CUDC-907 monotherapy and in combination with standard-dose rituximab.
Phase II testing of CUDC-907 in combination with rituximab in relapsed/refractory DLBCL is projected to start at the earliest in fourth-quarter 2015, according to the authors.
CUDC-907 (60 mg 5/2 and 120 mg three times weekly) is also being evaluated in advanced or relapsed solid tumors in an ongoing phase I trial.
On Twitter@pwendl
VIENNA – The investigational dual HDAC and Pi3K inhibitor CUDC-907 was reasonably tolerated and clinically active in a phase I study of relapsed or refractory lymphomas and multiple myeloma.
Among 44 patients evaluable for response, 7 had objective responses (16%).
Two complete and four partial responses occurred in 10 evaluable patients with diffuse large B-cell lymphoma (DLBCL).
One partial response was reported in 12 evaluable patients with Hodgkin lymphoma.
Stable disease was the best response in 4 of 6 evaluable patients with multiple myeloma and 11 of 16 patients with other lymphomas, Dr. Yasuhiro Oki reported at the annual congress of the European Hematology Association.
The first-in-human trial enrolled 57 patients with lymphoma (DLBCL, Hodgkin, Burkitt, follicular, gray zone, lymphoplasmacytic, mantle cell, marginal zone, and small lymphocytic) or multiple myeloma that was refractory to or relapsed after at least two prior regimens.
The median number of prior regimens was 5 (range 2-10), including prior histone deacetylase (HDAC) inhibitors in 11% and prior phosphatidylinositol 3-kinase (Pi3K) inhibitors in 9%.
The 3+3 design tested three different once-daily dosing schedules for the oral small molecule: 30 mg and 60 mg, 5 days on and 2 days off (5/2) 60 mg, and intermittent twice- or thrice-weekly at 60 mg, 90 mg, 120 mg, and 150 mg. The safety and efficacy data are from the completed dose escalation and ongoing expansion stages of the phase I trial with CUDC-907 administered as monotherapy.
Median treatment duration in the DLBCL group was 3 months, with treatment ongoing in some patients beyond 2 years. Long-term responders have included three patients with transformed follicular lymphoma (t-FL)/DLBCL, one with so-called triple-hit status involving translocations/rearrangements of MYC, BCL-2, and BCL-6 genes, according to Dr. Oki of University of Texas MD Anderson Cancer Center in Houston.
The patient with Hodgkin lymphoma who responded had failed four prior therapies, but experienced a 42% reduction in tumor size on imaging by cycle two and a partial response to 60 mg 5/2 CUDC-907 by cycle six.
At least one adverse event (AE) occurred in 50 of the 57 patients, but AEs have been reversible with standard interventions, dose holds, or dose reductions, he added.
The most common grade 3/4 AEs reported in two or more patients were diarrhea, hyperglycemia, fatigue, thrombocytopenia, and decreased neutrophils.
Four dose-limiting toxicities occurred in three patients: grade 3 diarrhea in the 60-mg once-daily and 150-mg thrice-weekly dose groups and grade 4 hyperglycemia in the 60-mg once-daily and 150-mg twice-weekly dose groups.
“The 5/2 60-mg and thrice-weekly 120-mg dosing was found to be reasonably tolerated while still achieving objective responses,” Dr. Oki noted in the poster.
The ongoing expansion phase is evaluating CUDC-907 at the recommended phase II doses of 60 mg 5/2 and 120 mg thrice-weekly in patients with relapsed refractory DLBCL, Hodgkin lymphoma, and multiple myeloma.
The trial is currently enrolling patients with DLBCL for treatment with CUDC-907 monotherapy and in combination with standard-dose rituximab.
Phase II testing of CUDC-907 in combination with rituximab in relapsed/refractory DLBCL is projected to start at the earliest in fourth-quarter 2015, according to the authors.
CUDC-907 (60 mg 5/2 and 120 mg three times weekly) is also being evaluated in advanced or relapsed solid tumors in an ongoing phase I trial.
On Twitter@pwendl
AT EHA CONGRESS
Key clinical point: The dual HDAC and Pi3K inhibitor CUDC-907 was reasonably tolerated and clinically active in a phase I study of heavily pretreated lymphoma and myeloma.
Major finding: Objective responses occurred in 16% of 44 evaluable patients.
Data source: A phase I study in relapsed or refractory lymphoma or multiple myeloma.
Disclosures: Curis funded the study, with financial support from the Leukemia & Lymphoma Society. Dr. Oki reported having no financial conflicts; four coauthors are employees of Curis.
Progressive Cribriform and Zosteriform Hyperpigmentation
To the Editor:
Progressive cribriform and zosteriform hyperpigmentation (PCZH) was first described by Rower et al1 in 1978. The diagnostic criteria included the following: (1) uniformly tan cribriform macular pigmentation in a zosteriform distribution; (2) a histologic pattern that consisted of a mild increase in melanin pigment in the basal cell layer and complete absence of nevus cells; (3) no history of rash, injury, or inflammation to suggest postinflammatory hyperpigmentation; (4) onset occurring well after birth with gradual extension; and (5) lack of other associated cutaneous or internal abnormalities.1
Many pigmentary disorders occurring along the Blaschko lines are included in differential diagnosis of PCZH such as incontinentia pigmenti (IP), progressive zosteriform macular pigmented lesion (PZMPL), and linear and whorled nevoid hypermelanosis (LWNH). However, PCZH is considered to be the localized variant (the late onset) of LWNH.2 We report a case of PCZH, a segmented and delayed form of LWNH.
A 25-year-old woman presented with asymptomatic progressive multiple brownish macular eruptions arranged in a zosteriform pattern on the left arm and thigh of 3 months’ duration. There was no history of injury or any prior cutaneous changes. There was no personal or family history of similar eruptions and she was otherwise in good health. She was not taking any medications. Physical examination showed linear, uniformly tanned, cribriform hyperpigmentation along the Blaschko lines on the left arm and thigh (Figure 1). Routine laboratory tests, including complete blood cell count with differential, were normal. Assuming a diagnosis of PCZH or PZMPL, we performed a punch biopsy on the left upper arm. The histopathologic findings showed increased pigmentation of the basal layer. There were a few dermal melanophages and no nevus cells present (Figure 2A). Fontana-Masson stain showed an increase in melanin in the basal layer (Figure 2B). On the basis of these clinical and histological findings, a diagnosis of PCZH was made. She was observed without treatment for 6 months showing no change.
![]() |
![]() |
Progressive cribriform and zosteriform hyperpigmentation is a disorder of pigmentation along the Blaschko lines. The trunk is the most common site of involvement.3 In the differential diagnosis, other pigmentary disorders along the Blaschko lines must be excluded, including the pigmentary stage of IP, PZMPL, and LWNH. In IP, characteristic inflammatory vesicular and verrucous stages usually precede the whorled pigmentation.4 In approximately 80% of cases, IP is associated with various congenital abnormalities, particularly of the central nervous system, eyes, and teeth.5 Progressive zosteriform macular pigmented lesion is a chronic pigmentary dermatosis similar to PCZH but is characteristically accompanied by pruritus as a prodromal symptom. It is usually preceded by multiple pruritic macular pigmentation in part of the dermatome for a period of time. Then the size and number of the pigmented macules abruptly increases and coalesces into patches.6 Linear and whorled nevoid hypermelanosis was first described by Kalter et al7 in 1988. It is characterized by swirls and whorls of hyperpigmented macules without preceding bullae or verrucae along Blaschko lines, usually occurring within the first 2 years of life. The lesions are stable in some patients but can spread in others, stabilizing by 2 to 3 years of age.7-10 It has been referred to as zosteriform lentiginous nevus, zebralike hyperpigmentation, and reticulate hyperpigmentation distributed in a zosteriform fashion.2,9
Linear and whorled nevoid hypermelanosis can be distinguished from PCZH by a diffuse or localized pattern and an association of congenital anomalies.3 However, neurologic and skeletal anomalies also can be observed in PCZH.11 Additionally, not all LWNH cases show a diffuse type.2 Therefore, LWNH has been used to encompass a wide spectrum of clinical entities, ranging from the congenital or perinatal form described by Kalter et al7 to the segmented and delayed form described by Rower et al1 for which there is a tendency to use the term progressive cribriform and zosteriform hyperpigmentation.2,10,11 There are no clinical and histologic differences between PCZH and LWNH, other than a later onset.2 Although some authors reported that PCZH and LWNH have increased hyperpigmentation of the basal layer and prominent melanocytes without incontinence of pigment on histopathology,2,7,8 other reports have demonstrated that both could show pigment incontinence,3,10,12-14 such as in our case.
Figure 2. Histopathologic findings showed increased pigmentation of the basal layer with a few dermal melanophages. No nevus cells were present (A)(H&E, original magnification ×100). Fontana-Masson stain showed an increase in melanin in the basal layer (B)(original magnification ×100). |
Progressive cribriform and zosteriform hyperpigmentation is considered to be the localized variant as well as the late onset of LWNH.2 We report a case of PCZH, a segmented and delayed form of LWNH without systemic abnormalities.
1. Rower JM, Carr RD, Lowney ED. Progressive cribriform and zosteriform hyperpigmentation. Arch Dermatol. 1978;114:98-99.
2. Di Lernia V. Linear and whorled hypermelanosis. Pediatr Dermatol. 2007;24:205-210.
3. Cho E, Cho SH, Lee JD. Progressive cribriform and zosteriform hyperpigmentation: a clinicopathologic study. Int J Dermatol. 2012;51:399-405.
4. Hong SP, Ahn SY, Lee WS. Linear and whorled nevoid hypermelanosis: unique clinical presentations and their possible association with chromosomal abnormality inv(9). Arch Dermatol. 2008;144:415-416.
5. Carney RG. Incontinentia pigmenti: a world statistical analysis. Arch Dermatol. 1976;112:535-542.
6. Hong JW, Lee KY, Jeon SY, et al. Progressive zosteriform macular pigmented lesion. Korean J Dermatol. 2011;49:621-624
7. Kalter DC, Griffiths WA, Atherton AJ. Linear and whorled nevoid hypermelanosis. J Am Acad Dermatol. 1988;19:1037-1044.
8. Ertam I, Turk BG, Urkmez A, et al. Linear and whorled nevoid hypermelanosis: dermatoscopic features. J Am Acad Dermatol. 2009;60:328-331.
9. Mehta V, Vasanth V, Balachandran C, et al. Linear and whorled nevoid hypermelanosis. Int J Dermatol. 2011;50:491-492.
10. Choi JC, Yang JH, Lee UH, et al. Progressive cribriform and zosteriform hyperpigmentation—the late onset linear and whorled nevoid hypermelanosis. J Eur Acad Dermatol Venereol. 2005;19:638-639.
11. Schepis C, Alberti A, Siragusa M, et al. Progressive cribriform and zosteriform hyperpigmentation: the late onset feature of linear and whorled nevoid hypermelanosis associated with congenital neurological, skeletal and cutaneous anomalies. Dermatology. 1999;199:72-73.
12. Kovarik CL, Spielvogel RL, Kantor GR. Pigmentary disorders of the skin. In: Elder DE, Elenitsas R, Murphy GF, et al, eds. Lever’s Histopathology of the Skin. 10th ed. Philadelphia, PA: Lippincott Williams & Wilkins; 2009:690.
13. Kim SJ, Kim MB, Oh CK, et al. Three cases of progressive cribriform and zosteriform hyperpigmentation. Korean J Dermatol. 2002;40:181-186.
14. Cho SH, Ha JH, Choi HC, et al. A case of atypical progressive cribriform and zosteriform hyperpigmentation. Korean J Dermatol. 2003;41:792-795.
To the Editor:
Progressive cribriform and zosteriform hyperpigmentation (PCZH) was first described by Rower et al1 in 1978. The diagnostic criteria included the following: (1) uniformly tan cribriform macular pigmentation in a zosteriform distribution; (2) a histologic pattern that consisted of a mild increase in melanin pigment in the basal cell layer and complete absence of nevus cells; (3) no history of rash, injury, or inflammation to suggest postinflammatory hyperpigmentation; (4) onset occurring well after birth with gradual extension; and (5) lack of other associated cutaneous or internal abnormalities.1
Many pigmentary disorders occurring along the Blaschko lines are included in differential diagnosis of PCZH such as incontinentia pigmenti (IP), progressive zosteriform macular pigmented lesion (PZMPL), and linear and whorled nevoid hypermelanosis (LWNH). However, PCZH is considered to be the localized variant (the late onset) of LWNH.2 We report a case of PCZH, a segmented and delayed form of LWNH.
A 25-year-old woman presented with asymptomatic progressive multiple brownish macular eruptions arranged in a zosteriform pattern on the left arm and thigh of 3 months’ duration. There was no history of injury or any prior cutaneous changes. There was no personal or family history of similar eruptions and she was otherwise in good health. She was not taking any medications. Physical examination showed linear, uniformly tanned, cribriform hyperpigmentation along the Blaschko lines on the left arm and thigh (Figure 1). Routine laboratory tests, including complete blood cell count with differential, were normal. Assuming a diagnosis of PCZH or PZMPL, we performed a punch biopsy on the left upper arm. The histopathologic findings showed increased pigmentation of the basal layer. There were a few dermal melanophages and no nevus cells present (Figure 2A). Fontana-Masson stain showed an increase in melanin in the basal layer (Figure 2B). On the basis of these clinical and histological findings, a diagnosis of PCZH was made. She was observed without treatment for 6 months showing no change.
![]() |
![]() |
Progressive cribriform and zosteriform hyperpigmentation is a disorder of pigmentation along the Blaschko lines. The trunk is the most common site of involvement.3 In the differential diagnosis, other pigmentary disorders along the Blaschko lines must be excluded, including the pigmentary stage of IP, PZMPL, and LWNH. In IP, characteristic inflammatory vesicular and verrucous stages usually precede the whorled pigmentation.4 In approximately 80% of cases, IP is associated with various congenital abnormalities, particularly of the central nervous system, eyes, and teeth.5 Progressive zosteriform macular pigmented lesion is a chronic pigmentary dermatosis similar to PCZH but is characteristically accompanied by pruritus as a prodromal symptom. It is usually preceded by multiple pruritic macular pigmentation in part of the dermatome for a period of time. Then the size and number of the pigmented macules abruptly increases and coalesces into patches.6 Linear and whorled nevoid hypermelanosis was first described by Kalter et al7 in 1988. It is characterized by swirls and whorls of hyperpigmented macules without preceding bullae or verrucae along Blaschko lines, usually occurring within the first 2 years of life. The lesions are stable in some patients but can spread in others, stabilizing by 2 to 3 years of age.7-10 It has been referred to as zosteriform lentiginous nevus, zebralike hyperpigmentation, and reticulate hyperpigmentation distributed in a zosteriform fashion.2,9
Linear and whorled nevoid hypermelanosis can be distinguished from PCZH by a diffuse or localized pattern and an association of congenital anomalies.3 However, neurologic and skeletal anomalies also can be observed in PCZH.11 Additionally, not all LWNH cases show a diffuse type.2 Therefore, LWNH has been used to encompass a wide spectrum of clinical entities, ranging from the congenital or perinatal form described by Kalter et al7 to the segmented and delayed form described by Rower et al1 for which there is a tendency to use the term progressive cribriform and zosteriform hyperpigmentation.2,10,11 There are no clinical and histologic differences between PCZH and LWNH, other than a later onset.2 Although some authors reported that PCZH and LWNH have increased hyperpigmentation of the basal layer and prominent melanocytes without incontinence of pigment on histopathology,2,7,8 other reports have demonstrated that both could show pigment incontinence,3,10,12-14 such as in our case.
Figure 2. Histopathologic findings showed increased pigmentation of the basal layer with a few dermal melanophages. No nevus cells were present (A)(H&E, original magnification ×100). Fontana-Masson stain showed an increase in melanin in the basal layer (B)(original magnification ×100). |
Progressive cribriform and zosteriform hyperpigmentation is considered to be the localized variant as well as the late onset of LWNH.2 We report a case of PCZH, a segmented and delayed form of LWNH without systemic abnormalities.
To the Editor:
Progressive cribriform and zosteriform hyperpigmentation (PCZH) was first described by Rower et al1 in 1978. The diagnostic criteria included the following: (1) uniformly tan cribriform macular pigmentation in a zosteriform distribution; (2) a histologic pattern that consisted of a mild increase in melanin pigment in the basal cell layer and complete absence of nevus cells; (3) no history of rash, injury, or inflammation to suggest postinflammatory hyperpigmentation; (4) onset occurring well after birth with gradual extension; and (5) lack of other associated cutaneous or internal abnormalities.1
Many pigmentary disorders occurring along the Blaschko lines are included in differential diagnosis of PCZH such as incontinentia pigmenti (IP), progressive zosteriform macular pigmented lesion (PZMPL), and linear and whorled nevoid hypermelanosis (LWNH). However, PCZH is considered to be the localized variant (the late onset) of LWNH.2 We report a case of PCZH, a segmented and delayed form of LWNH.
A 25-year-old woman presented with asymptomatic progressive multiple brownish macular eruptions arranged in a zosteriform pattern on the left arm and thigh of 3 months’ duration. There was no history of injury or any prior cutaneous changes. There was no personal or family history of similar eruptions and she was otherwise in good health. She was not taking any medications. Physical examination showed linear, uniformly tanned, cribriform hyperpigmentation along the Blaschko lines on the left arm and thigh (Figure 1). Routine laboratory tests, including complete blood cell count with differential, were normal. Assuming a diagnosis of PCZH or PZMPL, we performed a punch biopsy on the left upper arm. The histopathologic findings showed increased pigmentation of the basal layer. There were a few dermal melanophages and no nevus cells present (Figure 2A). Fontana-Masson stain showed an increase in melanin in the basal layer (Figure 2B). On the basis of these clinical and histological findings, a diagnosis of PCZH was made. She was observed without treatment for 6 months showing no change.
![]() |
![]() |
Progressive cribriform and zosteriform hyperpigmentation is a disorder of pigmentation along the Blaschko lines. The trunk is the most common site of involvement.3 In the differential diagnosis, other pigmentary disorders along the Blaschko lines must be excluded, including the pigmentary stage of IP, PZMPL, and LWNH. In IP, characteristic inflammatory vesicular and verrucous stages usually precede the whorled pigmentation.4 In approximately 80% of cases, IP is associated with various congenital abnormalities, particularly of the central nervous system, eyes, and teeth.5 Progressive zosteriform macular pigmented lesion is a chronic pigmentary dermatosis similar to PCZH but is characteristically accompanied by pruritus as a prodromal symptom. It is usually preceded by multiple pruritic macular pigmentation in part of the dermatome for a period of time. Then the size and number of the pigmented macules abruptly increases and coalesces into patches.6 Linear and whorled nevoid hypermelanosis was first described by Kalter et al7 in 1988. It is characterized by swirls and whorls of hyperpigmented macules without preceding bullae or verrucae along Blaschko lines, usually occurring within the first 2 years of life. The lesions are stable in some patients but can spread in others, stabilizing by 2 to 3 years of age.7-10 It has been referred to as zosteriform lentiginous nevus, zebralike hyperpigmentation, and reticulate hyperpigmentation distributed in a zosteriform fashion.2,9
Linear and whorled nevoid hypermelanosis can be distinguished from PCZH by a diffuse or localized pattern and an association of congenital anomalies.3 However, neurologic and skeletal anomalies also can be observed in PCZH.11 Additionally, not all LWNH cases show a diffuse type.2 Therefore, LWNH has been used to encompass a wide spectrum of clinical entities, ranging from the congenital or perinatal form described by Kalter et al7 to the segmented and delayed form described by Rower et al1 for which there is a tendency to use the term progressive cribriform and zosteriform hyperpigmentation.2,10,11 There are no clinical and histologic differences between PCZH and LWNH, other than a later onset.2 Although some authors reported that PCZH and LWNH have increased hyperpigmentation of the basal layer and prominent melanocytes without incontinence of pigment on histopathology,2,7,8 other reports have demonstrated that both could show pigment incontinence,3,10,12-14 such as in our case.
Figure 2. Histopathologic findings showed increased pigmentation of the basal layer with a few dermal melanophages. No nevus cells were present (A)(H&E, original magnification ×100). Fontana-Masson stain showed an increase in melanin in the basal layer (B)(original magnification ×100). |
Progressive cribriform and zosteriform hyperpigmentation is considered to be the localized variant as well as the late onset of LWNH.2 We report a case of PCZH, a segmented and delayed form of LWNH without systemic abnormalities.
1. Rower JM, Carr RD, Lowney ED. Progressive cribriform and zosteriform hyperpigmentation. Arch Dermatol. 1978;114:98-99.
2. Di Lernia V. Linear and whorled hypermelanosis. Pediatr Dermatol. 2007;24:205-210.
3. Cho E, Cho SH, Lee JD. Progressive cribriform and zosteriform hyperpigmentation: a clinicopathologic study. Int J Dermatol. 2012;51:399-405.
4. Hong SP, Ahn SY, Lee WS. Linear and whorled nevoid hypermelanosis: unique clinical presentations and their possible association with chromosomal abnormality inv(9). Arch Dermatol. 2008;144:415-416.
5. Carney RG. Incontinentia pigmenti: a world statistical analysis. Arch Dermatol. 1976;112:535-542.
6. Hong JW, Lee KY, Jeon SY, et al. Progressive zosteriform macular pigmented lesion. Korean J Dermatol. 2011;49:621-624
7. Kalter DC, Griffiths WA, Atherton AJ. Linear and whorled nevoid hypermelanosis. J Am Acad Dermatol. 1988;19:1037-1044.
8. Ertam I, Turk BG, Urkmez A, et al. Linear and whorled nevoid hypermelanosis: dermatoscopic features. J Am Acad Dermatol. 2009;60:328-331.
9. Mehta V, Vasanth V, Balachandran C, et al. Linear and whorled nevoid hypermelanosis. Int J Dermatol. 2011;50:491-492.
10. Choi JC, Yang JH, Lee UH, et al. Progressive cribriform and zosteriform hyperpigmentation—the late onset linear and whorled nevoid hypermelanosis. J Eur Acad Dermatol Venereol. 2005;19:638-639.
11. Schepis C, Alberti A, Siragusa M, et al. Progressive cribriform and zosteriform hyperpigmentation: the late onset feature of linear and whorled nevoid hypermelanosis associated with congenital neurological, skeletal and cutaneous anomalies. Dermatology. 1999;199:72-73.
12. Kovarik CL, Spielvogel RL, Kantor GR. Pigmentary disorders of the skin. In: Elder DE, Elenitsas R, Murphy GF, et al, eds. Lever’s Histopathology of the Skin. 10th ed. Philadelphia, PA: Lippincott Williams & Wilkins; 2009:690.
13. Kim SJ, Kim MB, Oh CK, et al. Three cases of progressive cribriform and zosteriform hyperpigmentation. Korean J Dermatol. 2002;40:181-186.
14. Cho SH, Ha JH, Choi HC, et al. A case of atypical progressive cribriform and zosteriform hyperpigmentation. Korean J Dermatol. 2003;41:792-795.
1. Rower JM, Carr RD, Lowney ED. Progressive cribriform and zosteriform hyperpigmentation. Arch Dermatol. 1978;114:98-99.
2. Di Lernia V. Linear and whorled hypermelanosis. Pediatr Dermatol. 2007;24:205-210.
3. Cho E, Cho SH, Lee JD. Progressive cribriform and zosteriform hyperpigmentation: a clinicopathologic study. Int J Dermatol. 2012;51:399-405.
4. Hong SP, Ahn SY, Lee WS. Linear and whorled nevoid hypermelanosis: unique clinical presentations and their possible association with chromosomal abnormality inv(9). Arch Dermatol. 2008;144:415-416.
5. Carney RG. Incontinentia pigmenti: a world statistical analysis. Arch Dermatol. 1976;112:535-542.
6. Hong JW, Lee KY, Jeon SY, et al. Progressive zosteriform macular pigmented lesion. Korean J Dermatol. 2011;49:621-624
7. Kalter DC, Griffiths WA, Atherton AJ. Linear and whorled nevoid hypermelanosis. J Am Acad Dermatol. 1988;19:1037-1044.
8. Ertam I, Turk BG, Urkmez A, et al. Linear and whorled nevoid hypermelanosis: dermatoscopic features. J Am Acad Dermatol. 2009;60:328-331.
9. Mehta V, Vasanth V, Balachandran C, et al. Linear and whorled nevoid hypermelanosis. Int J Dermatol. 2011;50:491-492.
10. Choi JC, Yang JH, Lee UH, et al. Progressive cribriform and zosteriform hyperpigmentation—the late onset linear and whorled nevoid hypermelanosis. J Eur Acad Dermatol Venereol. 2005;19:638-639.
11. Schepis C, Alberti A, Siragusa M, et al. Progressive cribriform and zosteriform hyperpigmentation: the late onset feature of linear and whorled nevoid hypermelanosis associated with congenital neurological, skeletal and cutaneous anomalies. Dermatology. 1999;199:72-73.
12. Kovarik CL, Spielvogel RL, Kantor GR. Pigmentary disorders of the skin. In: Elder DE, Elenitsas R, Murphy GF, et al, eds. Lever’s Histopathology of the Skin. 10th ed. Philadelphia, PA: Lippincott Williams & Wilkins; 2009:690.
13. Kim SJ, Kim MB, Oh CK, et al. Three cases of progressive cribriform and zosteriform hyperpigmentation. Korean J Dermatol. 2002;40:181-186.
14. Cho SH, Ha JH, Choi HC, et al. A case of atypical progressive cribriform and zosteriform hyperpigmentation. Korean J Dermatol. 2003;41:792-795.
Levonorgestrel-Releasing Intrauterine System Causes a Lichenoid Drug Eruption
To the Editor:
Numerous drugs have been implicated as possible causes of lichenoid drug eruptions (LDEs). We describe a case of an LDE secondary to placement of a levonorgestrel-releasing intrauterine system (IUS).
A 28-year-old woman presented with an extensive pruritic rash of 2 months’ duration. She reported that it began on the wrists; progressed inward to involve the trunk; and then became generalized over the trunk, back, wrists, and legs. A levonorgestrel-releasing IUS had been placed 6 weeks prior to the onset of the rash. She was otherwise healthy and took loratadine and pseudoephedrine on occasion for environmental allergies. On examination there were violaceous, lichenified, flat-topped, polygonal papules scattered over the arms, legs, and trunk (Figure 1). Some papules demonstrated a Köbner phenomenon. No Wickham striae or mucosal involvement was noted. Rapid plasma reagin and hepatitis panel were negative. The patient was treated empirically with fluocinonide ointment 0.05% twice daily.
![]()
|
A shave biopsy was taken at the initial visit prior to steroid treatment. Histology revealed a classic lichenoid reaction pattern (Figure 2) and irregular acanthosis lying above the dense bandlike infiltrate of lymphocytes with liquefaction degeneration of the basal layer, rare Civatte bodies in the epidermis, and melanophages in the dermis.
At 5-week follow-up, the patient showed some improvement but not complete control of the lesions with topical steroids. Because the patient was on no other regular medications, we recommended a 3-month trial removal of the IUS. The patient decided to have the IUS removed and noted complete clearance of the skin lesions within 1 month. Challenge with oral or intradermal levonorgestrel was not conducted after clearance of the rash, which is a weakness in this report. Accordingly, the possibility that this patient’s condition was caused by idiopathic lichen planus, which may resolve spontaneously, cannot be ruled out. However, because the patient noted substantial improvement following removal of the device and remained symptom free 2 years after removal, we concluded that the cutaneous lesions were secondary to an LDE in response to the IUS.
It should be noted that as-needed use of pseudoephedrine and loratadine continued during this 2-year follow-up period and again the patient experienced no return of symptoms, which is particularly important because both of these agents have been associated with drug eruption patterns akin to lichenoid tissue reaction/interface dermatitis patterns. Pseudoephedrine is particularly notorious for causing nonpigmenting fixed drug eruptions such as those that heal without hyperpigmentation, while antihistamines such as loratadine have been associated with lichenoid and subacute lupus erythematosus–pattern drug reactions.1,2
Lichenoid drug reactions fall into the category of lymphocyte-rich lichenoid tissue reaction/interface dermatitis skin disorders.3 There are currently 202 different drugs reported to cause lichen planus or lichenoid eruptions as collected in Litt’s Drug Eruption & Reaction Database.4 Some of the more common causes of an LDE include angiotensin-converting enzyme inhibitors, antimalarials, calcium channel blockers, gold salts, and nonsteroidal anti-inflammatory drugs.3,4 Lichenoid eruptions typically are attributed to oral hormonal contraceptives only.5,6 An eruption in response to intrauterine levonorgestrel treatment is rare. One case report of a lichenoid eruption in response to a copper IUS was hypothesized to be due to presence of nickel salts as a manufacturing contaminant; however, the manufacturer denied the presence of the contaminant.7
The manufacturer’s information for health care professionals prescribing levonorgestrel-releasing IUS describes rashes as an adverse reaction present in less than 5% of individuals.8 Levonorgestrel-releasing IUS consists of a polyethylene frame compounded with barium sulfate, 52 mg of levonorgestrel, silicone (polydimethylsiloxane), and a monofilament brown polyethylene removal thread. The device initially releases 20 μg levonorgestrel daily, with a stable levonorgestrel plasma level of 150 to 200 pg/mL reached after the first few weeks following insertion of the device.8 Levonorgestrel is an agonist at the progesterone and androgen receptors.9 In clinical trials, levonorgestrel was implicated as the cause of increased acne, hair loss, and hirsutism as cutaneous side effects from use of levonorgestrel implants.10 However, to our knowledge, none of the other components of the levonorgestrel-releasing IUS have previously been reported to cause lichen planus or LDE.
The levonorgestrel-releasing IUS has been implicated as the cause of biopsy-proven Sweet disease,11 exacerbation of preexisting seborrheic dermatitis,12 rosacea,13 and autoimmune progesterone dermatitis.14 The skin findings in these cases resolved after removal of the IUS and appropriate treatment.
Identification of the causative drug can be difficult in LDE, as timing of the eruption can vary. The latent period has been reported to range from a few months to 1 to 2 years.15 Additionally, the clinical picture is often complicated in patients with a history of different drug dosages or multiple medications. When present, the histologic features of parakeratosis and eosinophils can be clues that a lichen planus–like eruption is drug related rather than idiopathic. However, the absence of these features does not rule out a medication or environmental trigger. In this case, the time-event relationship likely indicates that the eruption was related to the levonorgestrel-releasing IUS and not triggered by other medications or not idiopathic in nature. Lichenoid drug eruptions can resolve within a few weeks or up to 2 years after drug cessation and can occasionally be complicated by partial or complete resolution and recurrence even when the drug has not been discontinued.16,17 Lichenoid drug eruptions or idiopathic lichen planus generally are treated with topical immunomodulators or corticosteroids.3
Based on the time-event relationship, morphology, distribution, and histopathologic findings, we conclude that our patient developed LDE in response to the placement of a levonorgestrel-releasing IUS. Clinicians should be aware of the possibility of LDE occurring as a rare adverse effect of these devices.
1. Shelley WB, Shelley ED. Nonpigmenting fixed drug eruption as a distinctive reaction pattern: examples caused by sensitivity to pseudoephedrine hydrochloride and tetrahydrozoline. J Am Acad Dermatol. 1987;17:403-407.
2. Crowson AN, Magro CM. Lichenoid and subacute cutaneous lupus erythematosus-like dermatitis associated with antihistamine therapy. J Cutan Pathol. 1999;26:95-99.
3. Sontheimer RD. Lichenoid tissue reaction/interface dermatitis: clinical and histological perspectives [published online ahead of print February 26, 2009]. J Invest Dermatol. 2009;129:1088-1099.
4. Litt’s Drug Eruption & Reaction Database. Boca Raton, FL: Taylor & Francis Group; 2015. http://www.drugeruptiondata.com/searchresults/index/reaction_type/id/1/char/L. Accessed June 11, 2015.
5. Coskey RJ. Eruptions due to oral contraceptives. Arch Dermatol. 1977;113:333-334.
6. Thomas P, Dalle E, Revillon B, et al. Cutaneous effects in hormonal contraception [in French]. NPN Med. 1985;5:19-24.
7. Lombardi P, Campolmi P, Sertoli A. Lichenoid dermatitis caused by nickel salts? Contact Dermatitis. 1983;9:520-521.
8. Mirena [package insert]. Whippany, NJ: Bayer HealthCare Pharmaceuticals Inc; 2014.
9. Lemus AE, Vilchis F, Damsky R, et al. Mechanism of action of levonorgestrel: in vitro metabolism and specific interactions with steroid receptors in target organs. J Steroid Biochem Mol Biol. 1992;41:881-890.
10. Brache V, Faundes A, Alvarex F, et al. Nonmenstrual adverse events during use of implantable contraceptives for women: data from clinical trials. Contraception. 2002;65:63-74.
11. Hamill M, Bowling J, Vega-Lopez F. Sweet’s syndrome and a Mirena intrauterine system. J Fam Plann Reprod Health Care. 2004;30:115-116.
12. Karri K, Mowbray D, Adams S, et al. Severe seborrhoeic dermatitis: side-effect of the Mirena intra-uterine system. Eur J Contracept Reprod Health Care. 2006;11:53-54.
13. Choudry K, Humphreys F, Menage J. Rosacea in association with the progesterone-releasing intrauterine contraceptive device. Clin Exp Dermatol. 2001;26:102.
14. Pereira A, Coker A. Hypersensitivity to Mirena—a rare complication. J Obstet Gynaecol. 2003;23:81.
15. Halevy S, Shai A. Lichenoid drug eruptions. J Am Acad Dermatol. 1993;29(2, pt 1):249-255.
16. Seehafer JR, Rogers RS 3rd, Fleming CR, et al. Lichen planus-like lesions caused by penicillamine in primary biliary cirrhosis. Arch Dermatol. 1981;117:140-142.
17. Anderson TE. Lichen planus following quinidine therapy. Br J Dermatol. 1967;79:500.
To the Editor:
Numerous drugs have been implicated as possible causes of lichenoid drug eruptions (LDEs). We describe a case of an LDE secondary to placement of a levonorgestrel-releasing intrauterine system (IUS).
A 28-year-old woman presented with an extensive pruritic rash of 2 months’ duration. She reported that it began on the wrists; progressed inward to involve the trunk; and then became generalized over the trunk, back, wrists, and legs. A levonorgestrel-releasing IUS had been placed 6 weeks prior to the onset of the rash. She was otherwise healthy and took loratadine and pseudoephedrine on occasion for environmental allergies. On examination there were violaceous, lichenified, flat-topped, polygonal papules scattered over the arms, legs, and trunk (Figure 1). Some papules demonstrated a Köbner phenomenon. No Wickham striae or mucosal involvement was noted. Rapid plasma reagin and hepatitis panel were negative. The patient was treated empirically with fluocinonide ointment 0.05% twice daily.
![]()
|
A shave biopsy was taken at the initial visit prior to steroid treatment. Histology revealed a classic lichenoid reaction pattern (Figure 2) and irregular acanthosis lying above the dense bandlike infiltrate of lymphocytes with liquefaction degeneration of the basal layer, rare Civatte bodies in the epidermis, and melanophages in the dermis.
At 5-week follow-up, the patient showed some improvement but not complete control of the lesions with topical steroids. Because the patient was on no other regular medications, we recommended a 3-month trial removal of the IUS. The patient decided to have the IUS removed and noted complete clearance of the skin lesions within 1 month. Challenge with oral or intradermal levonorgestrel was not conducted after clearance of the rash, which is a weakness in this report. Accordingly, the possibility that this patient’s condition was caused by idiopathic lichen planus, which may resolve spontaneously, cannot be ruled out. However, because the patient noted substantial improvement following removal of the device and remained symptom free 2 years after removal, we concluded that the cutaneous lesions were secondary to an LDE in response to the IUS.
It should be noted that as-needed use of pseudoephedrine and loratadine continued during this 2-year follow-up period and again the patient experienced no return of symptoms, which is particularly important because both of these agents have been associated with drug eruption patterns akin to lichenoid tissue reaction/interface dermatitis patterns. Pseudoephedrine is particularly notorious for causing nonpigmenting fixed drug eruptions such as those that heal without hyperpigmentation, while antihistamines such as loratadine have been associated with lichenoid and subacute lupus erythematosus–pattern drug reactions.1,2
Lichenoid drug reactions fall into the category of lymphocyte-rich lichenoid tissue reaction/interface dermatitis skin disorders.3 There are currently 202 different drugs reported to cause lichen planus or lichenoid eruptions as collected in Litt’s Drug Eruption & Reaction Database.4 Some of the more common causes of an LDE include angiotensin-converting enzyme inhibitors, antimalarials, calcium channel blockers, gold salts, and nonsteroidal anti-inflammatory drugs.3,4 Lichenoid eruptions typically are attributed to oral hormonal contraceptives only.5,6 An eruption in response to intrauterine levonorgestrel treatment is rare. One case report of a lichenoid eruption in response to a copper IUS was hypothesized to be due to presence of nickel salts as a manufacturing contaminant; however, the manufacturer denied the presence of the contaminant.7
The manufacturer’s information for health care professionals prescribing levonorgestrel-releasing IUS describes rashes as an adverse reaction present in less than 5% of individuals.8 Levonorgestrel-releasing IUS consists of a polyethylene frame compounded with barium sulfate, 52 mg of levonorgestrel, silicone (polydimethylsiloxane), and a monofilament brown polyethylene removal thread. The device initially releases 20 μg levonorgestrel daily, with a stable levonorgestrel plasma level of 150 to 200 pg/mL reached after the first few weeks following insertion of the device.8 Levonorgestrel is an agonist at the progesterone and androgen receptors.9 In clinical trials, levonorgestrel was implicated as the cause of increased acne, hair loss, and hirsutism as cutaneous side effects from use of levonorgestrel implants.10 However, to our knowledge, none of the other components of the levonorgestrel-releasing IUS have previously been reported to cause lichen planus or LDE.
The levonorgestrel-releasing IUS has been implicated as the cause of biopsy-proven Sweet disease,11 exacerbation of preexisting seborrheic dermatitis,12 rosacea,13 and autoimmune progesterone dermatitis.14 The skin findings in these cases resolved after removal of the IUS and appropriate treatment.
Identification of the causative drug can be difficult in LDE, as timing of the eruption can vary. The latent period has been reported to range from a few months to 1 to 2 years.15 Additionally, the clinical picture is often complicated in patients with a history of different drug dosages or multiple medications. When present, the histologic features of parakeratosis and eosinophils can be clues that a lichen planus–like eruption is drug related rather than idiopathic. However, the absence of these features does not rule out a medication or environmental trigger. In this case, the time-event relationship likely indicates that the eruption was related to the levonorgestrel-releasing IUS and not triggered by other medications or not idiopathic in nature. Lichenoid drug eruptions can resolve within a few weeks or up to 2 years after drug cessation and can occasionally be complicated by partial or complete resolution and recurrence even when the drug has not been discontinued.16,17 Lichenoid drug eruptions or idiopathic lichen planus generally are treated with topical immunomodulators or corticosteroids.3
Based on the time-event relationship, morphology, distribution, and histopathologic findings, we conclude that our patient developed LDE in response to the placement of a levonorgestrel-releasing IUS. Clinicians should be aware of the possibility of LDE occurring as a rare adverse effect of these devices.
To the Editor:
Numerous drugs have been implicated as possible causes of lichenoid drug eruptions (LDEs). We describe a case of an LDE secondary to placement of a levonorgestrel-releasing intrauterine system (IUS).
A 28-year-old woman presented with an extensive pruritic rash of 2 months’ duration. She reported that it began on the wrists; progressed inward to involve the trunk; and then became generalized over the trunk, back, wrists, and legs. A levonorgestrel-releasing IUS had been placed 6 weeks prior to the onset of the rash. She was otherwise healthy and took loratadine and pseudoephedrine on occasion for environmental allergies. On examination there were violaceous, lichenified, flat-topped, polygonal papules scattered over the arms, legs, and trunk (Figure 1). Some papules demonstrated a Köbner phenomenon. No Wickham striae or mucosal involvement was noted. Rapid plasma reagin and hepatitis panel were negative. The patient was treated empirically with fluocinonide ointment 0.05% twice daily.
![]()
|
A shave biopsy was taken at the initial visit prior to steroid treatment. Histology revealed a classic lichenoid reaction pattern (Figure 2) and irregular acanthosis lying above the dense bandlike infiltrate of lymphocytes with liquefaction degeneration of the basal layer, rare Civatte bodies in the epidermis, and melanophages in the dermis.
At 5-week follow-up, the patient showed some improvement but not complete control of the lesions with topical steroids. Because the patient was on no other regular medications, we recommended a 3-month trial removal of the IUS. The patient decided to have the IUS removed and noted complete clearance of the skin lesions within 1 month. Challenge with oral or intradermal levonorgestrel was not conducted after clearance of the rash, which is a weakness in this report. Accordingly, the possibility that this patient’s condition was caused by idiopathic lichen planus, which may resolve spontaneously, cannot be ruled out. However, because the patient noted substantial improvement following removal of the device and remained symptom free 2 years after removal, we concluded that the cutaneous lesions were secondary to an LDE in response to the IUS.
It should be noted that as-needed use of pseudoephedrine and loratadine continued during this 2-year follow-up period and again the patient experienced no return of symptoms, which is particularly important because both of these agents have been associated with drug eruption patterns akin to lichenoid tissue reaction/interface dermatitis patterns. Pseudoephedrine is particularly notorious for causing nonpigmenting fixed drug eruptions such as those that heal without hyperpigmentation, while antihistamines such as loratadine have been associated with lichenoid and subacute lupus erythematosus–pattern drug reactions.1,2
Lichenoid drug reactions fall into the category of lymphocyte-rich lichenoid tissue reaction/interface dermatitis skin disorders.3 There are currently 202 different drugs reported to cause lichen planus or lichenoid eruptions as collected in Litt’s Drug Eruption & Reaction Database.4 Some of the more common causes of an LDE include angiotensin-converting enzyme inhibitors, antimalarials, calcium channel blockers, gold salts, and nonsteroidal anti-inflammatory drugs.3,4 Lichenoid eruptions typically are attributed to oral hormonal contraceptives only.5,6 An eruption in response to intrauterine levonorgestrel treatment is rare. One case report of a lichenoid eruption in response to a copper IUS was hypothesized to be due to presence of nickel salts as a manufacturing contaminant; however, the manufacturer denied the presence of the contaminant.7
The manufacturer’s information for health care professionals prescribing levonorgestrel-releasing IUS describes rashes as an adverse reaction present in less than 5% of individuals.8 Levonorgestrel-releasing IUS consists of a polyethylene frame compounded with barium sulfate, 52 mg of levonorgestrel, silicone (polydimethylsiloxane), and a monofilament brown polyethylene removal thread. The device initially releases 20 μg levonorgestrel daily, with a stable levonorgestrel plasma level of 150 to 200 pg/mL reached after the first few weeks following insertion of the device.8 Levonorgestrel is an agonist at the progesterone and androgen receptors.9 In clinical trials, levonorgestrel was implicated as the cause of increased acne, hair loss, and hirsutism as cutaneous side effects from use of levonorgestrel implants.10 However, to our knowledge, none of the other components of the levonorgestrel-releasing IUS have previously been reported to cause lichen planus or LDE.
The levonorgestrel-releasing IUS has been implicated as the cause of biopsy-proven Sweet disease,11 exacerbation of preexisting seborrheic dermatitis,12 rosacea,13 and autoimmune progesterone dermatitis.14 The skin findings in these cases resolved after removal of the IUS and appropriate treatment.
Identification of the causative drug can be difficult in LDE, as timing of the eruption can vary. The latent period has been reported to range from a few months to 1 to 2 years.15 Additionally, the clinical picture is often complicated in patients with a history of different drug dosages or multiple medications. When present, the histologic features of parakeratosis and eosinophils can be clues that a lichen planus–like eruption is drug related rather than idiopathic. However, the absence of these features does not rule out a medication or environmental trigger. In this case, the time-event relationship likely indicates that the eruption was related to the levonorgestrel-releasing IUS and not triggered by other medications or not idiopathic in nature. Lichenoid drug eruptions can resolve within a few weeks or up to 2 years after drug cessation and can occasionally be complicated by partial or complete resolution and recurrence even when the drug has not been discontinued.16,17 Lichenoid drug eruptions or idiopathic lichen planus generally are treated with topical immunomodulators or corticosteroids.3
Based on the time-event relationship, morphology, distribution, and histopathologic findings, we conclude that our patient developed LDE in response to the placement of a levonorgestrel-releasing IUS. Clinicians should be aware of the possibility of LDE occurring as a rare adverse effect of these devices.
1. Shelley WB, Shelley ED. Nonpigmenting fixed drug eruption as a distinctive reaction pattern: examples caused by sensitivity to pseudoephedrine hydrochloride and tetrahydrozoline. J Am Acad Dermatol. 1987;17:403-407.
2. Crowson AN, Magro CM. Lichenoid and subacute cutaneous lupus erythematosus-like dermatitis associated with antihistamine therapy. J Cutan Pathol. 1999;26:95-99.
3. Sontheimer RD. Lichenoid tissue reaction/interface dermatitis: clinical and histological perspectives [published online ahead of print February 26, 2009]. J Invest Dermatol. 2009;129:1088-1099.
4. Litt’s Drug Eruption & Reaction Database. Boca Raton, FL: Taylor & Francis Group; 2015. http://www.drugeruptiondata.com/searchresults/index/reaction_type/id/1/char/L. Accessed June 11, 2015.
5. Coskey RJ. Eruptions due to oral contraceptives. Arch Dermatol. 1977;113:333-334.
6. Thomas P, Dalle E, Revillon B, et al. Cutaneous effects in hormonal contraception [in French]. NPN Med. 1985;5:19-24.
7. Lombardi P, Campolmi P, Sertoli A. Lichenoid dermatitis caused by nickel salts? Contact Dermatitis. 1983;9:520-521.
8. Mirena [package insert]. Whippany, NJ: Bayer HealthCare Pharmaceuticals Inc; 2014.
9. Lemus AE, Vilchis F, Damsky R, et al. Mechanism of action of levonorgestrel: in vitro metabolism and specific interactions with steroid receptors in target organs. J Steroid Biochem Mol Biol. 1992;41:881-890.
10. Brache V, Faundes A, Alvarex F, et al. Nonmenstrual adverse events during use of implantable contraceptives for women: data from clinical trials. Contraception. 2002;65:63-74.
11. Hamill M, Bowling J, Vega-Lopez F. Sweet’s syndrome and a Mirena intrauterine system. J Fam Plann Reprod Health Care. 2004;30:115-116.
12. Karri K, Mowbray D, Adams S, et al. Severe seborrhoeic dermatitis: side-effect of the Mirena intra-uterine system. Eur J Contracept Reprod Health Care. 2006;11:53-54.
13. Choudry K, Humphreys F, Menage J. Rosacea in association with the progesterone-releasing intrauterine contraceptive device. Clin Exp Dermatol. 2001;26:102.
14. Pereira A, Coker A. Hypersensitivity to Mirena—a rare complication. J Obstet Gynaecol. 2003;23:81.
15. Halevy S, Shai A. Lichenoid drug eruptions. J Am Acad Dermatol. 1993;29(2, pt 1):249-255.
16. Seehafer JR, Rogers RS 3rd, Fleming CR, et al. Lichen planus-like lesions caused by penicillamine in primary biliary cirrhosis. Arch Dermatol. 1981;117:140-142.
17. Anderson TE. Lichen planus following quinidine therapy. Br J Dermatol. 1967;79:500.
1. Shelley WB, Shelley ED. Nonpigmenting fixed drug eruption as a distinctive reaction pattern: examples caused by sensitivity to pseudoephedrine hydrochloride and tetrahydrozoline. J Am Acad Dermatol. 1987;17:403-407.
2. Crowson AN, Magro CM. Lichenoid and subacute cutaneous lupus erythematosus-like dermatitis associated with antihistamine therapy. J Cutan Pathol. 1999;26:95-99.
3. Sontheimer RD. Lichenoid tissue reaction/interface dermatitis: clinical and histological perspectives [published online ahead of print February 26, 2009]. J Invest Dermatol. 2009;129:1088-1099.
4. Litt’s Drug Eruption & Reaction Database. Boca Raton, FL: Taylor & Francis Group; 2015. http://www.drugeruptiondata.com/searchresults/index/reaction_type/id/1/char/L. Accessed June 11, 2015.
5. Coskey RJ. Eruptions due to oral contraceptives. Arch Dermatol. 1977;113:333-334.
6. Thomas P, Dalle E, Revillon B, et al. Cutaneous effects in hormonal contraception [in French]. NPN Med. 1985;5:19-24.
7. Lombardi P, Campolmi P, Sertoli A. Lichenoid dermatitis caused by nickel salts? Contact Dermatitis. 1983;9:520-521.
8. Mirena [package insert]. Whippany, NJ: Bayer HealthCare Pharmaceuticals Inc; 2014.
9. Lemus AE, Vilchis F, Damsky R, et al. Mechanism of action of levonorgestrel: in vitro metabolism and specific interactions with steroid receptors in target organs. J Steroid Biochem Mol Biol. 1992;41:881-890.
10. Brache V, Faundes A, Alvarex F, et al. Nonmenstrual adverse events during use of implantable contraceptives for women: data from clinical trials. Contraception. 2002;65:63-74.
11. Hamill M, Bowling J, Vega-Lopez F. Sweet’s syndrome and a Mirena intrauterine system. J Fam Plann Reprod Health Care. 2004;30:115-116.
12. Karri K, Mowbray D, Adams S, et al. Severe seborrhoeic dermatitis: side-effect of the Mirena intra-uterine system. Eur J Contracept Reprod Health Care. 2006;11:53-54.
13. Choudry K, Humphreys F, Menage J. Rosacea in association with the progesterone-releasing intrauterine contraceptive device. Clin Exp Dermatol. 2001;26:102.
14. Pereira A, Coker A. Hypersensitivity to Mirena—a rare complication. J Obstet Gynaecol. 2003;23:81.
15. Halevy S, Shai A. Lichenoid drug eruptions. J Am Acad Dermatol. 1993;29(2, pt 1):249-255.
16. Seehafer JR, Rogers RS 3rd, Fleming CR, et al. Lichen planus-like lesions caused by penicillamine in primary biliary cirrhosis. Arch Dermatol. 1981;117:140-142.
17. Anderson TE. Lichen planus following quinidine therapy. Br J Dermatol. 1967;79:500.
Guidelines, appropriateness, and quality of care in PAD
Symptomatic PAD is among the most common reasons for referral to a vascular specialist. The volume of invasive procedures for PAD, and the attendant cost, has risen dramatically over the last decade. The majority of these interventions are for treatment of intermittent claudication (IC). Patients with IC have a broad range of disabilities and comorbid conditions. Medical therapy, smoking cessation, and exercise are of proven value for symptom improvement and long-term vascular health. In appropriately selected patients, revascularization for IC can relieve pain and improve ambulatory function. As a vascular surgeon keenly interested in PAD, I perform both open and endovascular interventions for IC in my practice.
Recent reports have highlighted rising concerns about the overuse of invasive procedures in PAD. A New York Times article1 cited the dramatic growth of stent procedures, raising a red flag among multiple stakeholders and consumers of vascular care. Although a closer look at the NY Times data highlights the explosion of stenting for venous disease, much of the subsequent discussion focused on PAD treatment, with its decade-long trend of rising volumes.
Another recent report2 documented the growing volume and costs of office-based percutaneous interventions for PAD in the United States, coincident with changes in Medicare reimbursement that greatly incentivized providers. This has turned the spotlight on office-based angiography suites, and how they are monitored. Improved, less invasive technology is often cited as a rational basis for offering intervention more readily to PAD patients. Unfortunately, the data on efficacy of interventions in IC is shockingly limited, leaving a wide gap in evidence supplanted by poor quality studies, overemphasis on technical success, market forces, and naked economics.
Just prior to the publication of the New York Times article on stent use, the SVS released a clinical practice guideline on the management of asymptomatic PAD and claudication.3 Systematic evidence reviews were undertaken4,5 and an expert panel of clinicians developed a list of specific recommendations. Medical therapy and exercise, preferably supervised exercise, were strongly recommended as first-line therapy for IC. Revascularization was considered reasonable for those patients with significant disability, acceptable risk, and after pharmacologic or exercise therapy have failed. An important recommendation in the guideline addresses a minimal effectiveness standard for revascularization in IC. Physicians should carefully consider the likelihood of functional benefit of a procedure based on patient risk, degree of impairment, and anatomic/technical factors that are known to impact patency.
The guideline suggests that a recommended intervention for IC should have a minimum expectation of >50% likelihood of sustained benefit for at least 2 years. At a recent local vascular symposium attended by more than 100 vascular providers, I asked the following question: “If you were a PAD patient considering an invasive procedure for claudication, what is the minimum likelihood of durable walking improvement you would expect?” The choices were >50% likelihood for at least 1 year, 2 years, or 3 years. Nearly 80% voted that they would want a 3-year, 50% minimum “guarantee” to consent to treatment. That seems quite rational to me.
Surgical and endovascular interventions for even advanced forms of aorto-iliac disease would generally meet the “>50% patency for at least 2-3 years” bar. But infrainguinal intervention is quite a different story. Although technology continues to advance with drug elution and improved stent designs for femoro-popliteal occlusive disease (FPOD), it has been incremental. I think it is fair to say that 3-year durability of an endovascular intervention for extensive FPOD is much more the exception than the rule. Now let’s consider a bit of “claudication math”. FPOD is commonly bilateral and symmetric.
How does one approach bilateral significant FPOD in a claudicant? If an intervention of long segment FPOD has a 60% chance of patency for 2 years, what’s the likelihood of a successful patient outcome if both legs are treated? Since we can usually assume two good legs are required for walking, it would be 0.6 x 0.6= 0.36! The best treatment we have for FPOD is a vein bypass graft, with a 70%-80% 3-year outcome. Bilateral fem-pop vein bypass grafts would just make the 50%, 3-year minimum expectation threshold, at the expense of two open procedures with their potential complications and costs. All of this means what we have always known: that we need to choose very wisely when intervening for claudication to get successful and satisfying outcomes. The old dictum “stop smoking and start walking” should not be replaced by “lets do a Duplex and take a look at your blockage, then we’ll see.”
Practice guidelines are important because they represent consensus recommendations, but they often leave considerable room for interpretation, particularly where the evidence is less strong. “Appropriateness” criteria, rather than addressing care of a specific clinical condition, focus on indications for specific procedures. Because the notion of “inappropriate” carries liability implications, appropriateness criteria tend to be even more liberal. What we really need are criteria for “rational use” of interventions, and I believe the “50%/2-year” minimum threshold for claudication in the SVS guideline is a good place to start.
Payers, most importantly Medicare, are getting increasingly interested in measuring quality of care in PAD. I believe that there are too many interventions being done in mild to moderate PAD, without adequate patient education, medical therapy, and exercise trials. I believe that informed consent is inconsistent at best, and that patients largely lack the tools for true “shared decision making” in these interactions. I believe that provider implementation of guideline-recommended medical therapy and follow-up care after invasive procedures is highly variable.
So here is what I would do if I were the CEO of a large payer looking at this state of affairs: I would offer qualified coverage for exercise therapy for 3-6 months for IC, and stipulate that outside of vocation-limiting disability, revascularization would not be covered unless a bona fide trial of exercise was made. I would contract with vascular practices that met a high standard of pre- and post-procedural guideline adherence, including prescription of cardioprotective drugs and surveillance. And I would mandate that authorized vascular providers on my panel collect follow-up data for at least 1 year in a high percentage of their PAD interventions, using VQI or a similar tool. Of course real change will require a better alignment of incentives, and by that I don’t mean just penalties, but also rewards for meeting benchmarks. The SVS should continue to broadly promote the development of higher quality standards in PAD care, for the long-term benefit of our patients and our specialty.
References:
1. Medicare payment surge for stents to unblock blood vessels in limbs. New York Times. Jan. 29, 2015 (online).
2. J. Amer. Coll. Card. 2015; 65:920-7.
3. J. Vasc. Surg. 2015;61 (3 suppl):2S-41S.
4. J. Vasc. Surg. 2015;61 (3 suppl):42S-53S.
5. J. Vasc. Surg. 2015; 61 (3 suppl):54S-73S.
Dr. Conte is professor of surgery at the University of California, San Francisco, co-chair of the SVS Lower Extremity Practice Guidelines Committee, and one of three co-editors leading the GVG CLTI Guidelines Steering Committee. He reported that he is on the Cook Medical–Scientific Advisory Board and the Medtronic Inc. Scientific Advisory Board, and is a lecturer for Cook Medical.
Symptomatic PAD is among the most common reasons for referral to a vascular specialist. The volume of invasive procedures for PAD, and the attendant cost, has risen dramatically over the last decade. The majority of these interventions are for treatment of intermittent claudication (IC). Patients with IC have a broad range of disabilities and comorbid conditions. Medical therapy, smoking cessation, and exercise are of proven value for symptom improvement and long-term vascular health. In appropriately selected patients, revascularization for IC can relieve pain and improve ambulatory function. As a vascular surgeon keenly interested in PAD, I perform both open and endovascular interventions for IC in my practice.
Recent reports have highlighted rising concerns about the overuse of invasive procedures in PAD. A New York Times article1 cited the dramatic growth of stent procedures, raising a red flag among multiple stakeholders and consumers of vascular care. Although a closer look at the NY Times data highlights the explosion of stenting for venous disease, much of the subsequent discussion focused on PAD treatment, with its decade-long trend of rising volumes.
Another recent report2 documented the growing volume and costs of office-based percutaneous interventions for PAD in the United States, coincident with changes in Medicare reimbursement that greatly incentivized providers. This has turned the spotlight on office-based angiography suites, and how they are monitored. Improved, less invasive technology is often cited as a rational basis for offering intervention more readily to PAD patients. Unfortunately, the data on efficacy of interventions in IC is shockingly limited, leaving a wide gap in evidence supplanted by poor quality studies, overemphasis on technical success, market forces, and naked economics.
Just prior to the publication of the New York Times article on stent use, the SVS released a clinical practice guideline on the management of asymptomatic PAD and claudication.3 Systematic evidence reviews were undertaken4,5 and an expert panel of clinicians developed a list of specific recommendations. Medical therapy and exercise, preferably supervised exercise, were strongly recommended as first-line therapy for IC. Revascularization was considered reasonable for those patients with significant disability, acceptable risk, and after pharmacologic or exercise therapy have failed. An important recommendation in the guideline addresses a minimal effectiveness standard for revascularization in IC. Physicians should carefully consider the likelihood of functional benefit of a procedure based on patient risk, degree of impairment, and anatomic/technical factors that are known to impact patency.
The guideline suggests that a recommended intervention for IC should have a minimum expectation of >50% likelihood of sustained benefit for at least 2 years. At a recent local vascular symposium attended by more than 100 vascular providers, I asked the following question: “If you were a PAD patient considering an invasive procedure for claudication, what is the minimum likelihood of durable walking improvement you would expect?” The choices were >50% likelihood for at least 1 year, 2 years, or 3 years. Nearly 80% voted that they would want a 3-year, 50% minimum “guarantee” to consent to treatment. That seems quite rational to me.
Surgical and endovascular interventions for even advanced forms of aorto-iliac disease would generally meet the “>50% patency for at least 2-3 years” bar. But infrainguinal intervention is quite a different story. Although technology continues to advance with drug elution and improved stent designs for femoro-popliteal occlusive disease (FPOD), it has been incremental. I think it is fair to say that 3-year durability of an endovascular intervention for extensive FPOD is much more the exception than the rule. Now let’s consider a bit of “claudication math”. FPOD is commonly bilateral and symmetric.
How does one approach bilateral significant FPOD in a claudicant? If an intervention of long segment FPOD has a 60% chance of patency for 2 years, what’s the likelihood of a successful patient outcome if both legs are treated? Since we can usually assume two good legs are required for walking, it would be 0.6 x 0.6= 0.36! The best treatment we have for FPOD is a vein bypass graft, with a 70%-80% 3-year outcome. Bilateral fem-pop vein bypass grafts would just make the 50%, 3-year minimum expectation threshold, at the expense of two open procedures with their potential complications and costs. All of this means what we have always known: that we need to choose very wisely when intervening for claudication to get successful and satisfying outcomes. The old dictum “stop smoking and start walking” should not be replaced by “lets do a Duplex and take a look at your blockage, then we’ll see.”
Practice guidelines are important because they represent consensus recommendations, but they often leave considerable room for interpretation, particularly where the evidence is less strong. “Appropriateness” criteria, rather than addressing care of a specific clinical condition, focus on indications for specific procedures. Because the notion of “inappropriate” carries liability implications, appropriateness criteria tend to be even more liberal. What we really need are criteria for “rational use” of interventions, and I believe the “50%/2-year” minimum threshold for claudication in the SVS guideline is a good place to start.
Payers, most importantly Medicare, are getting increasingly interested in measuring quality of care in PAD. I believe that there are too many interventions being done in mild to moderate PAD, without adequate patient education, medical therapy, and exercise trials. I believe that informed consent is inconsistent at best, and that patients largely lack the tools for true “shared decision making” in these interactions. I believe that provider implementation of guideline-recommended medical therapy and follow-up care after invasive procedures is highly variable.
So here is what I would do if I were the CEO of a large payer looking at this state of affairs: I would offer qualified coverage for exercise therapy for 3-6 months for IC, and stipulate that outside of vocation-limiting disability, revascularization would not be covered unless a bona fide trial of exercise was made. I would contract with vascular practices that met a high standard of pre- and post-procedural guideline adherence, including prescription of cardioprotective drugs and surveillance. And I would mandate that authorized vascular providers on my panel collect follow-up data for at least 1 year in a high percentage of their PAD interventions, using VQI or a similar tool. Of course real change will require a better alignment of incentives, and by that I don’t mean just penalties, but also rewards for meeting benchmarks. The SVS should continue to broadly promote the development of higher quality standards in PAD care, for the long-term benefit of our patients and our specialty.
References:
1. Medicare payment surge for stents to unblock blood vessels in limbs. New York Times. Jan. 29, 2015 (online).
2. J. Amer. Coll. Card. 2015; 65:920-7.
3. J. Vasc. Surg. 2015;61 (3 suppl):2S-41S.
4. J. Vasc. Surg. 2015;61 (3 suppl):42S-53S.
5. J. Vasc. Surg. 2015; 61 (3 suppl):54S-73S.
Dr. Conte is professor of surgery at the University of California, San Francisco, co-chair of the SVS Lower Extremity Practice Guidelines Committee, and one of three co-editors leading the GVG CLTI Guidelines Steering Committee. He reported that he is on the Cook Medical–Scientific Advisory Board and the Medtronic Inc. Scientific Advisory Board, and is a lecturer for Cook Medical.
Symptomatic PAD is among the most common reasons for referral to a vascular specialist. The volume of invasive procedures for PAD, and the attendant cost, has risen dramatically over the last decade. The majority of these interventions are for treatment of intermittent claudication (IC). Patients with IC have a broad range of disabilities and comorbid conditions. Medical therapy, smoking cessation, and exercise are of proven value for symptom improvement and long-term vascular health. In appropriately selected patients, revascularization for IC can relieve pain and improve ambulatory function. As a vascular surgeon keenly interested in PAD, I perform both open and endovascular interventions for IC in my practice.
Recent reports have highlighted rising concerns about the overuse of invasive procedures in PAD. A New York Times article1 cited the dramatic growth of stent procedures, raising a red flag among multiple stakeholders and consumers of vascular care. Although a closer look at the NY Times data highlights the explosion of stenting for venous disease, much of the subsequent discussion focused on PAD treatment, with its decade-long trend of rising volumes.
Another recent report2 documented the growing volume and costs of office-based percutaneous interventions for PAD in the United States, coincident with changes in Medicare reimbursement that greatly incentivized providers. This has turned the spotlight on office-based angiography suites, and how they are monitored. Improved, less invasive technology is often cited as a rational basis for offering intervention more readily to PAD patients. Unfortunately, the data on efficacy of interventions in IC is shockingly limited, leaving a wide gap in evidence supplanted by poor quality studies, overemphasis on technical success, market forces, and naked economics.
Just prior to the publication of the New York Times article on stent use, the SVS released a clinical practice guideline on the management of asymptomatic PAD and claudication.3 Systematic evidence reviews were undertaken4,5 and an expert panel of clinicians developed a list of specific recommendations. Medical therapy and exercise, preferably supervised exercise, were strongly recommended as first-line therapy for IC. Revascularization was considered reasonable for those patients with significant disability, acceptable risk, and after pharmacologic or exercise therapy have failed. An important recommendation in the guideline addresses a minimal effectiveness standard for revascularization in IC. Physicians should carefully consider the likelihood of functional benefit of a procedure based on patient risk, degree of impairment, and anatomic/technical factors that are known to impact patency.
The guideline suggests that a recommended intervention for IC should have a minimum expectation of >50% likelihood of sustained benefit for at least 2 years. At a recent local vascular symposium attended by more than 100 vascular providers, I asked the following question: “If you were a PAD patient considering an invasive procedure for claudication, what is the minimum likelihood of durable walking improvement you would expect?” The choices were >50% likelihood for at least 1 year, 2 years, or 3 years. Nearly 80% voted that they would want a 3-year, 50% minimum “guarantee” to consent to treatment. That seems quite rational to me.
Surgical and endovascular interventions for even advanced forms of aorto-iliac disease would generally meet the “>50% patency for at least 2-3 years” bar. But infrainguinal intervention is quite a different story. Although technology continues to advance with drug elution and improved stent designs for femoro-popliteal occlusive disease (FPOD), it has been incremental. I think it is fair to say that 3-year durability of an endovascular intervention for extensive FPOD is much more the exception than the rule. Now let’s consider a bit of “claudication math”. FPOD is commonly bilateral and symmetric.
How does one approach bilateral significant FPOD in a claudicant? If an intervention of long segment FPOD has a 60% chance of patency for 2 years, what’s the likelihood of a successful patient outcome if both legs are treated? Since we can usually assume two good legs are required for walking, it would be 0.6 x 0.6= 0.36! The best treatment we have for FPOD is a vein bypass graft, with a 70%-80% 3-year outcome. Bilateral fem-pop vein bypass grafts would just make the 50%, 3-year minimum expectation threshold, at the expense of two open procedures with their potential complications and costs. All of this means what we have always known: that we need to choose very wisely when intervening for claudication to get successful and satisfying outcomes. The old dictum “stop smoking and start walking” should not be replaced by “lets do a Duplex and take a look at your blockage, then we’ll see.”
Practice guidelines are important because they represent consensus recommendations, but they often leave considerable room for interpretation, particularly where the evidence is less strong. “Appropriateness” criteria, rather than addressing care of a specific clinical condition, focus on indications for specific procedures. Because the notion of “inappropriate” carries liability implications, appropriateness criteria tend to be even more liberal. What we really need are criteria for “rational use” of interventions, and I believe the “50%/2-year” minimum threshold for claudication in the SVS guideline is a good place to start.
Payers, most importantly Medicare, are getting increasingly interested in measuring quality of care in PAD. I believe that there are too many interventions being done in mild to moderate PAD, without adequate patient education, medical therapy, and exercise trials. I believe that informed consent is inconsistent at best, and that patients largely lack the tools for true “shared decision making” in these interactions. I believe that provider implementation of guideline-recommended medical therapy and follow-up care after invasive procedures is highly variable.
So here is what I would do if I were the CEO of a large payer looking at this state of affairs: I would offer qualified coverage for exercise therapy for 3-6 months for IC, and stipulate that outside of vocation-limiting disability, revascularization would not be covered unless a bona fide trial of exercise was made. I would contract with vascular practices that met a high standard of pre- and post-procedural guideline adherence, including prescription of cardioprotective drugs and surveillance. And I would mandate that authorized vascular providers on my panel collect follow-up data for at least 1 year in a high percentage of their PAD interventions, using VQI or a similar tool. Of course real change will require a better alignment of incentives, and by that I don’t mean just penalties, but also rewards for meeting benchmarks. The SVS should continue to broadly promote the development of higher quality standards in PAD care, for the long-term benefit of our patients and our specialty.
References:
1. Medicare payment surge for stents to unblock blood vessels in limbs. New York Times. Jan. 29, 2015 (online).
2. J. Amer. Coll. Card. 2015; 65:920-7.
3. J. Vasc. Surg. 2015;61 (3 suppl):2S-41S.
4. J. Vasc. Surg. 2015;61 (3 suppl):42S-53S.
5. J. Vasc. Surg. 2015; 61 (3 suppl):54S-73S.
Dr. Conte is professor of surgery at the University of California, San Francisco, co-chair of the SVS Lower Extremity Practice Guidelines Committee, and one of three co-editors leading the GVG CLTI Guidelines Steering Committee. He reported that he is on the Cook Medical–Scientific Advisory Board and the Medtronic Inc. Scientific Advisory Board, and is a lecturer for Cook Medical.
Society of Hospital Medicine Events, Online Tools, Programs for Hospitalists
Career Advancers: SHM Events, Online Tools, and Programs
Hospitalists can advance their careers and the hospital medicine movement at the same time, with in-person events, online tools, and other programs designed specifically for people providing care to hospitalized patients.
When hospitalists meet face to face, good things happen. Solutions are shared. Challenges are addressed. But most importantly, SHM’s meetings are sources of energy and inspiration for the thousands of hospitalists who attend them every year.
July 23-26, San Antonio
There’s still time to register for the fast-growing national event organized specifically for pediatric hospitalists. This year, the meeting will focus on mentoring, networking, and partnerships to improve children’s health locally and globally.
Meeting attendees should plan on downloading the PHM 2015 app to get session materials, download presentations, and find their way at the conference.
October 19-22, Austin
Have you taken on more leadership responsibilities at your hospital?
Or are you ready to demonstrate that you’re ready to take them on?
SHM’s Leadership Academy has trained thousands of hospitalists to lead groups more effectively and to understand the financial realities of running a hospital
medicine practice. www.hospitalmedicine.org/leadership
March 6-9, 2016, San Diego
Every year, thousands of hospitalists gather for educational sessions, professional networking, and time to catch up with friends in the hospital medicine movement. Now is the time to schedule time off and register! www.hospitalmedicine2016.org
Meet-Ups for Medical Students and Residents
Chicago and Los Angeles
Are you in the Chicago or Los Angeles area? Do you know medical students and residents exploring their career options? Make sure they know about SHM’s
Future of Hospital Medicine events later this year. Each event features hospitalist leaders talking about their careers and—of course—there will be food. The first event was held in May at University of Chicago. Upcoming events will be at Rush University in Chicago on September 24 and David Geffen School of Medicine at UCLA on October 22. Visit the website below for details, and share with your colleagues! www.futureofhospitalmedicine.org/events
If you can’t make it to in-person events, SHM brings some of the very best of the hospital medicine movement to your smartphone, tablet, and computer.
New at the Learning Portal: “Perioperative Cardiac Risk Assessment” and “Patient Safety Tools”
Free CME is available to all SHM members at www.shmlearningportal.org, and new modules are added all the time. Recently, SHM has added two new modules:
- Perioperative Cardiac Risk Assessment. Perioperative cardiac complications are the most widely feared medical issues for the anesthesiologist, surgeon, and medical consultant as they approach a patient with the option of surgery. To assess for pre-operative cardiac risk, hospitalists should follow a step-wise algorithm. This new module reviews the risk assessment process and enables the hospitalist to order appropriate pre-operative testing.
- Patient Safety Tools: Root Cause Analysis and Failure Mode and Effects Analysis 2015. This updated online learning module begins with a lesson and contains a 10-question post-test with accompanying answers, rationales, and references. When the participant selects an answer, immediate feedback is given explaining the correct answer.
Quality Improvement Webinars
SHM is hosting nine webinars between now and September. Hospitalists can attend the webinars in real time or download them from the SHM website at www.hospitalmedicine.org/qiwebinar.
Project BOOST webinar series:
- Project BOOST Teach-Back;
- Project BOOST Presents “Partnering with Skilled Nursing Facilities”; and
- Project BOOST Presents “Approaches to Readmission Risk Stratification.”
Glycemic control webinar series:
- Perioperative Management of Hyperglycemia;
- Hypoglycemia Management and Prevention; and
- Subcutaneous Insulin Order Sets in the Inpatient Setting: Design and Implementation.
General QI webinars:
- Quality Improvement for Hospital Medicine Groups: Self-Assessment and Self-Improvement Using the SHM Key Characteristics;
- Coaching a Quality Improvement Team: Basics for Being Sure Any QI Team and Project Are on the Right Track; and
- Elevating Provider Experience to Improve Patient Experience.
Evaluate Your Performance with the ACS Performance Improvement CME Program
The ACS PI-CME is a self-directed, web-based activity designed to help you evaluate your practice. Registration is FREE. Upon completion of the activity, participants will receive 20 CME Credits.
For details, visit www.hospitalmedicine.org/acs and click “REGISTER.”
Career Advancers: SHM Events, Online Tools, and Programs
Hospitalists can advance their careers and the hospital medicine movement at the same time, with in-person events, online tools, and other programs designed specifically for people providing care to hospitalized patients.
When hospitalists meet face to face, good things happen. Solutions are shared. Challenges are addressed. But most importantly, SHM’s meetings are sources of energy and inspiration for the thousands of hospitalists who attend them every year.
July 23-26, San Antonio
There’s still time to register for the fast-growing national event organized specifically for pediatric hospitalists. This year, the meeting will focus on mentoring, networking, and partnerships to improve children’s health locally and globally.
Meeting attendees should plan on downloading the PHM 2015 app to get session materials, download presentations, and find their way at the conference.
October 19-22, Austin
Have you taken on more leadership responsibilities at your hospital?
Or are you ready to demonstrate that you’re ready to take them on?
SHM’s Leadership Academy has trained thousands of hospitalists to lead groups more effectively and to understand the financial realities of running a hospital
medicine practice. www.hospitalmedicine.org/leadership
March 6-9, 2016, San Diego
Every year, thousands of hospitalists gather for educational sessions, professional networking, and time to catch up with friends in the hospital medicine movement. Now is the time to schedule time off and register! www.hospitalmedicine2016.org
Meet-Ups for Medical Students and Residents
Chicago and Los Angeles
Are you in the Chicago or Los Angeles area? Do you know medical students and residents exploring their career options? Make sure they know about SHM’s
Future of Hospital Medicine events later this year. Each event features hospitalist leaders talking about their careers and—of course—there will be food. The first event was held in May at University of Chicago. Upcoming events will be at Rush University in Chicago on September 24 and David Geffen School of Medicine at UCLA on October 22. Visit the website below for details, and share with your colleagues! www.futureofhospitalmedicine.org/events
If you can’t make it to in-person events, SHM brings some of the very best of the hospital medicine movement to your smartphone, tablet, and computer.
New at the Learning Portal: “Perioperative Cardiac Risk Assessment” and “Patient Safety Tools”
Free CME is available to all SHM members at www.shmlearningportal.org, and new modules are added all the time. Recently, SHM has added two new modules:
- Perioperative Cardiac Risk Assessment. Perioperative cardiac complications are the most widely feared medical issues for the anesthesiologist, surgeon, and medical consultant as they approach a patient with the option of surgery. To assess for pre-operative cardiac risk, hospitalists should follow a step-wise algorithm. This new module reviews the risk assessment process and enables the hospitalist to order appropriate pre-operative testing.
- Patient Safety Tools: Root Cause Analysis and Failure Mode and Effects Analysis 2015. This updated online learning module begins with a lesson and contains a 10-question post-test with accompanying answers, rationales, and references. When the participant selects an answer, immediate feedback is given explaining the correct answer.
Quality Improvement Webinars
SHM is hosting nine webinars between now and September. Hospitalists can attend the webinars in real time or download them from the SHM website at www.hospitalmedicine.org/qiwebinar.
Project BOOST webinar series:
- Project BOOST Teach-Back;
- Project BOOST Presents “Partnering with Skilled Nursing Facilities”; and
- Project BOOST Presents “Approaches to Readmission Risk Stratification.”
Glycemic control webinar series:
- Perioperative Management of Hyperglycemia;
- Hypoglycemia Management and Prevention; and
- Subcutaneous Insulin Order Sets in the Inpatient Setting: Design and Implementation.
General QI webinars:
- Quality Improvement for Hospital Medicine Groups: Self-Assessment and Self-Improvement Using the SHM Key Characteristics;
- Coaching a Quality Improvement Team: Basics for Being Sure Any QI Team and Project Are on the Right Track; and
- Elevating Provider Experience to Improve Patient Experience.
Evaluate Your Performance with the ACS Performance Improvement CME Program
The ACS PI-CME is a self-directed, web-based activity designed to help you evaluate your practice. Registration is FREE. Upon completion of the activity, participants will receive 20 CME Credits.
For details, visit www.hospitalmedicine.org/acs and click “REGISTER.”
Career Advancers: SHM Events, Online Tools, and Programs
Hospitalists can advance their careers and the hospital medicine movement at the same time, with in-person events, online tools, and other programs designed specifically for people providing care to hospitalized patients.
When hospitalists meet face to face, good things happen. Solutions are shared. Challenges are addressed. But most importantly, SHM’s meetings are sources of energy and inspiration for the thousands of hospitalists who attend them every year.
July 23-26, San Antonio
There’s still time to register for the fast-growing national event organized specifically for pediatric hospitalists. This year, the meeting will focus on mentoring, networking, and partnerships to improve children’s health locally and globally.
Meeting attendees should plan on downloading the PHM 2015 app to get session materials, download presentations, and find their way at the conference.
October 19-22, Austin
Have you taken on more leadership responsibilities at your hospital?
Or are you ready to demonstrate that you’re ready to take them on?
SHM’s Leadership Academy has trained thousands of hospitalists to lead groups more effectively and to understand the financial realities of running a hospital
medicine practice. www.hospitalmedicine.org/leadership
March 6-9, 2016, San Diego
Every year, thousands of hospitalists gather for educational sessions, professional networking, and time to catch up with friends in the hospital medicine movement. Now is the time to schedule time off and register! www.hospitalmedicine2016.org
Meet-Ups for Medical Students and Residents
Chicago and Los Angeles
Are you in the Chicago or Los Angeles area? Do you know medical students and residents exploring their career options? Make sure they know about SHM’s
Future of Hospital Medicine events later this year. Each event features hospitalist leaders talking about their careers and—of course—there will be food. The first event was held in May at University of Chicago. Upcoming events will be at Rush University in Chicago on September 24 and David Geffen School of Medicine at UCLA on October 22. Visit the website below for details, and share with your colleagues! www.futureofhospitalmedicine.org/events
If you can’t make it to in-person events, SHM brings some of the very best of the hospital medicine movement to your smartphone, tablet, and computer.
New at the Learning Portal: “Perioperative Cardiac Risk Assessment” and “Patient Safety Tools”
Free CME is available to all SHM members at www.shmlearningportal.org, and new modules are added all the time. Recently, SHM has added two new modules:
- Perioperative Cardiac Risk Assessment. Perioperative cardiac complications are the most widely feared medical issues for the anesthesiologist, surgeon, and medical consultant as they approach a patient with the option of surgery. To assess for pre-operative cardiac risk, hospitalists should follow a step-wise algorithm. This new module reviews the risk assessment process and enables the hospitalist to order appropriate pre-operative testing.
- Patient Safety Tools: Root Cause Analysis and Failure Mode and Effects Analysis 2015. This updated online learning module begins with a lesson and contains a 10-question post-test with accompanying answers, rationales, and references. When the participant selects an answer, immediate feedback is given explaining the correct answer.
Quality Improvement Webinars
SHM is hosting nine webinars between now and September. Hospitalists can attend the webinars in real time or download them from the SHM website at www.hospitalmedicine.org/qiwebinar.
Project BOOST webinar series:
- Project BOOST Teach-Back;
- Project BOOST Presents “Partnering with Skilled Nursing Facilities”; and
- Project BOOST Presents “Approaches to Readmission Risk Stratification.”
Glycemic control webinar series:
- Perioperative Management of Hyperglycemia;
- Hypoglycemia Management and Prevention; and
- Subcutaneous Insulin Order Sets in the Inpatient Setting: Design and Implementation.
General QI webinars:
- Quality Improvement for Hospital Medicine Groups: Self-Assessment and Self-Improvement Using the SHM Key Characteristics;
- Coaching a Quality Improvement Team: Basics for Being Sure Any QI Team and Project Are on the Right Track; and
- Elevating Provider Experience to Improve Patient Experience.
Evaluate Your Performance with the ACS Performance Improvement CME Program
The ACS PI-CME is a self-directed, web-based activity designed to help you evaluate your practice. Registration is FREE. Upon completion of the activity, participants will receive 20 CME Credits.
For details, visit www.hospitalmedicine.org/acs and click “REGISTER.”
Society of Hospital Medicine Membership Ambassador Program Benefits Hospitalists
Now, through SHM’s Membership Ambassador Program, SHM members can earn 2016-2017 dues credits and special recognition for recruiting new physician, physician assistant, nurse practitioner, pharmacist, or affiliate members. And for every new member recruited, hospitalists will receive one entry into a grand prize drawing to receive complimentary registration to Hospital Medicine 2016 in San Diego.
Demonstrating leadership by becoming a Fellow or Senior Fellow in Hospital Medicine is another great way to move it forward—and propel your career at the same time. July and August are excellent months to begin the FHM or SFHM application process.
Click for more details and great SHM merchandise.
Now, through SHM’s Membership Ambassador Program, SHM members can earn 2016-2017 dues credits and special recognition for recruiting new physician, physician assistant, nurse practitioner, pharmacist, or affiliate members. And for every new member recruited, hospitalists will receive one entry into a grand prize drawing to receive complimentary registration to Hospital Medicine 2016 in San Diego.
Demonstrating leadership by becoming a Fellow or Senior Fellow in Hospital Medicine is another great way to move it forward—and propel your career at the same time. July and August are excellent months to begin the FHM or SFHM application process.
Click for more details and great SHM merchandise.
Now, through SHM’s Membership Ambassador Program, SHM members can earn 2016-2017 dues credits and special recognition for recruiting new physician, physician assistant, nurse practitioner, pharmacist, or affiliate members. And for every new member recruited, hospitalists will receive one entry into a grand prize drawing to receive complimentary registration to Hospital Medicine 2016 in San Diego.
Demonstrating leadership by becoming a Fellow or Senior Fellow in Hospital Medicine is another great way to move it forward—and propel your career at the same time. July and August are excellent months to begin the FHM or SFHM application process.
Click for more details and great SHM merchandise.