Affiliations
Center for Research on End of Life Care, Weill Cornell Medicine, New York, New York
Given name(s)
Daniel C.
Family name
McFarland
Degrees
DO

Inpatient Hospital Pain Management

Article Type
Changed
Mon, 01/02/2017 - 19:34
Display Headline
Predictors of patient satisfaction with inpatient hospital pain management across the United States: A national study

Pain management is an integral component of patient‐centered medical care and is a major concern for patients who are hospitalized.[1] Patient‐reported ratings of pain management are highly correlated with overall satisfaction with healthcare delivery.[2] Current research indicates that patient satisfaction with pain management may be improving[3]; however, there may be structural and county‐level disparities in these improvements in satisfaction. Although patient satisfaction with pain management increased from 2008 to 2012, a discrepancy in patient satisfaction with pain management has emerged between 3 different hospital systems (safety net, acute care, critical access hospitals)[3] Specifically, acute care hospitals provide less satisfactory pain management as compared to critical access hospitals.[3] Although patients' perception of pain management is an integral part of delivering patient‐centered care, prior research indicates that there may not be a simple inverse association between pain intensity score and patient satisfaction.[4] The management of pain in hospitals continues to be problematic, perhaps, for instance, due to discrepancies in understanding the relationship between patient satisfaction and pain management. Certainly for this reason and many others, satisfaction with pain management is now one of the dimensions assessed by the Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) survey, which is a global measure of patient satisfaction.

The HCAHPS survey is utilized by 85% of all US‐based hospitals and gathers patient satisfaction information pertaining to 10 dimensions, including pain management. Patient satisfaction scores (via HCAHPS) now constitute 30% of Hospital Value‐Based Purchasing (HVBP), which makes up 2% of at‐risk reimbursements by the Centers for Medicare and Medicaid Services (CMS) as put forth by the Affordable Care Act (ACA) of 2010.[5] The ACA mandates that payments to hospitals must partly depend on metrics that assess patient satisfaction, as broadly measured by the HCAHPS, which are completed by patients upon hospital discharge.[5, 6] Therefore, patient satisfaction, as measured by patients, now directly affects CMS payments for over 3000 hospitals across the United States. This constitutes a large amount of money for most hospitals that operate on high revenue but have low profit margins. As such, the 2% at‐risk reimbursement may place many hospitals at financial risk that could be ameliorated with effective inpatient pain management.

In addition to its critical role in reimbursement to hospitals, patient satisfaction with pain management is also integrally related to providing patient‐centered care. As such, patient satisfaction with pain management is considered a critical element of various models of the patient‐centered approach to providing medical care. Although a medical inpatient team can assess objective signs of pain, patient‐centric pain measurements are paramount in understanding the pain experience of patients and providing adequate pain management care. Moreover, patients, doctors, payers of medical services, and now CMS increasingly regard a patient‐centered approach to medical care as crucial for the delivery of high‐quality care.

HCAHPS survey sampling represents an excellent opportunity to help assess current gaps in patient‐centered clinical care. However, ecological factors, such as county‐level demographics and hospital size (eg, bed number), are known to influence health outcomes but have not been adequately studied in pain management patient satisfaction.[7] Hospital and county‐level factors may influence the degree to which patients experience patient‐centered pain management care. For instance, most patient satisfaction scores are worse in urban areas.[8, 9] These disparities in patient satisfaction scores could be associated with population density, greater ethnic diversity or nonEnglish‐speaking individuals, or number of hospital beds.

The US Census demographics and hospital‐bed number provide a concurrent measure that can be used across the country to estimate hospital ecology. This study evaluated the influence of county‐level demographic and structural factors (ie, hospital beds) on patient satisfaction with hospital pain management in all HCAHPS‐participating hospitals across the United States. We hypothesized that demographic diversity, higher population density, and higher numbers of hospital beds would predict lower levels of patient satisfaction with inpatient pain management.

METHODS

Data Collection: County‐Level Predictors

Publically available data were obtained from the American Hospital Directory[10] and United States Census Bureau[11] websites. Twenty US Census data categories were selected a priori by their clinical relevance to influence pain management perception out of the 50 publically reported US Census categories. Final variables utilized in regression modeling are listed under the Variable column in Table 1. Covariate correlation coefficients were all under 0.7, indicating a lack of significant colinearity.

Bivariate Linear Regression of Pain Management Patient Satisfaction With 20 Explanatory Variables (County‐Level Demographics and Hospital Bed Numbers)
Variable Median Value (SD) Range Regression Coefficient (SE) t Value
  • NOTE: Pain management patient satisfaction was determined by the percentage of patients who stated that their pain was always well controlled (median 71%, SD 5.5, range 33%100%). Abbreviations: SD, standard deviation; SE, standard error. *P < 0.001. P < 0.01.

African American alone, % 5.6% (13.8%) 0%85.4% 0.02 (00) 3.609*
White alone, % 86.2% (15.8%) 5.3%99.0% 0.06 (0.01) 6.661*
Per capita income $24,499 ($6,419) $7,887$61,290 0.00 (0.00) 7.561*
With bachelor's degree, % 22.0% (10.1%) 6.3%70.7% 0.06 (0.01) 7.348*
Population <18 years of age, % 23.2% (3.1%) 8.3%40.6% 0.18 (0.05) 3.498*
With a high school degree, % 86.0% (6.4%) 46.3%98.6% 0.02 (0.01) 1.424
Population change over 1 year, % 0.7% (2.2%) 18.1%25.6% 0.25 (0.04) 5.645*
Same house over 1 year, % 85.4% (4.2%) 57.1%98.0% 0.01 (0.02) 0.493
White alone (not Hispanic), % 75.2% (21.8%) 3.2%98.4% 0.05(0.00) 12.077*
Household size 2.52 (0.3) 1.924.77 2.266 (0.36) 6.283*
Population county 105,937 (1,524,223) 1,1609,818,605 0.00 (0.00) 13.117*
Average travel time to work, min 23 (5.0) 642.5 0.21 (0.02) 11.071*
NonEnglish speaking, % 8.6% (15.1%) 0.2%95.9% 0.08 (0.01) 13.843*
Total female, % 50.7% (1.6%) 34.4%57.0% 0.44 (0.06) 7.489*
Population 65 years old, % 14.7% (4.1%) 5.8%49.3% 0.06 (0.02) 2.697
Population in poverty, % 14.7% (5.6%) 5.8%49.3% 0.02 (0.02) 1.01
Population density 138.7 (4,534) 0.369,467 0.73 (0.05) 15.734*
Foreign born, % 4.9% (9.3%) 0%51.2% 0.15 (0.01) 16.775*
Median household income $46,880 ($12,868) $20,206$120,096 0.00 (0.00) 6.052*
No. of hospital beds 103 (193) 22,259 0.01 (0.00) 15.403*

Data Collection: Patient Satisfaction With Pain Management

Pain management was measured using the HCAHPS survey pain management dimension by calculating the percentage of patient responders who said their pain was always controlled. HCAHPS data are publically available on the CMS Hospital Compare website.[6] It contains 32 questions that comprise 10 evaluative measures. It is provided to a random sample of patients across the United States throughout the year at 48 hours to 6 weeks after discharge from the hospital.

Analytic Plan

HCAHPS and US Census datasets were analyzed to assess their distribution curves. The population density variable was converted to a logarithmic scale to account for its skewed distribution and long tail in the area of low population density. Data were subsequently merged into an Excel (Microsoft Corp., Redmond, WA) spreadsheet using the VLOOKUP function such that relevant 2010 census county data were added to each hospital's HCAHPS data.

Bivariate analyses were conducted to determine which US Census categories were significant predictors for patient satisfaction with pain management. All significant predictors were then included in a multivariate model, which predicted for patient satisfaction with pain management. All analyses were 2‐tailed, and statistical significance was set at = 0.05.

RESULTS

Complete HCAHPS scores were obtained from 3907 hospitals out of a total of 4621 US hospitals (85%). The majority of hospitals (73.8%, n = 2884) collected over 300 surveys, fewer (n = 696) collected 100 to 299 surveys, and a small number of hospitals (n = 327) collected less than 100 surveys. Based on the most conservative estimate, results were available from at least 934,800 individual surveys. Missing HCAHPS hospital data averaged 13.4 (standard deviation [SD] = 12.2) hospitals per state. County‐level data were obtained from all 3144 county or county equivalents across the United States (100%).

Bivariate Analyses

Univariate regression indicated a significant association between pain management patient satisfaction and most county‐level demographic variables and number of hospital beds.

Multivariate Analyses

A multivariate linear regression model was run in which 20 county‐level demographic and hospital factors were examined as predictors of patient satisfaction with pain management. The model, which examined county‐level predictors of pain management, explained 12% of the variability in patients' ratings of pain management (R2 = 0.124, P < 0.0001). A total of 8 out of the 20 US Census variables were statistically significant predictors of pain management (Table 2). African American and white race were most strongly associated with higher ratings of patient satisfaction with pain management (ie, by partial coefficient and statistical significance). Number of hospital beds, percent foreign born, population density, and female gender were most strongly related to lower ratings of patient satisfaction with pain management.

Multivariate Regression Predicting Patient Satisfaction With Pain Management From HCAHPS Scores According to County Demographics and Hospital Size
Variable Median Value (SD) Range Regression Coefficient (SE) t Value
  • NOTE: This model demonstrates the multivariate association of 20 predictor variables with pain management patient satisfaction as determined by hospital percentage of patients who stated that their pain was always well controlled (median 71%, SD 5.5, range 33%100%). Abbreviations: HCAHPS = Hospital Consumer Assessment of Healthcare Providers and Systems; SD, standard deviation; SE, standard error. *P < 0.001. P < 0.01.

African American alone, % 5.6% (13.8%) 0%85.4% 0.07 (0.01) 0.23 7.104*
White alone, % 86.2% (15.8%) 5.3%99.0% 0.08 (0.01) 0.23 6.953*
Per capita income $24,499 ($6,419) $7,887$61,290 0.00 (0.00) 0.22 2.885
With bachelor's degree, % 22.0% (10.1%) 6.3%70.7% 0.03 (0.02) 0.10 1.401
Population <18 years old, % 23.2% (3.1%) 8.3%40.6% 0.18 (0.05) 0.08 3.498*
With a high school degree, % 86.0% (6.4%) 46.3%98.6% 0.02 (0.01) 0.02 1.424
Population change over 1 year, % 0.7% (2.2%) 18.1%25.6% 0.11 (0.06) 0.01 1.986
Same house over 1 year, % 85.4% (4.2%) 57.1%98.0% 0.01 (0.02) 0.01 0.493
White alone (not Hispanic), % 75.2% (21.8%) 3.2%98.4% 0.02(0.00) 0.01 0.740
Household size 2.52 (0.3) 1.924.77 0.92 (0.80) 0.03 1.145
Population county 105,937 (1,524,223) 1,1609,818,605 0.00 (0.00) 0.03 1.495
Average travel time to work, min 23 (5.0) 642.5 0.06 (0.02) 0.06 3.054
NonEnglish speaking, % 8.6% (15.1%) 0.2%95.9% 0.00 (0.03) 0.06 0.028
Total female, % 50.7% (1.6%) 34.4%57.0% 0.23 (0.07) 0.06 3.158
Population 65 years old, % 14.7% (4.1%) 5.8%49.3% 0.10 (0.04) 0.07 2.411
Population in poverty, % 14.7% (5.6%) 5.8%49.3% 0.02 (0.02) 0.08 1.01
Population density 138.7 (4,534) 0.369,467 0.24 (0.09) 0.08 2.823
Foreign born, % 4.9% (9.3%) 0%51.2% 0.07 (0.02) 0.12 4.906*
Median household income $46,880 ($12,868) $20,206‐$120,096 0.00 (0.00) 0.16 2.599
No. of hospital beds 103 (193) 22,259 0.00 (0.00) 0.16 9.167*
Model statistics F(1, 9) = 62.222, P < 0.001
Adjusted R2 0.124

DISCUSSION

By utilizing county‐level demographic data and the HCAHPS survey measures from across the United States, this study provides a representative sample of US hospitals that can be used to define ecological trends in patient satisfaction with pain management. This statistical model demonstrates the nonrandom variability of pain management satisfaction across the United States, even after CMS patient‐mix adjustment. Although the quality of pain management may be increasing by some reports, our present results indicate that pain management satisfaction is not equitable with the rest of the country among select groups of patients (eg, foreign born, female gender, areas of long travel times to work) or in certain care settings (eg, larger hospitals, population dense areas). These data suggest that areas of pain management may lack in quality compared to pain management across the entire US as a whole. This is consistent with the increasingly recognized contribution of multiple nonmedical determinates to health outcomes.[12] These results demonstrate the overall magnitude of healthcare disparity in the United States, and are particularly concerning because African Americans and Hispanics tend to rate overall satisfaction higher than Caucasians in other studies.[13, 14] The same minority reporting bias may be reflected in HCAHPS results. These patients may be reporting higher pain management satisfaction that is not consistent with the level of care they received, as studies have consistently indicated worse pain management delivery for racial and ethnic minorities.[15]

The present findings reveal structural (eg, hospital beds) and demographic (eg, population density, foreign born) gaps in satisfaction with pain management. An effort to improve pain management for all people in the heterogeneous makeup of the United States is an enormous challenge. However, change may be forthcoming, as Hospital Value‐Based Purchasing draws attention pain practice inequities in real time. Although several of the significant explanatory variables cannot be modified (eg, size of hospital, urban setting, patients served), pain management delivery should receive extra attention in hospitals with those characteristics. Pain management delivery in large, urban hospitals that serve foreign‐born patients may be improved with focused multilevel interventions. Future research should examine these inequities further and develop multilevel interventions that target hospitals in at‐risk areas with the aim of lessening disparities in hospital‐based pain management.

Disclosure

Nothing to report.

Files
References
  1. Dwamena F, Holmes‐Rovner M, Gaulden CM, et al. Interventions for providers to promote a patient‐centred approach in clinical consultations. Cochrane Database Syst Rev. 2012;12:CD003267.
  2. Gupta A, Daigle S, Mojica J, Hurley RW. Patient perception of pain care in hospitals in the United States. J Pain Res. 2009;2:157164.
  3. Gupta A, Lee LK, Mojica JJ, Nairizi A, George SJ. Patient perception of pain care in the United States: a 5‐year comparative analysis of hospital consumer assessment of health care providers and systems. Pain Physician. 2014;17(5):369377.
  4. Phillips S, Gift M, Gelot S, Duong M, Tapp H. Assessing the relationship between the level of pain control and patient satisfaction. J Pain Res. 2013;6:683689.
  5. H.R.3590—Patient Protection and Affordable Care Act 2010. Available at: https://www.congress.gov/bill/111th‐congress/house‐bill/3590. Accessed December 1, 2013.
  6. Centers for Medicare 55(1):125139.
  7. Joynt KE, Jha AK. Characteristics of hospitals receiving penalties under the Hospital Readmissions Reduction Program. JAMA. 2013;309(4):342343.
  8. Jha AK, Orav EJ, Zheng J, Epstein AM. Patients' perception of hospital care in the United States. N Engl J Med. 2008;359(18):19211931.
  9. American Hospital Directory. Hospital statistics by state. Available at: http://www.ahd.com/state_statistics.html. Accessed December 1, 2013.
  10. United States Census Bureau. Download center. Available at: http://factfinder.census.gov/faces/nav/jsf/pages/download_center.xhtml. Accessed December 1, 2013.
  11. Health policy brief: the relative contribution of multiple determinants to health outcomes. Health Affairs website. Available at: http://www.healthaffairs.org/healthpolicybriefs/brief.php?brief_id=123. Accessed December 1, 2013.
  12. Dayton E, Zhan C, Sangl J, Darby C, Moy E. Racial and ethnic differences in patient assessments of interactions with providers: disparities or measurement biases? Am J Med Qual. 2006;21(2):109114.
  13. Weech‐Maldonado R, Elliott MN, Oluwole A, Schiller KC, Hays RD. Survey response style and differential use of CAHPS rating scales by Hispanics. Med Care. 2008;46(9):963968.
  14. Institute of Medicine. Committee on Advancing Pain Research, Care, and Education. Relieving Pain in America: A Blueprint for Transforming Prevention, Care, Education, and Research. Washington, DC: National Academies Press; 2011.
Article PDF
Issue
Journal of Hospital Medicine - 11(7)
Page Number
498-501
Sections
Files
Files
Article PDF
Article PDF

Pain management is an integral component of patient‐centered medical care and is a major concern for patients who are hospitalized.[1] Patient‐reported ratings of pain management are highly correlated with overall satisfaction with healthcare delivery.[2] Current research indicates that patient satisfaction with pain management may be improving[3]; however, there may be structural and county‐level disparities in these improvements in satisfaction. Although patient satisfaction with pain management increased from 2008 to 2012, a discrepancy in patient satisfaction with pain management has emerged between 3 different hospital systems (safety net, acute care, critical access hospitals)[3] Specifically, acute care hospitals provide less satisfactory pain management as compared to critical access hospitals.[3] Although patients' perception of pain management is an integral part of delivering patient‐centered care, prior research indicates that there may not be a simple inverse association between pain intensity score and patient satisfaction.[4] The management of pain in hospitals continues to be problematic, perhaps, for instance, due to discrepancies in understanding the relationship between patient satisfaction and pain management. Certainly for this reason and many others, satisfaction with pain management is now one of the dimensions assessed by the Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) survey, which is a global measure of patient satisfaction.

The HCAHPS survey is utilized by 85% of all US‐based hospitals and gathers patient satisfaction information pertaining to 10 dimensions, including pain management. Patient satisfaction scores (via HCAHPS) now constitute 30% of Hospital Value‐Based Purchasing (HVBP), which makes up 2% of at‐risk reimbursements by the Centers for Medicare and Medicaid Services (CMS) as put forth by the Affordable Care Act (ACA) of 2010.[5] The ACA mandates that payments to hospitals must partly depend on metrics that assess patient satisfaction, as broadly measured by the HCAHPS, which are completed by patients upon hospital discharge.[5, 6] Therefore, patient satisfaction, as measured by patients, now directly affects CMS payments for over 3000 hospitals across the United States. This constitutes a large amount of money for most hospitals that operate on high revenue but have low profit margins. As such, the 2% at‐risk reimbursement may place many hospitals at financial risk that could be ameliorated with effective inpatient pain management.

In addition to its critical role in reimbursement to hospitals, patient satisfaction with pain management is also integrally related to providing patient‐centered care. As such, patient satisfaction with pain management is considered a critical element of various models of the patient‐centered approach to providing medical care. Although a medical inpatient team can assess objective signs of pain, patient‐centric pain measurements are paramount in understanding the pain experience of patients and providing adequate pain management care. Moreover, patients, doctors, payers of medical services, and now CMS increasingly regard a patient‐centered approach to medical care as crucial for the delivery of high‐quality care.

HCAHPS survey sampling represents an excellent opportunity to help assess current gaps in patient‐centered clinical care. However, ecological factors, such as county‐level demographics and hospital size (eg, bed number), are known to influence health outcomes but have not been adequately studied in pain management patient satisfaction.[7] Hospital and county‐level factors may influence the degree to which patients experience patient‐centered pain management care. For instance, most patient satisfaction scores are worse in urban areas.[8, 9] These disparities in patient satisfaction scores could be associated with population density, greater ethnic diversity or nonEnglish‐speaking individuals, or number of hospital beds.

The US Census demographics and hospital‐bed number provide a concurrent measure that can be used across the country to estimate hospital ecology. This study evaluated the influence of county‐level demographic and structural factors (ie, hospital beds) on patient satisfaction with hospital pain management in all HCAHPS‐participating hospitals across the United States. We hypothesized that demographic diversity, higher population density, and higher numbers of hospital beds would predict lower levels of patient satisfaction with inpatient pain management.

METHODS

Data Collection: County‐Level Predictors

Publically available data were obtained from the American Hospital Directory[10] and United States Census Bureau[11] websites. Twenty US Census data categories were selected a priori by their clinical relevance to influence pain management perception out of the 50 publically reported US Census categories. Final variables utilized in regression modeling are listed under the Variable column in Table 1. Covariate correlation coefficients were all under 0.7, indicating a lack of significant colinearity.

Bivariate Linear Regression of Pain Management Patient Satisfaction With 20 Explanatory Variables (County‐Level Demographics and Hospital Bed Numbers)
Variable Median Value (SD) Range Regression Coefficient (SE) t Value
  • NOTE: Pain management patient satisfaction was determined by the percentage of patients who stated that their pain was always well controlled (median 71%, SD 5.5, range 33%100%). Abbreviations: SD, standard deviation; SE, standard error. *P < 0.001. P < 0.01.

African American alone, % 5.6% (13.8%) 0%85.4% 0.02 (00) 3.609*
White alone, % 86.2% (15.8%) 5.3%99.0% 0.06 (0.01) 6.661*
Per capita income $24,499 ($6,419) $7,887$61,290 0.00 (0.00) 7.561*
With bachelor's degree, % 22.0% (10.1%) 6.3%70.7% 0.06 (0.01) 7.348*
Population <18 years of age, % 23.2% (3.1%) 8.3%40.6% 0.18 (0.05) 3.498*
With a high school degree, % 86.0% (6.4%) 46.3%98.6% 0.02 (0.01) 1.424
Population change over 1 year, % 0.7% (2.2%) 18.1%25.6% 0.25 (0.04) 5.645*
Same house over 1 year, % 85.4% (4.2%) 57.1%98.0% 0.01 (0.02) 0.493
White alone (not Hispanic), % 75.2% (21.8%) 3.2%98.4% 0.05(0.00) 12.077*
Household size 2.52 (0.3) 1.924.77 2.266 (0.36) 6.283*
Population county 105,937 (1,524,223) 1,1609,818,605 0.00 (0.00) 13.117*
Average travel time to work, min 23 (5.0) 642.5 0.21 (0.02) 11.071*
NonEnglish speaking, % 8.6% (15.1%) 0.2%95.9% 0.08 (0.01) 13.843*
Total female, % 50.7% (1.6%) 34.4%57.0% 0.44 (0.06) 7.489*
Population 65 years old, % 14.7% (4.1%) 5.8%49.3% 0.06 (0.02) 2.697
Population in poverty, % 14.7% (5.6%) 5.8%49.3% 0.02 (0.02) 1.01
Population density 138.7 (4,534) 0.369,467 0.73 (0.05) 15.734*
Foreign born, % 4.9% (9.3%) 0%51.2% 0.15 (0.01) 16.775*
Median household income $46,880 ($12,868) $20,206$120,096 0.00 (0.00) 6.052*
No. of hospital beds 103 (193) 22,259 0.01 (0.00) 15.403*

Data Collection: Patient Satisfaction With Pain Management

Pain management was measured using the HCAHPS survey pain management dimension by calculating the percentage of patient responders who said their pain was always controlled. HCAHPS data are publically available on the CMS Hospital Compare website.[6] It contains 32 questions that comprise 10 evaluative measures. It is provided to a random sample of patients across the United States throughout the year at 48 hours to 6 weeks after discharge from the hospital.

Analytic Plan

HCAHPS and US Census datasets were analyzed to assess their distribution curves. The population density variable was converted to a logarithmic scale to account for its skewed distribution and long tail in the area of low population density. Data were subsequently merged into an Excel (Microsoft Corp., Redmond, WA) spreadsheet using the VLOOKUP function such that relevant 2010 census county data were added to each hospital's HCAHPS data.

Bivariate analyses were conducted to determine which US Census categories were significant predictors for patient satisfaction with pain management. All significant predictors were then included in a multivariate model, which predicted for patient satisfaction with pain management. All analyses were 2‐tailed, and statistical significance was set at = 0.05.

RESULTS

Complete HCAHPS scores were obtained from 3907 hospitals out of a total of 4621 US hospitals (85%). The majority of hospitals (73.8%, n = 2884) collected over 300 surveys, fewer (n = 696) collected 100 to 299 surveys, and a small number of hospitals (n = 327) collected less than 100 surveys. Based on the most conservative estimate, results were available from at least 934,800 individual surveys. Missing HCAHPS hospital data averaged 13.4 (standard deviation [SD] = 12.2) hospitals per state. County‐level data were obtained from all 3144 county or county equivalents across the United States (100%).

Bivariate Analyses

Univariate regression indicated a significant association between pain management patient satisfaction and most county‐level demographic variables and number of hospital beds.

Multivariate Analyses

A multivariate linear regression model was run in which 20 county‐level demographic and hospital factors were examined as predictors of patient satisfaction with pain management. The model, which examined county‐level predictors of pain management, explained 12% of the variability in patients' ratings of pain management (R2 = 0.124, P < 0.0001). A total of 8 out of the 20 US Census variables were statistically significant predictors of pain management (Table 2). African American and white race were most strongly associated with higher ratings of patient satisfaction with pain management (ie, by partial coefficient and statistical significance). Number of hospital beds, percent foreign born, population density, and female gender were most strongly related to lower ratings of patient satisfaction with pain management.

Multivariate Regression Predicting Patient Satisfaction With Pain Management From HCAHPS Scores According to County Demographics and Hospital Size
Variable Median Value (SD) Range Regression Coefficient (SE) t Value
  • NOTE: This model demonstrates the multivariate association of 20 predictor variables with pain management patient satisfaction as determined by hospital percentage of patients who stated that their pain was always well controlled (median 71%, SD 5.5, range 33%100%). Abbreviations: HCAHPS = Hospital Consumer Assessment of Healthcare Providers and Systems; SD, standard deviation; SE, standard error. *P < 0.001. P < 0.01.

African American alone, % 5.6% (13.8%) 0%85.4% 0.07 (0.01) 0.23 7.104*
White alone, % 86.2% (15.8%) 5.3%99.0% 0.08 (0.01) 0.23 6.953*
Per capita income $24,499 ($6,419) $7,887$61,290 0.00 (0.00) 0.22 2.885
With bachelor's degree, % 22.0% (10.1%) 6.3%70.7% 0.03 (0.02) 0.10 1.401
Population <18 years old, % 23.2% (3.1%) 8.3%40.6% 0.18 (0.05) 0.08 3.498*
With a high school degree, % 86.0% (6.4%) 46.3%98.6% 0.02 (0.01) 0.02 1.424
Population change over 1 year, % 0.7% (2.2%) 18.1%25.6% 0.11 (0.06) 0.01 1.986
Same house over 1 year, % 85.4% (4.2%) 57.1%98.0% 0.01 (0.02) 0.01 0.493
White alone (not Hispanic), % 75.2% (21.8%) 3.2%98.4% 0.02(0.00) 0.01 0.740
Household size 2.52 (0.3) 1.924.77 0.92 (0.80) 0.03 1.145
Population county 105,937 (1,524,223) 1,1609,818,605 0.00 (0.00) 0.03 1.495
Average travel time to work, min 23 (5.0) 642.5 0.06 (0.02) 0.06 3.054
NonEnglish speaking, % 8.6% (15.1%) 0.2%95.9% 0.00 (0.03) 0.06 0.028
Total female, % 50.7% (1.6%) 34.4%57.0% 0.23 (0.07) 0.06 3.158
Population 65 years old, % 14.7% (4.1%) 5.8%49.3% 0.10 (0.04) 0.07 2.411
Population in poverty, % 14.7% (5.6%) 5.8%49.3% 0.02 (0.02) 0.08 1.01
Population density 138.7 (4,534) 0.369,467 0.24 (0.09) 0.08 2.823
Foreign born, % 4.9% (9.3%) 0%51.2% 0.07 (0.02) 0.12 4.906*
Median household income $46,880 ($12,868) $20,206‐$120,096 0.00 (0.00) 0.16 2.599
No. of hospital beds 103 (193) 22,259 0.00 (0.00) 0.16 9.167*
Model statistics F(1, 9) = 62.222, P < 0.001
Adjusted R2 0.124

DISCUSSION

By utilizing county‐level demographic data and the HCAHPS survey measures from across the United States, this study provides a representative sample of US hospitals that can be used to define ecological trends in patient satisfaction with pain management. This statistical model demonstrates the nonrandom variability of pain management satisfaction across the United States, even after CMS patient‐mix adjustment. Although the quality of pain management may be increasing by some reports, our present results indicate that pain management satisfaction is not equitable with the rest of the country among select groups of patients (eg, foreign born, female gender, areas of long travel times to work) or in certain care settings (eg, larger hospitals, population dense areas). These data suggest that areas of pain management may lack in quality compared to pain management across the entire US as a whole. This is consistent with the increasingly recognized contribution of multiple nonmedical determinates to health outcomes.[12] These results demonstrate the overall magnitude of healthcare disparity in the United States, and are particularly concerning because African Americans and Hispanics tend to rate overall satisfaction higher than Caucasians in other studies.[13, 14] The same minority reporting bias may be reflected in HCAHPS results. These patients may be reporting higher pain management satisfaction that is not consistent with the level of care they received, as studies have consistently indicated worse pain management delivery for racial and ethnic minorities.[15]

The present findings reveal structural (eg, hospital beds) and demographic (eg, population density, foreign born) gaps in satisfaction with pain management. An effort to improve pain management for all people in the heterogeneous makeup of the United States is an enormous challenge. However, change may be forthcoming, as Hospital Value‐Based Purchasing draws attention pain practice inequities in real time. Although several of the significant explanatory variables cannot be modified (eg, size of hospital, urban setting, patients served), pain management delivery should receive extra attention in hospitals with those characteristics. Pain management delivery in large, urban hospitals that serve foreign‐born patients may be improved with focused multilevel interventions. Future research should examine these inequities further and develop multilevel interventions that target hospitals in at‐risk areas with the aim of lessening disparities in hospital‐based pain management.

Disclosure

Nothing to report.

Pain management is an integral component of patient‐centered medical care and is a major concern for patients who are hospitalized.[1] Patient‐reported ratings of pain management are highly correlated with overall satisfaction with healthcare delivery.[2] Current research indicates that patient satisfaction with pain management may be improving[3]; however, there may be structural and county‐level disparities in these improvements in satisfaction. Although patient satisfaction with pain management increased from 2008 to 2012, a discrepancy in patient satisfaction with pain management has emerged between 3 different hospital systems (safety net, acute care, critical access hospitals)[3] Specifically, acute care hospitals provide less satisfactory pain management as compared to critical access hospitals.[3] Although patients' perception of pain management is an integral part of delivering patient‐centered care, prior research indicates that there may not be a simple inverse association between pain intensity score and patient satisfaction.[4] The management of pain in hospitals continues to be problematic, perhaps, for instance, due to discrepancies in understanding the relationship between patient satisfaction and pain management. Certainly for this reason and many others, satisfaction with pain management is now one of the dimensions assessed by the Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) survey, which is a global measure of patient satisfaction.

The HCAHPS survey is utilized by 85% of all US‐based hospitals and gathers patient satisfaction information pertaining to 10 dimensions, including pain management. Patient satisfaction scores (via HCAHPS) now constitute 30% of Hospital Value‐Based Purchasing (HVBP), which makes up 2% of at‐risk reimbursements by the Centers for Medicare and Medicaid Services (CMS) as put forth by the Affordable Care Act (ACA) of 2010.[5] The ACA mandates that payments to hospitals must partly depend on metrics that assess patient satisfaction, as broadly measured by the HCAHPS, which are completed by patients upon hospital discharge.[5, 6] Therefore, patient satisfaction, as measured by patients, now directly affects CMS payments for over 3000 hospitals across the United States. This constitutes a large amount of money for most hospitals that operate on high revenue but have low profit margins. As such, the 2% at‐risk reimbursement may place many hospitals at financial risk that could be ameliorated with effective inpatient pain management.

In addition to its critical role in reimbursement to hospitals, patient satisfaction with pain management is also integrally related to providing patient‐centered care. As such, patient satisfaction with pain management is considered a critical element of various models of the patient‐centered approach to providing medical care. Although a medical inpatient team can assess objective signs of pain, patient‐centric pain measurements are paramount in understanding the pain experience of patients and providing adequate pain management care. Moreover, patients, doctors, payers of medical services, and now CMS increasingly regard a patient‐centered approach to medical care as crucial for the delivery of high‐quality care.

HCAHPS survey sampling represents an excellent opportunity to help assess current gaps in patient‐centered clinical care. However, ecological factors, such as county‐level demographics and hospital size (eg, bed number), are known to influence health outcomes but have not been adequately studied in pain management patient satisfaction.[7] Hospital and county‐level factors may influence the degree to which patients experience patient‐centered pain management care. For instance, most patient satisfaction scores are worse in urban areas.[8, 9] These disparities in patient satisfaction scores could be associated with population density, greater ethnic diversity or nonEnglish‐speaking individuals, or number of hospital beds.

The US Census demographics and hospital‐bed number provide a concurrent measure that can be used across the country to estimate hospital ecology. This study evaluated the influence of county‐level demographic and structural factors (ie, hospital beds) on patient satisfaction with hospital pain management in all HCAHPS‐participating hospitals across the United States. We hypothesized that demographic diversity, higher population density, and higher numbers of hospital beds would predict lower levels of patient satisfaction with inpatient pain management.

METHODS

Data Collection: County‐Level Predictors

Publically available data were obtained from the American Hospital Directory[10] and United States Census Bureau[11] websites. Twenty US Census data categories were selected a priori by their clinical relevance to influence pain management perception out of the 50 publically reported US Census categories. Final variables utilized in regression modeling are listed under the Variable column in Table 1. Covariate correlation coefficients were all under 0.7, indicating a lack of significant colinearity.

Bivariate Linear Regression of Pain Management Patient Satisfaction With 20 Explanatory Variables (County‐Level Demographics and Hospital Bed Numbers)
Variable Median Value (SD) Range Regression Coefficient (SE) t Value
  • NOTE: Pain management patient satisfaction was determined by the percentage of patients who stated that their pain was always well controlled (median 71%, SD 5.5, range 33%100%). Abbreviations: SD, standard deviation; SE, standard error. *P < 0.001. P < 0.01.

African American alone, % 5.6% (13.8%) 0%85.4% 0.02 (00) 3.609*
White alone, % 86.2% (15.8%) 5.3%99.0% 0.06 (0.01) 6.661*
Per capita income $24,499 ($6,419) $7,887$61,290 0.00 (0.00) 7.561*
With bachelor's degree, % 22.0% (10.1%) 6.3%70.7% 0.06 (0.01) 7.348*
Population <18 years of age, % 23.2% (3.1%) 8.3%40.6% 0.18 (0.05) 3.498*
With a high school degree, % 86.0% (6.4%) 46.3%98.6% 0.02 (0.01) 1.424
Population change over 1 year, % 0.7% (2.2%) 18.1%25.6% 0.25 (0.04) 5.645*
Same house over 1 year, % 85.4% (4.2%) 57.1%98.0% 0.01 (0.02) 0.493
White alone (not Hispanic), % 75.2% (21.8%) 3.2%98.4% 0.05(0.00) 12.077*
Household size 2.52 (0.3) 1.924.77 2.266 (0.36) 6.283*
Population county 105,937 (1,524,223) 1,1609,818,605 0.00 (0.00) 13.117*
Average travel time to work, min 23 (5.0) 642.5 0.21 (0.02) 11.071*
NonEnglish speaking, % 8.6% (15.1%) 0.2%95.9% 0.08 (0.01) 13.843*
Total female, % 50.7% (1.6%) 34.4%57.0% 0.44 (0.06) 7.489*
Population 65 years old, % 14.7% (4.1%) 5.8%49.3% 0.06 (0.02) 2.697
Population in poverty, % 14.7% (5.6%) 5.8%49.3% 0.02 (0.02) 1.01
Population density 138.7 (4,534) 0.369,467 0.73 (0.05) 15.734*
Foreign born, % 4.9% (9.3%) 0%51.2% 0.15 (0.01) 16.775*
Median household income $46,880 ($12,868) $20,206$120,096 0.00 (0.00) 6.052*
No. of hospital beds 103 (193) 22,259 0.01 (0.00) 15.403*

Data Collection: Patient Satisfaction With Pain Management

Pain management was measured using the HCAHPS survey pain management dimension by calculating the percentage of patient responders who said their pain was always controlled. HCAHPS data are publically available on the CMS Hospital Compare website.[6] It contains 32 questions that comprise 10 evaluative measures. It is provided to a random sample of patients across the United States throughout the year at 48 hours to 6 weeks after discharge from the hospital.

Analytic Plan

HCAHPS and US Census datasets were analyzed to assess their distribution curves. The population density variable was converted to a logarithmic scale to account for its skewed distribution and long tail in the area of low population density. Data were subsequently merged into an Excel (Microsoft Corp., Redmond, WA) spreadsheet using the VLOOKUP function such that relevant 2010 census county data were added to each hospital's HCAHPS data.

Bivariate analyses were conducted to determine which US Census categories were significant predictors for patient satisfaction with pain management. All significant predictors were then included in a multivariate model, which predicted for patient satisfaction with pain management. All analyses were 2‐tailed, and statistical significance was set at = 0.05.

RESULTS

Complete HCAHPS scores were obtained from 3907 hospitals out of a total of 4621 US hospitals (85%). The majority of hospitals (73.8%, n = 2884) collected over 300 surveys, fewer (n = 696) collected 100 to 299 surveys, and a small number of hospitals (n = 327) collected less than 100 surveys. Based on the most conservative estimate, results were available from at least 934,800 individual surveys. Missing HCAHPS hospital data averaged 13.4 (standard deviation [SD] = 12.2) hospitals per state. County‐level data were obtained from all 3144 county or county equivalents across the United States (100%).

Bivariate Analyses

Univariate regression indicated a significant association between pain management patient satisfaction and most county‐level demographic variables and number of hospital beds.

Multivariate Analyses

A multivariate linear regression model was run in which 20 county‐level demographic and hospital factors were examined as predictors of patient satisfaction with pain management. The model, which examined county‐level predictors of pain management, explained 12% of the variability in patients' ratings of pain management (R2 = 0.124, P < 0.0001). A total of 8 out of the 20 US Census variables were statistically significant predictors of pain management (Table 2). African American and white race were most strongly associated with higher ratings of patient satisfaction with pain management (ie, by partial coefficient and statistical significance). Number of hospital beds, percent foreign born, population density, and female gender were most strongly related to lower ratings of patient satisfaction with pain management.

Multivariate Regression Predicting Patient Satisfaction With Pain Management From HCAHPS Scores According to County Demographics and Hospital Size
Variable Median Value (SD) Range Regression Coefficient (SE) t Value
  • NOTE: This model demonstrates the multivariate association of 20 predictor variables with pain management patient satisfaction as determined by hospital percentage of patients who stated that their pain was always well controlled (median 71%, SD 5.5, range 33%100%). Abbreviations: HCAHPS = Hospital Consumer Assessment of Healthcare Providers and Systems; SD, standard deviation; SE, standard error. *P < 0.001. P < 0.01.

African American alone, % 5.6% (13.8%) 0%85.4% 0.07 (0.01) 0.23 7.104*
White alone, % 86.2% (15.8%) 5.3%99.0% 0.08 (0.01) 0.23 6.953*
Per capita income $24,499 ($6,419) $7,887$61,290 0.00 (0.00) 0.22 2.885
With bachelor's degree, % 22.0% (10.1%) 6.3%70.7% 0.03 (0.02) 0.10 1.401
Population <18 years old, % 23.2% (3.1%) 8.3%40.6% 0.18 (0.05) 0.08 3.498*
With a high school degree, % 86.0% (6.4%) 46.3%98.6% 0.02 (0.01) 0.02 1.424
Population change over 1 year, % 0.7% (2.2%) 18.1%25.6% 0.11 (0.06) 0.01 1.986
Same house over 1 year, % 85.4% (4.2%) 57.1%98.0% 0.01 (0.02) 0.01 0.493
White alone (not Hispanic), % 75.2% (21.8%) 3.2%98.4% 0.02(0.00) 0.01 0.740
Household size 2.52 (0.3) 1.924.77 0.92 (0.80) 0.03 1.145
Population county 105,937 (1,524,223) 1,1609,818,605 0.00 (0.00) 0.03 1.495
Average travel time to work, min 23 (5.0) 642.5 0.06 (0.02) 0.06 3.054
NonEnglish speaking, % 8.6% (15.1%) 0.2%95.9% 0.00 (0.03) 0.06 0.028
Total female, % 50.7% (1.6%) 34.4%57.0% 0.23 (0.07) 0.06 3.158
Population 65 years old, % 14.7% (4.1%) 5.8%49.3% 0.10 (0.04) 0.07 2.411
Population in poverty, % 14.7% (5.6%) 5.8%49.3% 0.02 (0.02) 0.08 1.01
Population density 138.7 (4,534) 0.369,467 0.24 (0.09) 0.08 2.823
Foreign born, % 4.9% (9.3%) 0%51.2% 0.07 (0.02) 0.12 4.906*
Median household income $46,880 ($12,868) $20,206‐$120,096 0.00 (0.00) 0.16 2.599
No. of hospital beds 103 (193) 22,259 0.00 (0.00) 0.16 9.167*
Model statistics F(1, 9) = 62.222, P < 0.001
Adjusted R2 0.124

DISCUSSION

By utilizing county‐level demographic data and the HCAHPS survey measures from across the United States, this study provides a representative sample of US hospitals that can be used to define ecological trends in patient satisfaction with pain management. This statistical model demonstrates the nonrandom variability of pain management satisfaction across the United States, even after CMS patient‐mix adjustment. Although the quality of pain management may be increasing by some reports, our present results indicate that pain management satisfaction is not equitable with the rest of the country among select groups of patients (eg, foreign born, female gender, areas of long travel times to work) or in certain care settings (eg, larger hospitals, population dense areas). These data suggest that areas of pain management may lack in quality compared to pain management across the entire US as a whole. This is consistent with the increasingly recognized contribution of multiple nonmedical determinates to health outcomes.[12] These results demonstrate the overall magnitude of healthcare disparity in the United States, and are particularly concerning because African Americans and Hispanics tend to rate overall satisfaction higher than Caucasians in other studies.[13, 14] The same minority reporting bias may be reflected in HCAHPS results. These patients may be reporting higher pain management satisfaction that is not consistent with the level of care they received, as studies have consistently indicated worse pain management delivery for racial and ethnic minorities.[15]

The present findings reveal structural (eg, hospital beds) and demographic (eg, population density, foreign born) gaps in satisfaction with pain management. An effort to improve pain management for all people in the heterogeneous makeup of the United States is an enormous challenge. However, change may be forthcoming, as Hospital Value‐Based Purchasing draws attention pain practice inequities in real time. Although several of the significant explanatory variables cannot be modified (eg, size of hospital, urban setting, patients served), pain management delivery should receive extra attention in hospitals with those characteristics. Pain management delivery in large, urban hospitals that serve foreign‐born patients may be improved with focused multilevel interventions. Future research should examine these inequities further and develop multilevel interventions that target hospitals in at‐risk areas with the aim of lessening disparities in hospital‐based pain management.

Disclosure

Nothing to report.

References
  1. Dwamena F, Holmes‐Rovner M, Gaulden CM, et al. Interventions for providers to promote a patient‐centred approach in clinical consultations. Cochrane Database Syst Rev. 2012;12:CD003267.
  2. Gupta A, Daigle S, Mojica J, Hurley RW. Patient perception of pain care in hospitals in the United States. J Pain Res. 2009;2:157164.
  3. Gupta A, Lee LK, Mojica JJ, Nairizi A, George SJ. Patient perception of pain care in the United States: a 5‐year comparative analysis of hospital consumer assessment of health care providers and systems. Pain Physician. 2014;17(5):369377.
  4. Phillips S, Gift M, Gelot S, Duong M, Tapp H. Assessing the relationship between the level of pain control and patient satisfaction. J Pain Res. 2013;6:683689.
  5. H.R.3590—Patient Protection and Affordable Care Act 2010. Available at: https://www.congress.gov/bill/111th‐congress/house‐bill/3590. Accessed December 1, 2013.
  6. Centers for Medicare 55(1):125139.
  7. Joynt KE, Jha AK. Characteristics of hospitals receiving penalties under the Hospital Readmissions Reduction Program. JAMA. 2013;309(4):342343.
  8. Jha AK, Orav EJ, Zheng J, Epstein AM. Patients' perception of hospital care in the United States. N Engl J Med. 2008;359(18):19211931.
  9. American Hospital Directory. Hospital statistics by state. Available at: http://www.ahd.com/state_statistics.html. Accessed December 1, 2013.
  10. United States Census Bureau. Download center. Available at: http://factfinder.census.gov/faces/nav/jsf/pages/download_center.xhtml. Accessed December 1, 2013.
  11. Health policy brief: the relative contribution of multiple determinants to health outcomes. Health Affairs website. Available at: http://www.healthaffairs.org/healthpolicybriefs/brief.php?brief_id=123. Accessed December 1, 2013.
  12. Dayton E, Zhan C, Sangl J, Darby C, Moy E. Racial and ethnic differences in patient assessments of interactions with providers: disparities or measurement biases? Am J Med Qual. 2006;21(2):109114.
  13. Weech‐Maldonado R, Elliott MN, Oluwole A, Schiller KC, Hays RD. Survey response style and differential use of CAHPS rating scales by Hispanics. Med Care. 2008;46(9):963968.
  14. Institute of Medicine. Committee on Advancing Pain Research, Care, and Education. Relieving Pain in America: A Blueprint for Transforming Prevention, Care, Education, and Research. Washington, DC: National Academies Press; 2011.
References
  1. Dwamena F, Holmes‐Rovner M, Gaulden CM, et al. Interventions for providers to promote a patient‐centred approach in clinical consultations. Cochrane Database Syst Rev. 2012;12:CD003267.
  2. Gupta A, Daigle S, Mojica J, Hurley RW. Patient perception of pain care in hospitals in the United States. J Pain Res. 2009;2:157164.
  3. Gupta A, Lee LK, Mojica JJ, Nairizi A, George SJ. Patient perception of pain care in the United States: a 5‐year comparative analysis of hospital consumer assessment of health care providers and systems. Pain Physician. 2014;17(5):369377.
  4. Phillips S, Gift M, Gelot S, Duong M, Tapp H. Assessing the relationship between the level of pain control and patient satisfaction. J Pain Res. 2013;6:683689.
  5. H.R.3590—Patient Protection and Affordable Care Act 2010. Available at: https://www.congress.gov/bill/111th‐congress/house‐bill/3590. Accessed December 1, 2013.
  6. Centers for Medicare 55(1):125139.
  7. Joynt KE, Jha AK. Characteristics of hospitals receiving penalties under the Hospital Readmissions Reduction Program. JAMA. 2013;309(4):342343.
  8. Jha AK, Orav EJ, Zheng J, Epstein AM. Patients' perception of hospital care in the United States. N Engl J Med. 2008;359(18):19211931.
  9. American Hospital Directory. Hospital statistics by state. Available at: http://www.ahd.com/state_statistics.html. Accessed December 1, 2013.
  10. United States Census Bureau. Download center. Available at: http://factfinder.census.gov/faces/nav/jsf/pages/download_center.xhtml. Accessed December 1, 2013.
  11. Health policy brief: the relative contribution of multiple determinants to health outcomes. Health Affairs website. Available at: http://www.healthaffairs.org/healthpolicybriefs/brief.php?brief_id=123. Accessed December 1, 2013.
  12. Dayton E, Zhan C, Sangl J, Darby C, Moy E. Racial and ethnic differences in patient assessments of interactions with providers: disparities or measurement biases? Am J Med Qual. 2006;21(2):109114.
  13. Weech‐Maldonado R, Elliott MN, Oluwole A, Schiller KC, Hays RD. Survey response style and differential use of CAHPS rating scales by Hispanics. Med Care. 2008;46(9):963968.
  14. Institute of Medicine. Committee on Advancing Pain Research, Care, and Education. Relieving Pain in America: A Blueprint for Transforming Prevention, Care, Education, and Research. Washington, DC: National Academies Press; 2011.
Issue
Journal of Hospital Medicine - 11(7)
Issue
Journal of Hospital Medicine - 11(7)
Page Number
498-501
Page Number
498-501
Article Type
Display Headline
Predictors of patient satisfaction with inpatient hospital pain management across the United States: A national study
Display Headline
Predictors of patient satisfaction with inpatient hospital pain management across the United States: A national study
Sections
Article Source
© 2016 Society of Hospital Medicine
Disallow All Ads
Correspondence Location
Address for correspondence and reprint requests: Daniel McFarland, DO, Division of Network Medicine Services, Memorial Sloan Kettering Cancer Center, 500 Westchester Ave., West Harrison, NY 10604; Telephone: 914‐367‐7294; Fax: 646‐227‐7283; E‐mail: [email protected]
Content Gating
Gated (full article locked unless allowed per User)
Gating Strategy
First Peek Free
Article PDF Media
Media Files

Patient Satisfaction Variance Prediction

Article Type
Changed
Tue, 05/16/2017 - 23:12
Display Headline
Demographic factors and hospital size predict patient satisfaction variance—implications for hospital value‐based purchasing

The Affordable Care Act of 2010 mandates that government payments to hospitals and physicians must depend, in part, on metrics that assess the quality and efficiency of healthcare being provided to encourage value‐based healthcare.[1] Value in healthcare is defined by the delivery of high‐quality care at low cost.[2, 3] To this end, Hospital Value‐Based Purchasing (HVBP) and Physician Value‐Based Payment Modifier programs have been developed by the Centers for Medicare & Medicaid Services (CMS). HVBP is currently being phased in and affects CMS payments for fiscal year (FY) 2013 for over 3000 hospitals across the United States to incentivize healthcare delivery value. The final phase of implementation will be in FY 2017 and will then affect 2% of all CMS hospital reimbursement. HVBP is based on objective measures of hospital performance as well as a subjective measure of performance captured under the Patient Experience of Care domain. This subjective measure will remain at 30% of the aggregate score until FY 2016, when it will then be 25% the aggregate score moving forward.[4] The program rewards hospitals for both overall achievement and improvement in any domain, so that hospitals have multiple ways to receive financial incentives for providing quality care.[5] Even still, there appears to be a nonrandom pattern of patient satisfaction scores across the country with less favorable scores clustering in densely populated areas.[6]

Value‐Based Purchasing and other incentive‐based programs have been criticized for increasing disparities in healthcare by penalizing larger hospitals (including academic medical centers, safety‐net hospitals, and others that disproportionately serve lower socioeconomic communities) and favoring physician‐based specialty hospitals.[7, 8, 9] Therefore, hospitals that serve indigent and elderly populations may be at a disadvantage.[9, 10] HVBP portends significant economic consequences for the majority of hospitals that rely heavily on Medicare and Medicaid reimbursement, as most hospitals have large revenues but low profit margins.[11] Higher HVBP scores are associated with for profit status, smaller size, and location in certain areas of the United States.[12] Jha et al.[6] described Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) scores regional geographic variability, but concluded that poor satisfaction was due to poor quality.

The Patient Experience of Care domain quantifies patient satisfaction using the validated HCAHPS survey, which is provided to a random sample of patients continuously throughout the year at 48 hours to 6 weeks after discharge. It is a publically available standardized survey instrument used to measure patients perspectives on hospital care. It assesses the following 8 dimensions: nurse communication, doctor communication, hospital staff responsiveness, pain management, medicine communication, discharge information, hospital cleanliness and quietness, and overall hospital rating, of which the last 2 dimensions each have 2 measures (cleanliness and quietness) and (rating 9 or 10 and definitely recommend) to give a total of 10 distinct measures.

The United States is a complex network of urban, suburban, and rural demographic areas. Hospitals exist within a unique contextual and compositional meshwork that determines its caseload. The top population density decile of the United States lives within 37 counties, whereas half of the most populous parts of the United States occupy a total of 250 counties out of a total of 3143 counties in the United States. If the 10 measures of patient satisfaction (HCAHPS) scores were abstracted from hospitals and viewed according to county‐level population density (separated into deciles across the United States), a trend would be apparent (Figure 1). Greater population density is associated with lower patient satisfaction in 9 of 10 categories. On the state level, composite scores of overall patient satisfaction (amount of positive scores) of hospitals show a 12% variability and a significant correlation with population density (r=0.479; Figure 2). The lowest overall satisfaction scores are obtained from hospitals located in the population‐dense regions of Washington, DC, New York State, California, Maryland, and New Jersey (ie, 63%65%), and the best scores are from Louisiana, South Dakota, Iowa, Maine, and Vermont (ie, 74%75%). The average patient satisfaction score is 71%2.9%. Lower patient satisfaction scores appear to cluster in population‐dense areas and may be associated with greater heterogeneous patient demographics and economic variability in addition to population density.

Figure 1
Overall patient satisfaction by population density decile. Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) scores are segregated by population density deciles (representing 33 million people each). Population density increases along the grey scale. The composite score and 9 out of 10 HCAHPS dimensions demonstrate lower patient satisfaction as population density increases (darker shade). Abbreviations: Doc, doctor; Def Rec, definitely recommend.
Figure 2
Averaged Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) scores by state correlated with state population (Pop) density. Bivariate correlation of composite HCAHPS scores predicted by state population density without District of Columbia, r = −0.479, P < 0.001 (2‐tailed). This observed correlation informed the hypothesis that population density could predict for lower patient satisfaction via HCAHPS scores.

These observations are surprising considering that CMS already adjusts HCAHPS scores based on patient‐mix coefficients and mode of collection.[13, 14, 15, 16, 17, 18] Adjustments are updated multiple times per year and account for survey collection either by telephone, email, or paper survey, because the populations that select survey forms will differ. Previous studies have shown that demographic features influence the patient evaluation process. For example, younger and more educated patients were found to provide less positive evaluations of healthcare.[19]

This study examined whether patients perceptions of healthcare (pattern of patient satisfaction) as quantified under the patient experience domain of HVBP were affected and predicted by population density and other demographic factors that are outside the control of individual hospitals. In addition, hospital‐level data (eg, number of hospital beds) and county‐level data such as race, age, gender, overall population, income, time spent commuting to work, primary language, and place of birth were analyzed for correlation with patient satisfaction scores. Our study demonstrates that demographic and hospital‐level data can predict patient satisfaction scores and suggests that CMS may need to modify its adjustment formulas to eliminate bias in HVBP‐based reimbursement.

METHODS

Data Collection

Publically available data were obtained from Hospital Compare,[20] American Hospital Directory,[21] and the US Census Bureau[22] websites. Twenty relevant US Census data categories were selected by their relevance for this study out of the 50 publically reported US Census categories, and included the following: county population, county population density, percent of population change over 1 year, poverty level (percent), income level per capita, median household income, average household size, travel time to work, percentage of high school or college graduates, non‐English primary language spoken at home, percentage of residents born outside of the United States, population percent in same residence for over 1 year, gender, race (white alone, white alone (not Hispanic or Latino), black or African American alone), population over 65 years old, and population under 18 years old.

HCAHPS Development

The HCAHPS survey is 32 questions in length, comprised of 10 evaluative dimensions. All short‐term, acute care, nonspecialty hospitals are invited to participate in the HCAHPS survey.

Data Analysis

Statistical analyses used the Statistical Package for Social Sciences version 16.0 for Windows (SPSS Inc., Chicago, IL). Data were checked for statistical assumptions, including normality, linearity of relationships, and full range of scores. Categories in both the Hospital Compare (HCAHPS) and US Census datasets were analyzed to assess their distribution curves. The category of population densities (per county) was converted to a logarithmic scale to account for a skewed distribution and long tail in the area of low population density. Data were subsequently merged into an Excel (Microsoft, Redmond, WA) spreadsheet using the VLookup function such that relevant 2010 census county data were added to each hospital's Hospital Compare data. Linear regression modeling was performed. Bivariate analysis was conducted (ENTER method) to determine the significant US Census data predictors for each of the 10 Hospital Compare dimensions including the composite overall satisfaction score. Significant predictors were then analyzed in a multivariate model (BACKWORDS method) for each Hospital Compare dimension and the composite average positive score. Models were assessed by determinates of correlation (adjusted R2) to assess for goodness of fit. Statistically significant predictor variables for overall patient satisfaction scores were then ranked according to their partial regression coefficients (standardized ).

A patient satisfaction predictive model was sought based upon significant predictors of aggregate percent positive HCAHPS scores. Various predictor combinations were formed based on their partial coefficients (ie, standardized coefficients); combinations were assessed based on their R2 values and assessed for colinearity. Combinations of partial coefficients included the 2, 4, and 8 most predictive variables as well the 2 most positive and negative predictors. They were then incorporated into a multivariate analysis model (FORWARD method) and assessed based on their adjusted R2 values. A 4‐variable combination (the 2 most predictive positive partial coefficients plus the 2 most predictive negative partial coefficients) was selected as a predictive model, and a formula predictive of the composite overall satisfaction score was generated. This formula (predicted patient satisfaction formula [PPSF]) predicts hospital patient satisfaction HCAHPS scores based on the 4 predictive variables for particular county and hospital characteristics. PPSF=KMV+BHB(HB)+BNE(NE)+BE(E)+BW(W)where KMV=coefficient constant (70.9), B=unstandardized coefficient (see Table 1 for values), HB=number of hospital beds, NE=proportion of non‐English speakers, E=education (proportion with bachelor's degree), and W=proportion identified as white race only.

Multivariate Regression of Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) Average Positive Score by County and Hospital Demographics
 BSE tP
  • NOTE: A multivariate linear regression model of statistically significant dimensions of patient satisfaction as determined by Hospital Consumer Assessment of Healthcare Providers and Systems scores is provided. The dependent variable is the composite of average patient satisfaction scores by hospital (3192 hospitals). Predictors (independent variables) were collected from US Census data for counties or county equivalents. All of the listed predictors (first column) are statistically significant. They are placed in order of partial regression coefficient contribution to the model from most positive to most negative contribution. Adjusted R2 (last row) is used to signify the goodness of fit. Abbreviations: , standardized (partial coefficient); B, unstandardized coefficient; P, statistical significance; SE, standard error; t, t statistic.

Educational attainmentbachelor's degree0.1570.0180.278.612<0.001
White alone percent 20120.090.0120.2357.587<0.001
Resident population percent under 18 years0.4040.04440.2099.085<0.001
Black or African American alone percent 20120.0830.0140.1915.936<0.001
Median household income 200720110.000030.000.0622.0270.043
Population density (log) 20100.2770.0830.0873.33330.001
Average travel time to work0.1070.0240.0884.366<0.001
Educational attainmenthigh school0.0820.0260.0883.1470.002
Average household size2.580.7270.1073.55<0.001
Total females percent 20120.4230.0670.1076.296<0.001
Percent nonEnglish speaking at home 200720110.0520.0180.142.9290.003
No. of hospital beds0.0060.000.21312.901<0.001
Adjusted R20.222    

The PPSF was then modified by weighting with the partial coefficient () to remove the bias in patient satisfaction generated by demographic and structural factors over which individual hospitals have limited or no control. This formula generated a Weighted Individual (hospital) Predicted Patient Satisfaction Score (WIPPSS). Application of this formula narrowed the predicted distribution of patient satisfaction for all hospitals across the country. WIPPSS=KMV+BHB(HB)(1HB)+BNE(NE)(1NE)+BE(E)(1E)+BW(W)(1W)where =standardized coefficient (see Table 1 for values).

To create an adjusted score with direct relevance to the reported patient satisfaction scores, the reported scores were multiplied by an adjustment factor that defines the difference between individual hospital‐weighted scores and the national mean HCAHPS score across the United States. This formula, the Weighted Individual (hospital) Patient Satisfaction Adjustment Score (WIPSAS), represents a patient satisfaction score adjusted for demographic and structural factors that can be utilized for interhospital comparisons across all areas of the country. WIPSAS=PSrep[1+(PSUSAWIPPSSX)/100]

where PSrep=patient satisfaction reported score, PSUSA=mean reported score for United States (71.84), and WIPPSSX=WIPPSS for individual hospital.

Application of Data Analysis

PPSF, WIPPSS, and WIPSAS were calculated for all HCAHPS‐participating hospitals and compared with averaged raw HCAHPS scores across the United States. WIPSAS and raw scores were specifically analyzed for New York State to demonstrate exactly how adjustments would change state‐level rankings.

RESULTS

Complete HCAHPS scores were obtained from 3907 hospitals out of a total 4621 hospitals listed by the Hospital Compare website (85%). The majority of hospitals (2884) collected over 300 surveys, fewer hospitals (696) collected 100 to 299 surveys, and fewer still (333) collected <100 surveys. In total, results were available from at least 934,800 individual surveys, by the most conservative estimate. Missing HCAHPS hospital data averaged 13.4 (standard deviation [SD] 12.2) hospitals per state. County‐level data were obtained from all 3144 county or county equivalents across the United States (100%). Multivariate regression modeling across all HCAHPS dimensions found that between 10 and 16 of the 20 predictors (US Census categories) were statistically significant and predictive of individual HCAHPS dimension scores and the aggregate percent positive score as demonstrated in Table 2. For example, county percentage of bachelors degrees positively predicts for positive doctor communication scores, and hospital beds negatively predicts for quiet dimension. The strongest positive and negative predictive variables by model regression coefficients for each HCAHPS dimension are also listed in Table 2.

Multivariate Regression of Hospital Consumer Assessment of Healthcare Providers and Systems by County and Hospital Demographics
 Average Positive ScoresNurse CommunicationDoctor CommunicationHelpPainExplain MedsCleanQuietDischarge ExplainRecommend 9/10Definitely Recommend
  • NOTE: Linear regression modeling results of 10 dimensions of patient satisfaction (ie, Hospital Consumer Assessment of Healthcare Providers and Systems [HCAHPS]) and Average Positive Scores (top row) by county demographics and hospital size (left column) are shown. Adjusted R2 (last row) is used to signify the goodness of fit. All models are statistically significant with P=<0.001. Partial regression coefficients () are used to positively or negatively assess contribution to the individual models (ie, each column). The dash () indicates nonsignificance and the asterisk (*) indicates a value that was statistically significant in univariate analysis but not in multivariate analysis. Independent variables (first column) are ordered from top to bottom by the number of HCAHPS dimensions that each contributes to HCAHPS predictive scoring.

Educationalbachelor's0.270.190.450.100.100.050.080.330.150.270.416
Hospital beds0.210.160.190.260.160.170.270.260.060.11 
Population density 20100.090.070.280.200.080.230.140.190.220.07*
White alone percent0.240.250.090.160.230.070.16 0.170.310.317
Total females percent0.110.050.060.070.060.030.050.090.120.09 
African American alone0.190.19 0.090.230.090.070.34*0.090.084
Average travel time to work0.090.10*0.090.060.040.08*0.120.170.16
Foreign‐born percent*0.160.140.060.120.080.060.130.18**
Average household size0.110.050.150.07*0.07*0.01*0.070.076
NonEnglish speaking0.140.120.500.07*****0.340.28
Educationhigh school0.090.090.40*   0.270.060.08*
Household income0.06*0.350.08**0.160.41  0.265
Population 65 years and over*0.140.140.12*0.110.15  *0.10
White, not Hispanic/Latino**0.20***0.090.130.090.220.25
Population under 180.21 0.15 0.08   0.110.20 
Population (county)*0.060.08*0.030.05**0.06**
All ages in poverty  0.24   0.100.220.08*0.281
1 year at same residence*0.130.120.11  0.10*0.04**
Per capita income*0.07*****0.09  *
Population percent change******0.05  **
Adjusted R20.220.250.300.300.120.170.230.300.190.140.15

Table 1 highlights multivariate regression modeling of the composite average positive score, which produced an adjusted R2 of 0.222 (P<0.001). All variables were significant and predicted change of the composite HCAHPS except for place of birthforeign born (not listed in the table). Table 1 ranks variables from most positive to most negative predictors.

Other HCAHPS domains demonstrated statistically significant models (P<0.001) and are listed by their coefficients of determination (ie, adjusted R2) (Table 2). The best‐fit dimensions were help (adjusted R2=0.304), quiet (adjusted R2=0.299), doctor communication (adjusted R2=0.298), nurse communication (adjusted R2=0.245), and clean (adjusted R2=0.232). Models that were not as strongly predictive as the composite score included pain (adjusted R2=0.124), overall 9/10 (adjusted R2=0.136), definitely recommend (adjusted R2=0.150), and explained meds (adjusted R2=0.169).

A predictive formula for average positive scores was created by determination of the most predictive partial coefficients and the best‐fit model. Bachelor's degree and white only were the 2 greatest positive predictors, and number of hospital beds and nonEnglish speaking were the 2 greatest negative predictors. The PPSF (predictive formula) was chosen out of various combinations of predictors (Table 1), because its coefficient of determination (adjusted R2=0.155) was closest to the overall model's coefficient of determination (adjusted R2=0.222) without demonstrating colinearity. Possible predictive formulas were based on the predictors standardized and included the following combinations: the 2 greatest overall predictors (adjusted R2=0.051), the 2 greatest negative and positive predictors (adjusted R2=0.098), the 4 greatest overall predictors (adjusted R2=0.117), and the 8 greatest overall predictors (adjusted R2=0.201), which suffered from colinearity (household size plus nonEnglish speaking [Pearson=0.624] and under 18 years old [Pearson=0.708]). None of the correlated independent variables (eg, poverty and median income) were placed in the final model.

The mean WIPSAS scores closely corresponded with the national average of HCAHPS scores (71.6 vs 71.84) but compressed scores into a narrower distribution (SD 5.52 vs 5.92). The greatest positive and negative changes were by 8.51% and 2.25%, respectively. Essentially, a smaller number of hospitals in demographically challenged areas were more significantly impacted by the WIPSAS adjustment than the larger number of hospitals in demographically favorable areas. Large hospitals in demographically diverse counties saw the greatest positive change (e.g., Texas, California, and New York), whereas smaller hospitals in demographically nondiverse areas saw comparatively smaller decrements in the overall WIPSAS scores. The WIPSAS had the most beneficial effect on urban and rural safety‐net hospitals that serve diverse populations including many academic medical centers. This is illustrated by the reranking of the top 10 and bottom 10 hospitals in New York State by the WIPSAS (Table 3). For example, 3 academic medical centers in New York State, Montefiore Medical Center, New York Presbyterian Hospital, and Mount Sinai Hospital, were moved from the 46th, 43rd, and 42nd (out of 167 hospitals) respectively into the top 10 in patient satisfaction utilizing the WIPSAS methodology. Reported patient satisfaction scores, PPSF, WIPPSS, and WIPSAS scores for each hospital in the United States are available online (see Supporting Table S1 in the online version of this article).

Top Ten Highest‐Ranked Hospitals in New York State by HCAHPS Scores Compared to WIPSAS
Ten Highest Ranked New York State Hospitals by HCAHPSTen Highest Ranked New York State Hospitals After WIPSAS
  • NOTE: Top 10 highest‐ranked hospitals in New York State by overall patient satisfaction out of 167 evaluable hospitals are shown. The left column represents the current top 10 hospitals in 2013 by HCAHPS overall patient satisfaction scores, and the right column represents the top 10 hospitals after the WIPSAS adjustment. The 4 factors used to create the WIPSAS adjustment were the 2 most positive partial regression coefficients (educationbachelor's degree, white alone percent 2012) and the 2 most negative partial regression coefficients (number of hospital beds, nonEnglish speaking at home). Three urban academic medical centers, Montefiore Medical Center, New York Presbyterian Hospital, and Mount Sinai Hospital, were reranked from the 46th, 43rd, and 42nd respectively into the top 10. Abbreviations: HCAHPS, Hospital Consumer Assessment of Healthcare Providers and Systems; WIPSAS, Weighted Individual (hospital) Patient Satisfaction Adjustment Score.

1. River Hospital, Inc.1. River Hospital, Inc.
2. Westfield Memorial Hospital, Inc.2. Westfield Memorial Hospital, Inc.
3. Clifton Fine Hospital3. Clifton Fine Hospital
4. Hospital For Special Surgery4. Hospital For Special Surgery
5. Delaware Valley Hospital, Inc.5. New YorkPresbyterian Hospital
6. Putnam Hospital Center6. Delaware Valley Hospital, Inc.
7. Margaretville Memorial Hospital7. Montefiore Medical Center
8. Community Memorial Hospital, Inc.8. St. Francis Hospital, Roslyn
9. Lewis County General Hospital9. Putnam Hospital Center
10. St. Francis Hospital, Roslyn10. Mount Sinai Hospital

DISCUSSION

The HVBP program is an incentive program that is meant to enhance the quality of care. This study illustrates healthcare inequalities in patient satisfaction that are not accounted for by the current CMS adjustments, and shows that education, ethnicity, primary language, and number of hospital beds are predictive of how patients evaluate their care via patient satisfaction scores. Hospitals that treat a disproportionate percentage of nonEnglish speaking, nonwhite, noneducated patients in large facilities are not meeting patient satisfaction standards. This inequity is not ameliorated by the adjustments currently performed by CMS, and has financial consequences for those hospitals that are not meeting national standards in patient satisfaction. These hospitals, which often include academic medical centers in urban areas, may therefore be penalized under the existing HVBP reimbursement models.

Using only 4 demographic and hospital‐specific predictors (ie, hospital beds, percent nonEnglish speaking, percent bachelors degrees, percent white), it is possible to utilize a simple formula to predict patient satisfaction with a significant degree of correlation to the reported scores available through Hospital Compare.

Our initial hypothesis that population density predicted lower patient satisfaction scores was confirmed, but these aforementioned demographic and hospital‐based factors were stronger independent predictors of HCAHPS scores. The WIPSAS is a representation of patient satisfaction and quality‐of‐care delivery across the country that accounts for nonrandom variation in patient satisfaction scores.

For hospitals in New York State, WIPSAS resulted in the placement of 3 urban‐based academic medical centers in the top 10 in patient satisfaction, when previously, based on the raw scores, their rankings were between 42nd and 46th statewide. Prior studies have suggested that large, urban, teaching, and not‐for‐profit hospitals were disadvantaged based on their hospital characteristics and patient features.[10, 11, 12] Under the current CMS reimbursement methodologies, these institutions are more likely to receive financial penalties.[8] The WIPSAS is a simple method to assess hospitals performance in the area of patient satisfaction that accounts for the demographic and hospital‐based factors (eg, number of beds) of the hospital. Its incorporation into CMS reimbursement calculations, or incorporation of a similar adjustment formula, should be strongly considered to account for predictive factors in patient satisfaction that could be addressed to enhance their scores.

Limitations for this study are the approximation of county‐level data for actual individual hospital demographic information and the exclusion of specialty hospitals, such as cancer centers and children's hospitals, in HCAHPS surveys. Repeated multivariate analyses at different time points would also serve to identify how CMS‐specific adjustments are recalibrated over time. Although we have primarily reported on the composite percent positive score as a surrogate for all HCAHPS dimensions, an individual adjustment formula could be generated for each dimension of the patient experience of care domain.

Although patient satisfaction is a component of how quality should be measured, further emphasis needs to be placed on nonrandom patient satisfaction variance so that HVBP can serve as an incentivizing program for at‐risk hospitals. Regional variation in scoring is not altogether accounted for by the current CMS adjustment system. Because patient satisfaction scores are now directly linked to reimbursement, further evaluation is needed to enhance patient satisfaction scoring paradigms to account for demographic and hospital‐specific factors.

Disclosure

Nothing to report.

Files
References
  1. Florence CS, Atherly A, Thorpe KE. Will choice‐based reform work for Medicare? Evidence from the Federal Employees Health Benefits Program. Health Serv Res. 2006;41:17411761.
  2. H.R. 3590. Patient Protection and Affordable Care Act 2010 (2010).
  3. Donabedian A. The quality of care. How can it be assessed? JAMA. 1988;260(12):17431748.
  4. Lake Superior Quality Innovation Network. FY 2017 Value‐Based Purchasing domain weighting. Available at: http://www.stratishealth.org/documents/VBP‐FY2017.pdf. Accessed March 13, 2015.
  5. Hospital Value‐Based Purchasing Program. Available at: http://www.cms.gov/Medicare/Quality‐Initiatives‐Patient‐Assessment‐Instruments/Hospital‐Value‐Based‐Purchasing. Accessed December 1st, 2013.
  6. Jha AK, Orav EJ, Zheng J, Epstein AM. Patients' perception of hospital care in the United States. N Engl J Med. 2008;359(18):19211931.
  7. Porter ME, Lee TH. Providers must lead the way in making value the overarching goal Harvard Bus Rev. October 2013:319.
  8. Jha AK, Orav EJ, Epstein AM. The effect of financial incentives on hospitals that serve poor patients. Ann Intern Med. 2010;153(5):299306.
  9. Joynt KE, Jha AK. Characteristics of hospitals receiving penalties under the Hospital Readmissions Reduction Program. JAMA. 2013;309(4):342343.
  10. Ryan AM. Will value‐based purchasing increase disparities in care? N Engl J Med. 2013;369(26):24722474.
  11. Thorpe KE, Florence CS, Seiber EE. Hospital conversions, margins, and the provision of uncompensated care. Health Aff (Millwood). 2000;19(6):187194.
  12. Borah BJ, Rock MG, Wood DL, Roellinger DL, Johnson MG, Naessens JM. Association between value‐based purchasing score and hospital characteristics. BMC Health Serv Res. 2012;12:464.
  13. Elliott MN, Zaslavsky AM, Goldstein E, et al. Effects of survey mode, patient mix, and nonresponse on CAHPS hospital survey scores. Health Serv Res. 2009;44(2 pt 1):501518.
  14. Burroughs TE, Waterman BM, Cira JC, Desikan R, Claiborne Dunagan W. Patient satisfaction measurement strategies: a comparison of phone and mail methods. Jt Comm J Qual Improv. 2001;27(7):349361.
  15. Fowler FJ, Gallagher PM, Nederend S. Comparing telephone and mail responses to the CAHPS survey instrument. Consumer Assessment of Health Plans Study. Med Care. 1999;37(3 suppl):MS41MS49.
  16. Rodriguez HP, Glahn T, Rogers WH, Chang H, Fanjiang G, Safran DG. Evaluating patients' experiences with individual physicians: a randomized trial of mail, internet, and interactive voice response telephone administration of surveys. Med Care. 2006;44(2):167174.
  17. O'Malley AJ, Zaslavsky AM, Elliott MN, Zaborski L, Cleary PD. Case‐mix adjustment of the CAHPS Hospital Survey. Health Serv Res. 2005;40(6 pt 2):21622181.
  18. Mode and patient‐mix adjustments of CAHPS hospital survey (HCAHPS). Available at: http://www.hcahpsonline.org/modeadjustment.aspx. Accessed December 1, 2013.
  19. Zaslavsky AM, Zaborski LB, Ding L, Shaul JA, Cioffi MJ, Clear PD. Adjusting performance measures to ensure equitable plan comparisons. Health Care Financ Rev. 2001;22(3):109126.
  20. Official Hospital Compare Data. Displaying datasets in Patient Survey Results category. Available at: https://data.medicare.gov/data/hospital‐compare/Patient%20Survey%20Results. Accessed December 1, 2013.
  21. Hospital statistics by state. American Hospital Directory, Inc. website. Available at: http://www.ahd.com/state_statistics.html. Accessed December 1, 2013.
  22. U.S. Census Download Center. Available at: http://factfinder.census.gov/faces/nav/jsf/pages/download_center.xhtml. Accessed December 1, 2013.
Article PDF
Issue
Journal of Hospital Medicine - 10(8)
Page Number
503-509
Sections
Files
Files
Article PDF
Article PDF

The Affordable Care Act of 2010 mandates that government payments to hospitals and physicians must depend, in part, on metrics that assess the quality and efficiency of healthcare being provided to encourage value‐based healthcare.[1] Value in healthcare is defined by the delivery of high‐quality care at low cost.[2, 3] To this end, Hospital Value‐Based Purchasing (HVBP) and Physician Value‐Based Payment Modifier programs have been developed by the Centers for Medicare & Medicaid Services (CMS). HVBP is currently being phased in and affects CMS payments for fiscal year (FY) 2013 for over 3000 hospitals across the United States to incentivize healthcare delivery value. The final phase of implementation will be in FY 2017 and will then affect 2% of all CMS hospital reimbursement. HVBP is based on objective measures of hospital performance as well as a subjective measure of performance captured under the Patient Experience of Care domain. This subjective measure will remain at 30% of the aggregate score until FY 2016, when it will then be 25% the aggregate score moving forward.[4] The program rewards hospitals for both overall achievement and improvement in any domain, so that hospitals have multiple ways to receive financial incentives for providing quality care.[5] Even still, there appears to be a nonrandom pattern of patient satisfaction scores across the country with less favorable scores clustering in densely populated areas.[6]

Value‐Based Purchasing and other incentive‐based programs have been criticized for increasing disparities in healthcare by penalizing larger hospitals (including academic medical centers, safety‐net hospitals, and others that disproportionately serve lower socioeconomic communities) and favoring physician‐based specialty hospitals.[7, 8, 9] Therefore, hospitals that serve indigent and elderly populations may be at a disadvantage.[9, 10] HVBP portends significant economic consequences for the majority of hospitals that rely heavily on Medicare and Medicaid reimbursement, as most hospitals have large revenues but low profit margins.[11] Higher HVBP scores are associated with for profit status, smaller size, and location in certain areas of the United States.[12] Jha et al.[6] described Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) scores regional geographic variability, but concluded that poor satisfaction was due to poor quality.

The Patient Experience of Care domain quantifies patient satisfaction using the validated HCAHPS survey, which is provided to a random sample of patients continuously throughout the year at 48 hours to 6 weeks after discharge. It is a publically available standardized survey instrument used to measure patients perspectives on hospital care. It assesses the following 8 dimensions: nurse communication, doctor communication, hospital staff responsiveness, pain management, medicine communication, discharge information, hospital cleanliness and quietness, and overall hospital rating, of which the last 2 dimensions each have 2 measures (cleanliness and quietness) and (rating 9 or 10 and definitely recommend) to give a total of 10 distinct measures.

The United States is a complex network of urban, suburban, and rural demographic areas. Hospitals exist within a unique contextual and compositional meshwork that determines its caseload. The top population density decile of the United States lives within 37 counties, whereas half of the most populous parts of the United States occupy a total of 250 counties out of a total of 3143 counties in the United States. If the 10 measures of patient satisfaction (HCAHPS) scores were abstracted from hospitals and viewed according to county‐level population density (separated into deciles across the United States), a trend would be apparent (Figure 1). Greater population density is associated with lower patient satisfaction in 9 of 10 categories. On the state level, composite scores of overall patient satisfaction (amount of positive scores) of hospitals show a 12% variability and a significant correlation with population density (r=0.479; Figure 2). The lowest overall satisfaction scores are obtained from hospitals located in the population‐dense regions of Washington, DC, New York State, California, Maryland, and New Jersey (ie, 63%65%), and the best scores are from Louisiana, South Dakota, Iowa, Maine, and Vermont (ie, 74%75%). The average patient satisfaction score is 71%2.9%. Lower patient satisfaction scores appear to cluster in population‐dense areas and may be associated with greater heterogeneous patient demographics and economic variability in addition to population density.

Figure 1
Overall patient satisfaction by population density decile. Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) scores are segregated by population density deciles (representing 33 million people each). Population density increases along the grey scale. The composite score and 9 out of 10 HCAHPS dimensions demonstrate lower patient satisfaction as population density increases (darker shade). Abbreviations: Doc, doctor; Def Rec, definitely recommend.
Figure 2
Averaged Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) scores by state correlated with state population (Pop) density. Bivariate correlation of composite HCAHPS scores predicted by state population density without District of Columbia, r = −0.479, P < 0.001 (2‐tailed). This observed correlation informed the hypothesis that population density could predict for lower patient satisfaction via HCAHPS scores.

These observations are surprising considering that CMS already adjusts HCAHPS scores based on patient‐mix coefficients and mode of collection.[13, 14, 15, 16, 17, 18] Adjustments are updated multiple times per year and account for survey collection either by telephone, email, or paper survey, because the populations that select survey forms will differ. Previous studies have shown that demographic features influence the patient evaluation process. For example, younger and more educated patients were found to provide less positive evaluations of healthcare.[19]

This study examined whether patients perceptions of healthcare (pattern of patient satisfaction) as quantified under the patient experience domain of HVBP were affected and predicted by population density and other demographic factors that are outside the control of individual hospitals. In addition, hospital‐level data (eg, number of hospital beds) and county‐level data such as race, age, gender, overall population, income, time spent commuting to work, primary language, and place of birth were analyzed for correlation with patient satisfaction scores. Our study demonstrates that demographic and hospital‐level data can predict patient satisfaction scores and suggests that CMS may need to modify its adjustment formulas to eliminate bias in HVBP‐based reimbursement.

METHODS

Data Collection

Publically available data were obtained from Hospital Compare,[20] American Hospital Directory,[21] and the US Census Bureau[22] websites. Twenty relevant US Census data categories were selected by their relevance for this study out of the 50 publically reported US Census categories, and included the following: county population, county population density, percent of population change over 1 year, poverty level (percent), income level per capita, median household income, average household size, travel time to work, percentage of high school or college graduates, non‐English primary language spoken at home, percentage of residents born outside of the United States, population percent in same residence for over 1 year, gender, race (white alone, white alone (not Hispanic or Latino), black or African American alone), population over 65 years old, and population under 18 years old.

HCAHPS Development

The HCAHPS survey is 32 questions in length, comprised of 10 evaluative dimensions. All short‐term, acute care, nonspecialty hospitals are invited to participate in the HCAHPS survey.

Data Analysis

Statistical analyses used the Statistical Package for Social Sciences version 16.0 for Windows (SPSS Inc., Chicago, IL). Data were checked for statistical assumptions, including normality, linearity of relationships, and full range of scores. Categories in both the Hospital Compare (HCAHPS) and US Census datasets were analyzed to assess their distribution curves. The category of population densities (per county) was converted to a logarithmic scale to account for a skewed distribution and long tail in the area of low population density. Data were subsequently merged into an Excel (Microsoft, Redmond, WA) spreadsheet using the VLookup function such that relevant 2010 census county data were added to each hospital's Hospital Compare data. Linear regression modeling was performed. Bivariate analysis was conducted (ENTER method) to determine the significant US Census data predictors for each of the 10 Hospital Compare dimensions including the composite overall satisfaction score. Significant predictors were then analyzed in a multivariate model (BACKWORDS method) for each Hospital Compare dimension and the composite average positive score. Models were assessed by determinates of correlation (adjusted R2) to assess for goodness of fit. Statistically significant predictor variables for overall patient satisfaction scores were then ranked according to their partial regression coefficients (standardized ).

A patient satisfaction predictive model was sought based upon significant predictors of aggregate percent positive HCAHPS scores. Various predictor combinations were formed based on their partial coefficients (ie, standardized coefficients); combinations were assessed based on their R2 values and assessed for colinearity. Combinations of partial coefficients included the 2, 4, and 8 most predictive variables as well the 2 most positive and negative predictors. They were then incorporated into a multivariate analysis model (FORWARD method) and assessed based on their adjusted R2 values. A 4‐variable combination (the 2 most predictive positive partial coefficients plus the 2 most predictive negative partial coefficients) was selected as a predictive model, and a formula predictive of the composite overall satisfaction score was generated. This formula (predicted patient satisfaction formula [PPSF]) predicts hospital patient satisfaction HCAHPS scores based on the 4 predictive variables for particular county and hospital characteristics. PPSF=KMV+BHB(HB)+BNE(NE)+BE(E)+BW(W)where KMV=coefficient constant (70.9), B=unstandardized coefficient (see Table 1 for values), HB=number of hospital beds, NE=proportion of non‐English speakers, E=education (proportion with bachelor's degree), and W=proportion identified as white race only.

Multivariate Regression of Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) Average Positive Score by County and Hospital Demographics
 BSE tP
  • NOTE: A multivariate linear regression model of statistically significant dimensions of patient satisfaction as determined by Hospital Consumer Assessment of Healthcare Providers and Systems scores is provided. The dependent variable is the composite of average patient satisfaction scores by hospital (3192 hospitals). Predictors (independent variables) were collected from US Census data for counties or county equivalents. All of the listed predictors (first column) are statistically significant. They are placed in order of partial regression coefficient contribution to the model from most positive to most negative contribution. Adjusted R2 (last row) is used to signify the goodness of fit. Abbreviations: , standardized (partial coefficient); B, unstandardized coefficient; P, statistical significance; SE, standard error; t, t statistic.

Educational attainmentbachelor's degree0.1570.0180.278.612<0.001
White alone percent 20120.090.0120.2357.587<0.001
Resident population percent under 18 years0.4040.04440.2099.085<0.001
Black or African American alone percent 20120.0830.0140.1915.936<0.001
Median household income 200720110.000030.000.0622.0270.043
Population density (log) 20100.2770.0830.0873.33330.001
Average travel time to work0.1070.0240.0884.366<0.001
Educational attainmenthigh school0.0820.0260.0883.1470.002
Average household size2.580.7270.1073.55<0.001
Total females percent 20120.4230.0670.1076.296<0.001
Percent nonEnglish speaking at home 200720110.0520.0180.142.9290.003
No. of hospital beds0.0060.000.21312.901<0.001
Adjusted R20.222    

The PPSF was then modified by weighting with the partial coefficient () to remove the bias in patient satisfaction generated by demographic and structural factors over which individual hospitals have limited or no control. This formula generated a Weighted Individual (hospital) Predicted Patient Satisfaction Score (WIPPSS). Application of this formula narrowed the predicted distribution of patient satisfaction for all hospitals across the country. WIPPSS=KMV+BHB(HB)(1HB)+BNE(NE)(1NE)+BE(E)(1E)+BW(W)(1W)where =standardized coefficient (see Table 1 for values).

To create an adjusted score with direct relevance to the reported patient satisfaction scores, the reported scores were multiplied by an adjustment factor that defines the difference between individual hospital‐weighted scores and the national mean HCAHPS score across the United States. This formula, the Weighted Individual (hospital) Patient Satisfaction Adjustment Score (WIPSAS), represents a patient satisfaction score adjusted for demographic and structural factors that can be utilized for interhospital comparisons across all areas of the country. WIPSAS=PSrep[1+(PSUSAWIPPSSX)/100]

where PSrep=patient satisfaction reported score, PSUSA=mean reported score for United States (71.84), and WIPPSSX=WIPPSS for individual hospital.

Application of Data Analysis

PPSF, WIPPSS, and WIPSAS were calculated for all HCAHPS‐participating hospitals and compared with averaged raw HCAHPS scores across the United States. WIPSAS and raw scores were specifically analyzed for New York State to demonstrate exactly how adjustments would change state‐level rankings.

RESULTS

Complete HCAHPS scores were obtained from 3907 hospitals out of a total 4621 hospitals listed by the Hospital Compare website (85%). The majority of hospitals (2884) collected over 300 surveys, fewer hospitals (696) collected 100 to 299 surveys, and fewer still (333) collected <100 surveys. In total, results were available from at least 934,800 individual surveys, by the most conservative estimate. Missing HCAHPS hospital data averaged 13.4 (standard deviation [SD] 12.2) hospitals per state. County‐level data were obtained from all 3144 county or county equivalents across the United States (100%). Multivariate regression modeling across all HCAHPS dimensions found that between 10 and 16 of the 20 predictors (US Census categories) were statistically significant and predictive of individual HCAHPS dimension scores and the aggregate percent positive score as demonstrated in Table 2. For example, county percentage of bachelors degrees positively predicts for positive doctor communication scores, and hospital beds negatively predicts for quiet dimension. The strongest positive and negative predictive variables by model regression coefficients for each HCAHPS dimension are also listed in Table 2.

Multivariate Regression of Hospital Consumer Assessment of Healthcare Providers and Systems by County and Hospital Demographics
 Average Positive ScoresNurse CommunicationDoctor CommunicationHelpPainExplain MedsCleanQuietDischarge ExplainRecommend 9/10Definitely Recommend
  • NOTE: Linear regression modeling results of 10 dimensions of patient satisfaction (ie, Hospital Consumer Assessment of Healthcare Providers and Systems [HCAHPS]) and Average Positive Scores (top row) by county demographics and hospital size (left column) are shown. Adjusted R2 (last row) is used to signify the goodness of fit. All models are statistically significant with P=<0.001. Partial regression coefficients () are used to positively or negatively assess contribution to the individual models (ie, each column). The dash () indicates nonsignificance and the asterisk (*) indicates a value that was statistically significant in univariate analysis but not in multivariate analysis. Independent variables (first column) are ordered from top to bottom by the number of HCAHPS dimensions that each contributes to HCAHPS predictive scoring.

Educationalbachelor's0.270.190.450.100.100.050.080.330.150.270.416
Hospital beds0.210.160.190.260.160.170.270.260.060.11 
Population density 20100.090.070.280.200.080.230.140.190.220.07*
White alone percent0.240.250.090.160.230.070.16 0.170.310.317
Total females percent0.110.050.060.070.060.030.050.090.120.09 
African American alone0.190.19 0.090.230.090.070.34*0.090.084
Average travel time to work0.090.10*0.090.060.040.08*0.120.170.16
Foreign‐born percent*0.160.140.060.120.080.060.130.18**
Average household size0.110.050.150.07*0.07*0.01*0.070.076
NonEnglish speaking0.140.120.500.07*****0.340.28
Educationhigh school0.090.090.40*   0.270.060.08*
Household income0.06*0.350.08**0.160.41  0.265
Population 65 years and over*0.140.140.12*0.110.15  *0.10
White, not Hispanic/Latino**0.20***0.090.130.090.220.25
Population under 180.21 0.15 0.08   0.110.20 
Population (county)*0.060.08*0.030.05**0.06**
All ages in poverty  0.24   0.100.220.08*0.281
1 year at same residence*0.130.120.11  0.10*0.04**
Per capita income*0.07*****0.09  *
Population percent change******0.05  **
Adjusted R20.220.250.300.300.120.170.230.300.190.140.15

Table 1 highlights multivariate regression modeling of the composite average positive score, which produced an adjusted R2 of 0.222 (P<0.001). All variables were significant and predicted change of the composite HCAHPS except for place of birthforeign born (not listed in the table). Table 1 ranks variables from most positive to most negative predictors.

Other HCAHPS domains demonstrated statistically significant models (P<0.001) and are listed by their coefficients of determination (ie, adjusted R2) (Table 2). The best‐fit dimensions were help (adjusted R2=0.304), quiet (adjusted R2=0.299), doctor communication (adjusted R2=0.298), nurse communication (adjusted R2=0.245), and clean (adjusted R2=0.232). Models that were not as strongly predictive as the composite score included pain (adjusted R2=0.124), overall 9/10 (adjusted R2=0.136), definitely recommend (adjusted R2=0.150), and explained meds (adjusted R2=0.169).

A predictive formula for average positive scores was created by determination of the most predictive partial coefficients and the best‐fit model. Bachelor's degree and white only were the 2 greatest positive predictors, and number of hospital beds and nonEnglish speaking were the 2 greatest negative predictors. The PPSF (predictive formula) was chosen out of various combinations of predictors (Table 1), because its coefficient of determination (adjusted R2=0.155) was closest to the overall model's coefficient of determination (adjusted R2=0.222) without demonstrating colinearity. Possible predictive formulas were based on the predictors standardized and included the following combinations: the 2 greatest overall predictors (adjusted R2=0.051), the 2 greatest negative and positive predictors (adjusted R2=0.098), the 4 greatest overall predictors (adjusted R2=0.117), and the 8 greatest overall predictors (adjusted R2=0.201), which suffered from colinearity (household size plus nonEnglish speaking [Pearson=0.624] and under 18 years old [Pearson=0.708]). None of the correlated independent variables (eg, poverty and median income) were placed in the final model.

The mean WIPSAS scores closely corresponded with the national average of HCAHPS scores (71.6 vs 71.84) but compressed scores into a narrower distribution (SD 5.52 vs 5.92). The greatest positive and negative changes were by 8.51% and 2.25%, respectively. Essentially, a smaller number of hospitals in demographically challenged areas were more significantly impacted by the WIPSAS adjustment than the larger number of hospitals in demographically favorable areas. Large hospitals in demographically diverse counties saw the greatest positive change (e.g., Texas, California, and New York), whereas smaller hospitals in demographically nondiverse areas saw comparatively smaller decrements in the overall WIPSAS scores. The WIPSAS had the most beneficial effect on urban and rural safety‐net hospitals that serve diverse populations including many academic medical centers. This is illustrated by the reranking of the top 10 and bottom 10 hospitals in New York State by the WIPSAS (Table 3). For example, 3 academic medical centers in New York State, Montefiore Medical Center, New York Presbyterian Hospital, and Mount Sinai Hospital, were moved from the 46th, 43rd, and 42nd (out of 167 hospitals) respectively into the top 10 in patient satisfaction utilizing the WIPSAS methodology. Reported patient satisfaction scores, PPSF, WIPPSS, and WIPSAS scores for each hospital in the United States are available online (see Supporting Table S1 in the online version of this article).

Top Ten Highest‐Ranked Hospitals in New York State by HCAHPS Scores Compared to WIPSAS
Ten Highest Ranked New York State Hospitals by HCAHPSTen Highest Ranked New York State Hospitals After WIPSAS
  • NOTE: Top 10 highest‐ranked hospitals in New York State by overall patient satisfaction out of 167 evaluable hospitals are shown. The left column represents the current top 10 hospitals in 2013 by HCAHPS overall patient satisfaction scores, and the right column represents the top 10 hospitals after the WIPSAS adjustment. The 4 factors used to create the WIPSAS adjustment were the 2 most positive partial regression coefficients (educationbachelor's degree, white alone percent 2012) and the 2 most negative partial regression coefficients (number of hospital beds, nonEnglish speaking at home). Three urban academic medical centers, Montefiore Medical Center, New York Presbyterian Hospital, and Mount Sinai Hospital, were reranked from the 46th, 43rd, and 42nd respectively into the top 10. Abbreviations: HCAHPS, Hospital Consumer Assessment of Healthcare Providers and Systems; WIPSAS, Weighted Individual (hospital) Patient Satisfaction Adjustment Score.

1. River Hospital, Inc.1. River Hospital, Inc.
2. Westfield Memorial Hospital, Inc.2. Westfield Memorial Hospital, Inc.
3. Clifton Fine Hospital3. Clifton Fine Hospital
4. Hospital For Special Surgery4. Hospital For Special Surgery
5. Delaware Valley Hospital, Inc.5. New YorkPresbyterian Hospital
6. Putnam Hospital Center6. Delaware Valley Hospital, Inc.
7. Margaretville Memorial Hospital7. Montefiore Medical Center
8. Community Memorial Hospital, Inc.8. St. Francis Hospital, Roslyn
9. Lewis County General Hospital9. Putnam Hospital Center
10. St. Francis Hospital, Roslyn10. Mount Sinai Hospital

DISCUSSION

The HVBP program is an incentive program that is meant to enhance the quality of care. This study illustrates healthcare inequalities in patient satisfaction that are not accounted for by the current CMS adjustments, and shows that education, ethnicity, primary language, and number of hospital beds are predictive of how patients evaluate their care via patient satisfaction scores. Hospitals that treat a disproportionate percentage of nonEnglish speaking, nonwhite, noneducated patients in large facilities are not meeting patient satisfaction standards. This inequity is not ameliorated by the adjustments currently performed by CMS, and has financial consequences for those hospitals that are not meeting national standards in patient satisfaction. These hospitals, which often include academic medical centers in urban areas, may therefore be penalized under the existing HVBP reimbursement models.

Using only 4 demographic and hospital‐specific predictors (ie, hospital beds, percent nonEnglish speaking, percent bachelors degrees, percent white), it is possible to utilize a simple formula to predict patient satisfaction with a significant degree of correlation to the reported scores available through Hospital Compare.

Our initial hypothesis that population density predicted lower patient satisfaction scores was confirmed, but these aforementioned demographic and hospital‐based factors were stronger independent predictors of HCAHPS scores. The WIPSAS is a representation of patient satisfaction and quality‐of‐care delivery across the country that accounts for nonrandom variation in patient satisfaction scores.

For hospitals in New York State, WIPSAS resulted in the placement of 3 urban‐based academic medical centers in the top 10 in patient satisfaction, when previously, based on the raw scores, their rankings were between 42nd and 46th statewide. Prior studies have suggested that large, urban, teaching, and not‐for‐profit hospitals were disadvantaged based on their hospital characteristics and patient features.[10, 11, 12] Under the current CMS reimbursement methodologies, these institutions are more likely to receive financial penalties.[8] The WIPSAS is a simple method to assess hospitals performance in the area of patient satisfaction that accounts for the demographic and hospital‐based factors (eg, number of beds) of the hospital. Its incorporation into CMS reimbursement calculations, or incorporation of a similar adjustment formula, should be strongly considered to account for predictive factors in patient satisfaction that could be addressed to enhance their scores.

Limitations for this study are the approximation of county‐level data for actual individual hospital demographic information and the exclusion of specialty hospitals, such as cancer centers and children's hospitals, in HCAHPS surveys. Repeated multivariate analyses at different time points would also serve to identify how CMS‐specific adjustments are recalibrated over time. Although we have primarily reported on the composite percent positive score as a surrogate for all HCAHPS dimensions, an individual adjustment formula could be generated for each dimension of the patient experience of care domain.

Although patient satisfaction is a component of how quality should be measured, further emphasis needs to be placed on nonrandom patient satisfaction variance so that HVBP can serve as an incentivizing program for at‐risk hospitals. Regional variation in scoring is not altogether accounted for by the current CMS adjustment system. Because patient satisfaction scores are now directly linked to reimbursement, further evaluation is needed to enhance patient satisfaction scoring paradigms to account for demographic and hospital‐specific factors.

Disclosure

Nothing to report.

The Affordable Care Act of 2010 mandates that government payments to hospitals and physicians must depend, in part, on metrics that assess the quality and efficiency of healthcare being provided to encourage value‐based healthcare.[1] Value in healthcare is defined by the delivery of high‐quality care at low cost.[2, 3] To this end, Hospital Value‐Based Purchasing (HVBP) and Physician Value‐Based Payment Modifier programs have been developed by the Centers for Medicare & Medicaid Services (CMS). HVBP is currently being phased in and affects CMS payments for fiscal year (FY) 2013 for over 3000 hospitals across the United States to incentivize healthcare delivery value. The final phase of implementation will be in FY 2017 and will then affect 2% of all CMS hospital reimbursement. HVBP is based on objective measures of hospital performance as well as a subjective measure of performance captured under the Patient Experience of Care domain. This subjective measure will remain at 30% of the aggregate score until FY 2016, when it will then be 25% the aggregate score moving forward.[4] The program rewards hospitals for both overall achievement and improvement in any domain, so that hospitals have multiple ways to receive financial incentives for providing quality care.[5] Even still, there appears to be a nonrandom pattern of patient satisfaction scores across the country with less favorable scores clustering in densely populated areas.[6]

Value‐Based Purchasing and other incentive‐based programs have been criticized for increasing disparities in healthcare by penalizing larger hospitals (including academic medical centers, safety‐net hospitals, and others that disproportionately serve lower socioeconomic communities) and favoring physician‐based specialty hospitals.[7, 8, 9] Therefore, hospitals that serve indigent and elderly populations may be at a disadvantage.[9, 10] HVBP portends significant economic consequences for the majority of hospitals that rely heavily on Medicare and Medicaid reimbursement, as most hospitals have large revenues but low profit margins.[11] Higher HVBP scores are associated with for profit status, smaller size, and location in certain areas of the United States.[12] Jha et al.[6] described Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) scores regional geographic variability, but concluded that poor satisfaction was due to poor quality.

The Patient Experience of Care domain quantifies patient satisfaction using the validated HCAHPS survey, which is provided to a random sample of patients continuously throughout the year at 48 hours to 6 weeks after discharge. It is a publically available standardized survey instrument used to measure patients perspectives on hospital care. It assesses the following 8 dimensions: nurse communication, doctor communication, hospital staff responsiveness, pain management, medicine communication, discharge information, hospital cleanliness and quietness, and overall hospital rating, of which the last 2 dimensions each have 2 measures (cleanliness and quietness) and (rating 9 or 10 and definitely recommend) to give a total of 10 distinct measures.

The United States is a complex network of urban, suburban, and rural demographic areas. Hospitals exist within a unique contextual and compositional meshwork that determines its caseload. The top population density decile of the United States lives within 37 counties, whereas half of the most populous parts of the United States occupy a total of 250 counties out of a total of 3143 counties in the United States. If the 10 measures of patient satisfaction (HCAHPS) scores were abstracted from hospitals and viewed according to county‐level population density (separated into deciles across the United States), a trend would be apparent (Figure 1). Greater population density is associated with lower patient satisfaction in 9 of 10 categories. On the state level, composite scores of overall patient satisfaction (amount of positive scores) of hospitals show a 12% variability and a significant correlation with population density (r=0.479; Figure 2). The lowest overall satisfaction scores are obtained from hospitals located in the population‐dense regions of Washington, DC, New York State, California, Maryland, and New Jersey (ie, 63%65%), and the best scores are from Louisiana, South Dakota, Iowa, Maine, and Vermont (ie, 74%75%). The average patient satisfaction score is 71%2.9%. Lower patient satisfaction scores appear to cluster in population‐dense areas and may be associated with greater heterogeneous patient demographics and economic variability in addition to population density.

Figure 1
Overall patient satisfaction by population density decile. Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) scores are segregated by population density deciles (representing 33 million people each). Population density increases along the grey scale. The composite score and 9 out of 10 HCAHPS dimensions demonstrate lower patient satisfaction as population density increases (darker shade). Abbreviations: Doc, doctor; Def Rec, definitely recommend.
Figure 2
Averaged Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) scores by state correlated with state population (Pop) density. Bivariate correlation of composite HCAHPS scores predicted by state population density without District of Columbia, r = −0.479, P < 0.001 (2‐tailed). This observed correlation informed the hypothesis that population density could predict for lower patient satisfaction via HCAHPS scores.

These observations are surprising considering that CMS already adjusts HCAHPS scores based on patient‐mix coefficients and mode of collection.[13, 14, 15, 16, 17, 18] Adjustments are updated multiple times per year and account for survey collection either by telephone, email, or paper survey, because the populations that select survey forms will differ. Previous studies have shown that demographic features influence the patient evaluation process. For example, younger and more educated patients were found to provide less positive evaluations of healthcare.[19]

This study examined whether patients perceptions of healthcare (pattern of patient satisfaction) as quantified under the patient experience domain of HVBP were affected and predicted by population density and other demographic factors that are outside the control of individual hospitals. In addition, hospital‐level data (eg, number of hospital beds) and county‐level data such as race, age, gender, overall population, income, time spent commuting to work, primary language, and place of birth were analyzed for correlation with patient satisfaction scores. Our study demonstrates that demographic and hospital‐level data can predict patient satisfaction scores and suggests that CMS may need to modify its adjustment formulas to eliminate bias in HVBP‐based reimbursement.

METHODS

Data Collection

Publically available data were obtained from Hospital Compare,[20] American Hospital Directory,[21] and the US Census Bureau[22] websites. Twenty relevant US Census data categories were selected by their relevance for this study out of the 50 publically reported US Census categories, and included the following: county population, county population density, percent of population change over 1 year, poverty level (percent), income level per capita, median household income, average household size, travel time to work, percentage of high school or college graduates, non‐English primary language spoken at home, percentage of residents born outside of the United States, population percent in same residence for over 1 year, gender, race (white alone, white alone (not Hispanic or Latino), black or African American alone), population over 65 years old, and population under 18 years old.

HCAHPS Development

The HCAHPS survey is 32 questions in length, comprised of 10 evaluative dimensions. All short‐term, acute care, nonspecialty hospitals are invited to participate in the HCAHPS survey.

Data Analysis

Statistical analyses used the Statistical Package for Social Sciences version 16.0 for Windows (SPSS Inc., Chicago, IL). Data were checked for statistical assumptions, including normality, linearity of relationships, and full range of scores. Categories in both the Hospital Compare (HCAHPS) and US Census datasets were analyzed to assess their distribution curves. The category of population densities (per county) was converted to a logarithmic scale to account for a skewed distribution and long tail in the area of low population density. Data were subsequently merged into an Excel (Microsoft, Redmond, WA) spreadsheet using the VLookup function such that relevant 2010 census county data were added to each hospital's Hospital Compare data. Linear regression modeling was performed. Bivariate analysis was conducted (ENTER method) to determine the significant US Census data predictors for each of the 10 Hospital Compare dimensions including the composite overall satisfaction score. Significant predictors were then analyzed in a multivariate model (BACKWORDS method) for each Hospital Compare dimension and the composite average positive score. Models were assessed by determinates of correlation (adjusted R2) to assess for goodness of fit. Statistically significant predictor variables for overall patient satisfaction scores were then ranked according to their partial regression coefficients (standardized ).

A patient satisfaction predictive model was sought based upon significant predictors of aggregate percent positive HCAHPS scores. Various predictor combinations were formed based on their partial coefficients (ie, standardized coefficients); combinations were assessed based on their R2 values and assessed for colinearity. Combinations of partial coefficients included the 2, 4, and 8 most predictive variables as well the 2 most positive and negative predictors. They were then incorporated into a multivariate analysis model (FORWARD method) and assessed based on their adjusted R2 values. A 4‐variable combination (the 2 most predictive positive partial coefficients plus the 2 most predictive negative partial coefficients) was selected as a predictive model, and a formula predictive of the composite overall satisfaction score was generated. This formula (predicted patient satisfaction formula [PPSF]) predicts hospital patient satisfaction HCAHPS scores based on the 4 predictive variables for particular county and hospital characteristics. PPSF=KMV+BHB(HB)+BNE(NE)+BE(E)+BW(W)where KMV=coefficient constant (70.9), B=unstandardized coefficient (see Table 1 for values), HB=number of hospital beds, NE=proportion of non‐English speakers, E=education (proportion with bachelor's degree), and W=proportion identified as white race only.

Multivariate Regression of Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) Average Positive Score by County and Hospital Demographics
 BSE tP
  • NOTE: A multivariate linear regression model of statistically significant dimensions of patient satisfaction as determined by Hospital Consumer Assessment of Healthcare Providers and Systems scores is provided. The dependent variable is the composite of average patient satisfaction scores by hospital (3192 hospitals). Predictors (independent variables) were collected from US Census data for counties or county equivalents. All of the listed predictors (first column) are statistically significant. They are placed in order of partial regression coefficient contribution to the model from most positive to most negative contribution. Adjusted R2 (last row) is used to signify the goodness of fit. Abbreviations: , standardized (partial coefficient); B, unstandardized coefficient; P, statistical significance; SE, standard error; t, t statistic.

Educational attainmentbachelor's degree0.1570.0180.278.612<0.001
White alone percent 20120.090.0120.2357.587<0.001
Resident population percent under 18 years0.4040.04440.2099.085<0.001
Black or African American alone percent 20120.0830.0140.1915.936<0.001
Median household income 200720110.000030.000.0622.0270.043
Population density (log) 20100.2770.0830.0873.33330.001
Average travel time to work0.1070.0240.0884.366<0.001
Educational attainmenthigh school0.0820.0260.0883.1470.002
Average household size2.580.7270.1073.55<0.001
Total females percent 20120.4230.0670.1076.296<0.001
Percent nonEnglish speaking at home 200720110.0520.0180.142.9290.003
No. of hospital beds0.0060.000.21312.901<0.001
Adjusted R20.222    

The PPSF was then modified by weighting with the partial coefficient () to remove the bias in patient satisfaction generated by demographic and structural factors over which individual hospitals have limited or no control. This formula generated a Weighted Individual (hospital) Predicted Patient Satisfaction Score (WIPPSS). Application of this formula narrowed the predicted distribution of patient satisfaction for all hospitals across the country. WIPPSS=KMV+BHB(HB)(1HB)+BNE(NE)(1NE)+BE(E)(1E)+BW(W)(1W)where =standardized coefficient (see Table 1 for values).

To create an adjusted score with direct relevance to the reported patient satisfaction scores, the reported scores were multiplied by an adjustment factor that defines the difference between individual hospital‐weighted scores and the national mean HCAHPS score across the United States. This formula, the Weighted Individual (hospital) Patient Satisfaction Adjustment Score (WIPSAS), represents a patient satisfaction score adjusted for demographic and structural factors that can be utilized for interhospital comparisons across all areas of the country. WIPSAS=PSrep[1+(PSUSAWIPPSSX)/100]

where PSrep=patient satisfaction reported score, PSUSA=mean reported score for United States (71.84), and WIPPSSX=WIPPSS for individual hospital.

Application of Data Analysis

PPSF, WIPPSS, and WIPSAS were calculated for all HCAHPS‐participating hospitals and compared with averaged raw HCAHPS scores across the United States. WIPSAS and raw scores were specifically analyzed for New York State to demonstrate exactly how adjustments would change state‐level rankings.

RESULTS

Complete HCAHPS scores were obtained from 3907 hospitals out of a total 4621 hospitals listed by the Hospital Compare website (85%). The majority of hospitals (2884) collected over 300 surveys, fewer hospitals (696) collected 100 to 299 surveys, and fewer still (333) collected <100 surveys. In total, results were available from at least 934,800 individual surveys, by the most conservative estimate. Missing HCAHPS hospital data averaged 13.4 (standard deviation [SD] 12.2) hospitals per state. County‐level data were obtained from all 3144 county or county equivalents across the United States (100%). Multivariate regression modeling across all HCAHPS dimensions found that between 10 and 16 of the 20 predictors (US Census categories) were statistically significant and predictive of individual HCAHPS dimension scores and the aggregate percent positive score as demonstrated in Table 2. For example, county percentage of bachelors degrees positively predicts for positive doctor communication scores, and hospital beds negatively predicts for quiet dimension. The strongest positive and negative predictive variables by model regression coefficients for each HCAHPS dimension are also listed in Table 2.

Multivariate Regression of Hospital Consumer Assessment of Healthcare Providers and Systems by County and Hospital Demographics
 Average Positive ScoresNurse CommunicationDoctor CommunicationHelpPainExplain MedsCleanQuietDischarge ExplainRecommend 9/10Definitely Recommend
  • NOTE: Linear regression modeling results of 10 dimensions of patient satisfaction (ie, Hospital Consumer Assessment of Healthcare Providers and Systems [HCAHPS]) and Average Positive Scores (top row) by county demographics and hospital size (left column) are shown. Adjusted R2 (last row) is used to signify the goodness of fit. All models are statistically significant with P=<0.001. Partial regression coefficients () are used to positively or negatively assess contribution to the individual models (ie, each column). The dash () indicates nonsignificance and the asterisk (*) indicates a value that was statistically significant in univariate analysis but not in multivariate analysis. Independent variables (first column) are ordered from top to bottom by the number of HCAHPS dimensions that each contributes to HCAHPS predictive scoring.

Educationalbachelor's0.270.190.450.100.100.050.080.330.150.270.416
Hospital beds0.210.160.190.260.160.170.270.260.060.11 
Population density 20100.090.070.280.200.080.230.140.190.220.07*
White alone percent0.240.250.090.160.230.070.16 0.170.310.317
Total females percent0.110.050.060.070.060.030.050.090.120.09 
African American alone0.190.19 0.090.230.090.070.34*0.090.084
Average travel time to work0.090.10*0.090.060.040.08*0.120.170.16
Foreign‐born percent*0.160.140.060.120.080.060.130.18**
Average household size0.110.050.150.07*0.07*0.01*0.070.076
NonEnglish speaking0.140.120.500.07*****0.340.28
Educationhigh school0.090.090.40*   0.270.060.08*
Household income0.06*0.350.08**0.160.41  0.265
Population 65 years and over*0.140.140.12*0.110.15  *0.10
White, not Hispanic/Latino**0.20***0.090.130.090.220.25
Population under 180.21 0.15 0.08   0.110.20 
Population (county)*0.060.08*0.030.05**0.06**
All ages in poverty  0.24   0.100.220.08*0.281
1 year at same residence*0.130.120.11  0.10*0.04**
Per capita income*0.07*****0.09  *
Population percent change******0.05  **
Adjusted R20.220.250.300.300.120.170.230.300.190.140.15

Table 1 highlights multivariate regression modeling of the composite average positive score, which produced an adjusted R2 of 0.222 (P<0.001). All variables were significant and predicted change of the composite HCAHPS except for place of birthforeign born (not listed in the table). Table 1 ranks variables from most positive to most negative predictors.

Other HCAHPS domains demonstrated statistically significant models (P<0.001) and are listed by their coefficients of determination (ie, adjusted R2) (Table 2). The best‐fit dimensions were help (adjusted R2=0.304), quiet (adjusted R2=0.299), doctor communication (adjusted R2=0.298), nurse communication (adjusted R2=0.245), and clean (adjusted R2=0.232). Models that were not as strongly predictive as the composite score included pain (adjusted R2=0.124), overall 9/10 (adjusted R2=0.136), definitely recommend (adjusted R2=0.150), and explained meds (adjusted R2=0.169).

A predictive formula for average positive scores was created by determination of the most predictive partial coefficients and the best‐fit model. Bachelor's degree and white only were the 2 greatest positive predictors, and number of hospital beds and nonEnglish speaking were the 2 greatest negative predictors. The PPSF (predictive formula) was chosen out of various combinations of predictors (Table 1), because its coefficient of determination (adjusted R2=0.155) was closest to the overall model's coefficient of determination (adjusted R2=0.222) without demonstrating colinearity. Possible predictive formulas were based on the predictors standardized and included the following combinations: the 2 greatest overall predictors (adjusted R2=0.051), the 2 greatest negative and positive predictors (adjusted R2=0.098), the 4 greatest overall predictors (adjusted R2=0.117), and the 8 greatest overall predictors (adjusted R2=0.201), which suffered from colinearity (household size plus nonEnglish speaking [Pearson=0.624] and under 18 years old [Pearson=0.708]). None of the correlated independent variables (eg, poverty and median income) were placed in the final model.

The mean WIPSAS scores closely corresponded with the national average of HCAHPS scores (71.6 vs 71.84) but compressed scores into a narrower distribution (SD 5.52 vs 5.92). The greatest positive and negative changes were by 8.51% and 2.25%, respectively. Essentially, a smaller number of hospitals in demographically challenged areas were more significantly impacted by the WIPSAS adjustment than the larger number of hospitals in demographically favorable areas. Large hospitals in demographically diverse counties saw the greatest positive change (e.g., Texas, California, and New York), whereas smaller hospitals in demographically nondiverse areas saw comparatively smaller decrements in the overall WIPSAS scores. The WIPSAS had the most beneficial effect on urban and rural safety‐net hospitals that serve diverse populations including many academic medical centers. This is illustrated by the reranking of the top 10 and bottom 10 hospitals in New York State by the WIPSAS (Table 3). For example, 3 academic medical centers in New York State, Montefiore Medical Center, New York Presbyterian Hospital, and Mount Sinai Hospital, were moved from the 46th, 43rd, and 42nd (out of 167 hospitals) respectively into the top 10 in patient satisfaction utilizing the WIPSAS methodology. Reported patient satisfaction scores, PPSF, WIPPSS, and WIPSAS scores for each hospital in the United States are available online (see Supporting Table S1 in the online version of this article).

Top Ten Highest‐Ranked Hospitals in New York State by HCAHPS Scores Compared to WIPSAS
Ten Highest Ranked New York State Hospitals by HCAHPSTen Highest Ranked New York State Hospitals After WIPSAS
  • NOTE: Top 10 highest‐ranked hospitals in New York State by overall patient satisfaction out of 167 evaluable hospitals are shown. The left column represents the current top 10 hospitals in 2013 by HCAHPS overall patient satisfaction scores, and the right column represents the top 10 hospitals after the WIPSAS adjustment. The 4 factors used to create the WIPSAS adjustment were the 2 most positive partial regression coefficients (educationbachelor's degree, white alone percent 2012) and the 2 most negative partial regression coefficients (number of hospital beds, nonEnglish speaking at home). Three urban academic medical centers, Montefiore Medical Center, New York Presbyterian Hospital, and Mount Sinai Hospital, were reranked from the 46th, 43rd, and 42nd respectively into the top 10. Abbreviations: HCAHPS, Hospital Consumer Assessment of Healthcare Providers and Systems; WIPSAS, Weighted Individual (hospital) Patient Satisfaction Adjustment Score.

1. River Hospital, Inc.1. River Hospital, Inc.
2. Westfield Memorial Hospital, Inc.2. Westfield Memorial Hospital, Inc.
3. Clifton Fine Hospital3. Clifton Fine Hospital
4. Hospital For Special Surgery4. Hospital For Special Surgery
5. Delaware Valley Hospital, Inc.5. New YorkPresbyterian Hospital
6. Putnam Hospital Center6. Delaware Valley Hospital, Inc.
7. Margaretville Memorial Hospital7. Montefiore Medical Center
8. Community Memorial Hospital, Inc.8. St. Francis Hospital, Roslyn
9. Lewis County General Hospital9. Putnam Hospital Center
10. St. Francis Hospital, Roslyn10. Mount Sinai Hospital

DISCUSSION

The HVBP program is an incentive program that is meant to enhance the quality of care. This study illustrates healthcare inequalities in patient satisfaction that are not accounted for by the current CMS adjustments, and shows that education, ethnicity, primary language, and number of hospital beds are predictive of how patients evaluate their care via patient satisfaction scores. Hospitals that treat a disproportionate percentage of nonEnglish speaking, nonwhite, noneducated patients in large facilities are not meeting patient satisfaction standards. This inequity is not ameliorated by the adjustments currently performed by CMS, and has financial consequences for those hospitals that are not meeting national standards in patient satisfaction. These hospitals, which often include academic medical centers in urban areas, may therefore be penalized under the existing HVBP reimbursement models.

Using only 4 demographic and hospital‐specific predictors (ie, hospital beds, percent nonEnglish speaking, percent bachelors degrees, percent white), it is possible to utilize a simple formula to predict patient satisfaction with a significant degree of correlation to the reported scores available through Hospital Compare.

Our initial hypothesis that population density predicted lower patient satisfaction scores was confirmed, but these aforementioned demographic and hospital‐based factors were stronger independent predictors of HCAHPS scores. The WIPSAS is a representation of patient satisfaction and quality‐of‐care delivery across the country that accounts for nonrandom variation in patient satisfaction scores.

For hospitals in New York State, WIPSAS resulted in the placement of 3 urban‐based academic medical centers in the top 10 in patient satisfaction, when previously, based on the raw scores, their rankings were between 42nd and 46th statewide. Prior studies have suggested that large, urban, teaching, and not‐for‐profit hospitals were disadvantaged based on their hospital characteristics and patient features.[10, 11, 12] Under the current CMS reimbursement methodologies, these institutions are more likely to receive financial penalties.[8] The WIPSAS is a simple method to assess hospitals performance in the area of patient satisfaction that accounts for the demographic and hospital‐based factors (eg, number of beds) of the hospital. Its incorporation into CMS reimbursement calculations, or incorporation of a similar adjustment formula, should be strongly considered to account for predictive factors in patient satisfaction that could be addressed to enhance their scores.

Limitations for this study are the approximation of county‐level data for actual individual hospital demographic information and the exclusion of specialty hospitals, such as cancer centers and children's hospitals, in HCAHPS surveys. Repeated multivariate analyses at different time points would also serve to identify how CMS‐specific adjustments are recalibrated over time. Although we have primarily reported on the composite percent positive score as a surrogate for all HCAHPS dimensions, an individual adjustment formula could be generated for each dimension of the patient experience of care domain.

Although patient satisfaction is a component of how quality should be measured, further emphasis needs to be placed on nonrandom patient satisfaction variance so that HVBP can serve as an incentivizing program for at‐risk hospitals. Regional variation in scoring is not altogether accounted for by the current CMS adjustment system. Because patient satisfaction scores are now directly linked to reimbursement, further evaluation is needed to enhance patient satisfaction scoring paradigms to account for demographic and hospital‐specific factors.

Disclosure

Nothing to report.

References
  1. Florence CS, Atherly A, Thorpe KE. Will choice‐based reform work for Medicare? Evidence from the Federal Employees Health Benefits Program. Health Serv Res. 2006;41:17411761.
  2. H.R. 3590. Patient Protection and Affordable Care Act 2010 (2010).
  3. Donabedian A. The quality of care. How can it be assessed? JAMA. 1988;260(12):17431748.
  4. Lake Superior Quality Innovation Network. FY 2017 Value‐Based Purchasing domain weighting. Available at: http://www.stratishealth.org/documents/VBP‐FY2017.pdf. Accessed March 13, 2015.
  5. Hospital Value‐Based Purchasing Program. Available at: http://www.cms.gov/Medicare/Quality‐Initiatives‐Patient‐Assessment‐Instruments/Hospital‐Value‐Based‐Purchasing. Accessed December 1st, 2013.
  6. Jha AK, Orav EJ, Zheng J, Epstein AM. Patients' perception of hospital care in the United States. N Engl J Med. 2008;359(18):19211931.
  7. Porter ME, Lee TH. Providers must lead the way in making value the overarching goal Harvard Bus Rev. October 2013:319.
  8. Jha AK, Orav EJ, Epstein AM. The effect of financial incentives on hospitals that serve poor patients. Ann Intern Med. 2010;153(5):299306.
  9. Joynt KE, Jha AK. Characteristics of hospitals receiving penalties under the Hospital Readmissions Reduction Program. JAMA. 2013;309(4):342343.
  10. Ryan AM. Will value‐based purchasing increase disparities in care? N Engl J Med. 2013;369(26):24722474.
  11. Thorpe KE, Florence CS, Seiber EE. Hospital conversions, margins, and the provision of uncompensated care. Health Aff (Millwood). 2000;19(6):187194.
  12. Borah BJ, Rock MG, Wood DL, Roellinger DL, Johnson MG, Naessens JM. Association between value‐based purchasing score and hospital characteristics. BMC Health Serv Res. 2012;12:464.
  13. Elliott MN, Zaslavsky AM, Goldstein E, et al. Effects of survey mode, patient mix, and nonresponse on CAHPS hospital survey scores. Health Serv Res. 2009;44(2 pt 1):501518.
  14. Burroughs TE, Waterman BM, Cira JC, Desikan R, Claiborne Dunagan W. Patient satisfaction measurement strategies: a comparison of phone and mail methods. Jt Comm J Qual Improv. 2001;27(7):349361.
  15. Fowler FJ, Gallagher PM, Nederend S. Comparing telephone and mail responses to the CAHPS survey instrument. Consumer Assessment of Health Plans Study. Med Care. 1999;37(3 suppl):MS41MS49.
  16. Rodriguez HP, Glahn T, Rogers WH, Chang H, Fanjiang G, Safran DG. Evaluating patients' experiences with individual physicians: a randomized trial of mail, internet, and interactive voice response telephone administration of surveys. Med Care. 2006;44(2):167174.
  17. O'Malley AJ, Zaslavsky AM, Elliott MN, Zaborski L, Cleary PD. Case‐mix adjustment of the CAHPS Hospital Survey. Health Serv Res. 2005;40(6 pt 2):21622181.
  18. Mode and patient‐mix adjustments of CAHPS hospital survey (HCAHPS). Available at: http://www.hcahpsonline.org/modeadjustment.aspx. Accessed December 1, 2013.
  19. Zaslavsky AM, Zaborski LB, Ding L, Shaul JA, Cioffi MJ, Clear PD. Adjusting performance measures to ensure equitable plan comparisons. Health Care Financ Rev. 2001;22(3):109126.
  20. Official Hospital Compare Data. Displaying datasets in Patient Survey Results category. Available at: https://data.medicare.gov/data/hospital‐compare/Patient%20Survey%20Results. Accessed December 1, 2013.
  21. Hospital statistics by state. American Hospital Directory, Inc. website. Available at: http://www.ahd.com/state_statistics.html. Accessed December 1, 2013.
  22. U.S. Census Download Center. Available at: http://factfinder.census.gov/faces/nav/jsf/pages/download_center.xhtml. Accessed December 1, 2013.
References
  1. Florence CS, Atherly A, Thorpe KE. Will choice‐based reform work for Medicare? Evidence from the Federal Employees Health Benefits Program. Health Serv Res. 2006;41:17411761.
  2. H.R. 3590. Patient Protection and Affordable Care Act 2010 (2010).
  3. Donabedian A. The quality of care. How can it be assessed? JAMA. 1988;260(12):17431748.
  4. Lake Superior Quality Innovation Network. FY 2017 Value‐Based Purchasing domain weighting. Available at: http://www.stratishealth.org/documents/VBP‐FY2017.pdf. Accessed March 13, 2015.
  5. Hospital Value‐Based Purchasing Program. Available at: http://www.cms.gov/Medicare/Quality‐Initiatives‐Patient‐Assessment‐Instruments/Hospital‐Value‐Based‐Purchasing. Accessed December 1st, 2013.
  6. Jha AK, Orav EJ, Zheng J, Epstein AM. Patients' perception of hospital care in the United States. N Engl J Med. 2008;359(18):19211931.
  7. Porter ME, Lee TH. Providers must lead the way in making value the overarching goal Harvard Bus Rev. October 2013:319.
  8. Jha AK, Orav EJ, Epstein AM. The effect of financial incentives on hospitals that serve poor patients. Ann Intern Med. 2010;153(5):299306.
  9. Joynt KE, Jha AK. Characteristics of hospitals receiving penalties under the Hospital Readmissions Reduction Program. JAMA. 2013;309(4):342343.
  10. Ryan AM. Will value‐based purchasing increase disparities in care? N Engl J Med. 2013;369(26):24722474.
  11. Thorpe KE, Florence CS, Seiber EE. Hospital conversions, margins, and the provision of uncompensated care. Health Aff (Millwood). 2000;19(6):187194.
  12. Borah BJ, Rock MG, Wood DL, Roellinger DL, Johnson MG, Naessens JM. Association between value‐based purchasing score and hospital characteristics. BMC Health Serv Res. 2012;12:464.
  13. Elliott MN, Zaslavsky AM, Goldstein E, et al. Effects of survey mode, patient mix, and nonresponse on CAHPS hospital survey scores. Health Serv Res. 2009;44(2 pt 1):501518.
  14. Burroughs TE, Waterman BM, Cira JC, Desikan R, Claiborne Dunagan W. Patient satisfaction measurement strategies: a comparison of phone and mail methods. Jt Comm J Qual Improv. 2001;27(7):349361.
  15. Fowler FJ, Gallagher PM, Nederend S. Comparing telephone and mail responses to the CAHPS survey instrument. Consumer Assessment of Health Plans Study. Med Care. 1999;37(3 suppl):MS41MS49.
  16. Rodriguez HP, Glahn T, Rogers WH, Chang H, Fanjiang G, Safran DG. Evaluating patients' experiences with individual physicians: a randomized trial of mail, internet, and interactive voice response telephone administration of surveys. Med Care. 2006;44(2):167174.
  17. O'Malley AJ, Zaslavsky AM, Elliott MN, Zaborski L, Cleary PD. Case‐mix adjustment of the CAHPS Hospital Survey. Health Serv Res. 2005;40(6 pt 2):21622181.
  18. Mode and patient‐mix adjustments of CAHPS hospital survey (HCAHPS). Available at: http://www.hcahpsonline.org/modeadjustment.aspx. Accessed December 1, 2013.
  19. Zaslavsky AM, Zaborski LB, Ding L, Shaul JA, Cioffi MJ, Clear PD. Adjusting performance measures to ensure equitable plan comparisons. Health Care Financ Rev. 2001;22(3):109126.
  20. Official Hospital Compare Data. Displaying datasets in Patient Survey Results category. Available at: https://data.medicare.gov/data/hospital‐compare/Patient%20Survey%20Results. Accessed December 1, 2013.
  21. Hospital statistics by state. American Hospital Directory, Inc. website. Available at: http://www.ahd.com/state_statistics.html. Accessed December 1, 2013.
  22. U.S. Census Download Center. Available at: http://factfinder.census.gov/faces/nav/jsf/pages/download_center.xhtml. Accessed December 1, 2013.
Issue
Journal of Hospital Medicine - 10(8)
Issue
Journal of Hospital Medicine - 10(8)
Page Number
503-509
Page Number
503-509
Article Type
Display Headline
Demographic factors and hospital size predict patient satisfaction variance—implications for hospital value‐based purchasing
Display Headline
Demographic factors and hospital size predict patient satisfaction variance—implications for hospital value‐based purchasing
Sections
Article Source

© 2015 Society of Hospital Medicine

Disallow All Ads
Correspondence Location
Address for correspondence and reprint requests: Daniel McFarland, DO, Hematology/Oncology, Mount Sinai Medical Center, One Gustave L. Levy Place, Box 1079, New York, NY 10029; Telephone: 212–659‐5420; Fax: 212–241‐2684; E‐mail: [email protected]
Content Gating
No Gating (article Unlocked/Free)
Alternative CME
Article PDF Media
Media Files