User login
“Anyone who has been to a doctor’s office recently realizes that everyone there is very busy,” said David P. Miller Jr., MD, lead author of the paper published in JAMA Network Open, in an interview. “For our study, we programmed routine screening questions that nursing staff were asking at every visit into an app [called mPATH] that patients used on check-in.”
In particular, screening for depression, injurious falls, or intimate partner violence in a primary care setting is hampered not only by time constraints, but also staff discomfort and patients’ reluctance to disclose sensitive information, Dr. Miller of Wake Forest University, Winston-Salem, N.C., and colleagues explained in their paper.
Study methods and results
The researchers tested the app in three family practices and three internal medicine practices. They compared whether more patients were identified with depression, intimate partner violence, or fall risk in the 60 days of using the tablet-based app, compared with the 60-day period before introduction of the app, when nursing staff asked screening questions verbally. Patients were given the tablet and app to use at check-in, and results went into an electronic health record.
The study population included 23,026 individuals, aged 18 years and older who were seen between June 2019 and February 2020.
The post-app period was shortened to 30 days for the last two enrolled practices to avoid confounding from COVID-19, the researchers noted.
The primary outcome of the study was the proportion of patients who screened positive for a composite of depression, fall risk, or intimate partner violence.
“We found that [the app] significantly outperformed nursing staff in terms of detecting patients with depression or safety concerns,” Dr. Miller said in an interview. “By saving nurses time, we hope they can use the saved time to address patients’ identified concerns.”
Overall, the proportion of patients who screened positive for the composite outcome of depression, fall risk, or intimate partner violence increased from 8.7% to 19.5%. Increases were noted across all six participating clinics.
When broken out separately, the proportion of patients who screened positive for depression, based on Patient Health Questionnaire-2 scores of 2 or higher, increased from 1.5% to 4.2% from before to after the introduction of the tablet-based app. The proportion of patients screening positive for fall risk increased from 7.4% to 15.7%, and the proportion who screened positive for intimate partner violence increased from 0.1% to 2.9%.
Patient demographics were similar for the two time periods. Overall, 57.9% of patients were female, 80.5% were non-Hispanic White, and 13.5% were Black or African American. Patients ranged in age from 18-102 years, with a mean age of 59.7 years.
The association of app use on the primary outcome remained the same (adjusted odds ratio, 2.6) after accounting for patient characteristics.
Real-world setting supports clinical value
“One of the strengths of our study is that the mPATH app was delivered as usual care in the primary care clinics,” Dr. Miller said in an interview. “In other words, we relied entirely on clinical staff to hand the app to patients and transmit the screening results to the electronic health record. This allowed us to see how self-administered screening performs in the real world rather than in a research setting,” he said. “Another strength is our large sample size. We included more than 23,000 patients who were seen at one of six community-based primary care practices.”
“A few other studies have compared electronic self-administered screening with verbal screening, mainly in the areas of intimate partner violence or sexual health,” Dr. Miller noted. “However, these studies were administered by research staff and only included patients agreeing to be in a research study, which leaves many people out. What makes our study unique is that the primary care practices were using the self-screening app as part of their routine care,” he said.
“By analyzing deidentified data, we could see how self-administered screening compares to verbal screening among all patients in a real-world setting,” he added.
“We found that self-administered screening significantly outperforms verbal screening by clinical staff. Over twice as many patients with depression, fall risk, or intimate partner violence were identified by the app, compared to verbal screening,” said Dr. Miller. “We hope that clinics will look for ways to incorporate electronic self-screening in their usual processes. Self-administered screening not only saves staff time, but it does a much better job identifying patients with needs,” he said.
“The next step will be identifying the best way to incorporate digital health apps like mPATH into usual workflows,” Dr. Miller said. “We are currently conducting an implementation science trial of the mPATH app to learn this.”
App allows patients privacy in responses
“The study is important for assessing the physical and mental well-being of patients at all health care practices in general and in primary care practices in particular, said Noel Deep, MD, a general internist in group practice in Antigo, Wisc., in an interview. “This study provides the data that can be leveraged to provide this type of virtual or electronic options for patients to answer these sensitive questions,” he said.
“It provides them the opportunity to answer the questions truthfully and without fear of being judged by the staff who traditionally ask these questions,” he emphasized.
Dr. Deep was not surprised by the study outcomes.
“Almost all primary care practices administer these questionnaires to their patients, whether at their annual wellness exams or the Medicare wellness exams,” he said. “Many times, the staff asking these questions might introduce some of their personal bias or not ask the questions in a nonjudgmental manner, which may not elicit the right answers from the patients.”
The clinical value of the study is that it prompts physicians and health care organizations to consider adopting other modalities to collect screening information “that is comfortable to the patients, reproducible, patient-friendly, easily accessed by the patients and reviewable by their physicians, and, more importantly is private and maintains patient confidentiality,” said Dr. Deep.
Study needs to be replicated in rural, small communities
“I would like to see the study done among more diverse ethnic, age, socioeconomic, education, geographic, and physician practice–size populations,” which would reinforce the value of the tablet-based app if such studies yielded similar results, Dr. Deep said.
Privacy is especially important for practices in smaller communities/rural communities, such as the one where Dr. Deep practices, as everyone knows everyone in these kinds of places, he said.
“I understand that we are all sworn to maintaining patient confidentiality, but that may not be what the patients perceive. That is why I would like to see what the study finds in rural or small communities,” Dr. Deep explained.
The study was supported by the National Cancer Institute. Dr. Miller and coauthor Dr. Ajay Dharod are the coinventors of the mPATH app, and they and Wake Forest University Health Sciences have an ownership interest should the app be commercialized. Dr. Deep had no financial conflicts to disclose.
“Anyone who has been to a doctor’s office recently realizes that everyone there is very busy,” said David P. Miller Jr., MD, lead author of the paper published in JAMA Network Open, in an interview. “For our study, we programmed routine screening questions that nursing staff were asking at every visit into an app [called mPATH] that patients used on check-in.”
In particular, screening for depression, injurious falls, or intimate partner violence in a primary care setting is hampered not only by time constraints, but also staff discomfort and patients’ reluctance to disclose sensitive information, Dr. Miller of Wake Forest University, Winston-Salem, N.C., and colleagues explained in their paper.
Study methods and results
The researchers tested the app in three family practices and three internal medicine practices. They compared whether more patients were identified with depression, intimate partner violence, or fall risk in the 60 days of using the tablet-based app, compared with the 60-day period before introduction of the app, when nursing staff asked screening questions verbally. Patients were given the tablet and app to use at check-in, and results went into an electronic health record.
The study population included 23,026 individuals, aged 18 years and older who were seen between June 2019 and February 2020.
The post-app period was shortened to 30 days for the last two enrolled practices to avoid confounding from COVID-19, the researchers noted.
The primary outcome of the study was the proportion of patients who screened positive for a composite of depression, fall risk, or intimate partner violence.
“We found that [the app] significantly outperformed nursing staff in terms of detecting patients with depression or safety concerns,” Dr. Miller said in an interview. “By saving nurses time, we hope they can use the saved time to address patients’ identified concerns.”
Overall, the proportion of patients who screened positive for the composite outcome of depression, fall risk, or intimate partner violence increased from 8.7% to 19.5%. Increases were noted across all six participating clinics.
When broken out separately, the proportion of patients who screened positive for depression, based on Patient Health Questionnaire-2 scores of 2 or higher, increased from 1.5% to 4.2% from before to after the introduction of the tablet-based app. The proportion of patients screening positive for fall risk increased from 7.4% to 15.7%, and the proportion who screened positive for intimate partner violence increased from 0.1% to 2.9%.
Patient demographics were similar for the two time periods. Overall, 57.9% of patients were female, 80.5% were non-Hispanic White, and 13.5% were Black or African American. Patients ranged in age from 18-102 years, with a mean age of 59.7 years.
The association of app use on the primary outcome remained the same (adjusted odds ratio, 2.6) after accounting for patient characteristics.
Real-world setting supports clinical value
“One of the strengths of our study is that the mPATH app was delivered as usual care in the primary care clinics,” Dr. Miller said in an interview. “In other words, we relied entirely on clinical staff to hand the app to patients and transmit the screening results to the electronic health record. This allowed us to see how self-administered screening performs in the real world rather than in a research setting,” he said. “Another strength is our large sample size. We included more than 23,000 patients who were seen at one of six community-based primary care practices.”
“A few other studies have compared electronic self-administered screening with verbal screening, mainly in the areas of intimate partner violence or sexual health,” Dr. Miller noted. “However, these studies were administered by research staff and only included patients agreeing to be in a research study, which leaves many people out. What makes our study unique is that the primary care practices were using the self-screening app as part of their routine care,” he said.
“By analyzing deidentified data, we could see how self-administered screening compares to verbal screening among all patients in a real-world setting,” he added.
“We found that self-administered screening significantly outperforms verbal screening by clinical staff. Over twice as many patients with depression, fall risk, or intimate partner violence were identified by the app, compared to verbal screening,” said Dr. Miller. “We hope that clinics will look for ways to incorporate electronic self-screening in their usual processes. Self-administered screening not only saves staff time, but it does a much better job identifying patients with needs,” he said.
“The next step will be identifying the best way to incorporate digital health apps like mPATH into usual workflows,” Dr. Miller said. “We are currently conducting an implementation science trial of the mPATH app to learn this.”
App allows patients privacy in responses
“The study is important for assessing the physical and mental well-being of patients at all health care practices in general and in primary care practices in particular, said Noel Deep, MD, a general internist in group practice in Antigo, Wisc., in an interview. “This study provides the data that can be leveraged to provide this type of virtual or electronic options for patients to answer these sensitive questions,” he said.
“It provides them the opportunity to answer the questions truthfully and without fear of being judged by the staff who traditionally ask these questions,” he emphasized.
Dr. Deep was not surprised by the study outcomes.
“Almost all primary care practices administer these questionnaires to their patients, whether at their annual wellness exams or the Medicare wellness exams,” he said. “Many times, the staff asking these questions might introduce some of their personal bias or not ask the questions in a nonjudgmental manner, which may not elicit the right answers from the patients.”
The clinical value of the study is that it prompts physicians and health care organizations to consider adopting other modalities to collect screening information “that is comfortable to the patients, reproducible, patient-friendly, easily accessed by the patients and reviewable by their physicians, and, more importantly is private and maintains patient confidentiality,” said Dr. Deep.
Study needs to be replicated in rural, small communities
“I would like to see the study done among more diverse ethnic, age, socioeconomic, education, geographic, and physician practice–size populations,” which would reinforce the value of the tablet-based app if such studies yielded similar results, Dr. Deep said.
Privacy is especially important for practices in smaller communities/rural communities, such as the one where Dr. Deep practices, as everyone knows everyone in these kinds of places, he said.
“I understand that we are all sworn to maintaining patient confidentiality, but that may not be what the patients perceive. That is why I would like to see what the study finds in rural or small communities,” Dr. Deep explained.
The study was supported by the National Cancer Institute. Dr. Miller and coauthor Dr. Ajay Dharod are the coinventors of the mPATH app, and they and Wake Forest University Health Sciences have an ownership interest should the app be commercialized. Dr. Deep had no financial conflicts to disclose.
“Anyone who has been to a doctor’s office recently realizes that everyone there is very busy,” said David P. Miller Jr., MD, lead author of the paper published in JAMA Network Open, in an interview. “For our study, we programmed routine screening questions that nursing staff were asking at every visit into an app [called mPATH] that patients used on check-in.”
In particular, screening for depression, injurious falls, or intimate partner violence in a primary care setting is hampered not only by time constraints, but also staff discomfort and patients’ reluctance to disclose sensitive information, Dr. Miller of Wake Forest University, Winston-Salem, N.C., and colleagues explained in their paper.
Study methods and results
The researchers tested the app in three family practices and three internal medicine practices. They compared whether more patients were identified with depression, intimate partner violence, or fall risk in the 60 days of using the tablet-based app, compared with the 60-day period before introduction of the app, when nursing staff asked screening questions verbally. Patients were given the tablet and app to use at check-in, and results went into an electronic health record.
The study population included 23,026 individuals, aged 18 years and older who were seen between June 2019 and February 2020.
The post-app period was shortened to 30 days for the last two enrolled practices to avoid confounding from COVID-19, the researchers noted.
The primary outcome of the study was the proportion of patients who screened positive for a composite of depression, fall risk, or intimate partner violence.
“We found that [the app] significantly outperformed nursing staff in terms of detecting patients with depression or safety concerns,” Dr. Miller said in an interview. “By saving nurses time, we hope they can use the saved time to address patients’ identified concerns.”
Overall, the proportion of patients who screened positive for the composite outcome of depression, fall risk, or intimate partner violence increased from 8.7% to 19.5%. Increases were noted across all six participating clinics.
When broken out separately, the proportion of patients who screened positive for depression, based on Patient Health Questionnaire-2 scores of 2 or higher, increased from 1.5% to 4.2% from before to after the introduction of the tablet-based app. The proportion of patients screening positive for fall risk increased from 7.4% to 15.7%, and the proportion who screened positive for intimate partner violence increased from 0.1% to 2.9%.
Patient demographics were similar for the two time periods. Overall, 57.9% of patients were female, 80.5% were non-Hispanic White, and 13.5% were Black or African American. Patients ranged in age from 18-102 years, with a mean age of 59.7 years.
The association of app use on the primary outcome remained the same (adjusted odds ratio, 2.6) after accounting for patient characteristics.
Real-world setting supports clinical value
“One of the strengths of our study is that the mPATH app was delivered as usual care in the primary care clinics,” Dr. Miller said in an interview. “In other words, we relied entirely on clinical staff to hand the app to patients and transmit the screening results to the electronic health record. This allowed us to see how self-administered screening performs in the real world rather than in a research setting,” he said. “Another strength is our large sample size. We included more than 23,000 patients who were seen at one of six community-based primary care practices.”
“A few other studies have compared electronic self-administered screening with verbal screening, mainly in the areas of intimate partner violence or sexual health,” Dr. Miller noted. “However, these studies were administered by research staff and only included patients agreeing to be in a research study, which leaves many people out. What makes our study unique is that the primary care practices were using the self-screening app as part of their routine care,” he said.
“By analyzing deidentified data, we could see how self-administered screening compares to verbal screening among all patients in a real-world setting,” he added.
“We found that self-administered screening significantly outperforms verbal screening by clinical staff. Over twice as many patients with depression, fall risk, or intimate partner violence were identified by the app, compared to verbal screening,” said Dr. Miller. “We hope that clinics will look for ways to incorporate electronic self-screening in their usual processes. Self-administered screening not only saves staff time, but it does a much better job identifying patients with needs,” he said.
“The next step will be identifying the best way to incorporate digital health apps like mPATH into usual workflows,” Dr. Miller said. “We are currently conducting an implementation science trial of the mPATH app to learn this.”
App allows patients privacy in responses
“The study is important for assessing the physical and mental well-being of patients at all health care practices in general and in primary care practices in particular, said Noel Deep, MD, a general internist in group practice in Antigo, Wisc., in an interview. “This study provides the data that can be leveraged to provide this type of virtual or electronic options for patients to answer these sensitive questions,” he said.
“It provides them the opportunity to answer the questions truthfully and without fear of being judged by the staff who traditionally ask these questions,” he emphasized.
Dr. Deep was not surprised by the study outcomes.
“Almost all primary care practices administer these questionnaires to their patients, whether at their annual wellness exams or the Medicare wellness exams,” he said. “Many times, the staff asking these questions might introduce some of their personal bias or not ask the questions in a nonjudgmental manner, which may not elicit the right answers from the patients.”
The clinical value of the study is that it prompts physicians and health care organizations to consider adopting other modalities to collect screening information “that is comfortable to the patients, reproducible, patient-friendly, easily accessed by the patients and reviewable by their physicians, and, more importantly is private and maintains patient confidentiality,” said Dr. Deep.
Study needs to be replicated in rural, small communities
“I would like to see the study done among more diverse ethnic, age, socioeconomic, education, geographic, and physician practice–size populations,” which would reinforce the value of the tablet-based app if such studies yielded similar results, Dr. Deep said.
Privacy is especially important for practices in smaller communities/rural communities, such as the one where Dr. Deep practices, as everyone knows everyone in these kinds of places, he said.
“I understand that we are all sworn to maintaining patient confidentiality, but that may not be what the patients perceive. That is why I would like to see what the study finds in rural or small communities,” Dr. Deep explained.
The study was supported by the National Cancer Institute. Dr. Miller and coauthor Dr. Ajay Dharod are the coinventors of the mPATH app, and they and Wake Forest University Health Sciences have an ownership interest should the app be commercialized. Dr. Deep had no financial conflicts to disclose.
FROM JAMA NETWORK OPEN