User login
To improve autism screening rates, researchers in Utah tried a range of interventions.
They added automatic reminders to the electronic health record (EHR). They started using a shorter, more sensitive screening instrument. And they trained clinicians to perform autism-specific evaluations in a primary care clinic.
The researchers found that these interventions were associated with increased rates of autism screening and referrals.
At the same time, they looked at screening and referral rates at other community clinics in their health care system. These clinics incorporated EHR reminders but not all of the other changes.
“The community clinics had an increase in screening frequency with only automatic reminders,” the researchers reported. At the two intervention clinics, however, screening rates increased more than they did at the community clinics. Referrals did not significantly increase at the community clinics.
Kathleen Campbell, MD, MHSc, a pediatric resident at the University of Utah in Salt Lake City, and colleagues described their research in a study published in Pediatrics.
Three phases
They examined more than 12,000 well-child visits for children aged 16-30 months between July 2017 and June 2019.
In all, 4,155 visits occurred at the 2 intervention clinics, and 8,078 visits occurred at the 27 community clinics in the University of Utah health care system.
From baseline through the interventions, the proportion of visits with screening increased by 51% in the intervention clinics (from 58.6% to 88.8%), and by 21% in the community clinics (from 43.4% to 52.4%). The proportion of referrals increased 1.5-fold in intervention clinics, from 1.3% to 3.3%, the authors said.
The American Academy of Pediatrics (AAP) supports screening for autism in all children starting at age 18 months, but “only 44% of children with autism have had a comprehensive autism evaluation before age 36 months,” Dr. Campbell and colleagues wrote.
In their system, about half of the children were being screened for autism, and 0.5% had autism diagnosed.
In an effort to increase the proportion of visits with screening for autism and the proportion of visits with referrals for autism evaluation, Dr. Campbell and colleagues designed a quality improvement study.
Following a baseline period, they implemented interventions in three phases.
Initially, all clinics used the Modified Checklist for Autism in Toddlers, Revised (M-CHAT-R) for autism screening. For the first phase starting in July 2018, the researchers changed the screening instrument at the two intervention clinics to the Parent’s Observation of Social Interaction (POSI). This instrument “is embedded in a broadband developmental screen, is shorter than the M-CHAT-R, and includes questions about the consistency of the child’s behavior,” the authors said. “The POSI has greater sensitivity than the M-CHAT-R ... and similar, although somewhat lower, specificity.”
In intervention phase 2 starting in November 2018, the researchers “added an automatic reminder for autism screening to the EHR health maintenance screen.” Both the intervention clinics and the community clinics received the automatic reminders.
In intervention phase 3 starting in February 2019, they “added a referral option that clinicians could use for rapid access to autism-specific evaluation ... for children who had a POSI result suggestive of autism and for whom the clinician had sufficient concerns about autism that would indicate the need for referral for autism evaluation,” the researchers said.
“Using an online tutorial, we trained three clinicians in the intervention clinics to administer an observational assessment known as the Screening Tool for Autism in Toddlers (STAT),” which requires a 30-minute visit, they said. “Children who had a STAT result suggestive of autism were referred for expedited autism diagnostic evaluation, which was performed by a multidisciplinary team in our university-based developmental assessment clinic. Children who had a STAT result that did not suggest autism did not receive further autism evaluations unless the clinician felt they still needed further evaluation at the developmental clinic.”
After the switch to POSI, the percentage of visits with a positive screen result increased from 4.7% to 13.5% in the intervention clinics.
Furthermore, referrals were 3.4 times more frequent for visits during phase 3 in the intervention clinics, relative to the baseline period.
Potential to overwhelm
“The change to a more sensitive screening instrument increased the frequency of screening results suggestive of autism and informed our improvement team of the need to implement autism evaluation in primary care to avoid overwhelming our referral system,” Dr. Campbell and coauthors reported.
Future studies may assess whether increased screening and referrals speed the time to diagnosis and treatment and improve long-term functional abilities of children with autism. Some children in the study have received an autism diagnosis, while others have not yet been evaluated.
The use of STAT in primary care may be limited by “the barriers of training providers and purchasing materials,” the authors noted. “However, the time-based billing for lengthier appointments and billing for developmental testing help to cover cost.”
The intervention clinics and community clinics were staffed by pediatric providers, including residents and attendings, said Dr. Campbell.
“The staffing is similar at the community and intervention clinics, with mostly pediatricians and some nurse practitioners,” Dr. Campbell said. “One difference is that there are a few family medicine physicians in the community clinics, but we did not study whether that made a difference in screening. At the beginning of the study the approach to screening was the same.”
From the start, the community clinics were screening for autism and referring for further autism evaluation less often than the intervention clinics. “I don’t know why they were screening less, but they did improve with the automatic reminders,” said Dr. Campbell. “We didn’t examine type of provider or type of practice in this study, but the literature suggests that family physicians do not screen for autism as often as pediatricians.”
Payment and referral challenges
In theory, the approach in the study is a great idea, but it may not be feasible to implement for many private practices, said Herschel Lessin, MD. Dr. Lessin is a senior partner of the Children’s Medical Group in New York.
“We desperately need autism screening in a primary care setting,” Dr. Lessin said. “These authors found that wasn’t being done as recommended by the AAP Bright Futures, which is a problem.”
However, the researchers incorporated the interventions in a health care system with “far more resources than most people in practice would ever have” and substituted a less familiar screening tool.
In addition, the ability to use confirmatory STAT for primary care evaluations may be limited. “Unless you can find pediatricians willing to commit 30 to 45 minutes on one of these evaluations ... few are going to do that,” he said.
“The whole problem is that there are no referrals available or very few referrals available, and that insurance payments so underpay for developmental screening and evaluation that it does not justify the time doing it, so a lot of doctors are unable to do it,” said Dr. Lessin. When a referral is warranted, developmental pediatricians may have 6- to 12-month waiting lists, he said.
“For people in clinical practice, this is not news,” Dr. Lessin said. “We know we should screen for autism. The problem is it’s time consuming. Nobody pays for it. We have no place to send them even when we are suspicious.”
From screening to diagnosis to treatment
“Autism screen approaches vary but with educational efforts on the part of the AAP, CDC, and family organizations the rates for autism screening have dramatically improved,” said Susan L. Hyman, MD, professor of pediatrics at the University of Rochester in New York. “I do not know if screening rates have been impacted by COVID.”
Dr. Hyman and coauthors wrote an AAP clinical report on the identification, evaluation, and management of children with autism spectrum disorder. The report was published in the January 2020 issue of Pediatrics.
After screening and diagnostic testing, patients most importantly need to be able to access “timely and equitable evidence-based intervention,” which should be available, said Dr. Hyman.
Although researchers have proposed training primary care providers in autism diagnostics, “older, more complex patients with co-occurring behavioral health or other developmental disorders may need more specialized diagnostic assessment than could be accomplished in a primary care setting,” Dr. Hyman added.
“However, it is very important to identify children with therapeutic needs as early as possible and move them through the continuum from screening to diagnosis to treatment in a timely fashion. It would be wonderful if symptoms could be addressed without the need for diagnosis in the very youngest children,” Dr. Hyman said. “Early symptoms, even if not autism, are likely to be appropriate for intervention – whether it is speech therapy, attention to food selectivity, sleep problems – things that impact quality of life and potential future symptoms.”
The research was supported by the Utah Stimulating Access to Research in Residency Transition Scholar award, which is funded by the National Institutes of Health.
Dr. Campbell is an inventor on a patent related to screening for autism. The study authors otherwise had no disclosures. Dr. Lessin is on the editorial advisory board for Pediatric News and is on an advisory board for Cognoa, which is developing a medical device to diagnose autism and he is also the co-editor of the AAP's current ADHD Toolkit. Dr. Hyman had no relevant financial disclosures.
*This story was updated on Feb. 11, 2021.
To improve autism screening rates, researchers in Utah tried a range of interventions.
They added automatic reminders to the electronic health record (EHR). They started using a shorter, more sensitive screening instrument. And they trained clinicians to perform autism-specific evaluations in a primary care clinic.
The researchers found that these interventions were associated with increased rates of autism screening and referrals.
At the same time, they looked at screening and referral rates at other community clinics in their health care system. These clinics incorporated EHR reminders but not all of the other changes.
“The community clinics had an increase in screening frequency with only automatic reminders,” the researchers reported. At the two intervention clinics, however, screening rates increased more than they did at the community clinics. Referrals did not significantly increase at the community clinics.
Kathleen Campbell, MD, MHSc, a pediatric resident at the University of Utah in Salt Lake City, and colleagues described their research in a study published in Pediatrics.
Three phases
They examined more than 12,000 well-child visits for children aged 16-30 months between July 2017 and June 2019.
In all, 4,155 visits occurred at the 2 intervention clinics, and 8,078 visits occurred at the 27 community clinics in the University of Utah health care system.
From baseline through the interventions, the proportion of visits with screening increased by 51% in the intervention clinics (from 58.6% to 88.8%), and by 21% in the community clinics (from 43.4% to 52.4%). The proportion of referrals increased 1.5-fold in intervention clinics, from 1.3% to 3.3%, the authors said.
The American Academy of Pediatrics (AAP) supports screening for autism in all children starting at age 18 months, but “only 44% of children with autism have had a comprehensive autism evaluation before age 36 months,” Dr. Campbell and colleagues wrote.
In their system, about half of the children were being screened for autism, and 0.5% had autism diagnosed.
In an effort to increase the proportion of visits with screening for autism and the proportion of visits with referrals for autism evaluation, Dr. Campbell and colleagues designed a quality improvement study.
Following a baseline period, they implemented interventions in three phases.
Initially, all clinics used the Modified Checklist for Autism in Toddlers, Revised (M-CHAT-R) for autism screening. For the first phase starting in July 2018, the researchers changed the screening instrument at the two intervention clinics to the Parent’s Observation of Social Interaction (POSI). This instrument “is embedded in a broadband developmental screen, is shorter than the M-CHAT-R, and includes questions about the consistency of the child’s behavior,” the authors said. “The POSI has greater sensitivity than the M-CHAT-R ... and similar, although somewhat lower, specificity.”
In intervention phase 2 starting in November 2018, the researchers “added an automatic reminder for autism screening to the EHR health maintenance screen.” Both the intervention clinics and the community clinics received the automatic reminders.
In intervention phase 3 starting in February 2019, they “added a referral option that clinicians could use for rapid access to autism-specific evaluation ... for children who had a POSI result suggestive of autism and for whom the clinician had sufficient concerns about autism that would indicate the need for referral for autism evaluation,” the researchers said.
“Using an online tutorial, we trained three clinicians in the intervention clinics to administer an observational assessment known as the Screening Tool for Autism in Toddlers (STAT),” which requires a 30-minute visit, they said. “Children who had a STAT result suggestive of autism were referred for expedited autism diagnostic evaluation, which was performed by a multidisciplinary team in our university-based developmental assessment clinic. Children who had a STAT result that did not suggest autism did not receive further autism evaluations unless the clinician felt they still needed further evaluation at the developmental clinic.”
After the switch to POSI, the percentage of visits with a positive screen result increased from 4.7% to 13.5% in the intervention clinics.
Furthermore, referrals were 3.4 times more frequent for visits during phase 3 in the intervention clinics, relative to the baseline period.
Potential to overwhelm
“The change to a more sensitive screening instrument increased the frequency of screening results suggestive of autism and informed our improvement team of the need to implement autism evaluation in primary care to avoid overwhelming our referral system,” Dr. Campbell and coauthors reported.
Future studies may assess whether increased screening and referrals speed the time to diagnosis and treatment and improve long-term functional abilities of children with autism. Some children in the study have received an autism diagnosis, while others have not yet been evaluated.
The use of STAT in primary care may be limited by “the barriers of training providers and purchasing materials,” the authors noted. “However, the time-based billing for lengthier appointments and billing for developmental testing help to cover cost.”
The intervention clinics and community clinics were staffed by pediatric providers, including residents and attendings, said Dr. Campbell.
“The staffing is similar at the community and intervention clinics, with mostly pediatricians and some nurse practitioners,” Dr. Campbell said. “One difference is that there are a few family medicine physicians in the community clinics, but we did not study whether that made a difference in screening. At the beginning of the study the approach to screening was the same.”
From the start, the community clinics were screening for autism and referring for further autism evaluation less often than the intervention clinics. “I don’t know why they were screening less, but they did improve with the automatic reminders,” said Dr. Campbell. “We didn’t examine type of provider or type of practice in this study, but the literature suggests that family physicians do not screen for autism as often as pediatricians.”
Payment and referral challenges
In theory, the approach in the study is a great idea, but it may not be feasible to implement for many private practices, said Herschel Lessin, MD. Dr. Lessin is a senior partner of the Children’s Medical Group in New York.
“We desperately need autism screening in a primary care setting,” Dr. Lessin said. “These authors found that wasn’t being done as recommended by the AAP Bright Futures, which is a problem.”
However, the researchers incorporated the interventions in a health care system with “far more resources than most people in practice would ever have” and substituted a less familiar screening tool.
In addition, the ability to use confirmatory STAT for primary care evaluations may be limited. “Unless you can find pediatricians willing to commit 30 to 45 minutes on one of these evaluations ... few are going to do that,” he said.
“The whole problem is that there are no referrals available or very few referrals available, and that insurance payments so underpay for developmental screening and evaluation that it does not justify the time doing it, so a lot of doctors are unable to do it,” said Dr. Lessin. When a referral is warranted, developmental pediatricians may have 6- to 12-month waiting lists, he said.
“For people in clinical practice, this is not news,” Dr. Lessin said. “We know we should screen for autism. The problem is it’s time consuming. Nobody pays for it. We have no place to send them even when we are suspicious.”
From screening to diagnosis to treatment
“Autism screen approaches vary but with educational efforts on the part of the AAP, CDC, and family organizations the rates for autism screening have dramatically improved,” said Susan L. Hyman, MD, professor of pediatrics at the University of Rochester in New York. “I do not know if screening rates have been impacted by COVID.”
Dr. Hyman and coauthors wrote an AAP clinical report on the identification, evaluation, and management of children with autism spectrum disorder. The report was published in the January 2020 issue of Pediatrics.
After screening and diagnostic testing, patients most importantly need to be able to access “timely and equitable evidence-based intervention,” which should be available, said Dr. Hyman.
Although researchers have proposed training primary care providers in autism diagnostics, “older, more complex patients with co-occurring behavioral health or other developmental disorders may need more specialized diagnostic assessment than could be accomplished in a primary care setting,” Dr. Hyman added.
“However, it is very important to identify children with therapeutic needs as early as possible and move them through the continuum from screening to diagnosis to treatment in a timely fashion. It would be wonderful if symptoms could be addressed without the need for diagnosis in the very youngest children,” Dr. Hyman said. “Early symptoms, even if not autism, are likely to be appropriate for intervention – whether it is speech therapy, attention to food selectivity, sleep problems – things that impact quality of life and potential future symptoms.”
The research was supported by the Utah Stimulating Access to Research in Residency Transition Scholar award, which is funded by the National Institutes of Health.
Dr. Campbell is an inventor on a patent related to screening for autism. The study authors otherwise had no disclosures. Dr. Lessin is on the editorial advisory board for Pediatric News and is on an advisory board for Cognoa, which is developing a medical device to diagnose autism and he is also the co-editor of the AAP's current ADHD Toolkit. Dr. Hyman had no relevant financial disclosures.
*This story was updated on Feb. 11, 2021.
To improve autism screening rates, researchers in Utah tried a range of interventions.
They added automatic reminders to the electronic health record (EHR). They started using a shorter, more sensitive screening instrument. And they trained clinicians to perform autism-specific evaluations in a primary care clinic.
The researchers found that these interventions were associated with increased rates of autism screening and referrals.
At the same time, they looked at screening and referral rates at other community clinics in their health care system. These clinics incorporated EHR reminders but not all of the other changes.
“The community clinics had an increase in screening frequency with only automatic reminders,” the researchers reported. At the two intervention clinics, however, screening rates increased more than they did at the community clinics. Referrals did not significantly increase at the community clinics.
Kathleen Campbell, MD, MHSc, a pediatric resident at the University of Utah in Salt Lake City, and colleagues described their research in a study published in Pediatrics.
Three phases
They examined more than 12,000 well-child visits for children aged 16-30 months between July 2017 and June 2019.
In all, 4,155 visits occurred at the 2 intervention clinics, and 8,078 visits occurred at the 27 community clinics in the University of Utah health care system.
From baseline through the interventions, the proportion of visits with screening increased by 51% in the intervention clinics (from 58.6% to 88.8%), and by 21% in the community clinics (from 43.4% to 52.4%). The proportion of referrals increased 1.5-fold in intervention clinics, from 1.3% to 3.3%, the authors said.
The American Academy of Pediatrics (AAP) supports screening for autism in all children starting at age 18 months, but “only 44% of children with autism have had a comprehensive autism evaluation before age 36 months,” Dr. Campbell and colleagues wrote.
In their system, about half of the children were being screened for autism, and 0.5% had autism diagnosed.
In an effort to increase the proportion of visits with screening for autism and the proportion of visits with referrals for autism evaluation, Dr. Campbell and colleagues designed a quality improvement study.
Following a baseline period, they implemented interventions in three phases.
Initially, all clinics used the Modified Checklist for Autism in Toddlers, Revised (M-CHAT-R) for autism screening. For the first phase starting in July 2018, the researchers changed the screening instrument at the two intervention clinics to the Parent’s Observation of Social Interaction (POSI). This instrument “is embedded in a broadband developmental screen, is shorter than the M-CHAT-R, and includes questions about the consistency of the child’s behavior,” the authors said. “The POSI has greater sensitivity than the M-CHAT-R ... and similar, although somewhat lower, specificity.”
In intervention phase 2 starting in November 2018, the researchers “added an automatic reminder for autism screening to the EHR health maintenance screen.” Both the intervention clinics and the community clinics received the automatic reminders.
In intervention phase 3 starting in February 2019, they “added a referral option that clinicians could use for rapid access to autism-specific evaluation ... for children who had a POSI result suggestive of autism and for whom the clinician had sufficient concerns about autism that would indicate the need for referral for autism evaluation,” the researchers said.
“Using an online tutorial, we trained three clinicians in the intervention clinics to administer an observational assessment known as the Screening Tool for Autism in Toddlers (STAT),” which requires a 30-minute visit, they said. “Children who had a STAT result suggestive of autism were referred for expedited autism diagnostic evaluation, which was performed by a multidisciplinary team in our university-based developmental assessment clinic. Children who had a STAT result that did not suggest autism did not receive further autism evaluations unless the clinician felt they still needed further evaluation at the developmental clinic.”
After the switch to POSI, the percentage of visits with a positive screen result increased from 4.7% to 13.5% in the intervention clinics.
Furthermore, referrals were 3.4 times more frequent for visits during phase 3 in the intervention clinics, relative to the baseline period.
Potential to overwhelm
“The change to a more sensitive screening instrument increased the frequency of screening results suggestive of autism and informed our improvement team of the need to implement autism evaluation in primary care to avoid overwhelming our referral system,” Dr. Campbell and coauthors reported.
Future studies may assess whether increased screening and referrals speed the time to diagnosis and treatment and improve long-term functional abilities of children with autism. Some children in the study have received an autism diagnosis, while others have not yet been evaluated.
The use of STAT in primary care may be limited by “the barriers of training providers and purchasing materials,” the authors noted. “However, the time-based billing for lengthier appointments and billing for developmental testing help to cover cost.”
The intervention clinics and community clinics were staffed by pediatric providers, including residents and attendings, said Dr. Campbell.
“The staffing is similar at the community and intervention clinics, with mostly pediatricians and some nurse practitioners,” Dr. Campbell said. “One difference is that there are a few family medicine physicians in the community clinics, but we did not study whether that made a difference in screening. At the beginning of the study the approach to screening was the same.”
From the start, the community clinics were screening for autism and referring for further autism evaluation less often than the intervention clinics. “I don’t know why they were screening less, but they did improve with the automatic reminders,” said Dr. Campbell. “We didn’t examine type of provider or type of practice in this study, but the literature suggests that family physicians do not screen for autism as often as pediatricians.”
Payment and referral challenges
In theory, the approach in the study is a great idea, but it may not be feasible to implement for many private practices, said Herschel Lessin, MD. Dr. Lessin is a senior partner of the Children’s Medical Group in New York.
“We desperately need autism screening in a primary care setting,” Dr. Lessin said. “These authors found that wasn’t being done as recommended by the AAP Bright Futures, which is a problem.”
However, the researchers incorporated the interventions in a health care system with “far more resources than most people in practice would ever have” and substituted a less familiar screening tool.
In addition, the ability to use confirmatory STAT for primary care evaluations may be limited. “Unless you can find pediatricians willing to commit 30 to 45 minutes on one of these evaluations ... few are going to do that,” he said.
“The whole problem is that there are no referrals available or very few referrals available, and that insurance payments so underpay for developmental screening and evaluation that it does not justify the time doing it, so a lot of doctors are unable to do it,” said Dr. Lessin. When a referral is warranted, developmental pediatricians may have 6- to 12-month waiting lists, he said.
“For people in clinical practice, this is not news,” Dr. Lessin said. “We know we should screen for autism. The problem is it’s time consuming. Nobody pays for it. We have no place to send them even when we are suspicious.”
From screening to diagnosis to treatment
“Autism screen approaches vary but with educational efforts on the part of the AAP, CDC, and family organizations the rates for autism screening have dramatically improved,” said Susan L. Hyman, MD, professor of pediatrics at the University of Rochester in New York. “I do not know if screening rates have been impacted by COVID.”
Dr. Hyman and coauthors wrote an AAP clinical report on the identification, evaluation, and management of children with autism spectrum disorder. The report was published in the January 2020 issue of Pediatrics.
After screening and diagnostic testing, patients most importantly need to be able to access “timely and equitable evidence-based intervention,” which should be available, said Dr. Hyman.
Although researchers have proposed training primary care providers in autism diagnostics, “older, more complex patients with co-occurring behavioral health or other developmental disorders may need more specialized diagnostic assessment than could be accomplished in a primary care setting,” Dr. Hyman added.
“However, it is very important to identify children with therapeutic needs as early as possible and move them through the continuum from screening to diagnosis to treatment in a timely fashion. It would be wonderful if symptoms could be addressed without the need for diagnosis in the very youngest children,” Dr. Hyman said. “Early symptoms, even if not autism, are likely to be appropriate for intervention – whether it is speech therapy, attention to food selectivity, sleep problems – things that impact quality of life and potential future symptoms.”
The research was supported by the Utah Stimulating Access to Research in Residency Transition Scholar award, which is funded by the National Institutes of Health.
Dr. Campbell is an inventor on a patent related to screening for autism. The study authors otherwise had no disclosures. Dr. Lessin is on the editorial advisory board for Pediatric News and is on an advisory board for Cognoa, which is developing a medical device to diagnose autism and he is also the co-editor of the AAP's current ADHD Toolkit. Dr. Hyman had no relevant financial disclosures.
*This story was updated on Feb. 11, 2021.
FROM PEDIATRICS