Introduction
Attention-deficit/hyperactivity disorder (ADHD) and autism spectrum disorder (ASD) are impairing, persistent and heritable neurodevelopmental disorders (APA,
2013) that share some genetic (Ghirardi et al.,
2019; Lee et al.,
2019; Polderman et al.,
2014) and neural features (Boedhoe et al.,
2020). However, it is not clear whether these disorders share neurocognitive profiles (Antshel & Russo,
2019). Delineating neurocognitive profiles for ADHD and ASD could aid diagnosis, clarify whether ADHD found in ASD is a phenocopy of ADHD and advance understanding of disorder mechanisms (Chang et al.,
2020; Glahn et al.,
2014). To date, most conclusions about the neurocognitive profiles of ADHD and ASD have been derived from indirect comparisons of each disorder with typically developing controls (e.g., ADHD versus controls–Lipszyc & Schachar,
2010; Pievsky & McGrath,
2018; Pineda-Alhucema et al.,
2018; Wright et al.,
2014 and ASD versus controls–Demetriou et al.,
2018; Kaur & Pany,
2020). Results from these indirect comparisons suggest that ADHD, but not ASD, is characterized by poor response inhibition (Antshel & Russo,
2019; Corbett et al.,
2009; Craig et al.,
2015; Sinzig et al.,
2009) and poorer sustained attention (reflected in greater reaction time variability–RTV), whereas those with ASD have worse cognitive flexibility and planning (Craig et al.,
2015; Happé et al.,
2006; Hosenbocus & Chahal,
2012; Lukito et al.,
2020; Salcedo-Marin et al.,
2013).
More compelling evidence for the uniqueness of the neurocognitive profiles of ASD and ADHD would come from direct comparisons that would allow control over variations in task conditions, performance metrics, testing environments (e.g., in a neuroimaging scanner) and demographic variables including age, sex, and medication status during testing (Buti et al.,
2011). Importantly, direct comparison allows for systematic control over comorbidity, which is common between ASD and ADHD. ADHD is the most common comorbidity of ASD with comorbidity estimates of 40–70% (Brookman-Frazee et al.,
2018; Joshi et al.,
2017; Lyall et al.,
2017). Subthreshold ADHD traits are also common in ASD (Pehlivanidis et al.,
2020). While ASD traits are evident in ADHD, they are less common than ADHD traits in ASD (Nijmeijer et al.,
2009; Rommelse et al.,
2010). Given the well-established literature on neurocognitive impairment in ADHD such as in response inhibition and sustained attention (Karalunas et al.,
2014; Pievsky & McGrath,
2018), failure to control for comorbid ADHD traits in neurocognitive studies of ASD could yield misleading conclusions.
A scoping review (in progress) identified 60 direct comparisons of neurocognition (Mar et al., in prep) in ADHD and ASD. There was considerable variation in the measures used, the indices of performance derived from these measures and the neurocognitive domains covered in these studies. Only five studies reported performance on the stop-signal task (SST), a widely used measure of response inhibition (Albajara Sáenz et al.,
2020; Karalunas et al.,
2018; Kuijper et al.,
2015,
2017; Van Hulst et al.,
2018). The largest of these studies (Karalunas et al.,
2018) reported that ASD and ADHD had comparable deficits in response inhibition reflected in stop-signal reaction time (SSRT; also Van Hulst et al.,
2018). Two studies found no group differences (Kuijper et al.,
2015,
2017) and one study reported that ADHD, but not ASD, showed a deficit in response inhibition (Albajara Sáenz et al.,
2020). Reaction time (RT) and RTV measured in the SST were longer in ASD than in ADHD, which were both longer than in controls in two of the three studies that reported these performance indices (Karalunas et al.,
2018; Van Hulst et al.,
2018 compare with Albajara Sáenz et al.,
2020). Only the Karalunas et al. (
2018) study controlled for comorbid traits and reported that longer SSRT, slower RT and greater RTV in ASD was not a function of comorbid ADHD. They did not find any effect of comorbid ASD traits on neurocognitive impairment in ADHD (Karalunas et al.,
2018).
All direct comparisons of ADHD and ASD using the SST were conducted in clinic samples and each study had its own selection biases which, in some studies, differed for ADHD and ASD recruitment (cf. Karalunas et al.,
2018) leaving unanswered the question of whether findings can be generalized beyond specific clinic settings (Low et al.,
2008). Neurocognitive impairment could vary as a function of disorder severity or comorbidity in cases referred to specialty clinics (Pearce & Richiardi,
2014; Snoep et al.,
2014). Clearly, the differences in SSRT, RTV and RT between ADHD and ASD require further direct comparison in both clinical and non-clinical samples.
We report the results of a direct comparison of SSRT, RTV and RT in rigorously assessed ADHD and ASD participants measured using the SST. We controlled for comorbid ADHD and ASD using validated trait measures and by comparison of ASD groups with and without comorbid ADHD. To test the generalizability of the results of the clinic sample, we also studied a community sample of individuals who reported a diagnosis of ADHD or ASD, where comorbidity was also controlled for.
Discussion
We compared ADHD and ASD cases with controls on two indices of neurocognition (SSRT and RTV) with and without control for comorbid ADHD and ASD to determine whether ADHD and ASD share neurocognitive profiles. We conducted these comparisons in specialty clinics where ADHD and ASD diagnosis was established after rigorous assessment and in a community sample where ADHD and ASD was defined by parent and self-report in order to assess the generalizability of findings. This study was motivated by the fact that there have been few direct comparisons of neurocognitive function, in particular response inhibition, in large samples of individuals with ADHD and ASD (Albajara Sáenz et al.,
2020; Kuijper et al.,
2015,
2017; Van Hulst et al.,
2018). We focused on two key neuropsychological processes. SSRT is a well-established measure of response inhibition–the speed with which one can stop a speeded motor response. RTV has been interpreted in various ways, but the strongest case can be made for it to be a reflection of lapses in attention (Kofler et al.,
2013).
The current study more than doubled the number of ASD and ADHD participants in existing comparative studies. Moreover, there has been only one comparative study in which ADHD comorbidity has been controlled (Karalunas et al.,
2018). To assess the impact of ADHD comorbidity on ASD, we examined neurocognitive function in ASD with and without control for continuously measured ADHD traits using the SWAN rating scale–a normed and valid measure of ADHD traits as well as compared ASD with and without categorically defined comorbid ADHD in both clinic and community samples. We additionally checked for the impact of ASD comorbidity as measured by social cognitive deficits on neuropsychological performance, in ADHD using SCQ symptom counts in the clinic sample (c.f., Karalunas et al.,
2018).
Without control for ADHD traits,
both Clinic and Community ADHD and ASD groups showed longer (impaired) response inhibition (SSRT) and greater reaction time variability (RTV) than age-matched controls, but did not differ in response time (RT). The differences in SSRT and RTV between ASD and ADHD were not significant. Because it can be difficult to estimate the clinical significance of differences in reaction time measures, we estimated the magnitude of the impairments using “age equivalents''–the age at which statistical models predicted that a control would perform at the same level as a case. The difference between ADHD, ASD and controls was substantial. Clinic ADHD and Clinic ASD showed a 2-year delay in SSRT. For RTV, the delay was 1–2 years. The delay for Community cases was somewhat less for SSRT but similar for RTV. The functional implications of this effect needs further study as measures of impairment were not collected, but we note that a 2-year delay is the typical criterion for learning disability. We caution that while the observed impairments were statistically significant and may be clinically or aetiologically relevant, the associations were not sufficiently strong or sufficiently specific to use as a proxy for diagnosis (Zakzanis,
2001).
In a large direct comparison of ASD and ADHD, Karalunas et al. (
2018) reached the same conclusion as this study regarding impaired SSRT and greater RTV in ADHD and ASD. However, our conclusions about the role of comorbid ADHD differ from those of Karalunas and colleagues. We found that comorbid ADHD explained the deficits in ASD. We came to this conclusion after assessing the role of ADHD comorbidity in several ways. We added continuous trait scores for ADHD to the SSRT models and found that the effect of diagnosis on SSRT and RTV were no longer significant in either clinic or community samples, but the effect of ADHD trait severity was significant. In the case of ADHD, this result is not surprising. ADHD is a disorder defined by ADHD traits. After control for ADHD traits, the ASD group no longer exhibited a longer SSRT than controls in the community sample and the difference from controls in the clinic sample was not significant after correction for multiple testing. The story was similar with respect to RTV. Controlling for ADHD traits reduced the difference in ASD versus controls to a non-significant level in the clinic sample and reduced but did not eliminate the effect of ASD in the community sample. In contrast, Karalunas et al. (
2018) found no effect of ADHD traits on neurocognitive performance in the ASD group. The Karalunas et al. (
2018) and current study differ in a number of important ways. Karalunas used the ADHD rating scale (DuPaul et al.,
1998) as their measure of ADHD traits. The ADHD rating scale is truncated at zero where zero indicates that a trait is not present. By contrast, the SWAN allows for ratings from strengths to weaknesses so that zero indicates average behavior and minus scores reflect strengths. Using the ADHD Rating Scale could result in a loss of power to detect ADHD trait effects in their control sample compared to an analysis that uses the SWAN. Karalunas also dropped the ADHD group from their analyses controlling for ADHD traits. This would further cause a loss of power to detect an ADHD trait effect. We assume that they were concerned with picking up an ADHD trait effect driven by the ADHD sample that did not hold in the ASD sample. We checked this possibility by testing for a trait by group interaction and found no evidence that the ADHD trait effect was different in the ASD sample than in the control or ADHD samples. It should be noted that Karalunas et al. calculated RTV using all trials for which there was a response including those that followed unsuccessful efforts to stop. These responses are largely slower than trials for which stopping was not required (Dupuis et al.,
2018). We think that slowing after successful and unsuccessful stopping should be distinguished from RTV because of the potential confound between number of failed efforts to stop and RTV.
Karalunas et al. (
2018) found that the ASD-ADHD group was like the ASD + ADHD group and more impaired than controls. From this, they concluded that ADHD did not explain the effect of ASD. By comparison, we found the opposite-the ASD-ADHD group tended to align more closely with controls than with the ASD + ADHD group. Unlike Karalunas, we attribute any residual ASD-ADHD effect in the clinic to the large difference between the ASD-ADHD and Control groups in SWAN t-score even though this group did not include participants with comorbid ADHD. The difference in SWAN scores was larger in the clinic sample (14.4%) than in the community sample (8.2%) which may explain why the ASD-ADHD effect was significant in the clinic but not the community sample. A closer look at the Supplemental Table in Karalunas demonstrates that the total ADHD Rating Scale score for the ASD-ADHD was a full standard deviation greater than for controls. Looked at together, we conclude that a large proportion of the effect in ASD is driven by elevated ADHD traits with some much smaller proportion of variance driven by ASD specific deficits.
The current conclusion that response inhibition and reaction time variability impairment in ASD is largely, although not exclusively, associated with comorbid ADHD traits is consistent with other studies (Corbett et al.,
2009; Happé et al.,
2006; Rommelse et al.,
2010; Salunkhe et al.,
2021; Tye et al.,
2016). A recent meta-analysis of research in ASD identified 42 studies of inhibition which included 1534 participants (Lai et al.,
2017). But only 11 of these studies, involving 242 participants, controlled for ADHD. Similar to the current results, the magnitude of the deficit in ASD was reduced with control for ADHD (Lai et al.,
2017).
These results highlight the strong link between ADHD traits and neurocognitive test performance across disorders. This effect is most obvious in the strong and replicated deficits that are found in ADHD per se. The association of ADHD trait severity and neurocognition is also supported by the significant role of ADHD traits in predicting SSRT and RTV and in the neurocognitive impairments that we observed in the community high trait groups which reported neither ADHD nor ASD. Moreover, the association of ADHD traits and neurocognitive deficit, at least insofar as it was measured in this study, appears to be similar in ASD as in ADHD. More generally speaking, it appears as if ADHD traits are indicators of neurocognitive impairment in whatever disorder they are found. If one controls comorbid ADHD, neurocognitive impairment is essentially eliminated. You can see this in the fact that impaired response inhibition is found in anxious children with comorbid ADHD traits but not in those without comorbid ADHD (Korenblum et al.,
2007). Studies of other neurocognitive processes and variants of inhibition are needed to determine the generality of this conclusion.
Response inhibition and reaction time variability might prove to be good, cross-disorder markers of aetiological risk factors in disorders characterized by ADHD traits given that both response inhibition and RTV have genetic (Finkel & Pedersen,
2014; Friedman et al.,
2008; Schachar et al.,
2005) and neurobiological (Albaugh et al.,
2017; Chevrier & Schachar,
2020; Sonuga-Barke & Castellanos,
2007) underpinnings. We observed low correlation between RTV and SSRT across community and clinic groups among older and younger participants suggesting that these performance indices reflect separable rather than common processes (cf Karr et al.,
2018). These results also indicate that the ADHD associated with ASD is not a phenocopy of “true” ADHD at least using neurocognitive impairment as the criterion for phenocopies. As has been found in many previous studies, comorbid ADHD was common in ASD in both clinic and community ASD samples (Brookman-Frazee et al.,
2018; Joshi et al.,
2017; Lyall et al.,
2017).
Several other findings that emerged from the current study are worthy of mention. Differences among disorders in SSRT and RTV did not vary with age although age did affect performance as has been found previously (Crosbie et al.,
2013). The fact that there was no interaction between SWAN and disorder indicates that the effect of ADHD traits was the same in the lower range (among controls) as it was at the upper range, providing additional support for the quantitative nature of the ADHD effect. By contrast, social cognition as measured with SCQ symptom counts did not significantly impact SSRT or RTV when added to disorder in the models, indicating that ASD traits did not affect neurocognitive function in ADHD (or ASD for that matter) over and above the effect of diagnosis and ADHD trait severity. It is possible that the SCQ is less sensitive to ASD-related quantitative traits than the SWAN questionnaire because it lacks the capacity to measure the full spectrum of ASD traits.
IQ differences between ASD and ADHD or controls did not explain the observed impairments in neurocognitive test performance (Dennis et al.,
2009). Nor were neurocognitive differences between ADHD and ASD a function of stimulant medication taken around the time of testing. ADHD medication was widely used in ADHD and ASD participants. Control for stimulant usage was important because it predicted 7.9% shorter SSRT across all ages in the Community sample and shorter SSRT at younger but not older ages in the Clinic sample.
We found no support for the contention that longer SSRT or greater RTV were artifacts of slower response times as previously asserted (Alderson et al.,
2008; Huang-Pollock et al.,
2012). The tracking algorithm in the stop task is designed to separate reaction time from response inhibition (see
Supplemental material for details). However, reaction time is a complex process that can be operationalized in various ways (Rommelse et al.,
2020). In this study, we examined the speed of responding in a choice reaction time task where participants are required to make one of several different responses depending on which one of several stimuli are presented (respond with one hand if you see an ‘X’ and with the other hand if you see an ‘O’), namely reaction to the go stimuli in trials that did not involve stop signals. Previous research supports the hypothesis that processing speed might be slower in ADHD when operationalized as performance in the coding and symbol search subscales of intelligence tests (Braaten et al.,
2020; Nigg et al.,
2017).
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.