To increase the likelihood of finding clinically relevant and valid autism subgroups, we took several measures that also distinguish the current study from earlier subgrouping attempts. First, we include multiple self-report measures of autism characteristics and of demographic, psychological, and lifestyle variables as input for our analyses. The variables chosen as input are important for the expected utility of the obtained subgroups. We chose measures based on research literature and discussion with autistic adults, that can be easily administered on a large scale. Also, many of these variables are modifiable in nature. Consequently, we increase the likelihood that our findings will be informative for clinical practice. In addition, these variables are selected based on their relevance to the outcomes of interest (i.e., cognitive difficulties, psychological difficulties, and quality of life (QoL)). Second, for
external validation of the observed subgroups, we focus on the aforementioned outcomes as these are important to general aging (Beydoun et al.,
2014; Chen et al.,
2014; Goh et al.,
2012; Prenderville et al.,
2015). Moreover, these variables are clinically relevant and meaningful to autistic adults as well (Howlin & Magiati,
2017). Third, we include two separate samples which together include over 800 adults aged 30–89 years to ensure we can perform a
direct replication of our results. Fourth, we include both autistic adults and non-autistic adults without ADHD to see whether the observed heterogeneity in autism is distinct from variation we see in non-autistic adults (i.e., whether the observed variation is better described by diagnostic categories than by a continuum across groups). Fifth, we investigate the
specificity of the results to autism by repeating analyses with inclusion of a group of adults with an ADHD diagnosis; a neurodevelopmental condition which has shown strong overlap with autism in characteristics, as is also acknowledged in the DSM-5 (Antshel & Russo,
2019; Lau-Zhu et al.,
2019). Thus, we aim to determine whether valid, replicable, and specific autism subgroups can be identified that are informative for potential future support needs as one ages
.
Discussion
In this study, we identified subgroups in adults with autism or ADHD, and comparison participants using self-report measures of autism characteristics, and demographic, psychological, and lifestyle variables. Community detection analysis based on data from comparison participants and autistic adults indicated two distinct subgroups: one of comparison adults and one of autistic adults. We replicated these subgroups in a second data set. This indicates that the variation in variables as diverse as worrying, emotional support and mastery, is better described by diagnostic category than by continuous variation across people (Abu-Akel et al.,
2019; Frazier et al.,
2010). When we added ADHD adults to this second data set, half of them grouped together with the autism subgroup, and half with the COMP subgroup. Community detection analysis of just autistic adults indicated three subgroups: (a) “
Feelings of high grip”, (b)
Feelings of low grip”, and (c) “
Feelings of medium grip with high physical activity”. Subgroups were particularly distinct in feelings of grip (i.e., mastery), the social domain, and affect. We replicated the profiles of the first two subgroups in our replication data set, and showed that these subgroups differed on the external validators: cognitive difficulties, psychological difficulties, and QoL.
The two autism subgroups we identified and replicated were distinct on most cluster variables. Therefore, it seems that a variety of factors—i.e., not only variables related to self-reported autism characteristics—cause the distinction between subgroups. The “Feelings of low grip” subgroup was characterized by a more vulnerable profile on the cluster variables; low scores on the social domain, lowest sense of mastery (i.e., experienced grip on life), and highest level of negative affect. This was also indicated by the external validation, as this subgroup reported more cognitive difficulties, more psychological difficulties and a lower QoL compared to the “Feelings of high grip” subgroup. While the subgroups differed on most cluster variables, they were similar on some variables, including education and negative life events. Thus, while the subgroups did not differ on educational level attained and the amount of experienced negative life events, they showed large differences on the other cluster variables, and external validators. These results suggest that the differences between the subgroups are not driven by the number of negative/traumatic experiences, but rather by how these experiences are dealt with in daily life, or by the type of experiences.
We replicated two out of three autism subgroups. The third “rest” subgroup that did not replicate only included seven adults in our replication data set. We consider this subgroup an artifact of the Spinglass community detection method, rather than a distinct and valid subgroup. Subgrouping techniques, including community detection, are known for over-fitting or failing to generalize (Bubeck & von Luxburg,
2007; Horne et al.,
2020). Consequently, it is worrying how validating one’s results in a separate sample is often not included in subgrouping studies in the autism research field (Agelink van Rentergem et al.,
2021). The findings of the current study emphasize the importance of a direct replication: Without this validation procedure, we would not have known that this rest subgroup was not a valid subgroup and we could have overinterpreted the findings in the original dataset.
The results on the specificity to autism were somewhat inconclusive. We had anticipated several possible results: had adults with ADHD been similar to comparison participants or formed their own subgroup, this would have suggested specificity of the autism subgroup; had they been similar to autistic adults, this would have suggested nonspecificity of the autism subgroup. However, the adults with ADHD were divided equally across both subgroups. One possible explanation for our findings may be related to an overarching condition perspective of autism and ADHD (van der Meer et al.,
2012): Those with the fewest ADHD characteristics are indistinguishable from comparison participants, and those with the most ADHD characteristics are indistinguishable from autistic adults. However, critical examination of our inclusion criteria is also warranted. Autistic adults were allowed to have a comorbid ADHD diagnosis, and 20% of our autism sample did. The ADHD group was not screened for reporting too many autism characteristics on the AQ. Therefore, some overlap between ADHD and the other two categories may have been rooted in the design.
The finding that the autism and COMP subgroups did not differ on education level was unexpected, since the literature often shows that autistic adults attain a lower education level than non-autistic adults (Anderson et al.,
2017; Shattuck et al.,
2012). There are several possible explanations for this result: (a) we did not include any participants with a diagnosis of intellectual disability, (b) most of the adults in the autism group received a late ASD diagnosis (i.e., 94% in original data and 97% in replication data was diagnosed after age of 18 years), so the included autistic aduls might not have encountered as many problems during their education as compared to people diagnosed in childhood, or might have been able to compensate for their difficulties (Livingston et al.,
2020), and (c) highly educated people are more likely to participate in scientific studies (Reinwand et al.,
2015; Viken et al.,
2019).
It is important to consider the representativeness of our autism sample when interpreting our findings. First, autistic participants were selected based on diagnosis rather than ADOS or AQ scores. Such scores are snapshots of the full behavioral profile and the scores that we report were not obtained throughout the diagnostic process. Hence, we consider it important for the inclusion criteria to follow the clinical diagnosis given the purpose of the current study. Second, most of the adults in the autism group received a late ASD diagnosis. Our knowledge of autism in adulthood is expanding so we are increasingly able to recognize the presentation of autism characteristics in this age group. Nonetheless, we need to be aware that these results may not be generalizable to autistic adults diagnosed in childhood. As indicated by a recent study, there may be differences between autistic adults diagnosed in adulthood and those diagnosed in childhood, especially in co-occurring psychiatric conditions (Jadav & Bal,
2022). Third, our sample was a blend of adults recruited from the community and from mental health institutions. This recruitment strategy was adopted to ensure an accurate representation of the diverse population of autistic adults. Fourth, we only included autistic adults with average to high intelligence. Inclusion of autistic adults with an intellectual disability (ID) would have likely resulted in two autism subgroups: one subgroup with ID and one subgroup without ID. This implies that our subgroup analysis would merely reflect subgroups across intellectual ability, rather than capturing the heterogeneity across demographic, psychological, and lifestyle factors. Thus, given the goal of the current study, we chose to exclude adults with an ID. Hence, our results are probably not generalizable to autistic adults with an intellectual disability.
Moreover, it should be noted that 12% of participants in the original data set and 6% in the replication data set were excluded due to missing data. Missing data mostly occurred on instruments measuring emotional support, physical activity and negative life events. The questionnaire measuring emotional support (Stansfeld & Marmot,
1992), was administered last in the questionnaire booklets, and may have been skipped more frequently by participants. To measure physical activity, a questionnaire was used that is relatively more demanding to fill out. For different types of physical activity, participants had to indicate how much time (in minutes) they spent on a specific physical activity, which is relatively more challenging than the other questionnaires. Nonetheless, this measure has been validated in previous research (Craig et al.,
2003). Missing data on the questionnaire measuring negative life events (Brugha et al.,
1985) could reflect the traumatic nature of the items, and therefore, could indicate difficulty participants may have had to complete these questions. Moreover, the questionnaires for physical activity and negative life events both include retrospective questions, that require more time from the participants and may, therefore, have been skipped more often.
This study is unique in its sample (e.g., autistic individuals included, sample size, and age span), included measures, analysis, and validation procedure. First, the sample was large compared to what is typical in the autism subgrouping literature (Agelink van Rentergem et al.,
2021). Also, we adopted a wider age range, and included both adults with autism, ADHD, and a comparison group. Second, we designed the study in such a way that we had a multivariate data set, which allowed us to include multiple cluster and external variables across different domains. This is important as the goal of our analysis was to detect differences between subgroups in variables that are meaningful to autistic adults: cognitive and psychological difficulties, and quality of life. This also guided the variable selection procedure. Third, the analysis method, Spinglass community detection, has rarely been used in autism. Fourth, we preregistered most analyses. Fifth, we included several validation strategies to critically evaluate our results and to examine the validity of the subgrouping results (Agelink van Rentergem et al.,
2021).
With our external validation procedure, the identified autism subgroups were compared on clinically relevant measures related to the cluster variables, that were not used in the community detection analysis itself: cognitive and psychological difficulties, and QoL. Although these cluster variables and external variables are different constructs, some may wonder whether certain variables used to build and test the subgroups (e.g., negative affect and psychological difficulties) are too closely associated and, therefore, being a methodological concern. However, it was a deliberate choice to include both external variables that are more closely related to the cluster variables (i.e., psychological difficulties), and some that are less closely related (i.e., QoL and cognitive difficulties) as they provide different information on the validity of the subgroups. Differences on external variables that are more closely related to the clustering variables suggest that the subgroup differences were structural, i.e., less overfitting of the random noise in the clustering variables in this particular sample. Including QoL and cognitive difficulties demonstrates that subgroup differences also extend to variables less closely related to the cluster variables, highlighting the generalizability of the subgroups.
It is relevant to point out that the use of subgroup labels (e.g., Feelings of high grip) could (mis)guide the interpretation of findings in subgroup research and could potentially affect conclusions. Therefore, we considered it both important and necessary to consult our think tank of older autistic adults for the subgroup labels and conclusions reported in this study. However, even in this case one should be careful not to use the suggested labels outside the context of this study. As our replication sample showed, the subgroups differed on more cluster variables than mastery, so nuances may get lost when using subgroup labels.
Moreover, the labels were based on the mean differences, between the groups, but the assignment of participants to a specific subgroup was not based on the level of the scores, but on the pattern of scores. By calculating the correlations and using this as input, the level of scores is corrected for. Therefore, participants in the same subgroup have a similar pattern of peaks and troughs, even though one participant may have high scores on specific measures, and the other has one low scores on specific measures. Conversely, participants in different subgroups may overall have the same level of scores, but are assigned to different subgroups because there is a double dissociation in where the peaks and troughs in their pattern of scores are (Crawford et al.,
2003). To interpret and describe the subgroups, we did examine whether there were level differences in scores as well, and found that these were present on some domains. But because of the way the participants were assigned based on strengths and difficulties, we should not and cannot state that participants in one subgroup show a deficit. The findings of the current study are in line with a categorical difference in autism, rather than a dimensional difference (Abu-Akel et al.,
2019; Frazier et al.,
2010). For clinical practice, this entails that to correctly apply these findings, clinicians should not focus on ‘severity’ by using cut off scores, but instead focus on the pattern of strengths and difficulties to determine subgroup membership.
Furthermore, it remains difficult to evaluate one’s subgrouping results, as there is no golden standard on how to determine the robustness of the results. In this study, we adopted several preregistered techniques to confirm the validity of our results, which is more than is usually done in the autism research realm (Agelink van Rentergem et al.,
2021). Nonetheless, the modularity index, that was calculated in addition to the preregistered analyses, resulted in
Q-values around 0.30. Although positive
Q-values are indicative of a potential community structure, the absolute values were relatively low. Even when we ran a community detection analysis including the autism and comparison group—that are known to differ on many cluster variables—the
Q-index was relatively low (
Q = 0.41). Similar values have been reported in different community detection studies analyzing psychological data (Blanken et al.,
2020; Karalunas et al.,
2014; Radhoe et al.,
2021). These low values could be due to the inclusion of people in the community detection analysis (as compared to more distinct entities), suggesting that people are overall more similar than different. This could indicate that the modularity index may not be well-suited for psychological data, although this has to be investigated in methodological research.
To be directly applicable to clinical practice, it is essential to first assess how these subgroups develop over time. The subgroups did not differ in age, but this only provides cross-sectional evidence for a lack of a developmental effect. Longitudinal data is needed to determine whether the identified subgroups are stable over time and can be used to make clinical predictions. Therefore, we collected follow-up data and aim to assess the temporal stability of the subgroups, and their predictive value for future clinical outcomes (Geurts et al.,
2021). If the subgroups’ validity proves robust in these additional validation steps, we can turn towards the development of interventions. For example, future studies could investigate whether the relationship among characteristics differs between the two subgroups. If differences are found in relationships between characteristics, future research may address whether intervening on the characteristics that differ most strongly between the subgroups, results in transitions in subgroup membership, or whether interventions should focus on the relationship between characteristics instead. Moreover, in this study we have focused on self-report questionnaire data; future work could also include proxy or clinican report for a more comprehensive picture. Furthermore, qualitative data can also enrich the interpretation of the current subgroup findings.
In the clinical field, it is recognized that there is a group of autistic adults that reports having feelings of low control, or low sense of mastery. In order to support these autistic adults, in the Netherlands, job coaches or life coaches are often hired to help people gain control over their life. This seems to be useful, but the subgroups formed could also inform us about the level of care needed. In the Netherlands, there is a distinction between general mental health care that is easily accessible for everyone, and specialized mental health care that is directed at specific groups such as those autistic adults for whom their care needs can not be met within general mental health care. The subgroups that we identified in this study could therefore indicate the distinction between autistic adults who could benefit from this highly specialized care (i.e., the “Feelings of low grip” subgroup) and those that might already be helped via basic mental health care (i.e., the “Feelings of high grip” subgroup) when this is needed. Thus, it should be noted that not every autistic adult is in need of highly specialized care. It is also more likely that in the group with higher quality of life and less cognitive and psychological difficulties, there are autistic people who do not have any support needs, as not every autistic adult is in need of mental health care. Moreover, the current study implies that for autistic adults in the LowGr subgroup, vulnerabilities in one domain (e.g., mastery) are often accompanied by other difficulties (e.g., worries or negative affect). Therefore, if an autistic person reports difficulties in one domain, it may be helpful to screen for vulnerabilities in additional domains as we know these are associated with more cognitive and psychological difficulties, and a lower QoL. A better grasp on the full representation of the challenges someone might experience, may be crucial for tailored support to eventually improve the lives of autistic people.
In conclusion, we not only discovered that autistic adults form a clearly distinct group from adults without an autism diagnosis, but also found subgroups among autistic adults when focusing on autism characteristics and demographic, psychological, and lifestyle factors. While we replicated these findings and showed that these subgroups differ on clinically relevant outcomes (i.e., they are externally valid), these subgroups warrant further research to determine the longitudinal stability. Moreover, with this study we show which largely modifiable variables may distinguish these subgroups, which might be a starting point for an intervention. For example, mastery can successfully be improved with intervention (van der Klink et al.,
2001; van der Zanden et al.,
2012). Future studies can focus on subgroup replication and validation, but also on the development of interventions for those autistic adults who could benefit from extra support.