Front. Pediatr.Frontiers in PediatricsFront. Pediatr.2296-2360Frontiers Media S.A.10.3389/fped.2014.00058PediatricsReview ArticlePredictors of Outcomes in Autism Early Intervention: Why Don’t We Know More?VivantiGiacomo12*PriorMargot13WilliamsKatrina4DissanayakeCheryl11Olga Tennison Autism Research Centre, School of Psychological Science, La Trobe University, Melbourne, VIC, Australia2Victorian Autism Specific Early Learning and Care Centre, La Trobe University, Melbourne, VIC, Australia3School of Psychological Sciences, University of Melbourne, Melbourne, VIC, Australia4Department of Pediatrics, University of Melbourne, Melbourne, VIC, Australia
Edited by: Roberto Canitano, University Hospital of Siena, Italy
Reviewed by: Leslie J. Carver, University of California San Diego, USA; Karen M. Smith, University of Louisiana at Lafayette, USA; Stephanie Ameis, University of Toronto, Canada; Xiaoming Wang, Duke University, USA
*Correspondence: Giacomo Vivanti, Olga Tennison Autism Research Centre, School of Psychological Science, La Trobe University, Bundoora Campus, Melbourne, VIC 3086, Australia e-mail: g.vivanti@latrobe.edu.au
This article was submitted to Child and Neurodevelopmental Psychiatry, a section of the journal Frontiers in Pediatrics.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
Response to early intervention programs in autism is variable. However, the factors associated with positive versus poor treatment outcomes remain unknown. Hence the issue of which intervention/s should be chosen for an individual child remains a common dilemma. We argue that lack of knowledge on “what works for whom and why” in autism reflects a number of issues in current approaches to outcomes research, and we provide recommendations to address these limitations. These include: a theory-driven selection of putative predictors; the inclusion of proximal measures that are directly relevant to the learning mechanisms demanded by the specific educational strategies; the consideration of family characteristics. Moreover, all data on associations between predictor and outcome variables should be reported in treatment studies.
With increasing advances in autism research over the past decades, it has become clear that clinical heterogeneity is one of the most significant features of autism spectrum disorder (ASD) as diagnosed today. Genetic research indicates that hundreds of genes are implicated in ASD (1); neuropsychological research suggests that multiple neurocognitive mechanisms, rather than a single impairment, might underlie ASD symptoms (2); clinical research points to remarkable heterogeneity at the behavioral/phenotypic level (3, 4). Concomitantly, substantial individual differences are apparent with regard to treatment outcomes in this population (5).
On the basis of group-level data, research suggests that behavioral programs that are implemented as early as possible and in an intensive manner [often referred as early intensive behavioral interventions (EIBI)] can be efficacious in improving cognitive, adaptive, and social–communicative outcomes in young children with ASD (6, 7). However, analysis of treatment response at the individual level indicates that whilst some children show dramatic improvements, some show moderate gains, and others only show minimal or no treatment gains (8). Moreover, there is marked variation in the type and magnitude of positive outcomes seen between studies assessing effectiveness of the same intervention (5, 9–13).
Current knowledge of the factors associated with such individual differences in response to early intervention is limited. Therefore, the positive impact of these programs is hampered by lack of knowledge on the critical issue of “which children benefit from which program” (14). In the absence of this crucial information, the issue of which interventions should be chosen for a particular child is a common dilemma facing both families and clinicians. This question needs to be answered so the most effective early interventions can be provided for every child and to allow service and policy level decision making that will make best use of resources.
Recent literature indicates that choice of early intervention and education programs by families and clinicians is currently linked to factors such as regional proximity to services, anecdotal reports on effectiveness, or persuasive sales pitches/marketing, rather than based on the knowledge of which specific service is likely to result in best outcomes given the individual characteristics of the child (15, 16). This gap in knowledge creates the risk of enrolling children in programs from which they will not gain benefit, leading to a profound emotional and economic burden for affected children, their families, and the community. Given the tremendous implications of this issue at the personal, family, and societal level, in our opinion the identification of predictors of treatment outcomes should be at the top of the autism research agenda. However, advances in this area require a different lens for assessing individual differences as well as the adoption of more fine-grained research methodology, including new theoretical frameworks to analyze profiles of “responders” and “non-responders” under different types of early intervention.
In this paper, we shall argue that information about predictors of treatment response is limited because the current theoretical and methodological approaches are not adequate to address this issue. Furthermore, we will offer some directions for research, and discuss the implications for clinical practice.
Current Knowledge on Predictors of Early Intervention Outcomes
While there are a number of treatments in the field of ASD, only a small proportion of these have scientific evidence for their efficacy. EIBI programs are currently recommended as the “treatment of choice” for children diagnosed with an ASD (17, 18), with most early intervention research focused on this type of approach. EIBI is characterized by the active engagement of the child for many hours per week (usually 20+) in a planned educational intervention delivered primarily in direct 1:1 child–adult instruction, with specific goals derived from assessment results, manualized/operationalized instructional procedures, and a data collection system to facilitate progress and outcome measurement (11). Within this framework there are different programs, which vary according to the specific curriculum and teaching procedures (19–21).
A number of reviews and meta-analyses have examined group-level outcomes in response to early intervention programs (6, 10, 22), indicating that EIBI programs appear to be effective for increasing adaptive behavior and IQ in young children with ASD. Nevertheless, there are limitations to available research, including lack of randomization in most published studies, small sample sizes, and possible biases due to awareness of treatment status in parents and providers. Moreover, the definitions of EIBI vary across studies, ranging from very specific definitions (e.g., including only programs that strictly adhere to the behavioral procedures originally described by Lovaas) [e.g., Ref. (23)] to very broad ones (including programs that are implemented early and intensively but use teaching procedures that significantly depart from the work of Lovaas, such as Pivotal Response Training) (22).
Importantly, available evidence suggests that EIBI programs (and early educational programs more in general) are not equally beneficial for all treated children (8). In the following, we focus on the factors associated with individual-level variability in response to current early educational intervention approaches, including strictly defined EIBI programs based on the work of Lovaas, as well as programs that are based on behavioral techniques but are not necessarily implemented at a high level of intensity [e.g., Reciprocal Imitation Training (24)], and interventions that meet the intensity requirement but do not have an explicit behavioral orientation [e.g., the PACT program (25)].
Analysis of available evidence indicates that pre-treatment cognitive abilities (IQ) and language abilities are the most often reported correlates of gains in early intervention studies (26–33), although not all studies concur in their conclusions (34–36). Several studies also indicate pre-treatment level of adaptive behaviors as a relevant correlate of treatment gains (6, 37, 38).
Whilst there is some evidence that children who are younger and less severely affected might be more responsive to early intervention, other studies report mixed or negative findings [(31, 39–43); see also Ref. (10, 44)].
A number of studies have identified more specific abilities associated with positive treatment outcomes, including play skills (24, 45–47), interest in objects (48–50), joint attention (46, 47, 50), imitation (38), low social avoidance (51), and response to social versus non-social reinforcement (52). In addition, there have been mixed reports on family factors such as the level of maternal education (53, 54) and family stress (55, 56).
Limitations with Current Approaches to Research on Predictors of Outcome
Despite such findings on predictors, knowledge of the factors underlying positive treatment outcomes is limited and inconclusive. The major limitations to current research approaches are outlined below.
Variables associated with change in treated groups do not necessarily reflect actual predictors of outcomes (i.e., moderators or mediators of treatment response), as not all the observed change can be attributed to treatment (57, 58). If factors other than treatment that might contribute to change are not considered and controlled, correlates of changes within a treated group might or might not tell the full story about prediction of treatment response.
The selection of predictor variables is often not theory-driven (59, 60). In most papers reporting on predictors of outcomes, no rationale is provided on why specific variables are selected for analyses. It is apparent that, in most cases, the predictor variables are the measures used to characterize samples at trial commencement, with the purpose of identifying any important differences between randomized groups. Equally, the types of measures used often indicate broad constructs and thus lack the specificity required for a predictor variable. Therefore, the current findings of IQ/language variables as the most consistent predictors of response to early intervention programs tell us more about how commonly these measures are used in baseline assessments in intervention research than about their strength as predictors.
Analyses of specific behavioral predictors that could account for individual or subgroup differences are rarely included in research on intervention and prognosis (61). Most intervention studies focus on overall group-level outcome data, and analyses on those factors associated with identifiable subgroups of children or individual differences are either not conducted or not reported, despite the fact that treatment response is so variable in ASD. In medical research, the evaluation of intervention effectiveness often follows a progression from an initial focus on overall group-level outcomes (“does the treatment work for this condition?”) to a subsequent focus on predictors of outcomes for identifiable subgroups or at an individual-level (“what are the factors associated with outcomes?”), particularly when treatment response is variable, of insufficient benefit compared to risk to warrant treatment for some, or when advances are still needed to improve outcomes. In research on autism intervention, most trials are designed to only address the question of group-level efficacy/effectiveness. However, as current research emphasizes the heterogeneity of ASD at every level of analysis, and the results of trials and meta-analyses show variable effect sizes, there is a clear need to move to the next stage of intervention research, with a focus on the specific individual predictors of treatment outcomes, and a focus on moderators and mediators of treatment response.
Few studies compare predictors of outcomes across different intervention programs (58). The impact of child characteristics is likely to vary according to the intervention program implemented, so that a child who is not responsive to program X (e.g., discrete trial training) might be more responsive to program Y [e.g., pivotal response training (14, 49)]. Since different programs utilize different instructional techniques (for example, different emphasis on external versus social reinforcements, different emphasis on verbal versus non-verbal instructions), it is likely that children with varying intrinsic cognitive and learning profiles will respond preferentially to different teaching approaches, just as do children who do not have ASD (60, 62, 63). However, the majority of studies on predictors of outcomes include data on response to one program only. Moreover, the inclusion of only one treatment leaves open the possibility that the change predicted by the pre-treatment factors is due to factors other than treatment (59).
Intervention studies recruit different samples from those that present at clinical services. Exclusion criteria in many intervention studies result in children with associated medical conditions, seizures, or a low IQs [e.g., IQ < 35 in Ref. (64)], or developmental age [e.g., <12 months in Ref. (25)] being excluded. While these exclusion criteria are set to create homogeneous samples for research purposes, they reduce generalizability to those who are seen in clinical and community-based settings, providing little information about which programs should be recommended based on different pre-treatment characteristics in the wider ASD population. Children with medical conditions, seizures, and/or severe intellectual disability make up a significant proportion of the ASD population (65, 66), and they are more likely to be referred to treatment programs compared to children with no identifiable comorbid features (67, 68). Therefore, research on their responses to different programs is crucial to inform clinical practice, so that enrollment to an intervention service is most likely to offer benefits and cause no harm.
Current guidelines in clinical trials suggest that excluding patients with associated disorders from research should not occur when these comorbidities are common or when they affect treatment response and prognosis (69). As current research reports an increasing number of comorbid conditions associated with ASDs (66), including dysfunctions that are not diagnosable as specific disorders, the attempt to isolate “pure autism” in the ASD population by excluding “autism complicated by comorbid features” appears to be increasingly impracticable and unrealistic [see Ref. (35)].
Standard predictor measures currently used in research are very broad. Omnibus factors such as tested IQ, speech and language assessments, and adaptive behavior have predominated as both predictors and outcome measures in intervention research (53, 60). The use of such broad measures in intervention studies as predictors is problematic for a number of reasons. Low scores in IQ, language, and adaptive behaviors reflect a variety of distinct underlying processes, making it difficult to understand the specific mechanisms underlying the intervention response. Given that performance on IQ tests is, in itself, a measure of learning abilities (e.g., inefficient information processing), it is not surprising that children with lower IQ have more difficulties in learning from educational treatments. To avoid circular reasoning (children who have more difficulties in learning, as measured through pre-treatment IQ testing, are the ones who will have more difficulties in learning from educational treatments), research needs to focus on more proximal predictor variables. These should reflect specific and clearly defined processes that might explain difficulties in responding to educational strategies [e.g., response to social reinforcements in (52); lack of spontaneous imitation in (70)]. Moreover, broad variables such as IQ and communication scores are not robust measures in children younger than 3 years (71), and different tools used to measure IQ might provide different results depending on the instruction formats (e.g., verbal instructions versus demonstration) in the ASD population.
Family factors are seldom considered as predictors in outcomes studies. There is very little systematic data on how the characteristics and behaviors of parents influence children’s responses to intervention (72). The motivation of parents to pursue and persist with intervention programs, which involve considerably more effort than administering medications or using complementary and alternative therapies, may be an important factor in treatment outcomes. Moreover, the parents’ personal strengths (e.g., communication style, flexibility) may contribute to the developmental gains of their child. Lack of research in this area is surprising, given that (1) parents are frequently expected to engage as the main therapists for their children in many interventions, even those that are not called parent-mediated interventions, and (2) family factors have been found to impact on treatment response across a number of intervention programs for children with other conditions [see Ref. (73)]. Moreover, family factors such as higher parenting stress, negativity and depression, and low SES are ubiquitous factors in poorer outcomes across a range of child mental health interventions (74–76). The few studies that have investigated family factors in ASD indicate the relevance of parent’s education, responsivity, and beliefs about the importance of child independence (77, 78). Another study (79) reported that higher distress in mothers pre-treatment was associated with lower adaptive behavior outcomes post-treatment, although the effect was not statistically significant [see also Ref. (30)]. Similarly, Osborne et al. (55) reported that high levels of parenting stress reduced the intervention gains in their children, particularly for high intensity interventions. Despite the relevance of this literature, the available evidence on family characteristics moderating treatment outcomes is limited and inconclusive.
Recommendations
On the basis of the limitations in the intervention outcome literature to date, a number of recommendations are made here.
Selection of putative predictors should be theory-driven, and predictors should be proximal and specific rather than broad. In order to match specific learning profiles to specific teaching programs, it is important to conduct a fine-grained analysis of child characteristics. Doing so will enable us to determine not only what the child needs to learn (which will inform treatment objectives) but also how the child learns (which will inform treatment strategies). In addition, we also need to develop a fine-grained understanding of how each treatment works; that is, what are the processes (or the active ingredients) of the intervention that interacts with the child characteristics to promote learning in that child? With time it is likely that an understanding will emerge about the role of different factors on the pathway to effective intervention, such that some will be seen as “first order” or “primary” and required for certain educational or behavioral approaches to be effective, while others will be “second or later order” indicating modification that need to be made to optimize effectiveness of intervention techniques.
The analysis of the active ingredients of treatment involves a conceptual distinction between moderators of treatment effects, and mediators through which the intervention supposedly works (80). Moderators of treatment outcomes are the pre-treatment characteristics that might determine the degree of effectiveness of treatment versus control, but do not change as a consequence of the intervention, such as chronological age, gender, or maternal education. Conversely, mediators of treatment outcomes are the factors through which a treatment exerts its effects: they are subject to change as a consequence of the treatment, and these changes, in turn, affect treatment outcomes. For example, based on the theoretical tenet and the educational strategies of the Early Start Denver Model (a program in which the therapists are instructed to follow the child’s lead), it is plausible that changes in the spontaneous propensity to initiate social interactions and engage in joint activities mediate outcomes in this program (81). Similarly, it is plausible that changes in the propensity to imitate others mediate outcomes in Reciprocal Imitation Training (24), and that changes in the ability to understand and follow visually mediated task instructions would be relevant in response to the TEACCH program (82).
The study of mediators of treatment outcomes requires the knowledge of the learning processes upon which the instructional techniques of the teaching program are based, or, in other words, understanding of the active ingredients underlying treatment-related changes. Without such knowledge, selecting among the many variables that are potentially associated with response to treatment in ASD is a difficult task. Importantly, intervention programs should have manualized guidelines and fidelity procedures to ensure that the active ingredients supposedly involved in the therapy are not “diluted” when the programs are translated into community practice.
A clear definition of the processes through which the child is able to learn in response to the particular instructional techniques is therefore one starting point for defining a specific set of putative moderators and mediators. Furthermore, it is crucial to focus on proximal factors that are known to support learning, with different predictor variables reflecting distinct and defined processes, so that the specific weight of these putative predictors mediating treatment response can be measured. Processes that are known to be foundational for social learning, and might be relevant predictors of outcomes for early educational programs include: social attention [paying attention to people and their actions (83)]; social motivation [which can be operationalized in terms of social approach versus social avoidance behavior, or response to social versus non-social rewards (52, 84)]; intentional communication [using language or non-verbal communication to communicate (85)]; receptive language/communication [understanding others’ communication (86)]; joint attention [both initiation and response to joint attention (87, 88)]; goal understanding (89, 90); imitation (91, 92); functional play (35, 93). All of these processes reflect different facets of social cognition that are known to support social learning, and which are associated with developmental outcomes in ASD as well as in typical development [e.g., Ref. (94, 95)]. Preliminary evidence provides encouragement on the value of these factors in predicting response to intervention [e.g., Ref. (24, 35, 38, 45, 46)]. Another factor that might be associated with outcomes is the extent of restricted/repetitive behaviors (RRBs), since engagement in inflexible routines and insistence on sameness are likely to hinder acquisition of new skills and social learning. For example, Watt et al. (96) reported that prolonged engagement with RBBs was negatively related to social competence across the crucial developmental period from 2 to 3 years. Data on the relevance of RRBs in response to treatment are scant and equivocal (52, 97, 98), so more research is needed to investigate how individual differences in the extent of RBRs affect response to intervention.
Other factors that are not specific to ASD might also be associated with treatment outcomes across intervention programs. These include attention (in particular sustained attention, e.g., the ability to be focused on a task from the beginning to the end); memory; responsivity to instrumental learning/conditioning (the ability to associate contingent rewards to own behaviors); processing speed and efficiency; generalization (the ability to use what has been learned in non-training situations). Rate of learning (e.g., number of treatment goals achieved in the first 6 months of treatment) might also be a relevant predictor of outcomes (99). Research on the predictive value of these factors in response to treatment is scant.
As standardized tests are not available for many of the processes listed above, it is necessary to develop and utilize novel, fine-grained experimental measures and observational protocols that are suitable for young children with ASD across the spectrum of severity [e.g., Ref. (35, 52)]. Table 1 summarizes a list of the factors that have been theoretically and/or empirically linked to positive treatment outcomes (including both child and family factors, discussed in the next section), and for which psychometric development is needed to advance a methodology for identifying predictors of outcomes.
Family factors should be investigated in treatment studies. As family involvement is a recommended component of early intervention (100), future research should systematically investigate the family characteristics associated with responses to treatment for children with ASD. Importantly, different early intervention programs involve instructional techniques (e.g., play-based versus highly structured strategies) that may or may not fit with a family’s educational practice and cultural values. Different families might also respond differently to the parent training formats used by the different programs, which vary from information sessions in small groups to 1:1 sessions in which the parent is asked to implement educational strategies under a therapist’s supervision. Other potential family factors mediating response to treatment are the level of parent/therapist collaboration, maintaining positive expectations for child outcomes, lack of family conflict, positive father involvement, level of social support, and level of stress in the family (14).
High levels of child behavior problems are prominent in families with children with developmental disabilities and contribute to greater stress in families than cognitive delay (101, 102). Generally, mothers of children with ASD report higher levels of distress than those of non-disabled children or those with children with other disabilities, although there is considerable variability across families (103, 104). In a recent paper, Benson (105) has shown that social network attributes, including the range and function of emotional support, are related to perceived social support, which in turn can bring about a decrease in depressed mood in mothers of children with ASD. Formal and informal social support networks can have the effect of enhancing quality of life, confidence in parenting and optimism (106) for families with children with disabilities, and might be crucial factors predicting treatment outcomes.
Accurate measures that appropriately capture individual differences between families in terms of specific values, attitudes, and resources may need to be developed. Future research should investigate the role of family factors in a systematic way, selecting specific, theory-driven variables, developing novel fine-grained measures and comparing variables associated to outcomes across different programs. When examining a broad array of putative factors (e.g., family characteristics and attitudes, sociodemographic background) that may be associated with outcomes, it is important to consider that while a single factor might not be predictive of outcomes, the accumulation of multiple risks often is. Studies looking at longitudinal outcomes in at-risk populations often use cumulative risk approaches (107) in which a discreet number of risk indexes are created to capture the level of risk within a number of predefined theoretically driven domains. To illustrate, a number of studies [e.g., Ref. (108, 109)] have examined the predictive value of risk factors within the child (various child attributes), sociocultural (demographic characteristics), and parenting domains (parent beliefs/attitudes), showing that cumulative risk within each domain predicted outcomes in typically developing children. This approach can be helpful in examining whether risk factors in family related and sociodemographic domains play a role in response to treatment in the ASD population.
Studies on treatment efficacy/effectiveness should always report on individual differences in response to treatment as well as those factors associated with positive treatment outcomes. The analysis of individual differences (i.e., characteristics of responders and non-responders) should become a standard procedure in early intervention research [similarly to current procedures in pharmacological intervention research (110)]. Moreover, when predictor variables are measured, their association with the outcome measures should always be reported. The tendency to report on predictors of outcomes only when results indicate significant associations makes it hard to draw clear conclusions on the robustness and consistency of factors associated with treatment response. Thus, it should be mandated that all data on predictor and outcome variables are reported, as in the case of outcome measures in clinical trials (111). Reporting all available information on the association between predictors and outcomes can also be useful in studies with small sample sizes, which comprise the majority in the field of ASD, so that data from multiple small trials can be pooled for meta-analyses. While data on correlates of treatment gains per se do not allow for definite conclusions on predictors of treatment outcomes, this information can be critical to inform subsequent research designed to control for the predictive value of factors that appear to be relevant in relation to treatment changes.
Research on predictors of treatment outcomes should compare responses across different programs. As mentioned above, the analysis of correlates of gains in a treated group might not be informative on predictors of treatment outcomes, as not all observed change in a treatment study can be attributed to the treatment. Research on predictors of treatment outcomes should use designs that compare different programs, thus allowing for the analysis of the interaction between selected participant characteristics X treatment group. This approach is critical not only from a methodological point of view (distinguishing moderated treatment effects from factors that are associated with outcomes/changes in ASD more generally), but also from a clinical perspective. Different early intervention programs, while sharing many similarities, involve distinct instructional techniques that are based on different theories and which tap into different learning processes. For example, some programs involve an emphasis on teaching words/sentences that have the instrumental function of obtaining desired items, whilst in other programs language is targeted with an emphasis on its social versus instrumental function. Similarly, programs vary across a number of teaching processes (e.g., verbal versus visually conveyed instructions, following the child’s lead versus adult-directed models), reflecting different underlying theoretical frameworks. Since these different teaching practices require different learning processes on the part of the learner, it is possible that different types of learners will respond to different types of teaching procedures. Given that remarkable differences are present both in the teaching procedures of the different programs and in the social, cognitive, and learning profiles of children with ASD, it is imperative that future research compares the profiles of response to different early learning programs that use different instructional techniques. This approach would allow identification of the pre-treatment child characteristics that support learning when a specific set of teaching procedures is used. Only a few studies to date have provided information on the specificity of predictors of outcomes to one versus another treatment program [see Ref. (49, 50)].
Research on predictors of outcomes should involve large heterogeneous samples. It is important for studies on the predictors of response to treatment to include the full range/spectrum of children with ASD. Many children with comorbid conditions are typically excluded from research studies, such as those with severe intellectual disability and associated medical conditions or seizures. However, as discussed above, these children represent a substantial proportion of the ASD population referred to community early intervention centers. It is particularly important that research focuses on children with very low IQ to determine whether the currently available early intervention programs are appropriate for this population, and which specific factors are predictive of positive outcomes (e.g., short attention span, passivity, poor play skills). If research shows that there are child characteristics that indicate a lack of responsivity to any of the currently available early intervention programs, we need to develop novel approaches targeting the specific impairments of the “non-responders,” rather than referring them routinely to programs from which they do not benefit.
Putative predictors of treatment outcomes that require standardization/psychometric development.
Child factors
Family factors
Functional communication (requesting, protesting)
Sociodemographic background (resource-poor versus resource-rich)
Little is known about predictors, moderators, and mediators of treatment response in children with neurodevelopmental and neuropsychiatric conditions (112, 113), and the field of ASD is no exception. With recent advances in research documenting the positive impact of early intensive behavioral programs for children with ASD, the critical issue facing researchers, clinicians, and practitioners in the field is not as much a lack of evidence-based treatments, but rather an inability to predict which treatment will work best for each child. The variability of response to EIBI and other early intervention programs is a phenomenon that very likely reflects the heterogeneity of the ASD population. While some crude prognostic variables, such as IQ level, hold some value in predicting which children will respond best to early intervention, to date, the available information on moderators and mediators of treatment response is inconclusive. In this paper, we argue that lack of knowledge on “what works for whom and why” in ASD reflects a number of methodological and theoretical issues in ASD treatment research.
We argue that the selection of treatment objectives and treatment strategies should be informed by knowledge of: (1) child characteristics (how does the child learn best, and what does s/he needs to learn); (2) family characteristics (what are the family priorities/expectations, and what is the family learning style); (3) treatment characteristics (what are the treatment aims, and how does the treatment work). This model is illustrated in Figure 1. Current understanding on the interplay of these factors in determining treatment outcomes is limited, and we have offered here a number of recommendations to advance knowledge in the field. Given the complexity of the biological underpinnings of ASD, behavioral predictors might not be sufficient to predict treatment outcomes to a high degree of accuracy. Nevertheless, knowledge arising from this line of research can critically contribute to the development of decision-making guidelines in the field of ASD early intervention.
Treatment goals should be selected on the basis of the child’s needs and family priorities. Treatment strategies should be selected on the basis of the child learning profile and the family’s learning style.
A number of questions remain, which need further critical evaluation. First, it is unclear whether predictors of intervention outcomes are specific to ASD. As reported above, a number of specific factors in the two areas of impairments that characterize ASD (social communication and repetitive behaviors domains) are likely to hinder positive responses to intervention; however, other factors that are not specific to ASD (e.g., attention span, memory) might also play an important role in predicting outcomes. For example, IQ and language abilities are associated with outcomes across a number of conditions [e.g., schizophrenia (114), depression (115), conduct disorder (116)] that are not related to ASD. Indeed, these factors might predict outcomes above and beyond receiving early intervention per se [see Ref. (117–119)].
It is possible that factors associated with positive responses to intervention are the same that support positive learning in children without an ASD. More research is needed, therefore, to achieve a more fine-grained understanding of mechanisms supporting early learning and cognitive development in typical development as well as atypical development (e.g., neuropsychological processes such as attention and processing speed and social processes such as social engagement, sharing of affect, and joint attention). Sophisticated research designs are also needed to identify distinctions and overlaps and the interplay between variables moderating treatment changes, those mediating outcomes, and those affecting both processes.
Given the scarcity of standardized tools to assess social and non-social factors that might be relevant for response to intervention, measurement of putative predictors of outcomes poses relevant challenges. More efforts are currently needed to develop systematic observational and experimental tasks that provide reliable measurements of such predictors.
Another critical aspect concerns the definition of positive versus nil or minimal outcomes in ASD research. Outcome measures used in treatment research might not be sufficiently sensitive to capture gains in children making very slow or very small gains. However, these small progressions might have a relevant impact on the family and child’s quality of life and may be the necessary “first order” changes that are needed to allow further positive response. Thus, the operational definition of “responders” versus “non-responders” should take into account different outcome criteria besides the standard/conventional measures used in ASD research.
Moreover intervention in ASD, while promoting gains in certain areas, can also be instrumental in preventing declines or worsening in other domains. For example, there is evidence that some repetitive behaviors might increase over time in ASD (120), and it is conceivable that a treatment program could aim to prevent such increase. In this case, the absence of change in repetitive behaviors in children undergoing treatment cannot be seen as evidence of a lack of treatment response. Therefore, definitions of responders and non-responders must be conceptualized and framed on knowledge of developmental patterns in the different treatment target domains.
A related issue is the question of when do we begin to classify children as “non-responders”? If children are not showing measurable gains after 1 year, is it possible that they will start responding in the second year? Currently, our knowledge on the timing of treatment response is limited. Different studies provide information on predictors of outcomes in relation to programs that vary in duration, making it difficult to compare results and to calibrate expectations about the timing of treatment response. In order for research to inform clinical decision-making, some consensus about the timing of expected response to treatment is therefore necessary, and approaches that allow time-limited intervention with ongoing follow-up to allow future intervention planning should be developed.
A further challenge is the clinical management of “non-responders” to early intervention programs. In the best-case scenario, future research will indicate that those children who do not respond to some early intervention programs will nonetheless respond to other available programs, so that each child can be matched to the most appropriate program. However, it is possible that specific child or family factors are associated with minimal or no responses across all available treatment options. If this is the case, it will be necessary to target the specific factors that are known to limit the efficacy of the program [“treating the constraints” approach (59)], and to conduct specific research focused on these “non-responders.” Until research indicates successful strategies to address the factors limiting response to treatment in this subgroup, the question is: should children who present with a “non-responder” profile be referred to programs from which they will not benefit? This raises a number of ethical issues as well as concerns with regard to cost–benefits considerations, and individual rights to access services.
Finally, the research recommendations that we have outlined, which involve a focus on individual differences in large heterogeneous samples, the measurement of a variety of theory-driven predictor variables at baseline, and the comparison of prognostic indicators across different programs, are expensive ones. To have a sufficient number of participants to identify robust profiles of responders and non-responders to available early intervention programs and to replicate findings across sites requires large-scale collaborative multisite research. Nonetheless, the practical implications of such a research program surely justify the necessary investment, especially as ASD is currently diagnosed in more than 1 in every 100 children and the problems associated with ASD have a high impact for the individual, their family, and the community.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
ReferencesBetancurC. Etiological heterogeneity in autism spectrum disorders: more than 100 genetic and genomic disorders and still counting. Brain Res (2011) 1380:42–77.10.1016/j.brainres.2010.11.07821129364HappeFRonaldAPlominR. Time to give up on a single explanation for autism. Nat Neurosci (2006) 9(10):1218–20.10.1038/nn177017001340BrockJ. Commentary: complementary approaches to the developmental cognitive neuroscience of autism – reflections on Pelphrey et al. (2011). J Child Psychol Psychiatry (2011) 52(6):645–6.10.1111/j.1469-7610.2011.02414.xWaterhouseL. Rethinking Autism: Variation and Complexity. London: Academic Press (2011).HowlinPMagiatiICharmanT. Systematic review of early intensive behavioral interventions for children with autism. Am J Intellect Dev Disabil (2009) 114(1):23–41.10.1352/2009.114:2319143460ReichowBBartonEEBoydBAHumeK. Early intensive behavioral intervention (EIBI) for young children with autism spectrum disorders (ASD). Cochrane Database Syst Rev (2012) 10:CD009260.10.1002/14651858.CD009260.pub2RogersSWallaceK. Intervention for infants and toddlers with autism spectrum disorders. In: AmaralDGDawsonGGeschwindDH, editors. Autism Spectrum Disorders. New York: Oxford University Press (2011). p. 1081–94.HowlinPCharmanT. Autism spectrum disorders, interventions and outcomes. In: HowlinPCharmanTGhaziuddinM, editors. The SAGE Handbook of Developmental Disorders. London: SAGE (2011). p. 309–26.EldevikSHastingsRPHughesJCJahrEEikesethSCrossS. Meta-analysis of early intensive behavioral intervention for children with autism. J Clin Child Adolesc Psychol (2009) 38(3):439–50.10.1080/1537441090285173919437303MagiatiITayXHowlinP. Early comprehensive behaviorally based interventions for children with autism spectrum disorders: a summary of findings from recent reviews and meta-analyses. Neuropsychiatry (2012) 2:543–70.10.2217/npy.12.59HepburnS. Early intensive behavioral intervention (EIBI). In: VolkmarF, editor. Encyclopedia of Autism Spectrum Disorders. New York: Springer (2013). p. 1028–31.FountainCWinterABearmanP. Six developmental trajectories characterize children with autism. Pediatrics (2012) 129:1112–20.10.1542/peds.2011-160122473372AnagnostouEBearMDawsonG. Future directions in the treatment of autism spectrum disorders. In: AmaralDDawsonGGeschwindD, editors. Autism Spectrum Disorders. New York: Oxford University Press (2011). p. 1259–68.StahmerACSchreibmanLCunninghamAB. Toward a technology of treatment individualization for young children with autism spectrum disorders. Brain Res (2011) 1380:229–39.10.1016/j.brainres.2010.09.04320858466GreenVAPituchKAItchonJChoiAO’ReillyMSigafoosJ. Internet survey of treatments used by parents of children with autism. Res Dev Disabil (2006) 27(1):70–84.10.1016/j.ridd.2004.12.00215919178LevySEHymanSL. Novel treatments for autistic spectrum disorders. Ment Retard Dev Disabil Res Rev (2005) 11(2):131–42.10.1002/mrdd.2006215977319PriorMRobertsJMARodgerSWilliamsKSutherlandR. A Review of the Research to Identify the Most Effective Models of Practice in Early Intervention of Children with Autism Spectrum Disorders. Australian Government Department of Families, Housing, Community Services and Indigenous Affairs (2011).ReichowBDoehringPCicchettiDVVolkmarFR. Evidence-Based Practices and Treatments for Children with Autism. New York, NY: Springer (2011).CarrJELeBlancLA. Autism spectrum disorders in early childhood: an overview for practicing physicians. Prim Care (2007) 34:343–59.10.1016/j.pop.2007.04.00917666231GrowLLCarrJEKodakTMJostadCMKisamoreAN. A comparison of methods for teaching receptive labeling to children with autism spectrum disorders. J Appl Behav Anal (2011) 44:475–98.10.1901/jaba.2011.44-47521941380LoveJRCarrJEAlmasonSMIngeborg PétursdóttirA. Early and intensive behavioral intervention for autism: a survey of clinical practices. Res Autism Spectr Disord (2009) 3:421–8.10.1016/j.rasd.2008.08.008ReichowB. Overview of meta-analyses on early intensive behavioral intervention for young children with autism spectrum disorders. J Autism Dev Disord (2012) 42:512–20.10.1007/s10803-011-1218-921404083LovaasOI. Teaching Developmentally Disabled Children: the ME Book. Austin, TX: Pro-Ed (1981).IngersollB. Pilot randomized controlled trial of reciprocal imitation training for teaching elicited and spontaneous imitation to children with autism. J Autism Dev Disord (2010) 40(9):1154–60.10.1007/s10803-010-0966-220155309GreenJCharmanTMcConachieHAldredCSlonimsVHowlinPParent-mediated communication-focused treatment in children with autism (PACT): a randomised controlled trial. Lancet (2010) 375(9732):2152–60.10.1016/S0140-6736(10)60587-920494434EldevikSHastingsRPJahrEHughesJC. Outcomes of behavioral intervention for children with autism in mainstream pre-school settings. J Autism Dev Disord (2012) 42(2):210–20.10.1007/s10803-011-1234-921472360HaywardDEikesethSGaleCMorganS. Assessing progress during treatment for young children with autism receiving intensive behavioural interventions. Autism (2009) 13(6):613–33.10.1177/136236130934002919933766MagiatiIMossJCharmanTHowlinP. Patterns of change in children with Autism Spectrum Disorders who received community based comprehensive interventions in their pre-school years: a seven year follow-up study. Res Autism Spectr Disord (2011) 5(3):1016–27.10.1016/j.rasd.2010.11.007Peters-SchefferNDiddenRKorziliusHSturmeyP. A meta-analytic study on the effectiveness of comprehensive ABA-based early intervention programs for children with autism spectrum disorders. Res Autism Spectr Disord (2011) 5:60–9.10.1016/j.rasd.2010.03.011PerryACummingsADunn GeierJFreemanNHughesSLaRoseLEffectiveness of intensive behavioural intervention in a large community based program. Res Autism Spectr Disord (2008) 2:621–42.10.1016/j.rasd.2008.01.002RemingtonBHastingsRPKovshoffHdegli EspinosaFJahrEBrownTEarly intensive behavioral intervention: outcomes for children with autism and their parents after two years. Am J Ment Retard (2007) 112(6):418–38.10.1352/0895-8017(2007)112[418:EIBIOF]2.0.CO;217963434SmithIMKoegelRLKoegelLKOpendenDAFossumKLBrysonSE. Effectiveness of a novel community-based early intervention model for children with autistic spectrum disorder. Am J Intellect Dev Disabil (2010) 115(6):504–23.10.1352/1944-7558-115.6.50420946003Ben-ItzchakEWatsonLRZachorDA. Cognitive ability is associated with different outcome trajectories in autism spectrum disorders. J Autism Dev Disord (2014).10.1007/s10803-014-2091-024710810MakrygianniMReedP. A meta-analytic review of the effectiveness of behavioural early intervention programs for children with autistic spectrum disorders. Res Autism Spectr Disord (2010) 4:577–93.10.1016/j.rasd.2010.01.014VivantiGBarbaroJHudryKDissanayakeCPriorM. Intellectual development in autism spectrum disorder. Front Hum Neurosci (2013) 7:354.10.3389/fnhum.2013.00354ZachorDABen-ItzchakERabinovichALahatE. Change in autism core symptoms with intervention. Res Autism Spectr Disord (2007) 1:304–17.10.1016/j.rasd.2006.12.001EldevikSHastingsRHughesJJahrEEikesethSCrossS. Using participant data to extend the evidence base for intensive behavioral intervention for children with autism. Am J Intellect Dev Disabil (2010) 115:381–405.10.1352/1944-7558-115.5.38120687823SallowsGOGraupnerTD. Intensive behavioral treatment for children with autism: four-year outcome and predictors. Am J Ment Retard (2005) 110(6):417–38.10.1352/0895-8017(2005)110[417:IBTFCW]2.0.CO;216212446FlanaganHEPerryAFreemanNL. Effectiveness of large-scale community-based intensive behavioral intervention: a waitlist comparison study exploring outcomes and predictors. Res Autism Spectr Disord (2012) 6(2):673–82.10.1016/j.rasd.2011.09.011LuiselliJKCannonBOEllisJTSissonRW. Home-based behavioral interventions for young children with autism/pervasive developmental disorder: a preliminary evaluation of outcome in relation to child age and intensity of service delivery. Autism (2000) 4:426–38.10.1177/1362361300004004007RogersSJVismaraLA. Evidence-based comprehensive treatments for early autism. J Clin Child Adolesc Psychol (2008) 37(1):8–38.10.1080/1537441070181780818444052SmithTGroenADWynnJW. Randomized trial of intensive early intervention for children with pervasive developmental disorder. Am J Ment Retard (2000) 105:269–85.10.1352/0895-8017(2000)105<0269:RTOIEI>2.0.CO;210934569Virues-OrtegaJ. Applied behavior analytic intervention for autism in early childhood: meta-analysis, meta-regression and dose-response meta-analysis of multiple outcomes. Clin Psychol Rev (2010) 30(4):387–99.10.1016/j.cpr.2010.01.00820223569EapenVCrncecRWalterA. Exploring links between genotypes, phenotypes, and clinical predictors of response to early intensive behavioral intervention in autism spectrum disorder. Front Hum Neurosci (2013) 7:567.10.3389/fnhum.2013.0056724062668ShererMRSchreibmanL. Individual behavioral profiles and predictors of treatment effectiveness for children with autism. J Consult Clin Psychol (2005) 73(3):525–38.10.1037/0022-006X.73.3.52515982150KasariCGulsrudAFreemanSPaparellaTHellemannG. Longitudinal follow-up of children with autism receiving targeted interventions on joint attention and play. J Am Acad Child Adolesc Psychiatry (2012) 51(5):487–95.10.1016/j.jaac.2012.02.01922525955KasariCPaparellaTFreemanSJahromiLB. Language outcome in autism: randomized comparison of joint attention and play interventions. J Consult Clin Psychol (2008) 76(1):125–37.10.1037/0022-006X.76.1.12518229990CarterASMessingerDSStoneWLCelimliSNahmiasASYoderP. A randomized controlled trial of Hanen’s ‘more than words’ in toddlers with early autism symptoms. J Child Psychol Psychiatry (2011) 52(7):741–52.10.1111/j.1469-7610.2011.02395.x21418212SchreibmanLStahmerACBarlettVCDufekS. Brief report: toward refinement of a predictive behavioral profile for treatment outcome in children with autism. Res Autism Spectr Disord (2009) 3(1):163–72.10.1016/j.rasd.2008.04.00820046210YoderPStoneWL. A randomized comparison of the effect of two prelinguistic communication interventions on the acquisition of spoken communication in preschoolers with ASD. J Speech Lang Hear Res (2006) 49(4):698–711.10.1044/1092-4388(2006/051)16908870IngersollBSchreibmanLStahmerA. Brief report: differential treatment outcomes for children with autistic spectrum disorder based on level of peer social avoidance. J Autism Dev Disord (2001) 31(3):343–9.10.1023/A:1010703521704KlintwallLEikesethS. Number and controllability of reinforcers as predictors of individual outcome for children with autism receiving early and intensive behavioral intervention: a preliminary study. Res Autism Spectr Disord (2012) 6:493–9.10.1016/j.rasd.2011.07.009Ben-ItzchakEZachorDA. Who benefits from early intervention in autism spectrum disorders?Res Autism Spectr Disord (2011) 5:345–50.10.1016/j.rasd.2010.04.018TurnerLMStoneWL. Variability in outcome for children with an ASD diagnosis at age 2. J Child Psychol Psychiatry (2007) 48(8):793–802.10.1111/j.1469-7610.2007.01744.x17683451OsborneLMcHughLSaundersJReedP. Parenting stress reduces the effectiveness of early teaching interventions for autistic spectrum disorders. J Autism Dev Disord (2008) 38:1092–103.10.1007/s10803-007-0497-718027079RickardsALWalstabJEWright-RossiRASimpsonJReddihoughDS. One-year follow-up of the outcome of a randomized controlled trial of a home-based intervention program for children with autism and developmental delay and their families. Child Care Health Dev (2009) 35:593–602.10.1111/j.1365-2214.2009.00953.x19508318KazdinAE. Mediators and mechanisms of change in psychotherapy research. Annu Rev Clin Psychol (2007) 3:1–27.10.1146/annurev.clinpsy.3.022806.091432LordCWagnerARogersSSzatmariPAmanMCharmanT. Challenges in evaluating psychosocial interventions for autistic spectrum disorders. J Autism Dev Disord (2005) 35(6):695–708.10.1007/s10803-005-0017-616496206YoderPComptonD. Identifying predictors of treatment response. Ment Retard Dev Disabil Res Rev (2004) 10(3):162–8.10.1002/mrdd.2001315611985TrembathDVivantiG. Problematic but predictive: individual differences in children with autism spectrum disorders. Int J Speech Lang Pathol (2014) 16:57–60.10.3109/17549507.2013.85930024345003MagiatiITayXHowlinP. Cognitive, language, social and behavioural outcomes in adults with autism spectrum disorders: a systematic review of longitudinal follow-up studies in adulthood. Clin Psychol Rev (2014) 34(1):73–86.10.1016/j.cpr.2013.11.00224424351CamarataS. Validity of early identification and early intervention in autism spectrum disorders: future directions. Int J Speech Lang Pathol (2014) 16:61–9.10.3109/17549507.2013.86470824410020ZachorDACuratoloP. Recommendations for early diagnosis and intervention in autism spectrum disorders: an Italian–Israeli consensus conference. Eur J Paediatr Neurol (2014) 18(2):107–18.10.1016/j.ejpn.2013.09.00224095105DawsonGRogersSMunsonJSmithMWinterJGreensonJRandomized, controlled trial of an intervention for toddlers with autism: the early start Denver model. Pediatrics (2010) 125(1):e17–23.10.1542/peds.2009-095819948568DykensEMLenseM. Intellectual disabilities and autism spectrum disorder: a cautionary note. In: AmaralDDawsonGGeschwindD, editors. Autism Spectrum Disorders. New York: Oxford University Press (2011). p. 261–9.GillbergC. Perspective article: autism as a medical disorder. In: AmaralDGDawsonGGeschwindDH, editors. Autism Spectrum Disorders. New York: Oxford University Press (2011). p. 611–31.DoverCJLeCouterA. How to diagnose autism. Arch Dis Child (2007) 92:540–5.10.1136/adc.2005.086280MatsonJJangJ. The most commonly reported behavior analytic methods in early intensive autism treatments. Rev J Autism Dev Disord (2014) 1:80–6.10.1007/s40489-013-0005-2CiprianiAGeddesJR. Randomised controlled trials. In: StolermanI, editor. Encyclopedia of Psychopharmacology. Heidelberg: Springer-Verlag (2010). p. 1112–9.VivantiGDissanayakeCZierhutCRogersSJ. Brief report: predictors of outcomes in the early start Denver model delivered in a group setting. J Autism Dev Disord (2012) 43:1717–24.10.1007/s10803-012-1705-723124361CharmanTTaylorEDrewACockerillHBrownJABairdG. Outcome at 7 years of children diagnosed with autism at age 2: predictive validity of assessments conducted at 2 and 3 years of age and pattern of symptom change over time. J Child Psychol Psychiatry (2005) 46:500–13.10.1111/j.1469-7610.2004.00377.x15845130KarstJSVan HeckeAV. Parent and family impact of autism spectrum disorders: a review and proposed model for intervention evaluation. Clin Child Fam Psychol Rev (2012) 15:247–77.10.1007/s10567-012-0119-622869324SingerGHS. Meta-analysis of comparative studies of depression in mothers of children with and without developmental disabilities. Am J Ment Retard (2006) 11:155–69.10.1352/0895-8017(2006)111[155:MOCSOD]2.0.CO;216597183KazdinAEMazurickJL. Dropping out of child psychotherapy: distinguishing early and late dropouts over the course of treatment. J Consult Clin Psychol (1994) 62:1069–74.10.1037/0022-006X.62.5.10697806717Webster-StrattonC. Early intervention with videotape modeling: programs for families of young children with oppositional defiant disorder or conduct disorder. In: HibbsEDJensenPS, editors. Psychosocial Treatment Research of Child and Adolescent Disorders. Washington, D.C: APA (1996). p. 435–74.WerbaBEEybergSMBoggsSRAlginaJ. Predicting outcome in parent-child interaction therapy: success and attrition. Behav Modif (2006) 30:618–46.10.1177/014544550427297716894233YoderPJWarrenSF. Maternal responsivity predicts the prelinguistic communication intervention that facilitates generalized intentional communication. J Speech Lang Hear Res (1998) 41(5):1207–19.9771641SchreibmanLKoegelRL. Fostering self-management: parent-delivered pivotal response training for children with autistic disorder. In: HibbsEDJensenPS, editors. Psychosocial Treatment for Child and Adolescent Disorders: Empirically Based Strategies for Clinical Practice. Washington, DC: American Psychological Association (1996). p. 525–52.ShineRPerryA. Brief report: the relationship between parental stress and intervention outcome of children with autism. J Dev Disabil (2010) 16(2):64–6.10.1007/s10803-007-0497-7ScottS. Outcomes of treatment. In: RemschmidtHBelferMGoodyerI, editors. Facilitating Pathways. Berlin: Springer (2004). p. 222–31.RogersSJDawsonG. Early Start Denver Model for Young Children with Autism: Promoting Language, Learning, and Engagement. New York: Guilford Press (2010).MesibovGBVSchoplerE. The TEACCH Approach to Autism Spectrum Disorders. New York: Kluwer Academic/Plenum Publishers (2005).DawsonGBernierR. Social brain circuitry in autism. In: CochDDawsonGFischerK, editors. Human Behavior and the Developing Brain. New York: Guilford Press (2007). p. 28–55.van OersB. Developmental Education for Young Children. Concept, Practice, and Implementation. International Perspectives on Early Childhood Education and Development 7. Dordrecht: Springer (2012). p. 13–27.de HaanD. Learning to communicate in young children’s classrooms. In: van OersB, editor. Developmental Education for Young Children: Concept, Practice, Implementation. New York: Springer (2012). p. 67–86.HartKIFujikiMBrintonBHartCH. The relationship between social behaviour and severity of language impairment journal of speech. Lang Hear Res (2004) 47(3):647.10.1044/1092-4388(2004/050)15212575BrunerJ. The ontogenesis of speech acts. J Child Lang (1975) 2:1–19.10.1017/S0305000900000866MundyP. Annotation: the neural basis of social impairments in autism: the role of the dorsal medial-frontal cortex and anterior cingulated system. J Child Psychol Psychiatry (2003) 44:793–809.10.1111/1469-7610.00165BanduraA. Social Learning Theory. New York: General Learning Press (1977).CsibraGGergelyG. ‘Obsessed with goals’: functions and mechanisms of teleological interpretation of actions in humans. Acta Psychol (Amst) (2007) 124(1):60–78.10.1016/j.actpsy.2006.09.00717081489TomaselloM. The Cultural Origins of Human Cognition. Cambridge, MA: Harvard University Press (1999).YoungGSRogersSJHutmanTRozgaASigmanMOzonoffS. Imitation from 12 to 24 months in autism and typical development: a longitudinal Rasch analysis. Dev Psychol (2011) 47(6):1565–78.10.1037/a002541821910524HernikMCsibraG. Functional understanding facilitates learning about tools in human children. Curr Opin Neurobiol (2009) 19(1):34–8.10.1016/j.conb.2009.05.00319477630ZwaigenbaumL. Screening, risk, and early identification of autism spectrum disorders. In: AmaralDGeschwindDDawsonG, editors. Autism Spectrum Disorders. New York: Oxford University Press (2011). p. 75–85.PoonKKWatsonLRBaranekGTPoeMD. To what extent do joint attention, imitation, and object play behaviors in infancy predict later communication and intellectual functioning in ASD?J Autism Dev Disord (2012) 42(6):1064–74.10.1007/s10803-011-1349-z21858585WattNWetherbyAMBarberAMorganL. Repetitive and stereotyped behaviors in children with autism spectrum disorders in the second year of life. J Autism Dev Disord (2008) 38(8):1518–33.10.1007/s10803-007-0532-818266099BoppKDMirendaPZumboBD. Behavior predictors of language development over 2 years in children with autism spectrum disorders. J Speech Lang Hear Res (2009) 52(5):1106–20.10.1044/1092-4388(2009/07-0262)EikesethSKlintwallLJahrEKarlssonP. Outcome for children with autism receiving early and intensive behavioral intervention in mainstream preschool and kindergarten settings. Res Autism Spectr Disord (2012) 6(2):829–35.10.1007/s10803-011-1234-921472360LevySKimAOliveM. Interventions for young children with autism: a synthesis of the literature. Focus Autism Other Dev Disabl (2006) 21(1):55–62.10.1177/10883576060210010701WallaceKSRogersSJ. Intervening in infancy: implications for autism spectrum disorders. J Child Psychol Psychiatry (2010) 51(12):1300–20.10.1111/j.1469-7610.2010.02308.x20868374BakerBBlacherJCrnicKEdelbrockC. Behavior problems and parenting stress in families of three-year-old children with and without developmental delays. Am J Ment Retard (2002) 107(6):433–44.10.1046/j.1365-2788.2003.00484.x12323068McStayRLDissanayakeCScheerenAKootHMBegeerS. Parenting stress and autism: the role of age, autism severity, quality of life and problem behaviour of children and adolescents with autism. Autism (2013).10.1177/136236131348516324104515BrobstJCloptonJHendrickS. Parenting children with autism spectrum disorders: the couple’s relationship. Focus Autism Other Dev Disabl (2009) 24(1):38–49.10.1177/1088357608323699GialloRWoodCJellettRPorterR. Fatigue, wellbeing and parental self-efficacy in mothers of children with an autism spectrum disorder. Autism (2013) 17(4):465–80.10.1177/136236131141683021788255BensonP. Network characteristics, perceived social support, and psychological distress in mothers of children with autism spectrum disorder. Paper Presented at the Annual Meeting of the American Sociological Association Annual Meeting. Denver, CO: Colorado Convention Centre and Hyatt Regency (2012).MinnesPMcShaneJForkesSGreenSClementBCardL. Coping resources of parents of developmentally handicapped children living in rural communities. Australia and New Zealand. J Dev Disabil (1989) 15:109–18.MarionSASchechterMT. Risk and prognosis. In: TroidlHSpitzerWMcPeekBMulderDMcKneallyMWechslerA, editors. Principles and Practice of Research. New York: Springer (1991). p. 169–80.Deater-DeckardKDodgeKABatesJEPettitGS. Multiple risk factors in the development of externalizing behavior problems: group and individual differences. Dev Psychopathol (1998) 10(3):469–93.10.1017/S0954579498001709TrentacostaCJHydeLWGoodlettBDShawDS. Longitudinal prediction of disruptive behavior disorders in adolescent males from multiple risk domains. Child Psychiatry Hum Dev (2013) 44(4):561–72.10.1007/s10578-012-0349-323239427HeimannHGaertnerHJ. Research methodology in clinical trials of psychotropic drugs. In: HoffmeisterFStilleG, editors. Handbook of Experimental Pharmacology. Berlin: Springer (1982). p. 391–407.BeggCChoMEastwoodSHortonRMoherDOlkinIImproving the quality of reporting of randomised controlled trials. The CONSORT statement. J Am Med Assoc (1996) 276:637–9.10.1001/jama.1996.03540080059030FonagyP. Psychotherapy research: do we know what works for whom?Br J Psychiatry (2010) 197(2):83–5.10.1192/bjp.bp.110.07965720679254National Institute of Mental Health. National Institutes of Mental Health Strategic Plan. (2010). Available from: http://www.nimh.nih.gov/about/strategic-planning-reports/index.shtmlBotaRGMunroSNguyenCPredaA. Course of schizophrenia: what has been learned from longitudinal studies? In: RitsnerM, editor. Handbook of Schizophrenia Spectrum Disorders. (Vol. II). New York: Springer (2011). p. 281–300.TreuerTTohenM. Predicting the course and outcome of bipolar disorder: a review. Eur Psychiatry (2010) 25(6):328–33.10.1016/j.eurpsy.2009.11.01220444581LaheyBBLoeberRHartELFrickPJApplegateBZhangQFour-year longitudinal study of conduct disorder in boys: patterns and predictors of persistence. J Abnorm Psychol (1995) 104(1):83.10.1037/0021-843X.104.1.837897057GabrielsRLHillDEPierceRARogersSJWehnerB. Predictors of treatment outcome in young children with autism: a retrospective study. Autism (2001) 5(4):407–29.10.1177/136236130100500400611777257EavesLCHoHH. The very early identification of autism: outcome to age 2–5. J Autism Dev Disord (2004) 34(4):367–78.10.1023/B:JADD.0000037414.33270.a815449513FernellEErikssonMAGillbergC. Early diagnosis of autism and impact on prognosis: a narrative review. Clin Epidemiol (2013) 5:33.10.2147/CLEP.S4171423459124HarropCMcConachieHEmsleyRLeadbitterKGreenJPACT Consortium. Restricted and repetitive behaviors in autism spectrum disorders and typical development. J Autism Dev Disord (2014) 44(5):1207–19.10.1007/s10803-013-1986-5.24234675