1

Word count: Abstract: 189 Text: 6485 Tables: 5 Figures: 0 Supplementary Tables: 1

The Structure of Adult ADHD

Running head: Structure of Adult ADHD

Lenard A. Adler1*, Stephen V. Faraone2, Thomas J. Spencer3, Patricia Berglund4, Samuel Alperin1,5, and Ronald C. Kessler6

July, 2016 Revised November, 2016

1 Department of and Child and Adolescent Psychiatry, New York University Langone School of Medicine and Psychiatry Service, New York, NY, USA 2Departments of Psychiatry and of and Physiology, SUNY Upstate Medical University, Syracuse, NY, USA 3Department of Psychiatry, Massachusetts General Hospital and , Boston, MA, USA 4Institute for Social Research, University of Michigan, Ann Arbor, MI, USA 5Hofstra Northwell School of Medicine, Hofstra University, Hempstead, NY, USA 6Department of Health Care Policy, Harvard Medical School, Boston, MA, USA

*Corresponding author: Lenard A. Adler, MD, Department of Psychiatry and Child and Adolescent Psychiatry, New York University Langone School of Medicine and Psychiatry Service, New York City, USA; Tel. (312) 753-7537; Fax (312) 753-7886; [email protected].

This is the author manuscript accepted for publication and has undergone full peer review but has not been through the copyediting, typesetting, pagination and proofreading process, which may lead to differences between this version and the Version of Record. Please cite this article as doi: 10.1002/mpr.1555

This article is protected by copyright. All rights reserved. 2

ABSTRACT

Although DSM-5 stipulates that symptoms of -deficit/hyperactivity disorder (ADHD) are the same for adults as children, clinical observations suggest that adults have more diverse deficits than children in higher-level executive functioning and emotional control. Previous psychometric analyses to evaluate these observations have been limited in ways addressed in the current study, which analyzes the structure of an expanded set of adult ADHD symptoms in 3 pooled U.S. samples: a national household sample, a sample of health plan members, and a sample of adults referred for evaluation at an adult ADHD clinic. Exploratory factor analysis found 4 factors representing executive dysfunction/inattention (including, but not limited to, all the DSM-5 inattentive symptoms, with non-DSM symptoms having factor loadings comparable to those of DSM symptoms), hyperactivity, , and emotional dyscontrol. Empirically- derived multivariate symptom profiles were broadly consistent with the DSM-5 inattentive-only, hyperactive/impulsive-only, and combined presentations, but with inattention including executive dysfunction/inattention and hyperactivity-only limited to hyperactivity without high symptoms of impulsivity. These results show that executive dysfunction is as central as DSM-5 symptoms to adult ADHD, while emotional dyscontrol is more distinct but prominent resent in the combined presentation of adult ADHD.

Key Words: adults; ADHD; attention-deficit hyperactivity disorder; epidemiology

This article is protected by copyright. All rights reserved. 3

Adult Attention Deficit Hyperactivity Disorder (ADHD) is a commonly-occurring childhood-

onset disorder that often persists into adulthood (Kessler et al., 2006). Although DSM-5 requires

fewer symptoms among adults than children (American Psychiatric Association., 2013), the

symptoms are stipulated to be the same for adults as children despite the fact that clinical

observations suggest that the frank hyperactivity of childhood ADHD manifests more as a sense

of internal restlessness among adults (Adler and Cohen, 2004) and that adults have a more

diverse set of deficits than children in higher-level executive functioning and emotional control

(Barkley et al., 2008; Faraone et al., 2010; Surman et al., 2011; Ward et al., 1993).

A number of researchers have attempted to confirm these clinical observations by

developing expanded assessments that include deficits in executive functioning and in emotional

control along with the DSM symptoms of inattention (AD) and hyperactivity-impulsivity (HD)

and carrying out exploratory factor analyses of this expanded symptom set among patients with

ADHD and controls (Amador-Campos et al., 2014; Christiansen et al., 2011; Conners et al.,

1999; Kessler et al., 2010; Marchant et al., 2013; Marchant et al., 2015). These studies have found a 2-factor structure in studies of the clinician-administered Wender-Reimherr Adult

Attention Deficit Disorder Scale (WRAADDS) (Marchant et al., 2013) and the self-report version of that scale (Marchant et al., 2015) compared to 3-factor (Kessler et al., 2010), 4-factor

(Amador-Campos et al., 2014; Conners et al., 1999), or 6-factor (Christiansen et al., 2011) solutions in studies using other instruments.

This article is protected by copyright. All rights reserved. 4

In evaluating these discrepant results, it is important to note that published WRAADDS factor analyses were carried out on 7 rationally-constructed subscales rather than on the more than 60 underlying symptoms assessed in the WRAADDS. The 2-factor solutions showed the inattention and disorganization subscales loading on the first factor, 3 emotion subscales (temper, affective liability, emotional over-reactivity) loading on the second factor, and the remaining subscales of hyperactivity/restless and impulsivity loading on both factors. However, the items in the overall scale were combined into these 7 presumed underlying subscales based on theory rather than on empirical considerations. To our knowledge, no empirical data have ever been reported confirming the empirical validity of these 7 subscales. Critically, the resulting 7x7 correlation matrix among the rational WRAADDS subscales contains only 21 correlations (i.e.,

7x6/2 = 21), making it impossible to identify a factor model with more than 2 correlated factors, as a 3-factor model would contain 21 factor loadings (7 for each of 3 factors) and 3 correlations among factors, which would exceed the number of degrees of freedom in the correlation matrix.

As a consequence, the “finding” of a 2-factor structure in the WRAADDS exploratory factor analyses is actually a construction rather than a finding.

This problem could have been avoided by carrying out the WRAADDS factor analyses on the symptom-level data rather than introducing the intermediate step of creating rationally- constructed subscales, but this was not done in the WRAADDS studies because the samples on which the factor analyses were based were thought to be too small to allow symptom-level factor analyses to be carried out. For example, the paper reporting the factor structure of the self-report

This article is protected by copyright. All rights reserved. 5 version of the WRAADDS was based on a mere 120 community controls and 122 patients with adult ADHD (Marchant et al., 2015). But were these samples too small? Guidelines on the required sample size for exploratory factor analysis have been inconsistent (Comrey and Lee,

1992; Gorsuch, 1983; Kline, 1994), but recent simulations show that the sample size required to recover a stable factor structure is a joint function of number of factors, number of items per factor (with the required sample size stabilizing after 6-10 items per factor), and strength of factor loadings (MacCallum et al., 1999; Mundfrom et al., 2005). In addition, sample size requirements are higher when the symptoms are dichotomies, as they typically are in factor analyses of psychiatric symptoms, and when symptom prevalence is variable (Pearson and

Mundfrom, 2010). Based on these results, a scale like the WRAADDS, where the number of items per hypothesized factor is 8-9, and there might be as many as 7 factors, the minimum required sample size for good recovery of the population factor structure would be 1,600-2,000.

For a 4-factor solution of the sort hypothesized to exist by many experts in ADHD (i.e., inattention/executive dysfunction, hyperactivity, impulsivity, emotional dyscontrol), a stable factor structure based on scales with between 9 (the number of DSM-5 symptoms of inattention and the number for hyperactivity/impulsivity) and 12 items the minimum required sample size would be 320-500 respondents (Pearson and Mundfrom, 2010). Even the smallest of these required sample sizes is several times larger than the sample size used in the factor analysis of the self-report version of the WRAADDS. However, the sample size used in an earlier factor analysis of the clinician-administered version of the WRAADDS that combined data across 3

This article is protected by copyright. All rights reserved. 6

clinical trial samples (with a combined sample of 717) would have been large enough to evaluate

a 4-factor model, although not a 7-factor model (Marchant et al., 2015).

Other published factor analyses of expanded adult ADHD symptom sets were based on symptom-level analyses. Our own previous work, based on a pooled analysis of 345 respondents in a national household sample and a health plan sample, found a 3-factor structure among symptoms in an expanded symptom assessment that included all 18 DSM symptoms of AD and

HD in addition to 14 additional symptom questions designed to assess executive dysfunction and emotional dyscontrol (Kessler et al., 2010). The 3 factors in that analysis included an inattentive/executive dysfunction factor, a hyperactivity factor, and an impulsivity factor, with the emotional dyscontrol items loading on the impulsivity factor. Other exploratory factor analyses evaluated the structure of the Conners’ Adult ADHD Rating Scale (CAARS; Amador-

Campos et al., 2014; Christiansen et al., 2011; Conners et al., 1999). The original CAARS factor analysis (Conners et al., 1999) and a confirmatory factor analysis replication (Amador-Campos

et al., 2014) found a 4-factor solution, with 3 of the factors the same as the inattentive/executive

dysfunction, hyperactivity, and impulsivity factors in our earlier study, and the 4th factor

representing problems with self-concept. However, another CAARS replication study in

Germany found a 6-factor solution after excluding CAARS items with high cross-loadings or low loadings on any factor were eliminated (Christiansen et al., 2011). That analysis found a separate emotional dyscontrol factor in addition to inattentive/executive dysfunction,

This article is protected by copyright. All rights reserved. 7

hyperactivity, and impulsivity factors as well as two other factors appearing to represent

dimensions not strongly related to adult ADHD.

The fact that an inattention/executive dysfunction factor was found consistently in all the

symptom-level factor analyses of expanded ADHD symptoms is consistent with the thinking of clinical experts that adults have a more diverse set of deficits than children in higher-level executive functioning. However, these studies were inconsistent in finding evidence that childhood hyperactivity or impulsivity broaden in adulthood to include difficulties in emotional control. Our failure to find evidence of such an emotional dyscontrol factor in our earlier study might have been due to our exclusive reliance on community samples, whereas the failure to find such evidence in the CAARS studies other than the German replication might have been due to conceptual confounding with self-concept problems that was removed in the German study by deleting items with cross-loadings.

Even if a distinct emotional dyscontrol factor can be found in future symptom-level factor analyses of the WRAADDS, CAARS, or other expanded assessments of adult ADHD, though, this might not mean that emotional dyscontrol is a feature of adult ADHD any more than the CAARS factor analyses demonstrated that problems with self-concept are a feature of adult

ADHD. An alternative possibility is that such factors emerge simply because the researchers who

developed the expanded adult ADHD symptom scales included symptoms of these dimensions in

their scales even though the dimensions underlying these symptoms are not specific to adult

ADHD. A confirmation that emotional dyscontrol is a feature of adult ADHD would require a

This article is protected by copyright. All rights reserved. 8 further person-level analysis that might involve a factor analysis carried out separately among cases (e.g., patients diagnosed with adult ADHD) and controls (e.g., a community sample), with factor structure-scores compared across the 2 samples to demonstrate similar structure and higher emotional dyscontrol among cases than controls. An alternative person-level analysis would be a person-level cluster analysis or latent class analysis of previously-derived factor scores to document the existence of one or more distinct adult ADHD presentations involving emotional dyscontrol. The latter approach would be the more attractive one due to the fact that the DSM system specifies that patients with ADHD can be divided into those with presentations characterized by either AD only, HD-only, and combined AD and HD. A number of analyses of adult ADHD treatment response (e.g., Unal et al., 2015) and consequences (e.g., Yoon et al.,

2013) are based on this 3-part subtyping scheme. If emotional dyscontrol is an adult variant of the hyperactivity and/or impulsivity of childhood ADHD, we would expect that a person-level analysis would find evidence of one or more presentations featuring elevated emotional dyscontrol. We are aware of no previous study that investigated this possibility.

The current report describes the results of an analysis designed to address the above methodological limitations of previous research by carrying out a symptom-level exploratory factor analysis of the same expanded symptom assessment as in our earlier study (Kessler et al.,

2010), but in an expanded sample that adds a subsample of adults referred for evaluation at an adult ADHD clinic, followed by a cluster analysis of factor scores that distinguishes respondents who meet full DSM-5 criteria for adult ADHD from other respondents. As in our earlier analysis,

This article is protected by copyright. All rights reserved. 9

the symptoms evaluated include both the 18 DSM symptoms of ADHD and 14 additional

symptoms indicative of executive dysfunction and emotional dyscontrol. We chose to add a

referred sample to the community samples in our earlier study in order to increase statistical

power in the upper end of the symptom distribution.

METHODS

Samples

NYU Langone sample: The patient sample was a mix of patients seeking treatment at

the Adult ADHD Program of the NYU Langone Medical Center (Kessler et al., 2004b; NYU

School of Medicine, 2015) and a convenience sample recruited through print, radio, and referral from health care professionals to receive a free evaluation for adult ADHD through that

Program. Blinded semi-structured diagnostic interviews described below were administered face- to-face to these patients and controls as part of their intake evaluation. No incentive for participation was provided to patients and only the free evaluation to controls. Study purposes and procedures were described to patients and controls and signed informed consent obtained before administering interviews. These recruitment and consent procedures were approved and a

HIPAA waiver granted for de-identified data analysis by the Institutional Review Board of NYU

Langone School of Medicine. These interviews were not weighted. We focused on the 191 individuals classified by the diagnostic interview as having at least one DSM-5 (American

Psychiatric Association., 2013) Criterion A1 (AD; inattention) or A2 (HD; hyperactivity- impulsivity) symptom of adult ADHD in the 6 months before interview.

This article is protected by copyright. All rights reserved. 10

NCS-R: The national general population sample was based on the subsample of

respondents in the National Comorbidity Survey Replication (NCS-R) (Kessler and Merikangas,

2004) who were used to validate the ASRS screening scale for adult ADHD (Kessler et al.,

2004a). The NCS-R was a face-to-face national US household survey (Kessler et al., 2004a). The validation sample assessed NCS-R respondents ages 18-40 meeting criteria for childhood ADHD who reported adult symptoms. This sample was administered the same blinded semi-structured diagnostic interview as in the NYU Langone sample telephonically. Interviews were tape recorded for quality control review. Respondents received a $25 incentive. Study purposes and procedures were described to patients and verbal informed consent obtained before administering and tape recording interviews. These recruitment, consent, and data collection procedures were approved by the Human Subjects committees of the University of Michigan and Harvard

Medical School. The completed interviews were weighted to adjust for over-sampling of screened positives. Study design is described elsewhere (Kessler et al., 2005). We focused on the

108 respondents classified by the diagnostic interview as having at least one DSM-5 Criterion

A1 or A2 symptom of adult ADHD in the 6 months before interview.

Health plan: The health plan sample was of participants in a telephone survey of

subscribers to a large managed healthcare plan (Brod et al., 2006) that included the ASRS

screening scale for adult ADHD (Kessler et al., 2004a). A subsample of these respondents over- sampling screened positives was re-interviewed 6 months later and a third-stage sample over- sampling stably screened positives was then telephonically administered the same blinded semi-

This article is protected by copyright. All rights reserved. 11

structured diagnostic interview as in the NCS-R using recruitment, consent, and quality

assurance procedures identical to those in the NCS-R (i.e., verbal informed consent over the

telephone, a $25 incentive, tape recording of interviews with respondent consent for quality

control review). These procedures were approved and a HIPAA waiver granted by the

Institutional Review Board of NYU Langone School of Medicine. The completed interviews

were weighted to adjust for over-sampling of screened positives. Study design is described

elsewhere (Kessler et al., 2007). We focused on the 161 respondents classified by the diagnostic

interview as having at least one DSM-5 Criterion A1 or A2 symptom of adult ADHD in the 6

months before interview.

The study was performed according to the Declaration of Helsinki.

The clinical reappraisal interview

Adult ADHD was assessed in these samples with version 1.2 of the Adult Clinician

ADHD Diagnostic Scale (ACDS; Adler and Cohen, 2004; Adler et al., 2015), a semi-structured research diagnostic interview used in a number of prior clinical studies of adult ADHD (Spencer et al., 2001; Spencer et al., 1998; Spencer et al., 1995). The interview began with a retrospective assessment of all symptoms of childhood ADHD and then assessed an expanded set of recent

(past 6 months) symptoms including all 9 DSM-5 Criterion A1 (AD) symptoms, all 9 A2 (HD) symptoms, and 14 non-DSM symptoms believed relevant to adult ADHD based on clinical experience and the research literature, including deficits in higher-level executive function and

This article is protected by copyright. All rights reserved. 12

emotional control. Many of these additional items are similar to symptoms proposed in the Utah

Criteria for adult ADHD (Wender, 1998).

The ACDS uses childhood and adult specific prompts to ensure adequate exploration of

the severity and breadth of DSM ADHD symptoms and additional symptoms of executive

dysfunction and emotional dyscontrol. The items related to executive function and emotional

dyscontrol are distinct from the DSM symptoms of inattention and hyperactivity-impulsivity.

Selected examples of executive function symptoms include: wasting or mismanaging time,

trouble planning ahead or planning for upcoming events, having a hard time keeping track of

several things at once and unable to complete tasks in the allotted time - needs extra time to

finish satisfactorily. Selected examples of emotional dyscontrol symptoms include: mood

changes frequently, feels easily hassled or frequently feel overwhelmed and difficulty expressing

anger appropriately at others - doesn’t stand up for self. These non-DSM symptoms were

established and validated by similar mechanisms as the basic ACDS v1.2 by investigators at

Massachusetts General Hospital and NYU School of Medicine.

DSM-5/ACDS diagnoses of adult ADHD require respondents to have 6-9 childhood and

5-9 current adult DSM-5 A1 or A2 symptoms (DSM-5 Criterion A), at least one Criterion A

symptom prior to age 12 (Criterion B), some ADHD-related impairment in at least 2 domains of functioning in the past 6 months (Criterion C), and clinically significant ADHD-related impairment in at least one domain of functioning over the same time period (Criterion D).

Criterion E (that the symptoms do not occur exclusively during the course of a pervasive

This article is protected by copyright. All rights reserved. 13

developmental disorder or psychotic disorder and are not better accounted for by another mental

disorder) was not operationalized and ADHD not otherwise specified was not diagnosed. None

of the 14 non-DSM symptom items was used in making diagnoses. The DSM-5 requirement of impairment before age 12 was not operationalized. Adult ADHD cases were further divided into

AD-only (inattention symptoms), HD-only (hyperactive-impulsive symptoms), and combined

(i.e., AD and HD). The AD-only and HD-only cases were further divided into restrictive (0-2

Criterion A symptoms of the other type) and non-restrictive (3+Criterion A symptoms of the

other type).

The ACDS interviews were administered in the NYU Langone sample by 2 clinical

trainees (a Ph.D. candidate with an MA and an MA candidate with a BA) trained by

one of the investigators (LA). Quarterly calibration meetings were used to review rating

guidelines and prevent drift. A random 20% of NCS-R and health plan interviews were reviewed by a supervising psychiatrist and agreement was over 95% in each of these samples. Validity of the NYU Langone interviews was established by regular direct observation of interviews. The

ACDS was administered in the NCS-R by 4 experienced PhD-level clinical interviewers who received 40 hours of training from 2 board certified psychiatrists specializing in adult ADHD research (LA, TS). Each interviewer had to complete 5 practice interviews with symptom ratings matching those of the trainers prior to beginning interviews. ACDS interviews in the managed care sample were administered by 6 PhD-level clinical or MA-level social workers experienced in administering the ACDS in clinical studies and trained by one of the investigators

This article is protected by copyright. All rights reserved. 14

(TS). Weekly calibration meetings and reviews of tapes were used in both studies to prevent drift.

Analysis methods

Analysis of de-identified data was approved by the Institutional Review Board of NYU

Langone School of Medicine. Participants provided written informed consent. RA tetrachoric correlation matrix was estimated for the 32 ACDS symptoms within each sample and pooled across samples. Exploratory factor analysis was used to analyze these data within and across samples. Our main focus is on pooled analysis that combines data across all the samples due to the fact that simulations described in the introduction show that the numbers of respondents in the individual samples are too small to recover a stable factor structure involving the anticipated number of factors with their anticipated number of per factor (Pearson and Mundfrom, 2010). In carrying out that analysis, the parallel analysis simulation method (Preacher et al., 2013) was used to determine the number of factors. Oblique (promax) rotation was used to improve factor interpretation.

Regression-based factor scores were generated retaining the correlations among factors.

K-means cluster analysis of standardized (to a mean of 0 and variance of 1) factor scores was used to estimate empirical symptom profiles. The optimal number of clusters was defined as the number that maximized explained variance in factor scores without producing small splinter clusters. Clusters were interpreted by inspecting mean factor scores and distributions of DSM-

5/ACDS adult ADHD presentations classified according to DSM-5 criteria. K-means cluster

This article is protected by copyright. All rights reserved. 15

analysis was used rather than latent class analysis based on evidence that cluster analysis

produces clusters with lower within-cluster variation and higher between-cluster variation than

latent class analysis (Eshghi et al., 2011). These desirable features are due to cluster analysis being designed to minimize distance between cluster centroids and observed cases within clusters (Chaturvedi et al., 2001), whereas latent class analysis requires that the variables used to define the clusters are uncorrelated within clusters (Goodman et al., 2002).

RESULTS

Socio-demographic characteristics of the samples

The NYU Langone patient sample was the youngest (66.5% of respondents ages 18-30) followed by the NCS-R (46.6% ages 18-30) and health plan (26.6% ages 18-30) samples. (Table

1) The NCS-R sample was a subset of respondents from a national household sampled ages 18-

44. The health plan sample was a more limited sample of the general population (i.e., of people with health insurance) without age restriction. The ratio of respondents in the age range 18-30 versus 31-40 (54.8%) in the health plan sample was similar to the NCS-R (46.6%), but the proportion was much higher in the NYU sample (66.5%), suggesting that younger adults were more likely than older adults to self-select into the NYU Langone sample.

(Table 1 about here)

The NCS-R and health plan samples also had higher proportions of women (57.8-61.0%)

than the NYU Langone sample (50.3%), suggesting either that men or people with symptom

profiles more characteristic of men were more likely than others with adult ADHD to self-select

This article is protected by copyright. All rights reserved. 16

into the NYU Langone sample. The health plan sample had a much higher proportion of Non-

Hispanic Whites (83.8%) than either the NCS-R (66.1%) or the NYU Langone (62.8%) samples,

presumably reflecting the higher rate of health insurance coverage among Non-Hispanic Whites

than racial-ethnic minorities (Artiga, 2013).

Distribution of DSM-5/ACDS adult ADHD presentations

DSM-5/ACDS adult ADHD prevalence was considerably lower in the NCS-R (23.3%)

and health plan (39.7%) samples than the NYU Langone sample (94.2%) (Table 2) Roughly half

(47.6%) of the NCS-R cases had the HD-only presentation, with the others divided roughly

equally between AD-only (23.2% of cases) and combined (29.2%) presentations. The majority of

health plan cases, in comparison, had the AD-only presentation (51.1%), followed by HD-only

(32.7%) and combined (16.4%) presentations. The majority of the NYU Langone cases, in comparison, had the combined presentation (63.4%), with almost all the remaining cases having the AD-only presentation (35.0%).

(Table 2 about here)

Exploratory factor analysis

Exploratory factor analysis in the pooled sample found one very large unrotated first principal factor (Eigenvalue = 15.3) for which 29 of the 32 ACDS items had factor loadings above .40. Almost all these loadings were higher than those on the second unrotated principal factor. These results suggest that all ACDS items are part of a single universe of content representing adult ADHD. (Table 3) Importantly in this regard, the non-DSM-5 symptoms had

This article is protected by copyright. All rights reserved. 17

loadings comparable to the DSM-5 symptoms (range .32-.84 versus .30-.86; inter-quartile range

.74-.82 versus .56-.82). The single DSM-5 symptom with a loading lower than .40 (talks excessively) was 1 of 3 DSM-5 symptoms with lower loadings on the first (.30) than second (.54) un-rotated principal factor, the others being fidgeting (.41, .44) and difficulty remaining seated

(.50, .54). The 2 non-DSM-5 items with loadings less than .40 on the first unrotated factor

(difficulty expressing anger, sensitive to criticism) both had higher loadings on the first (.33-.38) than second (-.03-.14) factor.

(Table 3 about here)

The existence of one dominant unrotated principal factor does not mean that the factor structure among items is unidimensional. In fact, simulation based on the parallel analysis method found 4 reliable factors in the pooled correlation matrix. Promax rotation showed that factor 1 (20 items with loadings above .40) included all 9 DSM-5 AD symptoms (with standardized regression coefficients in the range .47-97) and 11 of the 14 ACDS symptoms not in DSM-5, including all the ACDS symptoms of difficulties with planning and organization (.49-

.96) and 2 (easily bored [with prompting for resulting emotionality]; easily overwhelmed) indicating mood lability (.40-.51). The 2 mood lability symptoms, but none of the planning- organization symptoms, had meaningful loadings on other factors, leading us to interpret Factor

1 as Executive Dysfunction/Inattention. The 9 DSM-5 HD symptoms all had loadings greater than .40 on either Factor 2 (Hyperactivity; 5 items; .63-.84) or Factor 3 (Impulsivity; 4 symptoms; .62-86). Only one other symptom loaded on Factor 2: the non-DSM-5 symptom

This article is protected by copyright. All rights reserved. 18

being easily bored, with a higher loading on Factor 2 (.56) than Factor 1 (.40). No symptoms

other than those of the DSM-5 impulsivity symptoms had loadings as high as .40 on Factor 3.

The 3 symptoms with loadings of .40 or higher on Factor 4 (.77-81), finally, were all symptoms

of emotional dyscontrol: frequent mood changes, difficulty expressing anger, and sensitivity to criticism. Correlations among factors were all positive and in the range between .22 (Factors 2 and 4) and .49 (Factors 1 and 2).

Cluster analysis

Respondents were assigned standardized factor-weighted scores on each of the 4 factors.

K-means cluster analysis was used to examine the multivariate associations among these 4 factor scores. A 6-cluster solution was optimal in increasing explained variance in factor scores without producing small splinter clusters, with R2 values in the range .55-.80 across factors and each

cluster containing between 12.5% and 28.4% of respondents. (Table 4) Three of the clusters

featured respondents who were high on only one factor: executive dysfunction/inattention (C1;

12.4% of respondents), hyperactivity (C2; 15.9%), or emotional dyscontrol (C3; 28.5%), while

the other 3 clusters included respondents either high on all factors (C4; 17.6%), on all but

emotional dyscontrol (C5; 12.6%), or high on no factor (C6; 13.0%). The most prevalent cluster

was C3 (high only on emotional dyscontrol).

(Table 4 about here)

Cross-classification of cluster membership with DSM-5/ACDS diagnoses showed that

virtually all respondents in 3 of the clusters (C1 high only on executive dysfunction/inattention;

This article is protected by copyright. All rights reserved. 19

and C4- C5 (high either on all factors or on all but emotional dyscontrol) met DSM-5 criteria for adult ADHD and that 40.6-51.9% of those in 2 other clusters (C2 high only on hyperactivity, C6 high on none) did so. The remaining cluster (C3, high only on emotional dyscontrol), while having the highest prevalence in the sample, had by far the lowest proportion of cluster members with DSM-5 adult ADHD (0.5%). Cluster C1 cases (high only on executive dysfunction/inattention) were made up exclusively of DSM-5 AD-only cases. Cluster C4 (high on all factors) and C5 (high on all other than emotional dyscontrol) cases, in comparison, almost entirely had the combined presentation. Somewhat more than half the respondents in 2 clusters

C2 and C6 also met diagnostic criteria.

The 51.0% of respondents in C2 (high only on hyperactivity) who met diagnostic criteria consisted mostly of AD-only cases, with smaller numbers of HD-only cases, and very few cases with the combined presentation (0.7%). The 60.6% of respondents meeting diagnostic criteria in

C6 (low on all factors), in comparison, were primarily non-restrictive AD-only (24.4%) or non- restrictive HD-only (27.8%), with far fewer restrictive (0.0% AD-only; 2.2% HD-only) or combined (6.1%) cases. It is important to note in this regard that the characterization of C6 as not being high on any dimension is a comparative statement, as 60.6% of C6 respondents met DSM-

5 criteria. More detailed analysis showed, though, that most of these cases had the bare minimum of the 5 AD or HD symptoms required to meet diagnostic criteria.

Comparison of cluster-based profiles across samples

This article is protected by copyright. All rights reserved. 20

Cross-classification of DSM-5/ACDS diagnostic presentations with clusters documented

substantial differences across the 3 component samples. (Table 5) The most striking difference,

and the only one that was statistically significant, was that the majority of NYU Langone cases

had a DSM-5 combined presentation (63.3%), while that presentation was considerably less

common in the NCS-R (29.0%; t=2.9, p=.002) and health plan (16.3%; t=4.8, p<.001) samples.

The vast majority of combined presentation cases in all samples were either in cluster C4 (high on all factors) or cluster C5 (high on all but emotional dyscontrol). Nearly all (95.4%) of the remaining NYU Langone cases had the DSM-5 AD-only profile. The proportion of AD-only cases did not differ significantly across samples (t=0.1-1.7, p=.10-.88). Cluster 1 (high only on executive dysfunction/inattention) was the most common cluster among DSM-5 AD-only cases in all 3 samples (43.0-60.3%).

(Table 5 about here)

The DSM-5 HD-only profile was the most common one in the NCS (47.7%). A somewhat lower proportion of cases had the HD-only profile in the health plan sample (32.6%) while this profile was very rare in the NYU Langone sample (1.7%), suggesting a help-seeking bias. Yet none of the higher proportions in the 2 general population samples was statistically different from the extremely low proportions in the NYU Langone patient sample (NCS-R: t=1.5-1.7, p=.08-.14; health plan: t=1.2-1.5, p=.13-.23) due to the comparative rarity of the HD- only profile. Cluster 6 (high on none of the factors) was by far the most common cluster among

HD-only cases in the NCS-R (82.0%). In the health plan sample, in comparison, cluster 2 (high

This article is protected by copyright. All rights reserved. 21

only on hyperactivity) was the most common symptom profile among HD-only cases followed

by cluster 2 (34.3%). The DSM-5 AD-only profile was the most common one in the health plan

sample (51.1%), with insignificantly lower proportions of cases having this profile in the NCS-R

(23.3%) and NYU Langone (35.2%) samples (t=0.3-1.7; p = .09-.79). Cluster C1 (high only on executive dysfunction/inattention) was the most common cluster among AD-only cases in all 3 samples (43.0-66.3%).

DISCUSSION

Our factor analysis showed clearly that adult ADHD is characterized by a broader set of symptoms than in DSM-5. This conclusion is based on the observations that all but a handful of non-DSM-5 symptoms had factor loadings of .40 or higher on the first unrotated principal factor, that these loadings were similar to those of DSM-5 symptoms, and that these loadings were consistently much higher on the first than second unrotated principal factor. We are aware of no previous factor analysis of expanded adult ADHD symptoms that made these comparisons.

These results suggest that symptoms of executive dysfunction and emotional dyscontrol should be considered in future revisions of the DSM.

Our simulation showed that 4 correlated sub-factors underlie the strong first principal factor among adult ADHD symptoms. Although these 4 factors have an intuitive interpretation, they are inconsistent with all but one previous factor analysis of expanded ADHD symptoms. As noted in the introduction, the finding of a 2-factor structure in studies of the Wender-Reimherr

Adult Attention Deficit Disorder Scale (Marchant et al., 2013; Marchant et al., 2015) should not

This article is protected by copyright. All rights reserved. 22

be considered in this comparison, as this was a methodological artifact. That is, it was impossible

to find more than 2 factors in those studies because only 7 underlying subscales were used as the

basis of the factor analyses. However, our own prior analysis of the NCS-R and health plan samples found only 3 of these 4 factors: inattention/executive dysfunction, hyperactivity, and impulsivity. The emotional dyscontrol factor emerged only when we added the NYU patient sample to the analysis. A somewhat different 4-factor solution than ours was found in the original exploratory factor analysis of the Conners’ Adult ADHD Rating Scale (Conners et al.,

1999) as well as ina subsequently confirmatory factor analysis of that solution in a Spanish sample (Amador-Campos et al., 2014). However, a German replication of the CAARS factor analysis found evidence for an emotional dyscontrol factor along with inattention/executive dysfunction, hyperactivity, and impulsivity factors after excluding CAARS items with strong cross-loadings and weak loadings on all factors (Christiansen et al., 2011).

We are not aware of any previous investigation of multivariate adult ADHD symptom profiles comparable to our cluster analysis. We found evidence for the traditional distinctions among AD-only (C1), HD-only (C2), and combined (C4-C6) presentations, but the HD-only presentation was specific to hyperactivity rather than also including high impulsivity. No impulsivity-only presentation emerged in the analysis. Instead, high impulsivity was found only in the combined presentations. The three combined presentations differed in that one (C4) was characterized by high scores on all four factors, another (C5) by high scores on all factors other than emotional dyscontrol (C5), and the last (C6) by below-average scores on all factors.

This article is protected by copyright. All rights reserved. 23

It is noteworthy that the 20.9% of respondents meeting DSM-5/ACDS criteria for adult

ADHD who had an AD-only symptom profile is not dramatically higher than the 13.9% of

DSM-5/ACDS cases who had an HD-only profile. This finding is inconsistent with the widely-

accepted view that the AD-only presentation is much more common than the HD-only presentation in adult ADHD. An important reason for this discrepancy can be seen in Table 2, where we showed that the DSM-5 AD-only presentation was as common as the HD-only presentation in the community samples (i.e., the NCS-R and health plan samples), but much less common than the AD-only presentation in the treatment sample (i.e., the NYU Langone sample), suggesting that there is a treatment selection bias in favor of AD-only cases. This observation is worthy of future examination of the prevalence of narrowly-defined HD-only in unrestricted population samples of adults. Narrowly-defined HD-only has low prevalence among youth, but it might be that the results of our cluster analysis are due to a much higher proportion of these youth retaining their symptoms in adulthood than youth with an AD-only profile. If so, this would be a new and potentially important finding.

Virtually all respondents with the AD-only presentation and with the combined presentations featuring high factor scores met DSM-5/ACDS criteria for adult ADHD. This suggests that high inattention/executive dysfunction and high impulsivity (which, as noted above, occurred only in the combined presentations) are specific to adult ADHD. In comparison, only about half the respondents with the HD-only presentation met DSM-5/ACDS criteria for adult ADHD, suggesting that high HD is less specific to adult ADHD. And virtually none of the

This article is protected by copyright. All rights reserved. 24

respondents in the emotional dyscontrol-only cluster met DSM-5/ACDS criteria for adult

ADHD, suggesting that high emotional dyscontrol in the absence of high AD and high HD is strongly suggestive of the absence of adult ADHD.

It is instructive to compare C3 (high only on emotional dyscontrol) and C6 (below average on all factors) in this regard, as both clusters have very similar scores on the all factors other than emotional dyscontrol. C3 would be considered the more severe of the two clusters in that it featured high emotional dyscontrol while C6 did not. Yet only 0.5% of respondents in C3 met DSM-5/ACDS criteria for adult ADH D compared to 60.6% in C6. It is unclear what to make of this result. Other research suggests that emotional dyscontrol is common in adult ADHD

(Surman et al., 2013; Vidal et al., 2014), shows familial association with ADHD (Surman et al.,

2013), and predicts the longitudinal course of ADHD (Biederman et al., 2012). But our finding

that uniquely elevated emotional dyscontrol is indicative of an absence of adult ADHD suggests

that emotional dyscontrol is more a comorbidity than a central feature of adult ADHD. However,

an important caution here is that emotional dyscontrol was operationalized more narrowly in the

ACDS than in those other studies, with the ACDS including only one indicator of affective

lability (frequent mood changes) and 3 indicators of emotional over-reactivity (easily

overwhelmed, sensitive to criticism, difficulty expressing anger). It would consequently be valuable to replicate our cluster analysis in independent samples that had more exhaustive evaluations of emotional dyscontrol.

This article is protected by copyright. All rights reserved. 25

In interpreting the associations of cluster profiles with the DSM-5 specification of presentations it is important to recognize that our cluster analysis was based on standardized factor scores in which standardization was normed to the distribution of symptoms among people with adult ADHD symptoms. This means that our characterization of symptoms as high versus low was not based on DSM-5 thresholds but rather on the distributions in the sample. In addition, we gave equal weight to the symptoms in each of the 4 observed factors. The DSM-5 distinctions, in comparison, reflect threshold decisions using reduced sets of symptoms in which symptoms of hyperactivity and impulsivity are down-weighted (in the sense that they are combined into one dimension rather than 2) relative to symptoms of inattentiveness. It is unclear whether the cluster-based profiling approach would have any advantages over the DSM-5 approach in predicting differential treatment response or in improving understanding of the underlying pathophysiology of adult ADHD, but this question could be the subject of future study, possibly in the context more elaborate and objective characterizations of executive dysfunction (Barkley, 2012; Brown et al., 2009; Dehili et al., 2013) and emotional dyscontrol

(Surman et al., 2013; Surman et al., 2015; Vidal et al., 2014).

Although our analysis had a number of strengths, including a large sample size, diverse sample composition, and assessments based on semi-structured clinical interviews rather than self-report scales, the data we worked with also had 3 important limitations. First, as noted above, the ACDS assessment of emotional dyscontrol was less differentiated than the assessments in other recent studies. It would be valuable to determine the sensitivity of our

This article is protected by copyright. All rights reserved. 26

results to an expanded assessment of emotional dyscontrol. Second, our assessment did not

include any of the performance-based measures of neurocognitive functioning used in a number

of other recent studies of adult ADHD (e.g., Dehili et al., 2013; Micoulaud-Franchi et al., 2016;

Surman et al., 2015). It is important to note in this regard that the concept of “executive

dysfunction” is heterogeneous and that different behavioral and neurocognitive measures are

often only weakly correlated with each other (Biederman et al., 2008). Third, we did not assess comorbid disorders in a uniform fashion across samples, making it impossible to carry out an investigation of the extent to which the factors and clusters documented here are specific to adult

ADHD.

Within the context of these limitations, we found that virtually all of the expanded

symptoms had factor loadings on the first unrotated principal factor of adult ADHD symptoms

comparable to those of DSM-5 symptoms. This finding supports the importance of executive

dysfunction and emotional dyscontrol in many patients with adult ADHD, suggesting that

clinicians should consider including these additional symptoms in their evaluations of patients

for adult ADHD as they might provide targets for treatment with medication or cognitive

behavior therapy. We also found 4 meaningful factors among these symptoms. One of these

factors shows that DSM-5 AD symptoms are part of a larger executive dysfunction/inattention

factor, while others show that hyperactivity and impulsivity can be distinguished in adult ADHD

and that emotional dyscontrol is a distinct component of adult ADHD. Finally, we found that

empirically derived symptom profiles based on cluster analysis are broadly consistent with the

This article is protected by copyright. All rights reserved. 27

DSM-5 distinctions among AD-only, HD-only, and combined presentation, but that a considerably higher proportion of cases are characterized in this empirically-derived scheme as having the combined presentation than in the DSM-5 scheme. Although the data we presented shed no light on the extent to which this cluster-based scheme would have any advantages over the rationally-derived DSM-5 scheme in improving our understanding of adult ADHD, this is a question that could be investigated in future studies using external validators such as impairment and family history.

This article is protected by copyright. All rights reserved. 28

ACKNOWLEDGEMENTS

The ASRS Screener was developed in collaboration with the WHO World Mental Health (WMH)

Survey Initiative in conjunction with the revision of the WHO Composite International Diagnostic

Interview (CIDI) (Kessler and Ustun, 2004). Development of the ASRS screener was supported by

Eli Lilly and Company. The ASRS Screener cross-validation study was supported by Eli Lilly and

Company and HealthCore Inc. The larger series of WMH methodological studies in which the

ASRS development work was embedded were supported by the National Institute of Mental

Health (R01 MH070884), the John D. and Catherine T. MacArthur Foundation, the Pfizer

Foundation, the US Public Health Service (R13-MH066849, R01-MH069864, and R01

DA016558), the Fogarty International Center (FIRCA R01-TW006481), the Pan American

Health Organization, Eli Lilly and Company, Ortho-McNeil Pharmaceutical, Inc.,

GlaxoSmithKline, and Bristol-Myers Squibb. The WMH CIDI Advisory Group that developed the ASRS included Lenard Adler (New York University Medical School), Russell Barkley

(Medical College of South Carolina), Joseph Biederman (Massachusetts General Hospital and

Harvard Medical School), Keith Conners (Duke University Medical School), Stephen Faraone

(Massachusetts General Hospital and Harvard Medical School), Laurence Greenhill (New York

State Psychiatric Institute), Molly Howes (Harvard Medical School), Ronald Kessler (Harvard

Medical School), Thomas Spencer (Massachusetts General Hospital and Harvard Medical School) and T. Bedirhan Ustun (World Health Organization). All WMH instruments and publications are posted at http://www.hcp.med.harvard.edu/wmh. Professor Faraone is supported by the K.G.

This article is protected by copyright. All rights reserved. 29

Jebsen Centre for Research on Neuropsychiatric Disorders, University of Bergen, Bergen,

Norway, the European Union’s Seventh Framework Programme for research, technological development and demonstration under grant agreement no 602805 and NIMH grant

R01MH094469.

Declaration of Interest

L.A.A has had Grant/Research support from Sunovian Pharmaceuticals, Purdue Pharmaceuticals,

Enzymotec, Shire Pharmaceuticals, Lundbeck; served as a consulatant for Enzymotec, Alcobra

Pharmaceuticals, Rhodes Pharmaceuticals Shire Pharmaceuticals, National Football League,

Major League Baseball; and received royalty payments (as inventor) from NYU for license of adult ADHD scales and training materials since 2004. T.J.S. has had research support and/or served as a consultant for Alcobra, Lundbeck, Shire Laboratories Inc, Sunovion, the FDA and the Department of Defense; and served on an advisory board for Alcobra. T.J.S. receives research support from Royalties and Licensing fees on copyrighted ADHD scales through MGH

Corporate Sponsored Research and Licensing. T.J.S. has a US Patent Application pending

(Provisional Number 61/233,686), through MGH corporate licensing, on a method to prevent stimulant abuse. R.C.K. has served as a consultant for Johnson & Johnson Wellness and

Prevention Lake Nona Life Project. R.C.K. has served on advisory boards for Mensante

Corporation, Johnson & Johnson Services Inc. Lake Nona Life Project, and U.S. Preventive

This article is protected by copyright. All rights reserved. 30

Medicine. R.C.K. is a co-owner of DataStat, Inc. None of the other authors has any conflicts to declare.

This article is protected by copyright. All rights reserved. 31

REFERENCES

Adler, L., & Cohen, J. (2004). Diagnosis and evaluation of adults with attention-

deficit/hyperactivity disorder. The Psychiatric Clinics of North America, 27(2), 187-201.

Adler, L.A., Shaw, D.M., Kovacs, K., & Alperin, S. (2015). Diagnosing ADHD in children and

adults. In L.A. Adler , T.J. Spencer, & T.E. Wilens (Eds.), Attention Deficit Hyperactivity

Disorder in Adults and Children (pp. 16–23). United Kingdom: Cambridge University

Press.

Amador-Campos, J.A., Gomez-Benito, J., & Ramos-Quiroga, J.A. (2014). The conners' adult

ADHD rating scales--short self-report and observer forms: psychometric properties of the

Catalan version. Journal of Attention Disorders, 18(8), 671-679.

American Psychiatric Association. (2013). Diagnostic and Statistical Manual of Mental

Disorders : DSM-5. Washington, D.C.: American Psychiatric Association.

Barkley, R.A. (2012). Executive Functions : What They Are, How They Work, and Why They

Evolved. New York, NY: Guilford Press.

Barkley, R.A., Murphy, K.R., & Fischer, M. (2008). ADHD in Adults: What the Science Says.

New York, NY: Guilford Press.

Biederman, J., Petty, C.R., Fried, R., Black, S., Faneuil, A., Doyle, A.E., … Faraone, S.V.

(2008). Discordance between psychometric testing and questionnaire-based definitions of

This article is protected by copyright. All rights reserved. 32

executive function deficits in individuals with ADHD. Journal of Attention Disorders,

12(1), 92-102.

Biederman, J., Spencer, T.J., Petty, C., Hyder, L.L., O'Connor, K.B., Surman, C.B., & Faraone,

S.V. (2012). Longitudinal course of deficient emotional self-regulation CBCL profile in

youth with ADHD: prospective controlled study. Neuropsychiatric Disease and

Treatment, 8, 267-276.

Brod, M., Johnston, J., Able, S., & Swindle, R. (2006). Validation of the Adult Attention-

Deficit/Hyperactivity Disorder Quality-of-Life Scale (AAQoL): a disease-specific quality-

of-life measure. Quality of Life Research, 15(1), 117-129.

Brown, T.E., Reichel, P.C., & Quinlan, D.M. (2009). Executive function impairments in high IQ

adults with ADHD. Journal of Attention Disorders, 13(2), 161-167.

Chaturvedi, A., Green, E.P., & Caroll, D.J. (2001). K-modes clustering. Journal of

Classification, 18(1), 35-55.

Christiansen, H., Kis, B., Hirsch, O., Philipsen, A., Henneck, M., Panczuk, A., …

Schimmelmann, B.G. (2011). German validation of the Conners Adult ADHD Rating

Scales-self-report (CAARS-S) I: factor structure and normative data. European

Psychiatry, 26(2), 100-107.

Comrey, A.L., & Lee, H.B. (1992). A First Course in Factor Analysis. Mahwah, NJ. Lawrence

Erlbaum Associates.

This article is protected by copyright. All rights reserved. 33

Conners, C.K., Erhardt, D., & Sparrow, E. (1999). Conners’ Adult ADHD Rating Scales

(CAARS), Multi-Health Systems.

Dehili, V.M., Prevatt, F., & Coffman, T.P. (2013). An analysis of the Barkley Deficits in

Executive Functioning Scale in a college population: does it predict symptoms of ADHD

better than a visual-search task? Journal of Attention Disorders. Epub ahead of print, DOI:

10.1177/1087054713498932

Eshghi, A., Haughton, D., Legrand, P., Skaletsky, M., & Woolford, S. (2011). Identifying

groups: A comparison of methodologies. Journal of Data Science, 9(2), 271-291.

Faraone, S.V., Biederman, J., & Spencer, T. (2010). Diagnostic efficiency of symptom items for

identifying adult ADHD. Journal of ADHD and Related Disorders, 1, 38-48.

Goodman, L.A., Hagenaars, J.A., & McCutcheon, A.L. (2002). Latent class analysis: The

empirical study of latent types, latent variables, and latent structures. In J.A. Hagenaars &

A.L. McCutcheon (Eds.), Applied Latent Class Analysis (pp. 3-55). New York, NY:

Cambridge University Press.

Gorsuch, R.L. (1983). Factor Analysis (2nd ed.). New York, NY: Lawrence Erlbaum Associates.

Kessler, R.C., Adler, L., Ames, M., Demler, O., Faraone, S., Hiripi, E., … Walters, E.E. (2005).

The World Health Organization Adult ADHD Self-Report Scale (ASRS): a short

screening scale for use in the general population. Psychological Medicine, 35(2), 245-256.

Kessler, R.C., Adler, L., Barkley, R.A., Biederman, J., Connors, K., Demler, O., … Zaslavsky,

A.M. (2006). The prevalence and correlates of adult ADHD in the United States: results

This article is protected by copyright. All rights reserved. 34

from the National Comorbidity Survey Replication. The American Journal of Psychiatry,

163(4), 716-723.

Kessler, R.C., Adler, L.A., Gruber, M.J., Sarawate, C.A., Spencer, T., & Van Brunt, D.L. (2007).

Validity of the World Health Organization Adult ADHD Self-Report Scale (ASRS)

Screener in a representative sample of health plan members. International Journal of

Methods in Psychiatric Research, 16(2), 52-65.

Kessler, R.C., Ames, M., Hymel, P.A., Loeppke, R., McKenas, D.K., Richling, D.E., … Ustun,

T.B. (2004a). Using the World Health Organization Health and Work Performance

Questionnaire (HPQ) to evaluate the indirect workplace costs of illness. Journal of

Occupational and Environmental Medicine / American College of Occupational and

Environmental Medicine, 46(6 Suppl), S23-37.

Kessler, R.C., Berglund, P., Chiu, W.T., Demler, O., Heeringa, S., Hiripi, E., … Zheng, H.

(2004b). The US National Comorbidity Survey Replication (NCS-R): design and field

procedures. International Journal of Methods in Psychiatric Research, 13(2), 69-92.

Kessler, R.C., Green, J.G., Adler, L.A., Barkley, R.A., Chatterji, S., Faraone, S.V., … Van

Brunt, D.L. (2010). Structure and diagnosis of adult attention-deficit/hyperactivity

disorder: analysis of expanded symptom criteria from the Adult ADHD Clinical

Diagnostic Scale. Archives of General Psychiatry, 67(11), 1168-1178.

This article is protected by copyright. All rights reserved. 35

Kessler, R.C., & Merikangas, K.R. (2004). The National Comorbidity Survey Replication (NCS-

R): background and aims. International Journal of Methods in Psychiatric Research,

13(2), 60-68.

Kessler, R.C., & Ustun, T.B. (2004). The World Mental Health (WMH) Survey Initiative version

of the World Health Organization (WHO) Composite International Diagnostic Interview

(CIDI). International Journal of Methods in Psychiatric Research, 13(2), 93-121.

Kline, P. (1994). An Easy Guide to Factor Analysis. New York, NY: Routledge.

MacCallum, R.C., Widaman, K.F., Zhang, S., & Hong, S. (1999). Sample size in factor analysis.

Psychological Methods, 4(1), 84-99.

Marchant, B.K., Reimherr, F.W., Robison, D., Robison, R.J., & Wender, P.H. (2013).

Psychometric properties of the Wender-Reimherr Adult Attention Deficit Disorder Scale.

Psychological Assessment, 25(3), 942-950.

Marchant, B.K., Reimherr, F.W., Wender, P.H., & Gift, T.E. (2015). Psychometric properties of

the Self-Report Wender-Reimherr Adult Attention Deficit Disorder Scale. Annals of

Clinical Psychiatry, 27(4), 267-277; quiz 278-282.

Micoulaud-Franchi, J.A., Lopez, R., Cermolacce, M., Vaillant, F., Peri, P., Boyer, L., … Lancon,

C. (2016). Sensory gating capacity and attentional function in adults with ADHD: a

preliminary neurophysiological and neuropsychological study. Journal of Attention

Disorders. Epub ahead of print, DOI: 10.1177/1087054716629716

This article is protected by copyright. All rights reserved. 36

Mundfrom, D., Shaw, D., & Ke, T. (2005). Minimum sample size recommendations for

conducting factor analyses. International Journal of Testing, 5(2), 159-168.

NYU School of Medicine. (2015). Adult ADHD Program. New York: NYU School of Medicine.

Pearson, R.H., & Mundfrom, D.J. (2010). Recommended sample size for conducting exploratory

factor analysis on dichotomous data. Journal of Modern Applied Statistical Methods, 9(2),

359-368.

Preacher, K.J., Zhang, G., Kim, C., & Mels, G. (2013). Choosing the optimal number of factors

in exploratory factor analysis: a model selection perspective. Multivariate Behavioral

Research, 48(1), 28-56.

Spencer, T., Biederman, J., Wilens, T., Faraone, S., Prince, J., Gerard, K., … Bearman, S.K.

(2001). Efficacy of a mixed salts compound in adults with attention-

deficit/hyperactivity disorder. Archives of General Psychiatry, 58(8), 775-782.

Spencer, T., Biederman, J., Wilens, T., Prince, J., Hatch, M., Jones, J., … Seidman, L. (1998).

Effectiveness and tolerability of tomoxetine in adults with attention deficit hyperactivity

disorder. The American Journal of Psychiatry, 155(5), 693-695.

Spencer, T., Wilens, T., Biederman, J., Faraone, S.V., Ablon, J.S., & Lapey, K. (1995). A

double-blind, crossover comparison of and placebo in adults with

childhood-onset attention-deficit hyperactivity disorder. Archives of General Psychiatry,

52(6), 434-443.

This article is protected by copyright. All rights reserved. 37

Surman, C.B., Biederman, J., Spencer, T., Miller, C.A., McDermott, K.M., & Faraone, S.V.

(2013). Understanding deficient emotional self-regulation in adults with attention deficit

hyperactivity disorder: a controlled study. Attention Deficit and Hyperactivity Disorders,

5(3), 273-281.

Surman C.B., Biederman J., Spencer T., Miller C.A., Petty C.R., & Faraone S.V. (2015).

Neuropsychological deficits are not predictive of deficient emotional self-regulation in

adults with ADHD. Journal of Attention Disorders, 19(12), 1046-1053.

Surman, C.B., Biederman, J., Spencer, T., Yorks, D., Miller, C.A., Petty, C.R., & Faraone, S.V.

(2011). Deficient emotional self-regulation and adult attention deficit hyperactivity

disorder: a family risk analysis. The American Journal of Psychiatry, 168(6), 617-623.

Unal, G.A., Kenar, A.N., Herken, H., & Kiroglu, Y. (2015). Association of adult attention deficit

hyperactivity disorder subtypes and response to methylphenidate HCL treatment: a

magnetic resonance spectroscopy study. Neuroscience Letters, 604, 188-192.

Vidal, R., Valero, S., Nogueira, M., Palomar, G., Corrales, M., Richarte, V., … Ramos-Quiroga,

J.A. (2014). Emotional lability: the discriminative value in the diagnosis of attention

deficit/hyperactivity disorder in adults. Comprehensive Psychiatry, 55(7), 1712-1719.

Ward, M.F., Wender, P.H., & Reimherr, F.W. (1993). The Wender Utah Rating Scale: an aid in

the retrospective diagnosis of childhood attention deficit hyperactivity disorder. The

American Journal of Psychiatry, 150(6), 885-890.

This article is protected by copyright. All rights reserved. 38

Wender, P. (1998). Attention-Deficit Hyperactivity Disorder in Adults. New York, NY: Oxford

University Press.

Yoon, S.Y., Jain, U.R., & Shapiro, C.M. (2013). Sleep and daytime function in adults with

attention-deficit/hyperactivity disorder: subtype differences. Sleep Medicine, 14(7), 648-

655.

This article is protected by copyright. All rights reserved. 39

Table 1. Socio-demographic characteristics of the three samples (n = 460)

NCS-R HC NYU Total

% (se) % (se) % (se) % (se) X2 Df P Value

Age

18-30 46.6 (15.1) 26.7 (7.5) 66.5 (3.4) 47.9 (4.9) 0.2a 1 0.673

31-40 53.4 (15.1) 22.0 (7.2) 20.9 (2.9) 28.9 (4.9) ------

41-50 0.0 -- 25.8 (6.8) 8.9 (2.1) 12.7 (2.7) ------

51+ 0.0 -- 25.6 (9.1) 3.7 (1.4) 10.5 (3.7) 32.2*b 3 <.0001

Gender

Male 42.2 (14.3) 39.0 (8.3) 49.7 (3.6) 44.2 (4.8) ------

Female 57.8 (14.3) 61.0 (8.3) 50.3 (3.6) 55.8 (4.8) 0.8c 2 0.664

Race/Ethnicity

Non-Hispanic Black 14.0 (8.8) 4.7 (3.4) 9.4 (2.1) 8.8 (2.5) ------

Non-Hispanic White 66.1 (14.3) 83.8 (6.2) 62.8 (3.5) 71.0 (4.4) ------

Hispanic 4.2 (1.8) 8.3 (5.1) 12.6 (2.4) 9.1 (2.2) ------

Other 15.7 (13.3) 3.2 (2.1) 15.2 (2.6) 11.1 (3.5) 7.6d 6 0.268

(n) (108) (161) (191) (460)

*Indicates signficant at the alpha=0.05 level. aTest of significance of differences in age distributions across NCS-R and HC surveys, for age groups 18-30 and 31-40. bTest of significance of differences in age distributions across all surveys. cTest of significance of differences in gender distributions across all surveys. dTest of significance of differences in race/ethnicity distributions across all surveys.

This article is protected by copyright. All rights reserved. 40

Table 2. Distribution of DSM-V/ACDS adult ADHD presentations across samples (n = 460)

NCS-R HC NYU Total 2 % (se) % (se) % (se) % (se) X 2 P Value Inattentive

Restrictive 2.0 (1.2) 8.0 (4.8) 17.3 (2.7) 10.4 (2.2) 8.4* 0.015

Non-restrictive 3.4 ( 1.6 ) 12.3 ( 7.9 ) 15.7 ( 2.6 ) 11.6 (3.1) 3.0 0.219

Total 5.4 (2.2) 20.3 (8.5) 33.0 (3.4) 22.1 (3.7) 10.9* 0.004 Hyperactive/impulsive

Restrictive 2.4 (1.5) 7.7 (5.0) 1.0 (0.7) 3.7 (1.9) 7.1* 0.028

Non-restrictive 8.7 ( 7.4 ) 5.3 ( 4.3 ) 0.5 ( 0.5 ) 4.1 (2.3) 3.1 0.215

Total 11.1 (7.6) 13.0 (6.4) 1.5 (0.9) 7.8 (2.9) 4.6* 0.010 Combined

Total 6.8 (2.7) 6.5 (3.5) 59.7 (3.6) 28.7 (3.3) 101.7* <.0001

Total

Any adult ADHD 23.3 ( 9.3 ) 39.7 ( 9.1 ) 94.2 ( 1.7 ) 58.5 (5.3) 56.4* <.0001

Non-cases 76.7 ( 9.3 ) 60.3 ( 9.1 ) 5.8 ( 1.7 ) 41.5 (5.3) 56.4* <.0001

(n) (108) (161) (191) (460)

*Indicates significant at the alpha=0.05 level.

This article is protected by copyright. All rights reserved. 41

Table 3. Unrotated loadings on first principal factor and standardized partial regression coefficients of the 32 Adult ADHD Clinical Diagnostic Scale (ACDS) items from a 4-factor exploratory factor analysis with promax rotation1 in the pooled sample (n = 460)a

Standardized partial regression coefficients Executive Unrotated loadings Dysfunction/ Emotional first principal factor Inattention Hyperactive Impulsive Dyscontrol

I. DSM-V Criterion A symptoms of Inattention (AD) Makes careless mistakes .80 .82 -.08 .07 .06 Difficulty sustaining attention .84 .75 .25 -.12 .01 Does not listen .77 .47 .39 .10 .01 Difficulty follow instructions .85 .72 .29 -.09 .02 Difficulty organizing tasks .83 .97 -.06 -.07 -.08 Dislikes tasks requiring attention .86 .90 .12 -.07 -.11 Loses things .64 .58 .00 .00 .16 Easily distracted .82 .75 .25 -.04 -.10 Forgetful in daily activities .77 .68 .17 -.01 .01

II. DSM-V Criterion A symptoms of hyperactivity/impulsivity (HD)

Fidgets .41 -.07 .73 .03 -.04

Difficulty remaining seated .50 -.11 .84 .08 .00 Restless .66 .09 .74 .11 .05 Difficulty playing quietly .56 -.01 .78 -.07 .18 Driven by motor .58 .09 .63 .26 -.14 Talks excessively .30 -.18 .08 .86 -.07 Blurts out answers .57 .16 -.04 .80 .01 Difficulty waiting turn .47 .03 .15 .62 .03 Interrupts or intrudes .62 .14 .12 .68 .08 III. Symptoms not in DSM-V Wastes or mismanages time .80 .78 -.07 .15 .01 Trouble planning ahead .80 .91 -.07 .00 -.08 Lacks self-discipline .82 .80 -.11 .21 .02 Difficulty prioritizing work .85 .88 -.04 .05 -.01 Trouble keep track multiple things .78 .83 -.16 .01 .18 Easily bored .74 .40 .56 -.03 -.02 Others keep life order .59 .49 .19 -.10 .09 Cannot work unless deadline .84 .96 -.01 -.03 -.14 Cannot complete tasks in time .84 .93 -.09 -.03 .05 Remembers details, not main idea .75 .55 .11 .15 .13 Frequent mood changes .46 .01 -.02 .21 .76 Easily overwhelmed .67 .51 -.08 .10 .39 Difficulty expressing anger .33 .04 .13 -.32 .81

Sensitive to criticism .38 -.04 -.03 .15 .77

This article is protected by copyright. All rights reserved. 42 aAnalysis was based on a matrix of tetrachoric correlations among dichotomized symptom classifications. Correlations among factors in the promax solution were Factors 1-2 .49, Factors 1-3 .40, Factors 1-4 .37, Factors 2-3 .36, Factors 2-4 .22, and Factors 3-4 .30. Factor loadings (unrotated first principal factor) and standardized partial regression coefficients (promax-rotated 4-factor solution) greater than .40 are highlighted. Eigenvalues for the first four unrotated factors were 15.3, 2.7, 2.0, and 1.5.

This article is protected by copyright. All rights reserved. 43

Table 4. Mean factor scores and DSM-V/ACDS adult ADHD presentations prevalence within clusters

High on only one factor Others C1. Executive Dysfunction/ C3. Emotional C5. High on all but Inattention C2. Hyperactive Dyscontrol C4. High on all emotional dyscontrol C6. High on none Estimate (se) Estimate (se) Estimate (se) Estimate (se) Estimate (se) Estimate (se) I. Mean standardized factor scores Executive dysfunction/Inattention (ExD) 42 (.06) -.18 (.09) -.10 (.07) .82 (.07) .47 (.09) -1.45 (.03) Hyperactive -.74 (.07) .93 (.05) -.69 (.05) .83 (.08) .73 (.08) -1.02 (.06) Impulsive) -.67 (.08) -.53 (.06) -.50 (.06) .99 (.07) .99 (.06) -.78 (.08) Emotional dyscontrol -.82 (.06) -.10 (.09) .94 (.04) 1.04 (.06) -.81 (.06) -.89 (.05) II. DSM-5/ACDS adult ADHD presentation prevalence (i.e., row percentages); AD-only Restrictive 51.8 (9.4) 24.8 (8.1) 0.0 -- 0.0 -- 0.0 -- 0.0 -- Non-restrictive 44.2 (9.4) 9.8 (3.8) 0.0 -- 4.0 (2.1) 5.2 (2.9) 24.4 (18.0) HD-only Restrictive 0.0 -- 14.7 (10.1) 0.1 (0.1) 0.4 (0.2) 7.8 (3.7) 2.2 (1.8) Non-restrictive 0.0 -- 1.1 (1.1) 0.4 (0.4) 0.8 (0.4) 0.4 (0.3) 27.8 (16.4) Combined 2.0 (1.8) 0.7 (0.4) 0.0 -- 94.8 (2.2) 86.6 (4.6) 6.1 (3.7) Any DSM-5/ACDS ADHD 98.0 (1.8) 51.0 (11.3) 0.5 (0.4) 100.0 -- 100.0 -- 60.6 (20.3) III. DSM-5/ACDS adult ADHD Cluster Prevalence (i.e., column percentages) AD-only Restrictive 62.2 (10.0) 37.8 (10.0) 0.0 -- 0.0 -- 0.0 -- 0.0 -- Non-restrictive 47.5 (13.7) 13.4 (5.5) 0.0 -- 6.0 (3.5) 5.6 (3.4) 27.4 (17.8) HD-only Restrictive 0.0 -- 63.1 (20.3) 0.8 (0.8) 2.0 (1.4) 26.5 (16.3) 7.6 (6.6) Non-restrictive 0.0 -- 4.2 (4.7) 2.5 (2.8) 3.4 (2.5) 1.3 (1.1) 88.6 (8.0) Combined 0.9 (0.8) 0.4 (0.2) 0.0 -- 58.1 (4.5) 37.9 (4.4) 2.8 (1.7) Any DSM-5/ACDS ADHD 20.9 (3.7) 13.9 (3.6) 0.2 (0.2) 30.0 (3.7) 21.4 (2.9) 13.5 (5.5) (n) (57) (73) (131) (81) (58) (60)

This article is protected by copyright. All rights reserved. 44

This article is protected by copyright. All rights reserved. 45

Table 5. The distribution of DSM-5/ACDS adult ADHD in the general population, among health plan subscribers, and among help-seekers NCS-R Health plan NYU Langone Total % (se) % (se) % (se) % (se) AD-only Restrictive C1. High only on Executive Dysfunction/Inattention 4.8 (4.0) 11.9 (9.6) 11.7 (2.4) 11.1 (2.8) C2. High only on Hyperactivity 3.7 (2.7) 8.2 (7.4) 6.7 (1.9) 6.7 (2.2) Total 8.5 (5.1) 20.1 (11.7) 18.3 (2.9) 17.8 (3.4) AD-only non-restrictive C1. High only on Executive Dysfunction/Inattention 7.9 (4.3) 10.1 (8.9) 9.4 (2.2) 9.4 (2.6) C2. High only on Hyperactive 2.8 (2.0) --a --a 3.3 (1.3) 2.7 (0.9) C4. High on all --a --a --a --a 1.7 (1.0) 1.2 (0.6) C5. High on all but Emotional Dyscontrol --a --a --a --a 1.7 (1.0) 1.1 (0.6) C6. High on none 4.0 (3.5) 19.8 (16.7) --a --a 5.4 (2.6) Total 14.8 (6.8) 31.0 (16.7) 16.7 (2.8) 19.9 (4.8) HD-only restrictive C2. High only on Hyperactive --a --a 16.5 (11.9) --a --a 4.0 (3.0) C4. High on all --a --a --a --a --a --a --a --a C5. High on all but Emotional Dyscontrol 3.8 (3.9) 2.4 (2.3) 1.1 (0.8) 1.7 (0.8) C6. High on none 5.2 (4.1) --a --a --a --a --a --a Total 10.3 (6.1) 19.4 (12.1) 1.1 (0.8) 6.3 (3.1) HD-only non-restrictive C2. High only on Hyperactive --a --a 1.2 (1.3) --a --a --a --a C3. High only on Emotional Dyscontrol 1.9 (1.9) --a --a --a --a --a --a C4. High on all 1.4 (1.0) --a --a --a --a --a --a C6. High on none 33.9 (22.0) 11.2 (10.5) --a --a 6.2 (3.9) Total 37.4 (21.0) 13.2 (10.5) 0.6 (0.6) 7.0 (3.8) Combined type C1. High only on Executive Dysfunction/Inattention --a --a --a --a --a --a --a --a C2. High only on Hyperactive --a --a --a --a --a --a --a --a C4. High on all 12.0 (5.6) 13.3 (8.8) 36.1 (3.6) 28.5 (3.7) C5. High on all but Emotional Dyscontrol 14.0 (7.2) 2.1 (1.1) 25.0 (3.2) 18.5 (2.7) C6. High on none 2.2 (2.3) --a --a 1.7 (1.0) 1.4 (0.7) Total 29.0* (11.3) 16.3* (9.1) 63.3 (3.6) 49.0 (4.8)

(n)c (61) (92) (180) (333)

*Significantly different from the proportion in the NYU Langone sample at the .05-level aMeans <1.0% of sample, not reported bThe respondents considered here are restricted to those with DSM-5/ACDS Adult ADHD. cThe numbers of respondents with ADHD in the NCS-R and health plan samples are considerably more than the numbers expected by multiplying the prevalence estimates in Table 2 by the total sample sizes, as respondents who screened positive for ADHD in the first phases of those samples were over-sampled in the second-stage (NCS-R) and second/third-stage (health plan) samples considered here. Weights were introduced to correct for this over-sampling in calculating the prevalence estimates in Table 2.

This article is protected by copyright. All rights reserved. 46

This article is protected by copyright. All rights reserved.