You are on page 1of 10

Psychological Assessment 2012 American Psychological Association

2013, Vol. 25, No. 1, 194 203 1040-3590/13/$12.00 DOI: 10.1037/a0029966

A Taxometric Exploration of the Latent Structure of Hoarding

Kiara R. Timpano Joshua J. Broman-Fulks


University of Miami Appalachian State University

Heide Glaesmer and Cornelia Exner Winfried Rief


University of Leipzig University of Marburg

Bunmi O. Olatunji Meghan E. Keough


Vanderbilt University University of Washington
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

Christina J. Riccardi Elmar Brhler


This document is copyrighted by the American Psychological Association or one of its allied publishers.

Florida State University University of Leipzig

Sabine Wilhelm Norman B. Schmidt


Massachusetts General Hospital, Boston, Massachusetts, and Florida State University
Harvard Medical School

Despite controversy regarding the classification and diagnostic status of hoarding disorder, there remains
a paucity of research on the nosology of hoarding that is likely to inform the classification debate. The
present investigation examined the latent structure of hoarding in three, large independent samples. Data
for three well-validated measures of hoarding were subjected to taxometric procedures, including
MAXimum EIGenvalue, Mean Above Minus Below A Cut, and Latent-Mode factor. Two symptom
measures, one of which closely mirrors the proposed diagnostic criteria for hoarding disorder, and a
measure of hoarding beliefs were analyzed. Sample 1 (n 2,501) was representative of the general
German population, while Samples 2 (n 1,149) and 3 (n 500) consisted of unselected undergraduate
students. Findings across all three samples and taxometric procedures provided converging evidence that
hoarding is best conceptualized as a dimensional construct, present in varying degrees in all individuals.
Results have implications across research and treatment domains, particularly with respect to assessment
approaches, treatment response determination, and policy decisions. These findings underscore the need
for further investigations on the nosology of hoarding, to help validate this construct as we move forward
with respect to our research and treatment efforts, as well as the potential inclusion of hoarding disorder
in the Diagnostic and Statistical Manual of Mental Disorders (5th ed.; DSM5; American Psychiatric
Association, 2012).

Keywords: hoarding, taxometrics, dimensional latent structure

This article was published Online First September 17, 2012. from the National Institute of Mental Health (NIMH), the Obsessive-
Kiara R. Timpano, Department of Psychology, University of Miami; Joshua J. Compulsive Foundation, and the Tourette Syndrome Association. She
Broman-Fulks, Department of Psychology, Appalachian State University; Heide has also received medications and placebos from Forest Laboratories
Glaesmer, Abteilung fr Medizinische Psychologie und Medizinische Soziologie, for an NIMH-funded study; she is a presenter for the Massachusetts
University of Leipzig, Leipzig, Germany; Cornelia Exner, Department of Clinical General Hospital Psychiatry Academy in educational programs, sup-
Psychology, University of Leipzig; Winfried Rief, Department of Psychology, ported through independent medical education grants from pharmaceu-
University of Marburg, Marburg, Germany; Bunmi O. Olatunji, Department of tical companies; she has received royalties from Elsevier Publications,
Psychology, Vanderbilt University; Meghan E. Keough, Department of Psychia- Guilford Publications, New Harbinger Publications, and Oxford Uni-
try, University of Washington; Christina J. Riccardi, Department of Psychology, versity Press; and she has received speakers honorarium from various
Florida State University; Elmar Brhler, Abteilung fr Medizinische Psychologie academic institutions.
und Medizinische Soziologie, University of Leipzig; Sabine Wilhelm, Department We thank Carissa Orlando for her assistance in providing ratings of the
of Psychiatry, Massachusetts General Hospital, Boston, Massachusetts, and Har- taxometric plots.
vard Medical School; Norman B. Schmidt, Department of Psychology, Florida Correspondence concerning this article should be addressed to Kiara R.
State University. Timpano, Department of Psychology, University of Miami, 5665 Ponce de
The authors have no conflicts of interest or financial disclosures, with Leon Boulevard, Coral Gables, FL 33146. E-mail: kiaratimpano@
the exception of Sabine Wilhelm, who has received research support gmail.com

194
LATENT STRUCTURE OF HOARDING 195

Hoarding disorder is defined as a persistent and extreme diffi- taxonic phenomenon, the former reflecting a combination of mul-
culty with discarding possessions, which, combined with severely tiple, possibly graded factors, whereas the latter may be attribut-
cluttered living spaces and excessive acquiring, can lead to clinical able to a single gene or discrete environmental effect.
levels of distress and/or impairment (Frost & Hartl, 1996). Current Examining the extant research on hoarding disorder, it remains
prevalence estimates range from 2 6%, indicating that it is a far unclear whether the syndrome would be best classified as a distinct
more common phenomenon than initially hypothesized (Iervolino category or should be conceptualized as a dimensional phenome-
et al., 2009; Timpano, Exner, et al., 2011). Hoarding disorder has non. Considering the degree of impairment associated with hoard-
additionally been linked with a chronic course (Tolin, Meunier, ing disorder, along with the almost fantastical levels of clutter
Frost, & Steketee, 2010), high rates of comorbidity, and poor noted in some cases, it is plausible to conclude that clinical
physical health (Tolin, Frost, Steketee, Gray, & Fitch, 2008). The hoarding represents a unique or distinct phenomenon. That is, one
serious ramifications associated with hoarding are not just limited hypothesis may be that clinical hoarding is qualitatively different
to the individual, as symptoms may affect family members and from the collecting, saving, and acquiring behaviors seen in the
communities (Tolin, Frost, Steketee, & Fitch, 2008). Despite the nonclinical population (Nordsletten & Mataix-Cols, 2012). Pro-
development of a cognitive behavioral intervention (Steketee, viding support for this hypothesis are neuropsychological findings
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

Frost, Tolin, Rasmussen, & Brown, 2010), this syndrome is gen- that outline specific deficits in executive functioning among indi-
erally acknowledged as a challenge to treat. Considered collec- viduals with clinical hoarding (Tolin, Villavicencio, Umbach, &
This document is copyrighted by the American Psychological Association or one of its allied publishers.

tively, these data underscore our understanding of hoarding as a Kurtz, 2011). Individuals with hoarding also often endorse ex-
profound public health burden. tremely unusual, maladaptive beliefs about, and strong emotional
Hoarding symptoms have been traditionally associated with attachment toward their possessions (Gilliam & Tolin, 2010).
obsessive-compulsive disorder (OCD) or included as a symptom Finally, from a clinical perspective, one study found that treatment
of obsessive compulsive personality disorder; however, there is a providers easily distinguished clinical hoarding from normal sav-
growing consensus that this classification might not be empirically ing behaviors in children (Plimpton, Frost, Abbey, & Dorer, 2009).
warranted (Mataix-Cols et al., 2010). In light of clinical, genetic, In contrast, there are also a number of findings that support a
and neuropsychological research conducted over the last 10 years, dimensional perspective. These data present the alternative, yet
the Diagnostic and Statistical Manual of Mental Disorders (5th viable, hypothesis that individuals with hoarding may differ from
ed.; DSM5; American Psychiatric Association, 2012) Obsessive- nonclinical controls as a matter of degree, not type. Relevant
Compulsive Spectrum Sub-Workgroup has put forth the recom- to this is the fact that all individuals have at some point in their life
mendation to identify hoarding as a discrete disorder within saved and acquired objects. Some have suggested that hoarding
DSM5 (American Psychiatric Association, 2012; Mataix-Cols, et may even represent an adaptive mechanism that emerged through
al., 2010; Pertusa et al., 2010). Nevertheless, many questions evolutionary processes (Leckman & Mayes, 1998). Second, factor
regarding the nosology of hoarding remain. Finding answers to analytic studies of hoarding symptoms, as well as associations
these issues is of paramount importance, for as Cronbach and between hoarding symptoms and various mood and anxiety con-
Meehl (1955) have noted, classification provides the field with an structs, indicate comparable solutions across clinical and nonclini-
operationalization of a given phenomenon and, as such, represents cal samples (Coles, Frost, Heimberg, & Steketee, 2003; Frost,
the foundation for theory. Therefore, effectively capturing hoard- Steketee, & Grisham, 2004). Proposed risk factors, such as stress-
ing disorder within a scientifically informed nomenclature would ful or traumatic life events, are also associated with hoarding
significantly contribute to our understanding of its phenomenol- symptoms in a similar manner, regardless of the type of sample
ogy, etiology, and treatment. investigated (Timpano, Keough, Traeger, & Schmidt, 2011; Tolin,
One relevant nosological consideration pertains to the latent Meunier, et al., 2010). Similarly, a series of symptom provocation
structure of hoarding symptoms. That is, do individuals with imaging studies demonstrated that the same brain regionspre-
hoarding disorder reflect a distinct group or category, or do clinical dominantly frontal limbic regionsare associated with hoarding
hoarding symptoms reflect an extreme end of a larger spectrum of symptoms in both healthy controls and individuals with clinical
saving and acquiring behaviors? The proposed DSM5 definition hoarding (Mataix-Cols et al., 2003, 2004).
of hoarding reflects a categorical approach (American Psychiatric Taxometrics is a series of computational procedures and epis-
Association, 2012); however, the true nature and underlying struc- temological principles designed to discern the latent structure of
ture of hoarding remains an empirical question to be tested. The phenomena (Meehl, 1995; Schmidt, Kotov, & Joiner, 2004). Spe-
idea of a dimensional versus categorical structure of hoarding has cifically, taxometrics evaluates whether the relations among spec-
implications across research and treatment arenas. For example, ified indicators of a proposed category or taxon fit a categorical
from a measurement perspective, a dimensional view calls for the or a continuous solution. To date only one taxometric investigation
assessment of hoarding symptoms across a continuum, whereas a is relevant to hoarding. Olatunji, Williams, Haslam, Abramowitz,
categorical view necessitates instruments that accurately classify and Tolin (2008) examined the latent structure of obsessive com-
individuals as category members or nonmembers. In the same pulsive (OC) symptoms in a large sample of students, taking into
vein, should hoarding be determined to have a continuous struc- account six different symptom types (hoarding, washing, checking,
ture, then the diagnostic thresholds currently being discussed in obsessing, neutralizing, and ordering) and three beliefs associated
relation to DSM5 will in reality be relatively arbitrary. The latent with OCD. The findings supported a dimensional model of the
structure of hoarding can also inform etiological investigations and latent structure for all symptom types, with the exception of
treatment approaches. As Haslam (1997) and others (A. M. Rus- hoarding, which showed some evidence of taxonicity. A signifi-
cio, Borkovec, & Ruscio, 2001) have discussed, dimensional phe- cant limitation of this investigation with respect to hoarding is that
nomenon may be associated with different etiological models than it relied on the three hoarding items of the Obsessive-Compulsive
196 TIMPANO ET AL.

InventoryRevised (OCIR; Foa et al., 2002) to assess hoarding Measures


behaviors. While the OCIR represents a valid assessment instru-
ment for OCD, it does not adequately capture hoarding. As dis- Hoarding Rating Scale (HRS; Tolin, Frost, & Steketee,
cussed above, there is a growing understanding that hoarding 2010). The HRS is a five-item measure of the key hoarding
symptoms should not necessarily be considered OCD, and mea- dimensions. Participants are required to answer items using a
sures designed to assess OCD may not effectively reflect the core 9-point Likert-type scale, ranging from 0 (none) to 8 (extreme).
components of hoarding: clutter, difficulty discarding due to strong Items ask about (a) clutter, (b) difficulty with discarding posses-
urges to save and/or distress, and acquisition. Although the OCIR sions, (c) difficulty with excessive acquisition, (d) emotional dis-
includes items that generally address clutter, acquisition, and sav- tress, and (e) functional impairment. HRS scores have been shown
ing behaviors, this measure has not been validated for use with to have good measurement characteristics, including evidence for
hoarding samples (i.e., hoarding populations considered separately testretest reliability, internal consistency ( .97.87), conver-
from clinical OCD samples). Also, from a methodological per- gent and divergent validity, as well as construct validity in both
spective, the OCIR only includes three hoarding items, which give hoarding and nonclinical samples (Tolin, Frost, & Steketee, 2010).
rise to potential interpretative problems for taxometric analyses in The present investigation relied on the German-HRS (Timpano,
Exner, et al., 2011).
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

which indicators have limited ranges.


The aims of the current investigation were to examine the latent Saving InventoryRevised (SIR; Frost et al., 2004). The
This document is copyrighted by the American Psychological Association or one of its allied publishers.

structure of hoarding symptoms using a series of taxometric pro- SIR is a 23-item self-report questionnaire assessing a range of
cedures. We sought to extend previous research by using three hoarding behaviors in both clinical and nonclinical samples. Par-
separate and well established measures of hoarding to capture this ticipants are required to answer items using a 5-point Likert-type
multifaceted construct. In addition to considering two separate scale from 0 (none) to 4 (almost all/extreme/very often). The
symptom measures of hoarding, one of which closely mirrors the measure includes three factor analytically derived subscales, in-
proposed diagnostic criteria for hoarding disorder, we also ana- cluding acquisition (seven items), clutter (nine items), and diffi-
lyzed a measure of hoarding beliefs. Findings from clinical re- culty discarding (seven items). SIR scores have been shown to
search studies indicate that the average age of hoarding patients is have good psychometric indices, including strong internal consis-
around 50 years; however, age of onset research suggests that tency coefficients ( .97.87), as well as convergent and diver-
hoarding symptoms emerge prior to the age of 20 (Tolin, Meunier, gent validity in both clinical (Frost et al., 2004) and student
et al., 2010). Analyses were therefore conducted using three large, samples (Coles et al., 2003).
independent samples, including a community population with a Saving Cognitions Inventory (SCI; Steketee, Frost, &
large age range and two early adulthood student samples. This Kyrios, 2003). The SCI reflects a 24-item measure examining
sampling procedure was deemed suitable given the estimated attitudes and beliefs associated with hoarding symptoms. The scale
population prevalence of hoarding (Timpano, Exner, et al., 2011). includes four subscales: emotional attachment (10 items), memory
Considering the suggestive evidence from factor analytic studies (five items), control (three items), and responsibility (six items).
and the similarity of findings when clinical and nonclinical sam- Items are answered on a 7-point Likert-type scale from 1 (not at
ples are compared (Coles et al., 2003; Frost et al., 2004), we all) to 7 (very much). SCI scores have been found to have good
hypothesized that the taxometric procedures would yield a contin- internal consistency, as well as good convergent and discriminant
uous solution of hoarding across samples. validity (Steketee et al., 2003). It has been used with both clinical
(Muroff et al., 2009) and nonclinical (Luchian, McNally, &
Hooley, 2007) samples.
Method
Procedure
Participants
Sample 1 was collected with the assistance of an independent
The present investigation relied on three large, independent demographic consulting company (USUMA, Berlin, Germany), as
samples, which are characterized in Table 1. Sample 1 was repre- part of a large cross-sectional survey of a representative subgroup
sentative of the general German population, while Samples 2 and of the general German population. A detailed description of pro-
3 consisted of unselected undergraduate students. cedures and sampling strategies can be found in a previously

Table 1
Descriptive Statistics for the Three Samples

Indicator Indicator correlations


validity within:
Type of M age Age range % Range of total
Sample N sample (years) (years) Female Scale score M SD Taxon Complement

Sample 1 2,501 Community 48.8 1494 51.4 HRS 034 2.70 .67 .09 .37
Sample 2 1,149 Student 19.5 1833 68.3 SIR 081 2.41 .18 .14 .29
Sample 3 500 Student 19.1 1830 66.3 SCI 24148 2.04 .48 .23 .29
Note. HRS Hoarding Rating Scale (Tolin, Frost, & Steketee, 2010); SIR Saving InventoryRevised (Frost et al., 2004); SCI Saving Cognitions
Inventory (Steketee, Frost, & Kyrios, 2003).
LATENT STRUCTURE OF HOARDING 197

published report (Timpano, Exner, et al., 2011). Briefly, all sub- Data Analytic Strategy
jects were personally visited by a trained study assistant, informed
about the study procedures, and asked to sign an informed consent The latent structure of hoarding was investigated by submit-
document prior to completing a battery of questionnaires (includ- ting the hoarding indicators identified in each sample to three
ing the HRS). taxometric proceduresMAXimum EIGenvalue (MAXEIG),
With respect to the student samples, participants completed Mean Above Minus Below A Cut (MAMBAC), and Latent-
either the SIR (Sample 2) or the SCI (Sample 3) in exchange for Mode factor analysis (L-Mode). Simulated taxonic and dimen-
partial course credit. Informed consent (approved by the Institu- sional data plots were generated using Monte Carlo data that
tional Review Board) was obtained prior to completing a battery of matched the unique distributional characteristics (e.g., skew,
self-report questionnaires, and all studies were run in accordance kurtosis, N) of the research data to assist in the interpretation of
with American Psychological Association standard ethical guide- results. To derive parameter estimates and generate categorical
lines. comparison data, cases were assigned to groups using an iter-
ative method wherein analyses were initially run to obtain the
mean base rate. Analyses were then repeated a second time
Indicator Selection
using the mean base rate to classify cases into conjectured taxon
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

Composite indicators were derived based on the theoretical and complement groups. The relative fit of the research data
This document is copyrighted by the American Psychological Association or one of its allied publishers.

model of hoarding and prior factor analytic studies (Frost & Hartl, plots to the simulated taxonic and dimensional curves was
1996; Frost et al., 2004). The descriptive characteristics and inter- assessed visually by two independent raters (96% agreement)
nal consistency levels for each measure and sample are presented and using the Comparison Curve Fit Index (CCFI; J. Ruscio,
in Table 2, along with interindicator correlations. The five HRS Ruscio, & Meron, 2007). The algorithms for the taxometric
items map onto several of the proposed DSM5 hoarding criteria, procedures were obtained from J. Ruscio (2011).
including Criterion A (difficulty discarding personal possessions), MAXEIG. MAXEIG (Waller & Meehl, 1998) is a multivar-
Criterion C (clutter), Criterion D (distress and/or impairment), and iate procedure that calculates and plots eigenvalues from all
the acquiring specifier (Mataix-Cols et al., 2010; Tolin, Frost, & indicators across successive intervals of an input indicator. The
Steketee, 2010). Each item represented its own indicator. The SIR MAXEIG procedure offers a supplemental Inchworm Consistency
has been found to assess three behavioral facets of hoarding, Test (ICT), which repeats MAXEIG analyses on the research data
including clutter, difficulty discarding, and acquiring. Items load- with an increasing number of overlapping windows. The ICT
ing on each factor were summed to create three indicators. The SCI improves the interpretability of MAXEIG plots and is particularly
reflects four different cognitive aspects related to hoarding, includ- beneficial for elucidating the presence of a low base-rate taxon
ing emotional attachment to possessions, concerns about memory, (Waller & Meehl, 1998). The ICT was performed using 50, 100,
control over possessions, and responsibility toward possessions. 150, and 200 windows with .90 overlap.
Similar to our approach with the SIR, items loading on each SCI MAMBAC. The MAMBAC (Meehl & Yonce, 1994) proce-
factor were summed to create four indicators reflecting hoarding- dure is based on the assumption that if two discrete groups exist
relevant cognitions. (i.e., taxon and nontaxon), mean differences between groups will

Table 2
Descriptive Statistics, Reliability, and Pearson Correlation Coefficient for the Indicators Derived From Each of the Three
Hoarding Measures

Indicator correlation
Indicator M SD Indicator range Alpha 1 2 3 4

Study 1: Hoarding Rating Scale


1. Clutter 1.41 1.91 08
2. Discarding 1.39 1.71 08 .53
3. Acquisition 0.88 1.38 08 .47 .56
4. Distress 0.87 1.36 08 .49 .57 .69
5. Impairment 0.88 1.38 08 .52 .58 .69 .79

Study 2: Saving InventoryRevised


1. Clutter 6.17 5.72 031 .91
2. Discarding 7.99 5.39 027 .88 .68
3. Acquisition 7.60 4.79 027 .79 .55 .55

Study 3: Saving Cognitions Inventory


1. Emotion 23.57 11.91 1070 .92
2. Control 11.64 4.41 321 .73 .52
3. Responsibility 15.11 6.82 638 .82 .73 .62
4. Memory 13.80 6.63 534 .83 .64 .49 .68
Note. All correlation coefficients significant at p .001.
198 TIMPANO ET AL.

occur on valid indicators of group membership. MAMBAC anal- data plots were more consistent with the simulated dimensional
yses in the present study were conducted using 100 evenly spaced plots than the simulated taxonic plot (see the middle section of
cuts beginning 25 cases from either extreme. Figure 1 for the averaged MAMBAC plot superimposed on sim-
L-Mode. L-mode (Waller & Meehl, 1998) is a multivariate ulated taxonic and dimensional plots). Thus, the MAMBAC pro-
taxometric procedure that conducts a factor analysis on the pro- cedure provided convergent evidence for a latent hoarding dimen-
posed indicators, and plots the distribution of scores on the first sion.
principal factor. Taxonic variables tend to produce a bimodal L-Mode analysis of the HRS indicators generated a single factor
distribution of factor scores. In contrast, dimensional variables score density plot. As can be seen in lower section of Figure 1, the
generate factor score plots that are unimodally distributed. L-mode distribution did not contain two clearly delineated peaks
CCFI. The CCFI is an objective numerical gauge of whether and was relatively consistent with the simulated dimensional plot.
data plots more closely match simulated taxonic or simulated As noted above, the CCFI provides an index of whether the data
dimensional plots. The CCFI procedure compares the root-mean- plots more closely resemble simulated taxonic or dimensional
square residual (RMSR) estimates of the research data with the plots. The mean CCFI score across MAXEIG, MAMBAC, and
simulated taxonic and dimensional curves. The result is a CCFI L-Mode analyses was .36, providing additional objective evidence
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

score for each of the procedures that ranges from 0 to 1, which can that the HRS data plots were more comparable to the simulated
be averaged across taxometric procedures to produce a mean CCFI dimensional plots, and indicating that hoarding, as measured by
This document is copyrighted by the American Psychological Association or one of its allied publishers.

score for each sample. Scores 0.45 are interpreted as consistent the HRS in a large representative population sample, is dimen-
with a latent dimension and scores 0.55 are indicative of taxonic sional at the latent level.
latent structure. Caution is generally recommended in interpreting
CCFI scores between 0.45 and 0.55, as they do not provide strong
SIR-Suitability Analyses
support for either model (J. Ruscio, Walters, Marcus, & Kaczetow,
2010). Several recent studies have provided strong support for the The three SIR indicators (M 2.41, SD 0.18) met minimum
utility of the CCFI in accurately interpreting taxometric output (J. validity criteria and demonstrated low nuisance correlations (taxon
Ruscio, 2007; J. Ruscio & Kaczetow, 2009; J. Ruscio & Marcus, M .14, complement M .29, full sample M .62). As can be
2007; J. Ruscio, et al., 2007; J. Ruscio & Walters, 2009). seen in Figure 2, the MAXEIG, MAMBAC, and L-Mode proce-
dures passed the initial suitability test, with the simulated taxonic
Results and dimensional plots being of the expected shape and distinguish-
able from each other.
HRS-Suitability Analyses
SIR-Results
The five HRS indicator variables (M 2.70, SD .67) ex-
ceeded minimum validity criteria (1.25 SD; Meehl, 1995) and A visual analysis of the three MAXEIG plots indicated that all
demonstrated nuisance correlations (i.e., within conjectured group three were relatively flat and failed to demonstrate the peaks that
correlations) within tolerable limits (taxon M .09, complement would be typical of taxonic data. The ICT aided in interpretability
M .37, full sample M .59). To ensure that the hoarding data of the plots, with support for a dimensional solution increasing as
were capable of producing interpretable output, plots generated the number of overlapping windows increased. Although one plot
from simulated taxonic and dimensional data with similar distri- demonstrated a potential small peak on the right side at 200
butional characteristics to the research data were created. As can windows, this peak appeared to be spurious as it was not evident
be seen in Figure 1, the MAXEIG, MAMBAC, and L-Mode at other levels of overlapping windows. As can be seen in top
procedures passed the initial suitability test. Thus, the indicators section of Figure 2, the averaged MAXEIG curve more closely
and taxometric procedures were deemed appropriate for analysis. resembled the simulated dimensional plots. Similarly, the
MAMBAC procedure generated six plots, all of which were con-
cave in shape and failed to evidence typical peaks indicative of
HRS-Results
taxonicity. A comparison of the data plots with simulated taxonic
A visual analysis of the five MAXEIG plots indicated that all and dimensional plots revealed that the data plots were highly
five were relatively flat or rising toward the right side of the plot consistent with the simulated dimensional plots (see the middle
and failed to demonstrate the peaks that would be typical of section of Figure 2). Further, the factor score density plot created
taxonic data. Overall, the ICT aided in interpretability of the plots, by L-Mode did not evidence a clearly delineated second peak and
with support for a dimensional solution increasing as the number was consistent with the simulated dimensional plot. The mean
of overlapping windows increased. As can be seen in the top CCFI score for MAXEIG, MAMBAC, and L-Mode analyses of
section of Figure 1, the averaged MAXEIG curve more closely the SIR data provided strong support for a dimensional structure
resembled the simulated dimensional plots. (CCFI .33). Thus, the results of SIR taxometric analyses pro-
Similarly, the application of the MAMBAC procedure to the vided additional evidence that hoarding is dimensional at the latent
five hoarding indicators generated 20 plots, 16 of which were level.
concave or rising toward the right side of the plot and lacking
typical peaks indicative of taxonicity. The remaining four plots
SCI-Suitability Analyses
demonstrated peaks near the center of the plots, suggesting a
base-rate near .50. A comparison of the data plots with simulated A similar approach was used to examine the suitability of the
taxonic and dimensional plots revealed that vast majority of the SCI data for taxometric analysis. The four SCI indicators met
LATENT STRUCTURE OF HOARDING 199
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
This document is copyrighted by the American Psychological Association or one of its allied publishers.

Figure 1. Averaged MAXimum EIGenvalue (MAXEIG; Waller & Meehl, 1998; A), Mean Above Minus
Below A Cut (MAMBAC; Meehl & Yonce, 1994; B), and Latent-Mode factor analysis (L-Mode; Waller &
Meehl, 1998; C) curves for the Hoarding Rating Scale (HRS; Tolin, Frost, & Steketee, 2010) data (Sample 1)
superimposed on simulated taxonic (left) and dimensional curves (right).

minimum validity criteria (M 2.04, SD 0.48) and demon- taxon. The remaining three plots were relatively flat and con-
strated nuisance correlations within tolerable limits (taxon M sistent with a latent dimension. Refer to the top section of
.23, complement M .29, full sample M .62). The simulated Figure 3 for the averaged MAXEIG data curve. Visual com-
taxonic and dimensional plots were clearly distinguishable and parison of the data plots with simulated comparison plots re-
passed the initial suitability test. vealed that the data plots were highly consistent with the
simulated dimensional plots. MAMBAC analyses produced 12
SCI-Results plots, 10 of which lacked a distinct peak, were highly consistent
MAXEIG analyses produced four plots, only one of which with the simulated dimensional plots, and were interpreted as
appeared to demonstrate a peak that would be suggestive of a supporting a dimensional structure. The two remaining plots
200 TIMPANO ET AL.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
This document is copyrighted by the American Psychological Association or one of its allied publishers.

Figure 2. Averaged MAXimum EIGenvalue (MAXEIG; Waller & Meehl, 1998; A), Mean Above Minus
Below A Cut (MAMBAC; Meehl & Yonce, 1994; B), and Latent-Mode factor analysis (L-Mode; Waller &
Meehl, 1998; C) curves for the Saving InventoryRevised (SIR; Frost et al., 2004) data (Sample 2) superimposed
on simulated taxonic (left) and dimensional curves (right).

were ambiguous, demonstrating slight rises toward the right Discussion


side of the graph. The data plots were generally consistent with
the simulated dimensional plots. The L-mode data plot demon- Answers regarding the nosology of hoarding will be of key impor-
strated a unimodal distribution and was consistent with the tance in the coming years, as decisions are made about the classifi-
simulated dimensional plot. The mean CCFI score for cation of hoarding in our diagnostic system (Mataix-Cols et al., 2010).
MAXEIG, MAMBAC, and L-Mode analyses of the SCI data As it stands, there is a paucity of extant research on the latent structure
provided strong support for a dimensional structure (CCFI of hoarding, and as a result, different studies have used either a
.36). dimensional or categorical definition without a clear empirical basis
LATENT STRUCTURE OF HOARDING 201
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
This document is copyrighted by the American Psychological Association or one of its allied publishers.

Figure 3. Averaged MAXimum EIGenvalue (MAXEIG; Waller & Meehl, 1998; A), Mean Above Minus
Below A Cut (MAMBAC; Meehl & Yonce, 1994; B), and Latent-Mode factor analysis (L-Mode; Waller &
Meehl, 1998; C) curves for the Saving Cognitions Inventory (SCI; Steketee, Frost, & Kyrios, 2003) data (Sample
3) superimposed on simulated taxonic (left) and dimensional curves (right).

for doing so. In a similar fashion, the proposed DSM5 definition of MAXEIG, MAMBAC, and L-Modeand considered the collec-
hoarding assumes a categorical latent structure. The present investi- tive findings across three well validated measures of hoarding,
gation sought to address this issue by conducting a detailed taxometric including the HRS, SIR, and SCI. Overwhelmingly, the results
analysis of hoarding symptoms and associated beliefs. were consistent with a dimensional solution. That is, differences in
Taxometrics do not rely upon traditional significance testing. hoarding behaviors and beliefs seem to be quantitative versus
Rather, a notable strength of these procedures is that one can qualitative. These results are in contrast to the report by Olatunji et
evaluate the consistency of taxometric findings across a set of al. (2008), which examined the taxonicity of various subtypes of
different procedures (Schmidt et al., 2004). In our report, we OCD. However, it is likely that indicator selection (i.e., the OCIR
specifically integrated a series of three proceduresincluding hoarding subscale) contributed to these differences in findings.
202 TIMPANO ET AL.

There are a number of implications for the study and treatment sample, ameliorates this limitation somewhat. Nevertheless, these
of hoarding that emerge from our findings supporting a dimen- sampling issues remain an important consideration for future re-
sional structure. Etiological models should be able to account for search. A second limitation is our selection of indicators. It is
a continuum of hoarding symptoms, ranging from nonclinical possible that alternative sets of indicators could identify disconti-
levels to extreme representations with high levels of distress and nuity or taxonicity. To this end, we selected two measures of
impairment. Etiological studies should consider additive or inter- hoarding to capture different features of the current cognitive
active effects between various risk factors. That is, a dimensional behavioral conceptualization of hoarding (i.e., behaviors and be-
latent structure implies that the phenomenon may be multiply liefs); yet it is plausible that other facets of this phenomenon might
determined and would be best characterized by an additive or represent equally valuable indicators, which may, in turn, support
interactive, graded etiology, rather than discrete, single environ- more taxonic findings. For example, once the neuropsychological
mental or genetic effects. This finding is in line with a recent twin profile is better established for clinical hoarding, these measures
study of hoarding, which found support for both genetic and might represent interesting and informative indices for taxometric
nonshared environmental factors in the etiology of hoarding analysis.
among females (Iervolino et al., 2009). In conclusion, the current investigation found support for a
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

Assessment approaches to hoarding, from both a research and dimensional model of hoarding. This is the first taxometric study
clinical perspective, will need to be carefully considered. Measure- on hoarding to rely on well-validated measures of different facets
This document is copyrighted by the American Psychological Association or one of its allied publishers.

ment lies at the crux of successful empirical and clinical endeav- of the phenomenon. In general, our findings underscore the need
ors, and therefore the field as a whole needs to ensure that a given for further investigations on the nosology of hoarding, to help
phenomenon is being accurately captured. Our data recommend validate this construct as we move forward with respect to our
against the use of arbitrary cut-points to identify individuals with research and treatment efforts, as well as the potential inclusion of
hoarding. A dichotomization of study samples would have direct hoarding disorder in DSM5.
implications for construct validity and would also result in the loss
of statistical power for empirical investigations. Existing cutoff
scores certainly offer clinical utility; however, our data recom- References
mend that they be used as a gauge for identifying significant and American Psychiatric Association. (2012). Proposed draft revisions to
clinically meaningful levels of hoarding, rather than as a means to DSM disorders and criteria (DSM5 development). Retrieved from
place individuals in discrete categories. In line with current shifts http://www.dsm5.org
within the literature (Widiger & Trull, 2007), dimensional classi- Coles, M. E., Frost, R. O., Heimberg, R. G., & Steketee, G. (2003).
fication approaches to hoarding that disperse scores broadly may Hoarding behaviors in a large college sample. Behaviour Research and
be considered. Our findings also have implications for treatment Therapy, 41, 179 194. doi:10.1016/S0005-7967(01)00136-X
response and relapse, such that treatment response should not be Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological
understood as a discrete shift from hoarder to nonhoarder status. tests. Psychological Bulletin, 52, 281302. doi:10.1037/h0040957
Foa, E. B., Huppert, J. D., Leiberg, S., Langner, R., Kichic, R., Hajcak, G.,
Instead, our data support the notion that patients may move along
& Salkovskis, P. M. (2002). The Obsessive-Compulsive Inventory:
a continuum from clinically significant hoarding symptoms to Development and validation of a short version. Psychological Assess-
nonsignificant levels and that this movement may be gradual or ment, 14, 485 496. doi:10.1037/1040-3590.14.4.485
partial. Finally, these assessment considerations have implications Frost, R. O., & Hartl, T. L. (1996). A cognitive-behavioral model of
for public policies regarding hoarding, particularly with regard to compulsive hoarding. Behaviour Research and Therapy, 34, 341350.
disability determination criteria. Classifying patients into discrete doi:10.1016/0005-7967(95)00071-2
disordered and nondisordered categories may be less helpful (or Frost, R. O., Steketee, G., & Grisham, J. R. (2004). Measurement of
accurate) in such instances, and future research will be required to compulsive hoarding: Saving InventoryRevised. Behaviour Research
help determine how to best reconcile our understanding of the and Therapy, 42, 11631182. doi:10.1016/j.brat.2003.07.006
dimensional nature of hoarding with current policies and criteria. Gilliam, C. M., & Tolin, D. F. (2010). Compulsive hoarding. Bulletin of the
Menninger Clinic, 74, 93121. doi:10.1521/bumc.2010.74.2.93
The present findings should be considered in light of several
Haslam, N. (1997). Evidence that male sexual orientation is a matter of
limitations. First and foremost, it is possible that given the low
degree. Journal of Personality and Social Psychology, 73, 862 870.
base rate of hoarding we may not have had sufficient representa- doi:10.1037/0022-3514.73.4.862
tion to detect the putative taxon. Although each of the three Iervolino, A. C., Perroud, N., Fullana, M. A., Guipponi, M., Cherkas, L.,
samples included individuals with hoarding symptoms that fell Collier, D. A., & Mataix-Cols, D. (2009). Prevalence and heritability of
within the clinical range, future research should consider using compulsive hoarding: A twin study. American Journal of Psychiatry,
diagnostic interviews in conjunction with taxometric analyses. 166, 1156 1161. doi:appi.ajp.2009.08121789
This would help confirm that the study sample does in fact contain Leckman, J. F., & Mayes, L. C. (1998). Understanding developmental
a sufficient number of clinically diagnosed hoarding patients, psychopathology: How useful are evolutionary accounts? Journal of the
which would in turn ensure that hoarding symptoms range from American Academy of Child & Adolescent Psychiatry, 37, 10111021.
doi:10.1097/00004583-199810000-00010
mild to extreme. While purely clinical samples are often less
Luchian, S. A., McNally, R. J., & Hooley, J. M. (2007). Cognitive aspects
well suited to taxometric procedures, given the restricted range in
of nonclinical obsessive-compulsive hoarding. Behaviour Research and
both symptom type and severity, the ideal sample for taxometric Therapy, 45, 16571662. doi:10.1016/j.brat.2006.08.014
analyses includes about an equal number of potential taxon and Mataix-Cols, D., Cullen, S., Lange, K., Zelaya, F., Andrew, C., Amaro, E.,
complement members (Schmidt et al., 2004). The fact that we used . . . Phillips, M. L. (2003). Neural correlates of anxiety associated with
excellent indicators of hoarding in all three samples, along with the obsessive-compulsive symptom dimensions in normal volunteers. Bio-
fact that Sample 1 examined a large representative community logical Psychiatry, 53, 482 493. doi:S0006322302015044
LATENT STRUCTURE OF HOARDING 203

Mataix-Cols, D., Frost, R. O., Pertusa, A., Clark, L. A., Saxena, S., interpret results. Multivariate Behavioral Research, 42, 349 386. doi:
Leckman, J. F., . . . Wilhelm, S. (2010). Hoarding disorder: A new 10.1080/00273170701360795
diagnosis for DSMV? Depression and Anxiety, 27, 556 572. doi: Ruscio, J., & Walters, G. D. (2009). Using comparison data to differentiate
10.1002/da.20693 categorical and dimensional data by examining factor score distribu-
Mataix-Cols, D., Wooderson, S., Lawrence, N., Brammer, M. J., Speckens, tions: Resolving the mode problem. Psychological Assessment, 21, 578
A., & Phillips, M. L. (2004). Distinct neural correlates of washing, 594. doi:10.1037/a0016558
checking, and hoarding symptom dimensions in obsessive-compulsive Ruscio, J., Walters, G. D., Marcus, D. K., & Kaczetow, W. (2010).
disorder. Archives of General Psychiatry, 61, 564 576. doi:10.1001/ Comparing the relative fit of categorical and dimensional latent variable
archpsyc.61.6.564 models using consistency tests. Psychological Assessment, 22, 521.
Meehl, P. E. (1995). Bootstraps taxometrics: Solving the classification doi:10.1037/a0018259
problem in psychopathology. American Psychologist, 50, 266 275. doi: Schmidt, N. B., Kotov, R., & Joiner, T. E. (2004). Taxometrics: Toward a
10.1037/0003-066X.50.4.266 new diagnostic scheme for psychopathology. Washington, DC: Ameri-
Meehl, P. E., & Yonce, L. J. (1994). Taxometric analysis I: Detecting can Psychological Association. doi:10.1037/10810-000
taxonicity with two quantitative indicators using means above and below Steketee, G., Frost, R. O., & Kyrios, M. (2003). Cognitive aspects of
a sliding cut (MAMBAC procedure). Psychological Reports, 74, 1059 compulsive hoarding. Cognitive Therapy and Research, 27, 463 479.
doi:10.1023/A:1025428631552
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

1274.
Muroff, J., Steketee, G., Rasmussen, J., Gibson, A., Bratiotis, C., & Steketee, G., Frost, R. O., Tolin, D. F., Rasmussen, J., & Brown, T. A.
This document is copyrighted by the American Psychological Association or one of its allied publishers.

Sorrentino, C. (2009). Group cognitive and behavioral treatment for (2010). Waitlist-controlled trial of cognitive behavior therapy for hoard-
compulsive hoarding: A preliminary trial. Depression and Anxiety, 26, ing disorder. Depression and Anxiety, 27, 476 484. doi:10.1002/da
634 640. doi:10.1002/da.20591 .20673
Timpano, K. R., Exner, C., Glaesmer, H., Rief, W., Keshaviah, A., Brahler,
Nordsletten, A. E., & Mataix-Cols, D. (2012). Hoarding versus collecting:
E., & Wilhelm, S. (2011). The epidemiology of the proposed DSM5
Where does pathology diverge from play? Clinical Psychology Review,
hoarding disorder: Exploration of the acquisition specifier, associated
32, 165176. doi:10.1016/j.cpr.2011.12.003
features, and distress. Journal of Clinical Psychiatry, 72, 780 786,
Olatunji, B. O., Williams, B. J., Haslam, N., Abramowitz, J. S., & Tolin,
878 879. doi:10.4088/JCP.10m06380
D. F. (2008). The latent structure of obsessive-compulsive symptoms: A
Timpano, K. R., Keough, M. E., Traeger, L., & Schmidt, N. B. (2011).
taxometric study. Depression and Anxiety, 25, 956 968. doi:10.1002/
General life stress and hoarding: Examining the role of emotional
da.20387
tolerance. International Journal of Cognitive Therapy, 4, 263279.
Pertusa, A., Frost, R. O., Fullana, M. A., Samuels, J. F., Steketee, G., Tolin,
doi:10.1521/ijct.2011.4.3.263
D. F., . . . Mataix-Cols, D. (2010). Refining the diagnostic boundaries of
Tolin, D. F., Frost, R. O., & Steketee, G. (2010). A brief interview for
compulsive hoarding: A critical review. Clinical Psychology Review, 30,
assessing compulsive hoarding: The Hoarding Rating Scale-Interview.
371386. doi:S0272-7358(10)00020-6 Psychiatry Research, 178, 147152. doi:10.1016/j.psychres.2009.05.001
Plimpton, E. H., Frost, R. O., Abbey, B. C., & Dorer, W. (2009). Com- Tolin, D. F., Frost, R. O., Steketee, G., & Fitch, K. E. (2008). Family
pulsive hoarding in children: 6 case studies. International Journal of burden of compulsive hoarding: Results of an Internet survey. Behaviour
Cognitive Therapy, 2, 88 104. doi:10.1521/ijct.2009.2.1.88 Research and Therapy, 46, 334 344. doi:S0005-7967(08)00002-8
Ruscio, A. M., Borkovec, T. D., & Ruscio, J. (2001). A taxometric Tolin, D. F., Frost, R. O., Steketee, G., Gray, K. D., & Fitch, K. E. (2008).
investigation of the latent structure of worry. Journal of Abnormal The economic and social burden of compulsive hoarding. Psychiatry
Psychology, 110, 413 422. doi:10.1037/0021-843X.110.3.413 Research, 160, 200 211. doi:S0165-1781(07)00292-2
Ruscio, J. (2007). Taxometric analysis: An empirically grounded approach Tolin, D. F., Meunier, S. A., Frost, R. O., & Steketee, G. (2010). Course
to implementing the method. Criminal Justice and Behavior, 34, 1588 of compulsive hoarding and its relationship to life events. Depression
1622. doi:10.1177/0093854807307027 and Anxiety, 27, 829 838. doi:10.1002/da.20684
Ruscio, J. (2011). Documentation of program code to perform taxometric Tolin, D. F., Villavicencio, A., Umbach, A., & Kurtz, M. M. (2011).
analyses and simulate comparison data in the R language. Retrieved Neuropsychological functioning in hoarding disorder. Psychiatry Re-
from http://www.tcnj.edu/~ruscio/taxometrics.html search, 189, 413 418. doi:S0165-1781(11)00502-6
Ruscio, J., & Kaczetow, W. (2009). Differentiating categories and dimen- Waller, N. G., & Meehl, P. E. (1998). Multivariate taxometric procedures:
sions: Evaluating the robustness of taxometric analyses. Multivariate Distinguishing types from continua. Newberry Park, CA: Sage.
Behavioral Research, 44, 259 280. doi:10.1080/00273170902794248 Widiger, T. A., & Trull, T. J. (2007). Plate tectonics in the classification of
Ruscio, J., & Marcus, D. K. (2007). Detecting small taxa using simulated personality disorder: Shifting to a dimensional model. American Psy-
comparison data: A reanalysis of Beach, Amir, and Baus (2005) data. chologist, 62, 71 83. doi:2007-01685-001
Psychological Assessment, 19, 241246. doi:10.1037/1040-3590.19.2
.241 Received September 2, 2011
Ruscio, J., Ruscio, A. M., & Meron, M. (2007). Applying the bootstrap to Revision received July 16, 2012
taxometric analysis: Generating empirical sampling distributions to help Accepted July 20, 2012

You might also like