You are on page 1of 11

AJSLP

Research Article

Adaptation of the MacArthur-Bates


Communicative Development Inventories for
Spanish Children With Down Syndrome:
Validity and Reliability Data for Vocabulary
Miguel Galeote,a Elena Checa,a Concepción Sánchez-Palacios,a
Eugenia Sebastián,b and Pilar Sotob

Purpose: The MacArthur-Bates Communicative Development items of the Brunet-Lézine Scale (Josse, 1997; n = 70).
Inventories are widely used to study early language and Reliability (Study 3) was measured with a subset of parents
communicative development. We recently developed a who completed the same inventory 4 months after the
Spanish version for children with Down syndrome (the original sampling (n = 26).
CDI-Down) adapted to their particular profile of linguistic Results: CDI-Down expressive and receptive vocabulary
and communicative development. The principal aims of this scores showed a significant positive relationship with their
study are to assess the concurrent validity and test–retest comparison measures, thereby demonstrating convergent
reliability of the vocabulary section of this adaptation. validity. A significant positive relationship was also
Method: Validation for productive vocabulary (Study 1) was found between test–retest measures for productive and
achieved by correlating CDI-Down scores on expressive receptive vocabularies, thus supporting the reliability of the
vocabulary and measures on the basis of spontaneous adaptation.
speech samples (n = 29). Validation for receptive vocabulary Conclusion: The results demonstrate that the CDI-Down
(Study 2) was achieved by correlating CDI-Down scores on is a valid and reliable tool that could be useful for parents,
receptive vocabulary and measures derived from language teachers, clinicians, and researchers.

T
he assessment of early communicative and language of time), and children’s performance is affected by factors
development poses substantial methodological such as fatigue or lack of familiarity with the examiner.
challenges. As Mervis and Becerra (2003) pointed Similar problems arise when using standardized measures.
out, language samples obtained through recordings of parent– As a result, most studies incorporating language samples
child interactions consistently underestimate children’s use small numbers of participants, and large-scale studies
language skills for at least two reasons: (a) Young children are very scarce.
talk less when they find themselves in unfamiliar settings One viable alternative is to use parent reports, one of
or around people they do not know well, and (b) it is im- the most popular being the MacArthur-Bates Communi-
possible during a play session to simulate the wide variety cative Development Inventories (CDIs; Fenson et al., 1991,
of situations in which a child produces language. Further- 1993, 2007). CDIs have several strengths when assessing
more, this approach is expensive and time-consuming (i.e., early communicative and language development (Fenson
transcription and analysis of naturalistic language samples et al., 1993): (a) They are cost-effective and time-efficient,
requires highly trained personnel and a substantial amount (b) they take advantage of parents’ extensive knowledge of
their child’s language abilities, and (c) the child’s perfor-
mance is not affected by fatigue and lack of familiarity with
a the examiner. CDIs therefore provide a rapid overall assess-
University of Málaga, Spain
b
Autonomous University of Madrid, Spain ment that can serve both screening and research purposes.
Correspondence to Miguel Galeote: mgaleote@uma.es
There are two forms of CDIs: words and gestures
(CDI:WG) for children ages 8 to 16 months and words and
Editor: Krista Wilkinson
Associate Editor: Deborah Fidler
sentences (CDI:WS) for children ages 16 to 30 months. The
CDI:WG consists of a list of words and a list of gestures
Received January 22, 2015
Revision received June 30, 2015
Accepted December 8, 2015 Disclosure: The authors have declared that no competing interests existed at the time
DOI: 10.1044/2015_AJSLP-15-0007 of publication.

American Journal of Speech-Language Pathology • Vol. 25 • 371–380 • August 2016 • Copyright © 2016 American Speech-Language-Hearing Association 371
and actions. The list of words is divided into several se- DS relative to their receptive and expressive language skills
mantic categories that include nouns, verbs, and grammar (Caselli et al., 1998; Chan & Iacono, 2001; Galeote et al.,
words (e.g., articles, prepositions). The list of gestures and 2011; Singer-Harris, Bellugi, Bates, Jones, & Rossen, 1997).
actions is also grouped into categories (i.e., deictic and rep- In light of the above, it is clearly important to adapt
resentational gestures, routines, pretend actions). The CDI: CDIs to the developmental profile of children with DS.
WS form also consists of a list of words divided into several To date, however, they have not been adapted to the profile
categories in addition to a section on grammar production of language development shown by children with DS, nor
that assesses first word combinations, emerging syntax, and has the original version been validated for these children
use of various morphological forms. with the exception of a single study of the productive vocab-
There is now a substantial body of literature demon- ulary section (Miller, Sedey, & Miolo, 1995). Therefore, the
strating the validity and reliability of CDIs for assessing first objective of the research project of which the present
early language development of children learning English study forms part was to adapt CDIs to the profile of language
(Dale, 1991; Dale, Bates, Reznick, & Morisset, 1989; and communicative development of children with DS.
Fenson et al., 1994), Italian (Camaioni, Caselli, Longobardi, An adaptation of this kind would also need to be vali-
& Volterra, 1991; Modena & Caselli, 1996), Mexican Span- dated for use by parents of children with developmental dis-
ish (Jackson-Maldonado et al., 2003; Jackson-Maldonado, abilities. As highlighted by Miller et al. (1995), the validity
Thal, Marchman, Bates, & Gutiérrez-Clellen, 1993), Euro- of parent report instruments cannot be taken for granted in
pean Spanish (López-Ornat, Gallego, Gallo, Karousou, families of children with developmental disabilities because
& Mariscal, 2005), and Galician (Pérez-Pereira & García- parents of these children may not have the same reporting
Soto, 2003; Pérez-Pereira & Resches, 2011). Because of this styles as parents of children with TD. For example, several
high validity and reliability, CDIs have been incorporated studies have found that parents of disabled children overesti-
into early language assessment batteries along with other mate their child’s performance on cognitive tasks as compared
standardized tests and language samples. with their actual performance on standardized tests (Gradel,
It is important to note that CDIs have been used to Thompson, & Sheehan, 1981; Hunt & Paraskevopoulos,
assess early language development not only in children with 1980). On the other hand, Miller (1988) suggested that parents
typical development (TD) but also in those with particular of children with developmental disabilities are often in-
conditions (e.g., preterm, early and late talkers, language- formed at the child’s birth or shortly after that his or her
impaired children) or certain types of developmental disabil- development may be significantly compromised. This knowl-
ities. However, very few studies have been done on the edge may limit parents’ expectations of their child’s devel-
validity and reliability of this instrument for children with opment and lead them to underestimate his or her abilities.
disorders. This is a relevant point because each develop- In the case of children with DS, the asynchronies within
mental disorder has its own particular characteristics (i.e., different linguistic domains and subdomains, as well as in
different behavioral and language profiles), which a CDI other developmental areas, may make the accurate reporting
may not take into account. As Bruckner, Yoder, Stone, and of language abilities even more challenging for parents. This
Saylor (2007, p. 1636) noted, “Characteristics of clinical further underlines the importance of assessing the validity
populations may differ from those of typical populations in of parent report measures for use with this population.
important ways that affect item functioning and validity.” In previous work, Galeote, Soto, Lamela, et al. (2006)
Therefore, CDIs should not be considered as general tools and Galeote, Soto, Serrano, et al. (2006) developed an adapta-
that can be used to assess children who are not developing tion of the CDI for use with children with DS (hereinafter,
typically or who present developmental disabilities; for these the CDI-Down). The main aims of the present study were to
children, a specific adaptation is needed. examine the concurrent validity and reliability of the vocab-
Children with Down syndrome (DS) represent one such ulary checklist section of the new adaptation. In the next
group. These children present a general delay in language section, we summarize the general structure of the CDI-
development in relation to other developmental areas (e.g., Down, focusing specifically on the vocabulary part and de-
cognition, social), and this delay increases as they get older. scribing the modifications made in order to take into account
They also show specific dissociations among different linguis- the profile of language development shown by children with
tic domains (e.g., comprehension vs. production) or subdo- DS. We also refer to other sections or aspects of relevance
mains (e.g., lexicon vs. morphosyntax; Abbeduto, Warren, for this research (instructions, cultural and linguistic modi-
& Conners, 2007; Berglund, Eriksson, & Johansson, 2001; fications, etc.; for a detailed description of the adaptation,
Caselli et al., 1998; Chapman, 1995; Chapman, Schwartz, see Galeote, Soto, Lamela, et al., 2006; Galeote, Soto,
& Kay-Raining Bird, 1991; Chapman, Seung, Schwartz, & Serrano, et al., 2006).
Kay-Raining Bird, 1998; Fowler, 1990; Galeote, Sebastián,
Checa, Rey, & Soto, 2011; Galeote, Soto, Sebastián, Checa,
Adaptation of the CDI: General Structure
& Sánchez-Palacios, 2014; Miller, 1988, 1999; Roberts,
Price, & Malkin, 2007; Vicari, Caselli, & Tonucci, 2000). and Modifications
However, children with DS often use more complex com- At present, there are two recognized adaptations
municative gestures than do children with TD. In fact, of the CDI in Spanish: one in Mexican Spanish and
gesture production is considered a strength of children with the other in Iberian Spanish. The first was produced by

372 American Journal of Speech-Language Pathology • Vol. 25 • 371–380 • August 2016


Jackson-Maldonado et al. (2003) and the second by López- performance among children with DS, CA may not be an
Ornat et al. (2005). The CDI-Down draws on both these adequate measure for studying language development.
previous versions. Although the two adaptations present a Hence, we take into account the child’s MA, which can be
considerable overlap, the Iberian Spanish version is adapted determined using any test that measures a baby’s develop-
to the linguistic and sociocultural context of Spain (in terms mental age. In the present study, we used the Brunet-Lézine
of vocabulary used and the routines of interactive games Psychomotor Development Scale (hereinafter, the BL Scale;
most commonly played in Spain, etc.). Data from previous Josse, 1997).
work on the development of vocabulary in Spanish-speaking Last, the CDI-Down also assesses symbolic or refer-
children collected by our own research group (Lamela & ential gestures. Here, we added a third column (“understands
Soto, 2003) was also used as well as information provided by and gestures”) after the standard comprehension and pro-
parents of children with DS and clinicians working with duction columns (“understands” and “understands and
these children (see below). Last, the adaptation in Galician says”), the aim being to assess spontaneously produced
by Pérez-Pereira and García-Soto (2003), one of the first gestures representing concrete lexical items (e.g., closing
adaptations of CDIs produced in Spain, was also consulted. the fingers tightly together and bringing them near the
Our adaptation applies the same shared standards mouth to simulate “eat”). Parents are encouraged to dis-
and procedures as the original CDI format and maintains tinguish these gestures from more general deictic or pointing
the major structural categories. As in the original version, the gestures.
CDI-Down consists of the same three parts: (a) vocabulary
(words), (b) actions and gestures, and (c) sentences and gram- General Information
mar. The vocabulary part includes a vocabulary checklist
containing 651 words organized into 21 categories: animals, The section of the CDI compiling general informa-
vehicles, clothing, body parts, action words, and so forth. tion about children and their families was modified and
A major difference of the CDI-Down is that the two extended in order to account for physical, social, and family
original forms of the CDI are combined into a single inven- aspects of children with DS that might influence their lan-
tory that assesses the whole age range (from 8 to 30 months). guage and communicative development. Thus, in the
The rationale for this was that the chronological age (CA) CDI-Down, this section includes information about hearing
of children with DS is often twice that of their mental age and visual impairments, general health information (meta-
(MA). Compared with children with TD, therefore, children bolic diseases, hearing infections, etc.), schooling and early
with DS have a broader experience of the world, which intervention programs, and family information (sociocultural
may create opportunities for more diverse vocabulary expo- level, pregnancy, previous knowledge of DS, birth difficul-
sure and learning (Chapman, 1995; Galeote et al., 2011; ties, etc.) that may affect language development.
Grela, 2002, 2003). Indeed, Chapman et al. (1991) observed
superiority in comprehension in a group of adolescents and Instructions
young adults with DS, and Galeote et al. (2011) found a Special attention was also paid to the general and
similar result in children with DS with a MA of 8–29 months. specific instructions for completing the inventory. First, as
Regarding gestural communication, Franco and Wishart noted earlier, parents of children with developmental dis-
(1995) and Singer-Harris et al. (1997) have demonstrated abilities may have different reporting styles (Miller et al.,
that the greater ability shown by children with DS in using 1995). Second, parents evaluate their children’s language level
communicative gestures results from their longer social according to their knowledge of the behavior to be observed
experience due to their older CA. Although we do not claim (Carrillo, Jackson-Maldonado, Flores, & Thal, 1997; Fenson
that children with DS produce greater numbers of words et al., 2000). Last, levels of education, socioeconomic status,
than do children with TD, one cannot rule out differences and ethnicity may be associated with different CDI scores.
in the content of their vocabulary. Bruckner et al. (2007) As Stiles (1994) pointed out, the design of the CDI places
made a similar argument for toddlers with autism spectrum multiple demands on parents to observe and interpret
disorders, stating that differences in the experiences of chil- various aspects of communication. Feldman et al. (2000)
dren in different groups at different CAs may affect the noted that each of the CDI scales is potentially susceptible
content of the mental lexicon. to effects and biases related to the parents’ educational level.
As a consequence, in the vocabulary checklist, we In developing the CDI-Down, therefore, we sought to
assess both spontaneous production and comprehension of make the instructions clear and to provide examples so as to
words in children with mental ages of 8 to 30 months. We ensure that parents really do understand their task.
assess word comprehension because one of the character-
istics of the developmental profile of children with DS is
the relative preservation of their lexical comprehension Cultural and Linguistic Adaptation of the Inventory
versus lexical production abilities (Abbeduto et al., 2007; Care was also taken to ensure that the CDI-Down
Chapman, 1995; Chapman et al., 1991; Galeote et al., 2011; was well suited to the cultural and linguistic setting in which
Roberts et al., 2007). it would be used. Thus, before deciding upon the final
Another significant modification in the CDI-Down version, we asked several professionals (clinicians working in
has to do with age. Given the wide variability in cognitive early intervention units or associations for children with

Galeote et al.: Validity and Reliability of CDI-Down 373


DS, teachers, caregivers, etc.) and a sample of 20 parents 2012). The children ranged in CA from 26;4 (months;days)
about the content of the inventory. They were provided with to 72;19 (M = 52;12, SD = 13;27) and in MA from 15;15 to
a preliminary version of the CDI-Down and received an ex- 29;12 (M = 24;28, SD = 3;25). MAs were calculated using
planation of its objectives. They were then asked to check if normative data of the BL Scale. All children met the follow-
it reflected the language development of children with DS ing inclusion criteria: (a) cytogenetic documentation of
(daily and frequent words, gestures, behavior, etc.). Both trisomy 21 and (b) absence of neurosensory deficits and
clinicians and parents agreed that the inventory was fit for psychopathological disorders. All children had a monolin-
purpose. They especially endorsed the instructions, and they gual Spanish background.
stated that the behaviors considered in the inventory were Although this sample may seem small for a validity
consistent with those shown by their children in daily life. study, it represents 12.61% of the total sample in the nor-
In the next section, we present the results of three stud- mative study (230 children with DS from 8 to 29 months of
ies performed to attain our main objectives: MA; see Galeote et al., 2012). This proportion is higher
than those used in other studies of CDI validity involving
1. To establish the concurrent validity of the CDI-Down
children with TD.
for productive vocabulary, comparing the results
Vocabulary levels varied widely. Taking as a reference
obtained in the inventory with spontaneous language
the data from our normative study (Galeote et al., 2012),
measures (Study 1).
19 children were between the 25th and 75th percentiles,
2. To establish the concurrent validity of the CDI-Down three were below the 25th percentile, and seven were above
for receptive vocabulary comparing the results ob- the 75th percentile. This reflects the large interindividual
tained with those of an independent test (Study 2). variability typical of people with DS.
3. To study the reliability of the CDI-Down for produc- With respect to the mother’s educational level, eight
tive and receptive vocabulary through a test–retest (27.59%) had primary studies, nine (31.03%) had com-
procedure (Study 3). pleted secondary education, and 12 (41.38%) held a uni-
versity degree. Eleven children (37.93%) were first born,
13 (44.83%) second born, and three (10.34%) later born.
Study 1. Concurrent Validity: Two girls were first-born twins.
Productive Vocabulary Children were recruited from the cities of Malaga and
The purpose of this study was to examine concurrent Madrid, Spain. Families were contacted through early in-
validity for productive vocabulary on the CDI-Down tervention units or associations for children with DS, from
vocabulary checklist. Concurrent validity is demonstrated which the children received their standard treatment. In-
when a measure under evaluation correlates well with formed consent was obtained from the families. The research
another measure that has previously been validated for the followed the ethical guidelines of the Spanish Psychological
assessment of similar abilities. Here, this was achieved by Society. All parents willingly participated in the data col-
correlating parental reports of productive vocabulary from lection and showed interest in the instrument; in fact, they
the CDI-Down with the number of different words pro- often stated that the task of completing the CDI-Down made
duced spontaneously during a 30-min language sampling. them observe their child more carefully and made them
This is the approach most commonly used in validation more aware of his or her real abilities.
studies of CDI productive vocabulary.
Instruments
MA was measured by means of the BL Scale. This
Method scale assesses the development of children 1–30 months of
Participants age in four domains: postural control and motor function;
Twenty-nine children (17 girls, 12 boys) with DS oculomotor coordination or adaptation to objects; language;
and their parents participated in this study (see Table 1). and social and personal relationships.
Twenty-four of these children had taken part in an earlier For the assessment of vocabulary, a copy of the
normative study (Galeote, Soto, Sebastián, Rey, & Checa, CDI-Down was given to each family. Spontaneous speech

Table 1. Means and ranges for chronological age (CA) and mental age (MA) of the children with Down syndrome who participated in each of
the three studies.

CA, mean MA, mean


Study Girls Boys Total (range) (range)

1. Concurrent validity: Productive vocabulary 17 12 29 52;12 (26;4–72;19) 24;28 (15;15–29;12)


2. Concurrent validity: Receptive vocabulary 37 33 70 35;24 (11;12–71;1) 19;2 (8;3–29;12)
3. Reliability 11 15 26 44;7 (11;12–67;23) 22;7 (10;18–29;12)

Note. Age is presented as months;days.

374 American Journal of Speech-Language Pathology • Vol. 25 • 371–380 • August 2016


samples were also obtained using three sets of toys: (a) farm spontaneously by the children was then calculated (imitated
toys with farmers, animals, and vehicles; (b) vegetables and words were excluded; formulas and routines were only
money as a shopping game; and (c) plastic mobile tele- considered if they were produced spontaneously).
phones. In addition, we used a picture book especially de-
signed for the purpose of this research. Both the pictures Results and Discussion
in the book and the other material already mentioned rep-
resented words featured in the vocabulary section of the The mean scores, standard deviations, and ranges
CDI-Down, such as animals, parts of the body, vehicles, for parent report vocabulary (CDI-Down) and observed
and clothes. vocabulary are presented in Table 2. There was important
variability among children in the overall number of words
Procedure produced according to both measures.
An initial interview was held with the parents of each Correlations were calculated between (a) number of
child, in which the research objectives were carefully and words reported in the vocabulary section of the inventory
clearly explained. The instructions for completing the CDI- and (b) the number of different words (types) produced
Down were read aloud, and each section was shown and spontaneously by the children during the naturalistic inter-
explained so as to ensure that parents understood every actions. Because the second variable violated the Shapiro-
item. Parents were asked to begin by simply observing their Wilks test of normality (S-W = .84, df = 29, p = .001),
child during a week, thus giving them time to observe a Spearman’s rho coefficients were calculated in order to
range of the child’s communicative behaviors. At the end of obtain validity estimates. High and significant correlations
the week, they completed the inventory, which was to be between the two measures were obtained (rs = .91; p = .000,
returned within a maximum of 10 days. one-tailed).
Once the inventory was returned, parents attended Our correlations were very similar to those obtained
a new interview during which they discussed any difficul- in previous studies using the same measures for validity:
ties they had, and the inventory was reviewed in order to r = .83 in the study by Bates, Bretherton, and Snyder (1988);
detect any mistakes or misunderstandings. The aim was r = .79 in the report by Beeghly, Jernberg, and Burrows
to make sure that parents had filled them out correctly and (1989); and r = .84 in the study by Jackson-Maldonado
completely. et al. (1993). Pérez-Pereira and Resches (2011) also found
During this period, MAs were obtained and spon- strong and significant correlations between the number
taneous language samples were collected. For the latter, the of words in the CDI and the number of different words ob-
children were filmed as they participated in approximately served in spontaneous language samples at ages 18 and
30 min of free play: 15 min with the parent and 15 min with 24 months (r = .86 and r = .80, respectively). Miller et al.
the examiner (an expert in speech-language pathology). (1995) reported a correlation of .82 for parents of children
Parents were asked to interact with their child as they with DS and .75 for parents of children with TD. Thus, our
would usually do at home. All sessions included toy play data provide strong evidence for the validity of CDI-Down
(especially with the farm), symbolic play (especially with the in relation to the assessment of the productive vocabulary
shopping set and the mobile telephones), and book reading. of children with DS.
All intelligible and nonimitative utterances produced
by the children during the play interactions (30 min) were Study 2. Concurrent Validity:
transcribed orthographically and analyzed manually. Be-
cause the speech of children with DS is often unintelligible, Receptive Vocabulary
we chose a conservative method to transcribe the samples The purpose of this study was to examine the concur-
of spontaneous language. First, the samples were ortho- rent validity for receptive vocabulary on the CDI-Down
graphically transcribed by a trained transcriber. A second vocabulary checklist. This was achieved by correlating pa-
transcriber then transcribed the samples independently, rental reports of receptive vocabulary (number of words
and all disagreements were marked. Second, the two tran- understood by their children) using the CDI-Down with the
scribers reviewed together the items on which there was number of words understood by their children in some lan-
disagreement until they reached a consensus. If the two guage items from the BL Scale. A similar procedure was
transcribers could not reach agreement, a third transcriber followed by Dale et al. (1989), who used the receptive lan-
(the third author) watched the videotapes. If she agreed guage items on the Bayley Scales of Infant Development
with one of the two coders, then the agreed-upon utterance (Bayley, 1969) as a criterion variable.
was retained. If she did not agree with either transcriber, Analyzing the validity of parental reports by compar-
the word was deleted from the data. A total of 14 language ing them with the child’s comprehension on another mea-
samples were analyzed to determine the reliability of the data sure was regarded as important for two reasons. First, this
(words produced) transcribed. For orthographic transcrip- aspect is not usually assessed in CDI validation studies, and
tion of words, the average agreement before reviewing the second, the CDI:WS does not evaluate vocabulary com-
disagreements was 93.09% (range: 79.66%–100.00%). After prehension. The reason for this is that “parents are less
review, the reliability was 98.44% (range: 93.22%–100.00%). likely to be able to keep track of both comprehension and
The number of different words (lexical diversity) produced production as their child’s expressive language begins to

Galeote et al.: Validity and Reliability of CDI-Down 375


Table 2. Parent reports of vocabulary and the observed vocabulary measure (Study 1) and the number of words understood on the language
items of the Brunet-Lézine Psychomotor Development Scale–Revised (Study 2).

Study Measures n Mean SD Range

Study 1: Production CDI 29 275.59 181.92 18–640


Spontaneous speech 29 75.59 55.22 3–278
Study 2: Comprehension CDI 70 291.40 197.62 8–654
Number of items understood 70 4.23 3.32 0–8

Note. CDI = MacArthur-Bates Communicative Development Inventory.

grow rapidly toward the end of the second year of life” reached these developmental levels if they understand at
(Jackson-Maldonado et al., 2003, p. 11). Because the CDI- least one word at 14 months, three at 17 months, four at
Down assesses comprehension up to 30 months of MA, 20 months, and eight words at 20 months.
it was necessary to check that parents’ responses were valid. The objects presented to the children in the BL Scale
are a ball, doll, car, spoon, glasses, button, horse, clock,
Method pencil, and a sheep. All these objects occur frequently in early
childhood, and their names all appear in the CDI-Down. The
Participants objects were placed in front of the child (at the 14-month
The participants were 70 children (37 girls, 33 boys) level, only the first five objects were presented) while simul-
with DS and their parents, 19 of whom had participated in taneously asking him or her, “What is this?” If the child
Study 1. All these children had been included in the nor- had not named all the objects once they had been presented,
mative study. This sample represented 30.43% of the total the examiner then held out a hand, palm upward, and
sample in the normative study (see Galeote et al., 2012). asked the child to give her an object (e.g., “Give me the
The children ranged in CA from 11;12 to 71;1 (M = 35;24, ball”). In this case, it was important not to ask the child for
SD = 16;04) and in MA from 8;03 to 29;12 (M = 19;02, the object that he or she was currently touching or looking at.
SD = 6;14). Mental ages were again measured by means of For the purpose of scoring, the total number of words
the BL Scale. All children met the same inclusion criteria parents reported (using the CDI-Down) as understood by
as in Study 1, and all of them had a monolingual Spanish their child was added. For the BL Scale language items,
background. each child was assigned a score on the basis of the number
There was great variability in the level of vocabulary of object names that he or she had understood. Children
comprehension. Taking as a reference the data from our who failed to respond to any of these language items were
normative study (Galeote et al., 2012), 43 children were given a score of zero.
between the 25th and 75th percentiles, 13 were below the
25th percentile, and 14 were above the 75th percentile. As
in Study 1, this distribution reflects the large interindividual Results and Discussion
variability typical of people with DS. The mean scores, standard deviations, and ranges for
With respect to the mother’s educational level, 20 parent reports of vocabulary and the number of words
(28.57%) had primary studies, 26 (37.14%) had completed understood on the BL Scale are presented in Table 2. There
secondary education, and 24 (34.28%) held a university were considerable differences among children in the overall
degree. Thirty children (42.86%) were first born, 30 (42.86%) number of words understood according to both measures.
second born, and 10 (14.28%) later born. These interindividual variations are typical of children
Children were recruited from a number of Spanish with DS.
cities, mostly in the region of Andalusia. Families were Correlations were calculated between (a) the number
contacted in the same way as in Study 1. Informed consent of words understood according to parent reports using the
was again obtained, and all parents willingly participated in vocabulary section of the CDI-Down and (b) the number
the data collection, showing a similar degree of interest. of words understood when administering the language
items of the BL Scale. Because the two variables violated
Instruments and Procedure assumptions of normality (S-W = .94, df = 70, p = .002
Each family was given a copy of the CDI-Down. The and S-W = .80, df = 70, p = .000), Spearman’s rho coefficients
general procedure followed was the same as in Study 1: were calculated in order to obtain validity estimates. High
Two interviews were held, and the children’s MAs were ob- and significant correlations between the two measures were
tained by means of the BL Scale. As already stated, com- obtained (rs = .79; p = .000, one-tailed).
prehension was assessed using language items from the BL These results are important for two reasons. First,
Scale that serve to test children’s understanding of names of they show the validity of CDI-Down in relation to the
objects. This test is presented at developmental levels corre- assessment of the receptive vocabulary of children with DS.
sponding to 14, 17, 20, and 24 months (numbers of items: Second, they justify one of the most important modifica-
109, 118, 127, and 137). Children are considered to have tions made when developing the CDI-Down, namely the

376 American Journal of Speech-Language Pathology • Vol. 25 • 371–380 • August 2016


decision to assess vocabulary up to 30 months of MA. Of production, 16 children were between the 25th and 75th per-
the 70 children who took part in this study, 55 had an MA centiles, seven were below the 25th percentile, and three were
above 18 months (the CDI:WS begins at 16 months). above the 75th percentile.
These results are similar to those obtained by Dale In terms of the mother’s educational level, four (15.38%)
et al. (1989) when using the receptive language items on the had primary studies, 12 (46.15%) had completed second-
Bayley Scales of Infant Development as a criterion variable. ary education, and 10 (38.46%) held a university degree.
In their study, the total vocabulary score was based on the Eight children (30.77%) were first born, 14 (53.84%) second
Early Language Inventory, a previous version of the CDI, born, and four (15.38%) later born.
and their validity data were derived from samples of full-term Children were recruited from a number of Spanish
(n = 32), social risk full-term (n = 65), preterm (n = 21), cities, mostly in the region of Andalusia. Criteria for inclu-
and precocious (n = 44) children. Correlations between total sion and the general recruitment procedure were the same
vocabulary at age 20 months and the receptive language as in the previous study.
subscore of the Bayley Scales of Infant Development at age
24 months (there was a 4-month interval between the two Instruments and Procedure
measures) were statistically significant for full-term, social The same inventory (CDI-Down) was given to par-
risk, and precocious samples (r = .59, .41, and .50, respec- ents approximately 3 months after the original sampling,
tively). The correlation was not significant for the preterm thus allowing us to examine test–retest reliability. Care was
sample (r = .13). Our results cannot be compared with other taken to remind parents that they should begin by observing
studies because, as already noted, vocabulary comprehension their children during a week.
is not usually examined in CDI validity studies. At all events, This time interval between the two data collection
this is the first time that this aspect has been evaluated in points was chosen for several reasons. First, and as noted
children with DS. earlier, children with DS are identified as such right from
birth, and their parents generally monitor their development
very closely. Second, language development is very slow in
Study 3. Reliability these children. As a consequence, parents often have a very
Reliability refers to the consistency with which the clear memory of their child’s previous language and com-
items on a test or scale produce similar results under consis- municative behaviors, and this could affect the results of re-
tent conditions. In this study, the reliability of the CDI- liability studies. Last, other studies have also used long
Down was evaluated by means of the test–retest procedure intervals. For example, Fenson et al. (1994) and Pérez-
(i.e., the extent to which test scores are consistent across Pereira and García-Soto (2003) used, respectively, intervals
two or more assessment sessions). To this end, we asked a of 6 and 9 months between the first and second assessment
group of parents to fill out the inventory a second time. points.

Method Results and Discussion


Participants The mean scores, standard deviations, and ranges for
Participants in this study were the parents of 26 chil- parent reports of comprehension and productive vocabu-
dren (11 girls, 15 boys), 19 of whom had participated in lary at Times 1 and 2 are presented in Table 3. There were
Study 1, 18 in Study 2, and 17 in both. All these children considerable differences among children in the overall num-
had been included in the normative study (Galeote et al., ber of words produced and understood at Times 1 and 2.
2012), and they represented 11.30% of the total sample in Correlations were calculated between the number of
that study. At Time 1 the children ranged in CA from 11;12 words reported by parents in the first and second samples
to 67;23 (M = 44;07, SD = 17;26) and in MA from 8;15 (using the vocabulary section of the CDI-Down) as being
to 28;24 (M = 21;03, SD = 6;15). At Time 2, the children understood and produced by their children (see Table 3).
ranged in CA from 15;7 to 70;18 (M = 48;4, SD = 17;11) For comprehension, Pearson product–moment correlation
and in MA from 10;18 to 29;12 (M = 22;07, SD = 5;24; coefficients were calculated in order to obtain reliability
four children were not assessed). The mean interval between measures (the variables did not violate assumptions of
the two assessments was 3.26 months (SD = 3.06, range = normality). High and significant correlations were obtained
1.24–5.15). MAs were again measured by means of the between the two measures (r = .90; p = .000, one-tailed).
BL Scale. All the children recruited for this study met the
Table 3. Parent reports of vocabulary (production and
same inclusion criteria as in Studies 1 and 2, and they all comprehension) at Times 1 and 2 (Study 3).
had a monolingual Spanish background.
Levels of receptive and productive vocabulary varied Vocabulary Measures n Mean SD Range
considerably. Taking as a reference the data from our nor-
mative study (Galeote et al., 2012), the results for com- Production Time 1 26 131.08 144.65 0–409
prehension showed that 22 children were between the 25th Time 2 26 195.42 188.73 4–512
Comprehension Time 1 26 339.00 175.88 44–602
and 75th percentiles, two were below the 25th percentile, Time 2 26 401.08 164.76 90–465
and two were above the 75th percentile. With respect to

Galeote et al.: Validity and Reliability of CDI-Down 377


For vocabulary production, Spearman’s rho coeffi- the same reporting styles as parents of children with TD
cients were calculated in order to obtain validity estimates (Gradel et al., 1981; Miller, 1988; Miller et al., 1995).
because both variables violated assumptions of normality Nevertheless, our data indicate that parents of children with
(S-W = .82, df = 26, p = .000 and S-W = .83, df = 26, DS can provide a valid report of their child’s language and
p = .001 for Measures 1 and 2, respectively). High and sig- communicative ability. Several factors could explain our
nificant correlations were obtained between the two measures results. One is that we conducted an initial interview to
(rs = .93; p = .000, one-tailed). make sure that parents clearly understood not only the aims
These data provide evidence of strong reliability for of our research but also each part of the inventory and the
the CDI-Down as a measure of vocabulary comprehension task they were being asked to perform. In other words,
and production. The correlations obtained are also sim- steps were taken to ensure that the inventory was completed
ilar to those reported previously. For example, Jackson- properly. Parents were also requested to observe their chil-
Maldonado et al. (1993) obtained statistically significant dren for a week prior to filling in the CDI-Down (see also
correlations between their two assessment points of .97 for Caselli et al., 1998). Although this procedure is more time-
word comprehension and .81 for word production, on the consuming and demanding for parents, it may help to
basis of administration of the CDI:WG to a sample of reduce the overestimations and underestimations that are
16 children. The same authors also report a significant corre- often associated with parental reports. Another possible
lation of .70 for the CDI:WS in a sample of 20 children. explanation for our results has to do with the particular char-
López-Ornat et al. (2005) obtained even higher correlations acteristics of parents of children with DS. Because these
for the former inventory (.98 and .99 for vocabulary com- children are identified as such at birth, their parents tend to
prehension and production, respectively); for the second monitor their general development, and particularly their
inventory, these authors report a correlation of .99 for pro- language development, from the earliest stages. In fact, the
ductive vocabulary. For their part, Pérez-Pereira and García- interviews held after the CDI-Down had been returned
Soto (2003) obtained a correlation of .62 for productive revealed that parents carefully observed their children’s de-
vocabulary in a sample comprising 41 sets of parents. velopmental progress. A third explanation might be that
language development in children with DS is delayed, and
so parents may find it relatively easy to monitor their prog-
General Discussion ress; however, this possibility needs to be assessed in an
The primary aims of this research were to examine experimental situation.
the validity and reliability of the vocabulary part of the To sum up, our data suggest that the modifications
CDI-Down. Correlations were high and statistically signifi- introduced in the development of the CDI-Down have pro-
cant between CDI-Down scores on expressive vocabulary duced an instrument whose vocabulary part is a reliable
and measures from spontaneous speech samples (Study 1), and valid tool for assessing children with DS. The other
CDI-Down scores on receptive vocabulary and measures parts of the inventory (gestures and morphosyntax) are cur-
made on the basis of language items from the BL Scale rently under validation, and the preliminary results are sim-
(Study 2), and parent reports at Times 1 and 2 for the num- ilar to the ones presented here.
ber of words understood and produced by their children As with other CDIs (Fenson et al., 1993), the CDI-
(Study 3). These results provide strong evidence for the Down constitutes a tool for documenting the full range of
validity and reliability of this adaptation of the CDI and communicative abilities of children with DS on the basis of
support its use as a tool for assessing productive and re- their parents’ knowledge of the child’s language use across
ceptive vocabulary development in Spanish-speaking chil- a wide range of contexts and conversational partners. This
dren with DS. is important, because direct observation is an expensive and
Although our findings in general add to the literature less reliable method for this population, especially in the
on the validity and reliability of CDI, particular mention case of very young children in whom more extensive lan-
should be made of the results for receptive vocabulary. This guage sampling is required to detect their limited language
is because hardly any data have been published on this and communicative repertories. Parental reports therefore
measure (although see Dale et al., 1989), and to the best of represent a complementary alternative that provides a more
our knowledge, this is the first time that this aspect has complete and representative idea of the language and com-
been assessed in children with DS. Our data are also rele- municative abilities of these children.
vant because the CDI-Down examines receptive vocabulary A key modification introduced into the CDI-Down is
from 8 to 30 months (as opposed to the CDI:WG, e.g., the use of MA rather than CA due to the wide variability
which stops at 16 months). The inventory covers this wider in IQ among children with DS. In our view, the use of MA
age range because children with DS often show a dissociation may help researchers to study language development in
between productive and receptive language, and normative these children and to compare the results with those obtained
data regarding both aspects are required. in other populations. From the clinical point of view, the
As we noted in the introduction, several authors have use of MA enables psychologists and educational profes-
suggested that the validity of parent report instruments sionals to assess the development of a particular child and
cannot be taken for granted for families of children with de- compare his or her performance with standardized norms
velopmental disabilities because these parents may not have and thus guide the choice of intervention.

378 American Journal of Speech-Language Pathology • Vol. 25 • 371–380 • August 2016


Last, it should be noted that the CDI-Down has made Caselli, M. C., Vicari, S., Longobardi, E., Lami, L., Pizzoli, C., &
it possible to conduct large-scale studies to analyze develop- Stella, G. (1998). Gestures and words in early development
mental trends and individual variations in the language of children with Down syndrome. Journal of Speech, Language,
and Hearing Research, 41, 1125–1135.
and communicative development of Spanish children with
Chan, J., & Iacono, T. (2001). Gesture and word production in
DS (Galeote, Rey, Checa, & Sebastián, 2010; Galeote children with Down syndrome. Alternative and Augmentative
et al., 2011, 2014, 2012). This is important because, as Communication, 17, 73–87.
Pueschel and Hopmann (1993) pointed out, the results derived Chapman, R. S. (1995). Language development in children and ado-
from good normative studies of the communication and lescents with Down syndrome. In P. Fletcher & B. MacWhinney
language skills associated with DS could provide useful (Eds.), Handbook of child language (pp. 641–663). Oxford,
guidelines for both parents and professionals. As Berglund England: Blackwell.
et al. (2001) indicated, however, there are few studies of this Chapman, R. S., Schwartz, S. E., & Kay-Raining Bird, E. (1991).
kind with children with DS. In this respect, the informa- Language skills of children and adolescents with Down syndrome:
tion derived from the CDI-Down may begin to address this Comprehension. Journal of Speech and Hearing Research, 34,
1106–1120.
need and assist clinicians in developing intervention goals
Chapman, R. S., Seung, H.-K., Schwartz, S. E., & Kay-Raining Bird,
and monitoring the progress of these children over time. E. (1998). Language skills of children and adolescents with
Down syndrome: II. Production deficits. Journal of Speech,
Language, and Hearing Research, 41, 861–873.
Acknowledgments Dale, P. (1991). The validity of a parent report measure of vocab-
ulary and syntax at 24 months. Journal of Speech and Hearing
This research was supported by Grant PSI2008-02748 from
Research, 34, 565–571.
the Spanish Ministry for Science and Innovation (Ministerio de
Dale, P., Bates, E., Reznick, J. S., & Morisset, C. (1989). The
Ciencia e Innovación) and by the European Regional Development
validity of a parent report instrument of child language at
Fund (Fondo Europeo de Desarrollo Regional, FEDER). The
20 months. Journal of Child Language, 16, 239–250.
grant was awarded to Miguel Galeote. We would like to express our
Feldman, H. M., Dollaghan, C. A., Campbell, T. F., Kurs-Lasky, M.,
thanks to the children and their families and to the many therapists
Janosky, J. E., & Paradise, J. L. (2000). Measurement prop-
of the Down syndrome associations and early intervention units.
erties of the MacArthur communicative development inven-
We are also grateful to those members of the research team who
tories at ages one and two years. Child Development, 71,
helped to collect, transcribe, and analyze the data.
310–322.
Fenson, L., Bates, E., Dale, P., Goodman, J., Reznick, S., & Thal,
D. (2000). Measuring variability in early child language: Don’t
References shoot the messenger. Child Development, 71, 323–328.
Abbeduto, L., Warren, S. F., & Conners, F. A. (2007). Language Fenson, L., Dale, P. S., Reznick, J. S., Bates, E., Thal, D., &
development in Down syndrome: From the prelinguistic Pethick, S. (1994). Variability in early communicative devel-
period to the acquisition of literacy. Mental Retardation and opment. Monographs of the Society for Research in Child
Developmental Disabilities, 13, 247–261. Development, 59(5), 1–185.
Bates, E., Bretherton, I., & Snyder, L. (1988). From first words Fenson, L., Dale, P. S., Reznick, J. S., Thal, D., Bates, E., Hartung,
to grammar: Individual differences and dissociable mechanisms. J., . . . Reilly, J. (1991). The Technical Manual for the MacArthur
New York, NY: Academic Press. Communicative Development Inventories. San Diego, CA:
Bayley, N. (1969). Bayley Scales of Infant Development. New York, San Diego State University.
NY: The Psychological Corporation. Fenson, L., Dale, P. S., Reznick, J. S., Thal, D., Bates, E., Hartung,
Beeghly, M., Jernberg, E., & Burrows, E. (1989, April). Validity J., . . . Reilly, J. (1993). The MacArthur Communicative Develop-
of the Early Language Inventory (ELI) for use with 25-month- ment Inventories: User’s guide and technical manual. San Diego,
olds. Paper presented at the annual meeting of the Society CA: Singular.
for Research in Child Development, Kansas City, MO. Fenson, L., Marchman, V. A., Thal, D., Dale, P. S., Reznick, J. S.,
Berglund, E., Eriksson, M., & Johansson, I. (2001). Parental re- & Bates, E. (2007). The MacArthur Communicative Develop-
ports of spoken language skills in children with Down syn- ment Inventories: User’s guide and technical manual (2nd ed.).
drome. Journal of Speech, Language, and Hearing Research, Baltimore, MD: Brookes.
44, 179–191. Fowler, A. E. (1990). Language abilities in children with Down
Bruckner, C., Yoder, P., Stone, W., & Saylor, M. (2007). Con- syndrome: Evidence for specific syntactic delay. In D. Cichetti
struct validity of the MCDI-I receptive vocabulary scale can & M. Beeghly (Eds.), Children with Down syndrome: A de-
be improved: Differential item functioning between toddlers velopmental perspective (pp. 302–328). Cambridge, England:
with autism spectrum disorders and typically developing in- Cambridge University Press.
fants. Journal of Speech, Language, and Hearing Research, 50, Franco, F., & Wishart, J. G. (1995). The use of pointing and other
1631–1638. gestures by young children with Down syndrome. American
Camaioni, L., Caselli, M. C., Longobardi, E., & Volterra, V. (1991). Journal on Mental Retardation, 100, 160–182.
A parent report instrument for early language assessment. First Galeote, M., Rey, R., Checa, E., & Sebastián, E. (2010). El desarrollo
Language, 11, 345–359. de la morfosintaxis en niños con síndrome de Down: Primeros
Carrillo, G., Jackson-Maldonado, D., Flores, M., & Thal, D. datos normativos [The development of morphosyntax in
(1997, June). Language in lower income Spanish-speaking children with Down syndrome: First normative data]. Revista
toddlers: Can standard assessment measures be used? Poster Síndrome de Down, 27, 138–148.
presented at the Symposium on Research in Child Language Galeote, M., Sebastián, E., Checa, E., Rey, R., & Soto, P. (2011).
Disorders, Madison, WI. The development of vocabulary in Spanish children with Down

Galeote et al.: Validity and Reliability of CDI-Down 379


syndrome: Comprehension, production and gestures. Journal López-Ornat, S., Gallego, C., Gallo, P., Karousou, A., & Mariscal, S.
of Intellectual & Developmental Disability, 36, 184–196. (2005). Inventarios de Desarrollo Comunicativo MacArthur:
Galeote, M., Soto, P., Lamela, E., Checa, E., Pulido, L., & Rey, R. Manual técnico [The MacArthur Communicative Development
(2006). Adaptación de los Inventarios de Desarrollo Comuni- Inventories: Technical manual]. Madrid, Spain: Ediciones TEA.
cativo MacArthur-Bates para el estudio del desarrollo del Mervis, C. B., & Becerra, A. M. (2003). Lexical development and
lenguaje en niños con síndrome de Down [Adaptation of the intervention. In J. A. Rondal & S. Buckley (Eds.), Speech and
MacArthur-Bates Communicative Development Inventories language intervention in Down syndrome (pp. 63–85). London,
for the study of language development of children with Down England: Whurr.
syndrome]. Revista de Atención Temprana, 9, 4–16. Miller, J. F. (1988). The developmental asynchrony of language
Galeote, M., Soto, P., Sebastián, E., Checa, E., & Sánchez-Palacios, development in children with Down syndrome. In L. Nadel
C. (2014). Early grammatical development in Spanish children (Ed.), The psychobiology of Down syndrome (pp. 167–198).
with Down syndrome. Journal of Child Language, 41, 111–131. Cambridge, MA: MIT Press.
doi:10.1017/S0305000912000591 Miller, J. F. (1999). Profiles on language development in children
Galeote, M., Soto, P., Sebastián, E., Rey, R., & Checa, E. (2012). with Down syndrome. In J. F. Miller, M. Leddy, & L. A.
La adquisición del vocabulario en niños con síndrome de Leavitt (Eds.), Improving communication of people with Down
Down: Datos normativos y tendencias de desarrollo [Vocabulary syndrome (pp. 11–39). Baltimore, MD: Brookes.
acquisition in children with Down syndrome: Normative data Miller, J. F., Sedey, A., & Miolo, G. (1995). Validity of parent
and developmental trends]. Infancia y Aprendizaje, 35, 111–122. report measures of vocabulary development for children with
Galeote, M., Soto, P., Serrano, A., Pulido, L., Rey, R., & Martínez- Down syndrome. Journal of Speech and Hearing Research, 38,
Roa, P. (2006). Un nuevo instrumento para evaluar el desarrollo 1037–1044.
comunicativo y lingüístico de niños con síndrome de Down Modena, I., & Caselli, M. C. (1996). Valutare la comprensione
[A new instrument for the assessment of communicative and del linguaggio nel secondo anno di vita: Sperimentazione di un
linguistic development in children with Down syndrome]. test e utilizzazione di un questionario. Rassegna di Psicologia,
Revista Síndrome de Down, 23, 20–26. 3, 71–90.
Gradel, K., Thompson, M. S., & Sheehan, R. (1981). Parental and Pérez-Pereira, M., & García-Soto, P. (2003). El diagnóstico
professional agreement in early childhood assessment. Topics del desarrollo comunicativo en la primera infancia: Adapta-
in Early Childhood Special Education, 1, 31–39. ción de las escalas MacArthur al gallego [Diagnosis of com-
Grela, B. G. (2002). Lexical verb diversity in children with Down municative development in infant: Adaptation of MacArthur
syndrome. Clinical Linguistics & Phonetics, 16, 251–263. Scales to Galician]. Psicothema, 15, 352–361.
Grela, B. G. (2003). Do children with Down syndrome have dif- Pérez-Pereira, M., & Resches, M. (2011). Concurrent and predic-
ficulty with argument structure? Journal of Communication tive validity of the Galician CDI. Journal of Child Language,
Disorders, 36, 263–279. 38, 121–140.
Hunt, J., & Paraskevopoulos, J. (1980). Children’s psychological Pueschel, S. M., & Hopmann, M. R. (1993). Speech and language
development as a function of the inaccuracy of their mothers’ abilities of children with Down syndrome. In A. Kaiser
knowledge of their abilities. The Journal of Genetic Psychology, & D. Gray (Eds.), Enhancing children’s communication
136, 285–298. (pp. 335–362). Baltimore, MD: Brookes.
Jackson-Maldonado, D., Thal, D., Fenson, L., Marchman, V. A., Roberts, J. E., Price, J., & Malkin, C. (2007). Language and com-
Newton, T., & Conboy, B. (2003). MacArthur Inventarios munication development in Down syndrome. Mental Retar-
del desarrollo de habilidades comunicativas: User’s guide and dation and Developmental Disabilities Research Reviews, 13,
technical manual. Baltimore, MD: Brookes. 26–35.
Jackson-Maldonado, D., Thal, D., Marchman, V., Bates, E., & Singer-Harris, N. G., Bellugi, U., Bates, E., Jones, W., & Rossen, M.
Gutiérrez-Clellen, V. (1993). Early lexical development in (1997). Contrasting profiles of language in children with
Spanish-speaking infants and toddlers. Journal of Child Language, Williams and Down syndromes. Developmental Neuropsychology,
20, 523–549. 13, 345–370.
Josse, D. (1997). Escala de desarrollo psicomotor de la primera in- Stiles, J. (1994). On the nature of informant judgments in in-
fancia Brunet-Lézine-Revisado (Spanish edition) [Brunet-Lézine- ventory measures: … and so what is it you want to know?
Revised Psychomotor Development Scale]. Madrid, Spain: Monographs of the Society for Research in Child Development,
Psymtéc. 59, 180–185.
Lamela, E., & Soto, P. (2003, July) Vocabulary spurt in Spanish Vicari, S., Caselli, M. C., & Tonucci, F. (2000). Asynchrony of
speaking children. Poster presented at the Child Language lexical and morphosyntactic development in children with
Seminar. Newcastle upon Tyne, UK. Down syndrome. Neuropsychologia, 38, 634–644.

380 American Journal of Speech-Language Pathology • Vol. 25 • 371–380 • August 2016


Copyright of American Journal of Speech-Language Pathology is the property of American
Speech-Language-Hearing Association and its content may not be copied or emailed to
multiple sites or posted to a listserv without the copyright holder's express written permission.
However, users may print, download, or email articles for individual use.

You might also like