Professional Documents
Culture Documents
Method
Design
A within-participants design was used in
which two groups of typically-developing
children, rated by their teachers as being of
average reading ability, were each given two
interventions (traditional printed ORT Big
Book and ORT for Clicker). Each intervention was implemented over a five-day week,
for one hour every day. To control for order
and practice effects, an AB-BA counterbalanced design was used across the two groups
of children that were drawn from two different classes within the same school. The study
was conducted over five weeks in which
children were assessed on key measures of
literacy skill in the week before and after
each week of intervention. Table 1 summarises the study design: during intervention I Group A received the ORT for Clicker
intervention whilst Group B was given the
Big Book intervention; during intervention
II Group A received the Big Book intervention whilst Group B was given the ORT for
Clicker intervention.
Participants
Twenty-seven children, ranging in age
between 66 and 77 months (M 71.56
months; SD 2.86), were selected from two
different classes within the same school.
All of the children were at the educational
level Year-1, key-stage 1. Participants were
Week 1
Week 2
Week 3
Week 4
Week 5
101
Results
Group data were tested for homogeneity of
variance. Significant skewness was revealed
in the scores for the literacy tests indicating
substantial departures from normality and
thus non-parametric analyses were used.
Mann-Whitney tests were used to investigate
between-group differences at the first assessment period (i.e. baseline) to see if the two
groups differed in performance on each
measure of literacy development prior to the
interventions. Within-subjects analyses were
then conducted across the three assessment
periods for each group, for each of the
measures of literacy skill, using Friedman
tests. When significant in order to establish
where significant changes in performance
occurred, pairwise comparisons were conducted using Wilcoxon Signed Rank tests.
Results of these analyses are summarised in
Table 2 where all tests are reported at a twotailed level of probability. Effect sizes were
also calculated for each group following the
Clicker and Big Book interventions, using
Cohens d (Cohen, 1988), so as to assess the
magnitude of the intervention effects. These
are reported in Tables 3 and 4 along with
mean performance for each group.
Written word recognition
For the lexical decision task correct identification of words and nonwords (total correct
out of 90) for each child was calculated then
mean performance for each group was
determined (see Table 3). To investigate if
the two groups differed in pre-intervention
ability a Mann-Whitney U test was conducted
on mean performance at Time 1 (baseline).
Descriptive statistics showed that Group A
children (median 60) performed better at
baseline than Group B children (median
54). However, this difference was not significant (U 57, z 1.14, p .253). For each
group a Friedman Test was conducted to
explore differences in performance across
the three assessment periods during which
105
Time 1 vs 2 vs 3
Time 1 vs 2
Friedman test
LDT
Group A
Group B
SWORT
Group A
Group B
Rhyme
Group A
Group B
Segmentation
Group A
Group B
Graphemes
Group A
Group B
6.9
p .05
2 5.09
ns*
2 15.45
p .001
2 19.24
p .001
2 13.03
p .001
2 6.74
p .05
2 1.19
ns
2 .61
ns
2 6.19
p .05
2 4.33
ns
2
Time 2 vs 3
Time 3 vs 1
z 1.72
z 2.4
p .05
ns
p .05
z .51
z 1.74
z 1.96
ns
ns
p .05
z 1.38
z 2.94
z 2.88
ns
p .01
p .01
z 1.49
z 3.06
z 3.06
ns
p .05
p .05
z 2.39
z 1.1
z 2.81
p .05
ns
p .05
z 1.9
z 1.51
z 2.26
ns*
ns
p .05
z .14
z .92
z .45
ns
ns
ns
z .55
z .47
z .1
ns
ns
ns
z 1.54
z 2.39
z 2.33
ns
p .05
p .05
z 1.94
z .69
z 2.54
ns*
ns
p .05
Table 2: Summary of within-subject analyses conducted to assess the effects of each intervention
across the three assessment periods. Significant results are given at two-tailed level of probability;
*Refers to results that are significant at one-tailed level of probability
Task
LDT
Group A
Max. 90
Group B
SWORT
Group A
Max. 45
Group B
Time 1
Time 2
Time 3
Clicker
Big Book
Mean (sd)
Mean (sd)
Mean (sd)
Effect size
Effect size
.51
.18
.37
.12
.11
.32
.21
.45
59.30 (12.2)
65.70 (13.1)
68 (12.9)
(66%)
(73%)
(76%)
56.33 (8.9)
57.42 (9.3)
60.92 (9.8)
(51%)
(64%)
(68%)
25.20 (12.4)
26.70 (13.8)
31 (13.1)
(56%)
(59%)
(69%)
19.33 (13.2)
22.08 (13.4)
28 (13.2)
(43%)
(49%)
(62%)
Table 3: Mean raw scores correct (standard deviations) and effect size for each group, for the lexical
decision task (LDT) and single word oral reading test (SWORT). Mean percentage correct given in
parenthesis below
106
Time 1
Time 2
Time 3
Clicker
Big Book
Mean (sd)
Mean (sd)
Mean (sd)
Effect size
Effect size
15.58 (4.6)
17.83 (3.1)
18.42 (3.2)
.58
.19
78%
89%
92%
17.33 (3.7)
18.25 (2.6)
18.75 (2.6)
.19
.24
87%
91%
94%
Segmentation Group A
19.50 (3.9)
19.17 (4.1)
20.25 (4.5)
.08
.25
Max. 30
65%
64%
68%
.04
.02
.14
.25
.09
.28
Rhyme
Group A
Max. 20
Group B
Group B
Graphemes
18.92 (4.1)
19.08 (4.2)
19.17 (4.2)
63%
64%
64%
Group A
35 (8.11)
36.08 (7.6)
38 (7.8)
60%
62%
66%
Group B
34 (10.3)
36.92 (10.7)
37.92 (10.5)
59%
F64%
65%
Max. 58
Table 4: Mean raw scores correct (standard deviations) and effect size for each group, for the subtests
rhyme, segmentation and graphemes from the PAT. Mean percentage correct given in parenthesis below
the two interventions were given. Results
(given in Table 2) revealed a significant difference only for Group A. Paired comparisons using Wilcoxon Signed Ranks Test
showed significant gains only during the
Clicker intervention. In contrast, for Group
B the Friedman Test was not significant,
however, it is clear from table 3 that Group
B children showed greater improvements
following the Clicker intervention (mean
gain 3.5 words) than after the Big Book
intervention (mean gain 1.1 words) consistent with the pattern of results shown by
Group A. Table 3 reports effect sizes for
each group following each intervention.
Medium effect sizes were found for
the Clicker intervention whereas small
effect sizes were found for the Big Book
intervention. At the end of the study both
groups showed significant gains in performance after each group had received both
interventions.
determined (see Table 2). Descriptive statistics showed that Group A children
(median 31) performed better at baseline
than Group B children (median 22),
however, this difference just failed to reach
significance (U 47, z 1.93, p .053).
Within-subject comparisons (see Table 2)
revealed a significant difference across
assessment periods for Group A and paired
comparisons showed significant gains only
after the Big Book intervention (see Tables 2
and 3). A significant difference in performance across the three assessment periods was
also found for Group B and paired comparisons showed a significant improvement
during the Clicker intervention. Table 3
shows that small effect sizes were found for
the Clicker intervention whereas small to
medium effect sizes were found for the Big
Book intervention. Furthermore, by the end
of the study both groups showed significant
gains in performance.
Phonological awareness
For the rhyming subtest of the PAT, correct
discrimination and production of rhyming
words (total correct out of 20) for each child
was calculated, then mean performance for
107
intervention than after the Clicker intervention, consistent with the pattern of results
shown by Group A. Small effect sizes were
found for both interventions. As with the
other measures significant gains in performance were found at the end of the study.
Summary of results
Significant gains in performance were found
across the study, from baseline (time 1) to
the final assessment (time 3), for each measure of literacy skill investigated, except for
segmentation ability (as measured using a
subtest of the PAT). Thus, after receiving
both interventions childrens written word
recognition, written word naming and
phonological awareness skills had significantly improved. These gains could arise
from childrens reading development that
typically occurs over time under literacy
instruction with the Oxford Reading Tree
scheme or could imply familiarity with the
test items used that benefited from practice
effects because of repeated administration.
Importantly, significant gains were found for
each type of intervention on certain measures that cannot be attributed to practice
effects because of the counterbalanced
design. Specifically, the ORT for Clicker
intervention led to significant gains in written word recognition and rhyme awareness,
whereas the Big Book intervention produced
significant gains in graphemic awareness.
Discussion
This intervention study explored whether the
multimedia features of ORT for Clicker facilitated childrens literacy acquisition to a
greater extent than the regular printed books
used in the Oxford Reading Tree scheme. As
the stories used across the two interventions
were counterbalanced and the accompanying activities were highly similar this enabled
us to test directly the key multimedia features
(i.e. the auditory and highlighting cues)
incorporated in the e-book version of the
scheme, that are not present in the regular
printed texts. Thus, any differences in performance gains after each intervention could
Educational & Child Psychology Vol 25 No 3
110
Acknowledgements
We would like to thank Ann Crick of Crick
Software for her ideas and suggestions.
We also thank the staff and students of
St. Teresas Catholic Primary School for participating in the study and Maria Ktori and
Sue Kempston for their help with data collection. This research was supported by
an ESRC Case PhD studentship awarded to
Dr. Nicola Pitchford and Professor Claire
OMalley (grant number PTA-033-200400064).
References
Adams, M.J. (1990). Beginning to read: Thinking &
learning about print. Cambridge, MA: MIT Press.
Andrews, S. (2006). From inkmarks to ideas: Current issues
in lexical processing. Hove: Psychology Press.
Brown, M. (1994). Arthurs teacher trouble. Novato, CA:
Random House Broderbund.
Cannon, J. (1996). Stellaluna. Novato, CA: Random
House Broderbund.
Castles, A. & Coltheart, M. (2004). Is there a causal
link from phonological awareness to success in
learning to read? Cognition, 91, 77111.
Castles, A. & Nation, K. (2006). How does orthographic
learning happen? In S. Andrews (Ed.) From
inkmarks to ideas: Challenges and controversies about
word recognition and reading. Psychology Press.
Chera, P. & Wood, W. (2003). Animated multimedia
talking books can promote phonological awareness in children beginning to read. Learning and
Instruction, 13, 3352.
Crick Software (2006). Oxford Reading Tree for Clicker.
Northampton: Crick Software Ltd.
Cohen, J. (1988). Statistical power analysis for the behavioural sciences (2nd edn.). Hillsdale, NJ:
Lawrencce Erlbaum.
De Jong, M.T. & Bus A.G. (2003). How well suited are
electronic books to supporting literacy? Journal of
Early Childhood Literacy, 3, 147164.
Ehri, L.C. (1989). The development of spelling
knowledge and its role in reading acquisition and
reading disability. Journal of Learning Disabilities,
22, 356365.
Hunt, R. & Brychta, A. (2003). Kipper the clown.
Oxford University Press.
Hunt, R. & Brychta, A. (2003). Strawberry jam. Oxford
University Press.
Hunt, R. & Page, T. (2003). Teachers handbook; Stages
19. Oxford University Press.
Korat, O. & Shamir, A. (2004). Do Hebrew electronic
books differ from Dutch electronic books? A
replication of a Dutch content analysis. Journal of
Computer Assisted Learning, 20, 257268.
Korat, O. & Shamir, A. (2007). Electronic books versus adult readers: effects on childrens emergent
literacy as a function of social class. Journal of
Computer Assisted Learning, 23, 248259.
Labbo, L.D. & Kuhn, M.R. (2000). Weaving chains of
affect and cognition: A young childs understanding of CD-ROM talking books. Journal of Literacy
Research, 32, 187210.
Littleton, K., Wood, C. & Chera, P. (2006). Interactions with talking books: phonological awareness
affects boys use of talking books. Journal of
Computer Assisted Learning, 22, 382390.
Mann, V.A. & Wimmer, H. (2002). Phoneme awareness and pathways to literacy: A comparison of
111
112
Monday
Before Reading:
Look at the cover. Ask the
children to predict what they
think the book is about.
Read the title and talk
about whether the book is
going to give facts about
strawberry jam or tell a story.
During Reading:
Begin to read Strawberry
Jam. Ask the children to read
the story with you. Praise and
encourage them while they
read, and prompt as necessary.
Point out capital letters, full
stops, and speech marks
(wave, point to nose, etc.).
Stop reading on page 9
when the car is locked.
What happens next?
Shared work
Teacher Class
Word/sentence work
Focus group
Write the word had on the
Ask the children to think of
board. Ask the children to
words that begin with the
think of other words ending
same sound ha- but with
in the sounds -ad, e.g. Dad,
different final sounds, e.g.,
bad, sad.
hat, ham, has.
Which of these 3 options
Write the words in two lists.
rhyme with Dad?
The words that begin with
sad sat sack
the same sound ha- and
bat bad bag
the words that end with the
glad glum grab
same sound -ad (already on
mat map mad
the board).
Write sentences about Dad
using the rhyming words to
describe them.
Before Reading:
What happened in the story
yesterday?
Encourage the children
to tell the story through
what is happening in the
pictures.
During Reading:
Continue reading book.
Ask the children to read the
story with you.
Praise and encourage them
while they read, and prompt
as necessary.
Point out capital letters, full
stops, and speech marks
(wave, point to nose, etc.).
Reading:
Encourage the children to
tell the story through what
is happening in the pictures.
Ask the children to read the
story with you.
Tuesday
Wednesday
(Continued)
113
114
Friday
Thursday
Tuesday
Monday
Before Reading:
What happened in the story
yesterday?
Encourage the children
to tell the story through
Shared work
Before Reading:
Look at the cover. Ask the
children to predict what they
think the book is about.
Read the title and talk about
whether the book is going to
give facts about strawberry
jam or tell a story.
During Reading:
Begin to read Strawberry
Jam. Ask the children to read
the story with you. Praise and
encourage them while they
read, and prompt as necessary.
Point out capital letters, full
stops, and speech marks
(wave, point to nose, etc.).
Stop reading on page 9
when the car is locked.
What happens next?
Write on the board the
following words: bat,
bag, bad, map, mad, mat,
sad, sat, sack, grab, glad,
glum.
Teacher
Word/sentence work
Write the word had on the
board. Ask the children to
think of other words ending
in the sounds -ad, e.g. Dad,
bad, sad.
Which of these 3 options
rhyme with Dad?
sad sat sack
bat bad bag
glad glum grab
mat map mad
Show and explain the
children the activity
WORDS on the ICT board
(Grid activity 1 & 2)
Class
Focus group
Start the activity WORDS
on the computer. (Words 1
& 2)
Encourages children to
identify rhyming words and
relate them to spelling
patterns (focus on words
containing the rime ad).
Match words to the pictures,
click on empty cell to open a
pop-up grid and choose the
word that rhymes with Dad.
Write sentences about Dad
using the rhyming words to
describe them.
(Continued)
Plenary
Look at the word Dad again
(page 1) and ask the
children to remember the
words that rhyme with it
(like in the word/sentence
work). They can make up a
word if they want to but it
has to rhyme.
Look at the word put (page
7) and think of words that
rhyme with it.
115
116
Thursday
Wednesday
Reading:
Encourage the children to
tell the story through what
is happening in the pictures.
Ask the children to read the
story with you.
Friday
He strawberries picked
some.
They picked strawberries all.
Chip the strawberries to
the car took.
The children had an cream
ice
It was time to home go.
Show and explain to the
children the activity
SENTENCE LEVEL on the ICT
board.
Talk about what happened
at the beginning, in the
middle and at the end of the
story.
Show and explain the
children the activity
COMPREHENSION on the
ICT board.
117
Year-1 words
Year-2 words
Words
Nonwords
Words
Nonwords
Words
Nonwords
Words
Nonwords
and
ind
about
abond
bed
det
yellow
yelter
they
thim
an
en
his
hin
eight
teigh
big
cag
had
dal
more
moso
where
whust
see
teeg
help
welk
then
wesb
wednesday
wednesdau
said
faip
these
thamp
118
home
wame
were
lere
make
mage
once
kon
over
ovel
night
yatoe
put
pid
some
shom
ran
rop
came
hame
time
bime
down
drot
too
noo
took
hoos
want
nand
wanted
wented
your
yurt
after
dawoe
be
ob
did
tul
good
harc
laugh
healt
made
yade
man
mun
pull
grel
pulled
heapel
what
whut