Professional Documents
Culture Documents
Cognition
journal homepage: www.elsevier.com/locate/COGNIT
a r t i c l e i n f o a b s t r a c t
Article history: The metaphoric mapping theory suggests that abstract concepts, like time, are represented
Received 14 October 2008 in terms of concrete dimensions such as space. This theory receives support from several
Revised 18 July 2010 lines of research ranging from psychophysics to linguistics and cultural studies; especially
Accepted 7 August 2010
strong support comes from recent response time studies. These studies have reported con-
gruency effects between the dimensions of time and space indicating that time evokes spa-
tial representations that may facilitate or impede responses to words with a temporal
Keywords:
connotation. The present paper reports the results of three linguistic experiments that
Temporal cognition
Mental timeline
examined this congruency effect when participants processed past- and future-related sen-
Metaphoric mapping theory tences. Response time was shorter when past-related sentences required a left-hand
response and future-related sentences a right-hand response than when this mapping of
time onto response hand was reversed (Experiment 1). This result suggests that partici-
pants can form timespace associations during the processing of sentences and thus this
result is consistent with the view that time is mentally represented from left to right.
The activation of these timespace associations, however, appears to be non-automatic
as shown by the results of Experiments 2 and 3 when participants were asked to perform
a non-temporal meaning discrimination task.
2010 Elsevier B.V. All rights reserved.
0010-0277/$ - see front matter 2010 Elsevier B.V. All rights reserved.
doi:10.1016/j.cognition.2010.08.001
R. Ulrich, C. Maienborn / Cognition 117 (2010) 126138 127
time is structured and conceptualized through a meta- ent linkage between temporal and spatial concepts that
phoric mapping from the domain of space. The results of follows from the metaphoric mapping account.
several studies examining various phenomena support In the studies by Torralbo et al. (2006) and Santiago
the notion that peoples representation of time is grounded et al. (2007) on the mental timeline, single words were
on spatial experiences that are more concrete and richer presented on a computer screen. These words referred
than temporal experiences. One source of evidence for this either to the future or to the past (but see our criticism
assumption is provided by natural language. In most, if not on the stimulus material below). More specically, the
all, languages across the world, the vocabulary of time has experimental items taken from Spanish consisted of
spatial roots, i.e., temporal expressions are derived from temporal adverbs (e.g., ayer yesterday or maana tomor-
the inventory of spatial expressions (e.g., Clark, 1973; Has- row), temporal prepositions (e.g., antes before or despus
pelmath, 1997; Lakoff & Johnson, 1980; Nez & Sweetser, after), temporal nouns (e.g., pasado past or futuro fu-
2006). For example, in the sentence Bill was running ture), or tensed verbs (e.g., pregunt (he) asked or preg-
ahead of Paul the preposition ahead expresses a spatial untar (he) will ask). In one of Torralbo et al.s
relationship between Bill and Paul; whereas in Bill arrived experiments and in Santiago et al.s study, subjects were
ahead of Paul ahead expresses an analogous temporal asked to respond to each word with one hand if it was re-
relation between the two arrivals of Bill and Paul. That is, lated to the past, and with the other hand if it was related
we conceive the two events as being spatially located on to the future. Responses were faster when subjects had to
a one-dimensional timeline. Furthermore, in a series of respond with the left hand to past-related words and with
experiments Boroditsky and colleagues have shown that the right hand to future-related words compared to a con-
spatial experience inuences the processing of temporal dition in which the stimulusresponse (SR) mapping was
information (Boroditsky, 2000, 2001; Boroditsky & Ram- reversed.
scar, 2002; Gentner, Imai, & Boroditsky, 2002). This kind Weger and Pratt (2008) obtained an analogous effect
of cross-modal priming supports the idea that thinking when subjects had to decide whether an actor became
and speaking about time is anchored in space. popular before or after they were born (e.g., Charlie Chaplin
The idea that spatial representations are involved when vs. Tom Cruise). Although the names did not convey explicit
we consider time also receives support from psychophysi- temporal information, manual responses were again short-
cal studies, which investigated this relationship at a more er when the stimulusresponse mapping was compatible
basic level. For example, spatial attention inuences the with a left-to-right representation of time.
perceived duration of stimuli that appear briey in the vi- An analogous compatibility effect was demonstrated for
sual eld (Mattes & Ulrich, 1998). Furthermore, when a vi- non-linguistic stimuli that were explicitly related to time.
sual object is briey presented on a computer screen, In the study of Vallesi et al. (2008), the task-relevant infor-
subjects perceive the duration of the presentation as longer mation was the duration of a cross that was presented for
when the presented object is large than when it is small either one or three seconds on a screen. As soon as the
(e.g., Mo & Michalski, 1972; Ono & Kawahara, 2007; Xuan, cross disappeared, subjects manually classied the dura-
Zhang, He, & Chen, 2007). In addition, this effect appears to tion of the cross as short or long. Responses were faster,
be asymmetrical as one would expect when mental repre- when subjects had to respond to the short stimulus with
sentations of time are grounded on spatial representations. the left hand and to the long stimulus with the right hand
Specically, whereas spatial size inuences perceived than when this SR assignment was reversed. This study
duration, perceived size is not affected by temporal dura- thus associates short durations with left and long dura-
tion (Casasanto & Boroditsky, 2008). tions with right and this corroborates the notion of a men-
Thus, according to the metaphoric mapping assump- tal timeline that runs from left to right. More precisely, a
tion our thinking and speaking of time is based on a short duration presumably extends mentally only across
one-dimensional timeline. Does this timeline have an the initial (left) part of the timeline, whereas a long dura-
orientation in space? Several studies suggest that it is tion extends from the initial part to the right side.
oriented from left to right at least in cultures with a According to Vallesi et al. (2008) the leftright congru-
left-to-right writing system. Whether such a left-to-right ency effect of SR mapping observed in these response
orientation of the mental timeline is universal or rather time studies (Santiago et al., 2007; Torralbo et al., 2006;
dependent on the direction of a cultures predominant Vallesi et al., 2008; Weger & Pratt, 2008) suggests that a
writing system has not yet been rmly established (see stimulus generates a spatial response code that facilitates
the discussion in Chatterjee (2001)). In one of the rst the overt motor response if the spatial direction of this
studies on the mental timeline Tversky, Kugelmass, and code is congruent with the required response (for reviews
Winter (1991) asked their subjects to associate events see Hommel & Prinz, 1997; Umilt & Nicoletti, 1990). Thus,
in time (e.g., breakfast, going to bed, etc.) with locations when a stimulus requires a right-hand response, a future-
in space. English speakers associate early events with left related word or long stimulus duration will facilitate the
and late ones with right suggesting the idea that time response and thus shorten response time, because the acti-
ies from left to right. Recent response time studies vated response code is compatible with the direction of the
(Santiago, Lupiez, Prez, & Funes, 2007; Torralbo, San- required response. An analogous conclusion applies to
tiago, & Lupiez, 2006; Vallesi, Binns, & Shallice, 2008; past-related words or short stimulus duration requiring a
Weger & Pratt, 2008) provide especially strong evidence left-hand response.
for a mental timeline that runs from left to right. Thus, In addition, research has shown that ordinal sequences,
these studies further strengthen the notion of an inher- such as numbers (Dehaene, Bossini, & Giraux, 1993), the
128 R. Ulrich, C. Maienborn / Cognition 117 (2010) 126138
letters of the alphabet (Gevers, Reynvoet, & Fias, 2003) or (the) past or (the) future may be argued to refer to a certain
the days of the week (Gevers, Reynvoet, & Fias, 2004) are time interval on the mental time line. Moreover, tensed
also ordered from left to right (however, see Price & Mentz- verbs such as those used by Santiago et al. and Torralbo
oni, 2008). Furthermore, research employing material of et al. refer to events that are located on the mental time-
event sequences in natural scenes has provided evidence line. That is, these different word classes evoke clearly dis-
that mental representations of such sequences unfold from tinct modes of time reference and should better not be
left to right in our minds (Santiago, Romn, Ouellet, Rodr- mixed up when examining the linguistic relevance of a
guez, & Prez-Azor, 2010). These additional results are mental timeline.
clearly supportive for the notion that a static mental time- Secondly, not all of Santiago et al.s (2007) and Torralbo
line is involved in several cognitive functions making it un- et al.s (2006) experimental items are past- or future-re-
likely that this timeline merely represents an lated. Among the adverbs there are several exemplars that
epiphenomenon. do not express a deictic notion, i.e. reference to times ear-
From a linguistic point of view, the ndings in Santiago lier or later than NOW (as, e.g., ayer yesterday vs. maana
et al. (2007), Torralbo et al. (2006), and Weger and Pratt tomorrow), but rather they involve the notion of anterior-
(2008) which suggest a leftright mapping of time in lan- ity or posteriority, i.e., reference to one time as being ear-
guage are somewhat surprising and deserve further inves- lier or later in a sequence than another (e.g., antes
tigation. While virtually all languages have explicit spatial before vs. despus after or anteriormente previously vs.
means to refer to time (see above), there appears to be no posteriormente subsequently; see also the discussion in
single language that uses the concepts of left and right for Nez & Sweetser, 2006, on the confusion of futurity with
the expression of time. That is, while we frequently nd posteriority).
expressions like the day before Christmas, no case of an Thirdly and most importantly, the tensed verbs such as
expression like the day to the left of Christmas is attested pregunt (he) asked vs. preguntar (he) will ask, that con-
across the languages of the world (e.g., Haspelmath, 1997; stitute the great majority of Santiago et al.s (2007) and
Radden, 2004). In his crosslinguistic survey of spatial met- Torralbo et al.s (2006) stimulus material, might appear
aphors of time, Radden (2004, p. 228) therefore concludes: as single words but they are, no doubt, sentential units
the lateral axis with a leftright orientation [. . .] does not consisting of a (dropped) pronominal subject and a past-
seem to offer any sensible spatial basis for our understand- or future-related predicate. Hence, rather than using
ing of time at all. (see also Haspelmath, 1997, p. 22). The words, i.e., lexical items, Santiago et al. and Torralbo
studies by Santiago et al. (2007), Torralbo et al. (2006), et al. most of the time happen to test either complete or
and Weger and Pratt (2008) suggest that this conclusion incomplete sentences (depending on whether they use
might have been premature. Rather, the above mentioned intransitive or transitive verbs).
studies provide rst evidence that the expression of time In sum, the stimulus material used by Santiago et al.
in language refers to the leftright axis not overtly but (2007) and Torralbo et al. (2006) turns out to be rather het-
implicitly, at a deeper level of meaning representation. erogeneous, confounding word classes, semantic catego-
That is, a leftright-mapping of temporal expressions sug- ries, and lexical vs. sentential units. In order to put
gests that the metaphorical mapping from space to time Santiago et al.s and Torralbo et al.s claim that past- and
takes place at the conceptual level rather than at the level future-related expressions are mapped onto a mental
of linguistic expressions. timeline running from left to right on a more solid empir-
The experiments reported in this study were designed ical and methodological basis, we used uniformly past- vs.
to gain further insights into the linguistic relevance and future referring sentences rather than single words as
conceptual basis of a mental timeline. While previous re- stimulus materials for our experiments. Besides the lin-
sponse time studies have demonstrated a leftright map- guistic arguments presented above for the usage of sen-
ping of temporal expressions at the word level using tences in the present experiments, neuro-cognitive
isolated lexical items, we extend these studies to the pro- research (Raposo, Moss, Stamatakus, & Tyler, 2009) has
cessing of complete sentences. The use of sentences in- shown that the activation of motor and premotor cortices
stead of words as test items is motivated by some in the processing of certain words is reduced when these
linguistic concerns we have with the stimulus materials words are embedded in sentences rather presented alone.
used by Santiago et al. (2007) and Torralbo et al. (2006). Therefore, the study of Raposo et al. (2009) suggests that
As mentioned above, they chose their test material from the previous RT results concerning the mental timeline
different word classes. About 25% of the experimental may not generalize to the level of sentence processing.
items belong to the class of adverbs. Among these there A second major objective of our study was to examine
are two pairs that are word class ambiguous: antes before whether sentence processing automatically activates the
vs. despus after also belong to the class of temporal prep- mental timeline, which is an unsettled issue (see Santiago
ositions and pasado past vs. futuro future may also be et al., 2007; Weger & Pratt, 2008). Such activation could be
classied as temporal nouns. The overwhelming rest of seen as analogous to the Simon effect (Simon & Rudell,
experimental items are inected verbs either in future or 1967) and the SNARC effect (Spatial Numerical Association
in past tense. Our rst concern with this selection is that of Response Codes; Dehaene et al., 1993), in which task-
it neglects the different ways that verbs, adverbs, preposi- irrelevant stimuli inuence the speed of the response.
tions, or nouns are related to time. For instance, while a Analogous to the SNARC paradigm, Experiments 2 and 3
temporal preposition expresses a temporal relation that in this study required participants to judge whether sen-
holds between two arguments, a temporal noun such as tences were sensible or not. In such a setting, the temporal
R. Ulrich, C. Maienborn / Cognition 117 (2010) 126138 129
2.1.3. Procedure
2.1.1. Participants
A single trial started with the presentation of a xation
Eleven male and nineteen female volunteers partici-
cross (i.e., a plus sign) in the middle of the screen for
pated in a single 30-min session as partial fullment of
200 ms. The interval between the offset of the xation cross
course requirements or for a payment of 4 . Their mean
and the onset of the sentence was 500 ms. With equal prob-
age was 25.3 years (SD = 3.8 years) and all but two re-
ability, the sentence was either sensible and its content re-
ported to be right-handed. All of them were native speak-
lated to the past (SP), sensible and its content related to
ers of German.
the future (SF), or its content was nonsensical (N). Half of
the nonsensical sentences referred to the past and the other
2.1.2. Apparatus and stimuli half to the future. In the congruent condition, participants
Sentences were presented in black against a white pressed the left shift key with their left index nger in re-
background in the middle of a computer screen (standard sponse to SP and the right shift key with their right index n-
VGA screen, 150 Hz), using 15 point Arial font. The exper- ger in response to SF. In the incongruent condition, this
iment was programmed in Matlab using the Psychophys- assignment was reversed. Participants were instructed to
ics Toolbox 2.54 (Brainard, 1997; Pelli, 1997). The left and refrain from pressing a key when the sentences content
right shift key of the computer keyboard served as re- was nonsensical. The response of the participant terminated
130 R. Ulrich, C. Maienborn / Cognition 117 (2010) 126138
Fig. 1. Mean RT (left panel) and percentage of correct responses (right panel) as a function of response hand and temporal reference for Experiment 1. The
standard error SE of the mean was computed from the mean square error MSe for the interaction of factor response hand and temporal reference as
recommended by Loftus and Masson (1994) and Masson and Loftus (2003). Note that this standard error is particularly appropriate for assessing the
interaction of these two factors. Each point shows Mean 1SE.
R. Ulrich, C. Maienborn / Cognition 117 (2010) 126138 131
gruent). The overall mean RT was 1627 ms. Consistent with the right than onto the left. According to this memory ac-
the above hypothesis a signicant congruency effect count, then, SR coding is well-organized in the congruent
emerged, which is reected in a signicant interaction of condition implying a faster response selection in the con-
the factors hand and temporal reference, F(1, 28) = 8.03, gruent condition. A similar prediction follows from Proctor
MSe = 20684.8, p < 0.01, g2 = 0.22. Participants responded and Chos (2006) polarity hypothesis, which postulates
quicker to SP-sentences with their left than with right that the selection of a response is especially efcient when
hand (1574 vs. 1651 ms), whereas they responded faster salient features of a stimulus (e.g., past and future) and the
to SF-sentences with their right than their left hand associated responses (e.g., left and right) correspond.
(1606 vs. 1678 ms).1 Neither the main effect of hand, According to a second alternative, the temporal refer-
F(1, 28) = 0.03, MSe = 4249.2, p = 0.84, g2 = 0.00, nor of tem- ence of a sentence may produce automatic response acti-
poral reference, F(1, 28) = 3.41, MSe = 10529.9, p = 0.08, vation. More precisely, temporal information about the
g2 = 0.11, was reliable, though there was a tendency toward future may automatically activate the right body space,
longer RTs for SF- than for SP-sentences (1642 vs. 1613 ms), whereas temporal information about the past may auto-
an effect that was also observed by Torralbo et al. (2006) matically activate the left body space. Consistent with
with single words. Order of conditions produced no signi- the major result of Experiment 1, faster responses should
cant main effect, F < 1. This factor, however, modulated the be observed in the congruent than in the incongruent
interaction of hand and temporal reference, condition.
F(1, 28) = 152.68, MSe = 20684.8, p < 0.01, g2 = 0.85. This This automatic-activation account suggests that the
three-way interaction simply reects a practice effect, as mechanism underlying the congruency effect in Experiment
participants responded quicker in the second than in the 1 resembles the one that underlies the so-called SNARC ef-
rst part of the experiment. There were no further signi- fect (Dehaene et al., 1993). According to this latter effect,
cant results. A second ANOVA was performed on the per- the perception of numbers elicits spatial codes that are asso-
centage of correct (PC) responses, that is, on the ciated with the magnitude of the number (see Hubbard,
performance of correctly classifying SF- and SP-sentences. Piazza, Pinel, & Dehaene, 2005). Dehaene et al. (1993) had
This analysis only revealed a marginally signicant main ef- participants perform a parity judgment task (odd vs. even)
fect of temporal reference, F(1, 28) = 3.19, MSe = 18.6, in a bimanual response setting. Although magnitude infor-
p = 0.09, g2 = 0.10, that is, participants were more accurate mation is irrelevant to perform this judgment, relatively
when they had to respond to a SF- than to a SP-sentence. small numbers were responded to faster with the left hand
In sum then, the experiment clearly showed that partic- and relatively large numbers were responded to faster with
ipants produce faster responses when the response assign- the right hand (Dehaene et al., 1993). This effect has usually
ment is congruent with the mental timeline. Specically, been interpreted in terms of automatic response activation
when a past-related sentence required a left-hand re- arguing that small numbers prime the left whereas larger
sponse and a future-related sentence required a right-hand numbers prime the right response.
response, mean RT was shorter than when the response Experiment 2 was designed to discriminate between
assignment was reversed. The additional nding that par- the memory/salience account and the automatic-activa-
ticipants responded faster to SP than to SF sentences may tion account. In this experiment, participants performed
reect a trade-off between speed and accuracy, since per- a judgment only about the content of a sentence (Does it
centage of errors and response speed was negatively asso- make sense or not?) but not about its relation to the past
ciated. This effect, however, does not weaken the main or the future. Therefore, the temporal information of the
conclusion of this experiment: The leftright effect on tem- sentence was no longer directly relevant for selecting the
poral expressions found by Santiago et al. (2007) and Tor- correct response as in the previous experiment. Neverthe-
ralbo et al. (2006) can be reafrmed at sentence level. less, if meaning is action-based inducing automatic re-
sponse activation, SP sentences should be easier to
3. Experiment 2 classify as sensible when participants are required to press
the left key rather than the right key in response to sensi-
The major result of Experiment 1 is consistent with a ble sentences. Analogously, processing of SF sentences
mental left-to-right representation of time. Nevertheless, should be facilitated when they have to press the right
this result does not reveal the underlying cognitive mech- rather than the left key in response to sensible sentences.
anism that produces this congruency effect. There are at By contrast, if the congruency effect is the signature of an
least two alternative accounts that can explain this effect. improved SR coding that facilitates response selection,
The rst alternative assumes that participants can remem- one would expect that the design of this experiment elim-
ber the SR assignment in the congruent condition more inates the congruency effect observed in Experiment 1, be-
easily than in the incongruent condition. Perhaps peoples cause the temporal reference of the sentence is no longer a
memory about how the temporal reference of the sentence relevant dimension for determining the response hand.
is assigned to response hands (SR coding) is facilitated in
the congruent condition. That is, people may memorize the 3.1. Method
SR assignment more easily when future is mapped onto
3.1.1. Participants
1
The statistical reliability of this interaction effect was conrmed by a
Sixteen males and 54 females participated in a single ses-
F2-analysis that treated items as the only random factor, F2(1, 78) = 23.6, sion (mean age = 22.5 years, SD = 3.6 years). None of these
MSe = 5841.4, p < 0.001. 70 students had participated in the previous experiment.
132 R. Ulrich, C. Maienborn / Cognition 117 (2010) 126138
Seven of them claimed to be left-handed. Participants re- 3.1.2. Apparatus and stimuli
ceived either course-credit or 7 . The experiment lasted The number of sentences was increased from 120 to
approximately 50 min. The results of three participants 240; there were now 60 SP, 60 NP, 60 SF, and 60 NF sen-
had to be replaced by the results of three additional partic- tences. As before, we tried to equate the mean word length,
ipants, because their overall error rate was too high. the mean number of words per sentence, and the mean
number of total ASCII characters per sentence across the
four sets of sentences (see Table 2). Table 3 contains exam-
Table 3 ple sentences. The apparatus was identical to the one in the
Example sentences used in Experiment 2. (English translations are given by previous experiment.
interlinear word by word glosses and by normal translation.)
Fig. 2. Mean RT and percentage of correct responses as a function of response hand and temporal reference for Experiment 2, separately for sensible
sentences (left panels) and nonsensical sentences (right panels). The standard error SE of the mean was computed from the mean square error MSe for the
interaction of factor response hand and temporal reference as recommended by Loftus and Masson (1994) and Masson and Loftus (2003). Note that this
standard error is particularly appropriate for assessing the interaction of these two factors. Each point shows Mean 1SE.
R. Ulrich, C. Maienborn / Cognition 117 (2010) 126138 133
To assess the inuence of possible outliers on RT results, negligible small practice effect on PC, F(1, 68) = 17.1,
mean RT, median RT, and trimmed mean RT were again MSe = 9.6, p < 0.01, g2 = 0.98.
analysed in separate ANOVAs. Since the results were quite In sum, the results of Experiment 2 are consistent with
stable across these three analyses, we again only report the the memory account of the leftright congruency effect ob-
results on the (untrimmed) mean RT. served in Experiment 1. In line with this account, the left
right mental timeline seems to facilitate the SR coding
for selecting the appropriate response but does not auto-
4. Results and discussion matically do so in this experiment. Because the present
experiment has a higher statistical power than the previous
Fig. 2 summarizes the results of major theoretical inter- experiment (i.e., the number of participants was increased
est. It displays mean RT and percentage of correct re- from 30 to 70), we conclude that there was little or no
sponses as a function of response hand and temporal leftright congruency effect in this experiment. This conclu-
reference of a sentence. Separate ANOVAs with the three sion was strengthened by an additional ANOVA that in-
within-subjects factors temporal reference (past vs. fu- cluded the data from both experiments. The results of this
ture), response hand (left vs. right), and sentence content ANOVA revealed that the interaction of hand and temporal
(sensible vs. nonsensical), and the between-subjects factor reference changed from Experiments 1 to 2, F(1, 96) =
order of conditions (congruentincongruent vs. incongru- 17.90, MSe = 6591.2, p < 0.01 g2 = 0.98, In addition, the con-
entcongruent) were performed on mean RT and on PC. trast of the four cell means related to the hand time inter-
First of all, the overall mean RT was 1445 ms and thus action was virtually equal to zero (i.e., 0.5 4.7 ms) in
shorter than the overall mean of 1627 ms in Experiment 1, Experiment 2. By comparison, the corresponding contrast
although the level of response accuracy was about the same in Experiment 1 was 74.5 37.1 ms. We also performed a
in the two experiments (Fig. 2). This RT difference probably power analysis, employing an effect size of approximately
reects the fact that participants were only required to as- 0.5 for the congruency effect in Experiment 1 as a bench-
sess the meaning of each sentence in Experiment 2, whereas mark. Given this effect size, the probability of obtaining a
in Experiment 1 they were required to assess both the signicant effect (i.e., the statistical power) in Experiment
meaning and the temporal reference of each sentence be- 2 was computed to be 99.3% (see Mayr, Erdfelder, Buchner,
fore they could launch a correct response. Like in Experi- & Faul, 2007; but also see Miller, 2009, for a critical review of
ment 1, RTs were shorter for past-related than for future- estimating the statistical power on the basis of observed ef-
related sentences, even though the temporal reference of fect sizes). Therefore, it seems unlikely that we have missed
the sentence was not a relevant dimension for selecting a leftright congruency effect of any important size in
the response, F(1, 68) = 253.9, MSe = 2444.2, p < 0.01, Experiment 2.
g2 = 0.79; this difference could be attributed to the average
number of words per sentence, because this average was
5. Experiment 3
slightly larger for future-related than for past-related words
(see Table 2). Participants produced quicker responses with
The third experiment was designed to examine a possible
the right than with the left-hand, F(1, 68) = 14.0,
alternative explanation why no congruency effect emerged
MSe = 4093.0, p < 0.01, g2 = 0.17. Theoretically most impor-
in Experiment 2. It is conceivable that the activation of the
tantly, however, response hand and temporal reference pro-
left or right body space by temporal information is short-liv-
duced virtually additive effects, F(1, 68) = 0.03,
ing and thus will have decayed by the time when subjects
MSe = 1575.9, p = 0.866, g2 = 0.00. This lack of an interactive
produce their response after having read the complete sen-
effect provides evidence against the automatic response
tence (see Taylor & Zwaan, 2008). Although this idea seems
activation account. Furthermore, the interaction between
not well supported by the data of Experiment 2 since sub-
sentence content and temporal reference revealed a statisti-
jects tended to produce shorter RTs in Experiment 2 than
cal trend, F(1, 68) = 3.07, MSe = 2337.5, p = 0.084, g2 = 0.04;
in Experiment 1, a stronger test of this proposal is still possi-
temporal reference produced a somewhat smaller effect on
ble. In order to enable such test, Experiment 3 employed dif-
RT for sensible than for nonsensical sentences. Finally, there
ferent sentences than Experiments 1 and 2. Specically,
was a signicant three-way interaction of content, hand,
words that carry temporal information about past or future
and group, F(1, 68) = 146.8, MSe = 70536.5, p < 0.01,
were moved toward the end of a sentence in Experiment 3
g2 = 0.68. Like in Experiment 1, this triple interaction
note that this information was on average in the middle of
merely reects a practice effect because the order of the
a sentence in the previous two experiments. Therefore, if
two SR mappings was different for the two groups. There
temporal sentence information produces a transient activa-
were no further signicant effects.
tion of the left or right body space, one should observe an
Although the level of response accuracy was virtually
inuence of this activation when it overlaps temporally
identical in all conditions, an ANOVA on PC revealed some
more strongly with response selection.
signicant effects. First, there was a reliable main effect of
temporal reference, F(1, 68) = 4.34, MSe = 7.0, p = 0.04,
g2 = 0.10, indicating slightly more correct responses for 5.1. Method
past-related (95.8%) than for future-related (95.4%) sen-
tences. Second, this effect applied only to nonsensical sen- 5.1.1. Participants
tences, F(1, 68) = 12.4, MSe = 4.5, p < 0.01, g2 = 0.16. Factors One hundred and eighteen students participated in
content, hand, and group again produced a signicant yet a single session lasting about 45 min. The data of 18
134 R. Ulrich, C. Maienborn / Cognition 117 (2010) 126138
presented two times to a single participant. However, both How unreasonable that Karl the labor contract signed
lists contained the same number of sentences with respect has
to type of sentence (i.e., 60 SP, 60 NP, 60 SF, 60 NF, 20 SP (How unreasonable that Karl has signed the labor
llers, 20 NP llers, 20 SF llers, and 20 SP llers). The var- contract.)
ious possible arrangements of the two lists A and B were b. Klar, dass das Kind bei der Oma nur Schokolade essen
completely counterbalanced across participants. wird.
Clear that the child at the grandmothers only chocolate
5.1.3. Procedure eat will
The time course of a single trial was exactly identical to (Obvious that the child will only eat chocolate at its
Experiment 2. A single session consisted of two blocks with grandmothers.)
160 trials each (i.e., 30 SP, 30 NP, 30 SF, 30 NF, 10 SP llers, c. In den folgenden Nchten schlafe ich im Hotel. (ller
10 NP llers, 10 SF llers, and 10 SP llers). As in Experi- sentence)
ment 2, participants were asked to press one key if the con- In the following nights sleep I in the hotel
tent of a sentence was sensible (SP or SF) and another key if (Im going to spend the following nights at the hotel.)
the content was nonsensical (NP or NF). The assignment of
the two response keys was switched between the rst and NP a. Wie ungesund, dass Gisela die Sachertorte
unterschrieben hat.
the second block. Consistent with the data analysis in the
preceding experiments, the rst 10 trials in each block How unhealthy that Gisela the Sacher cake signed has
were considered practice and thus not entered into the (How unhealthy that Gisela has signed the Sacher cake.)
data analysis. Furthermore, trials with ller items were
b. Klasse, dass Annas Bruder das alte, klapprige Auto
also discarded from data analysis. geerntet hat.
Great that Annas brother the old rattly car harvested has
5.2. Results and discussion
(Great that Annas brother has harvested the old rattly car.)
The percentage and mean RT of correct responses was c. Der Rettungsring beobachtete den Knochen
95.1% and 2155 ms, respectively (Fig. 3). Although overall stundenlang. (ller sentence)
mean RT is clearly longer in this experiment than in the The lifebelt observed the bone for hours
previous one (1445 ms), the percentage of correct re-
(The lifebelt observed the bone for hours.)
sponses was virtually identical to the one in the previous
experiment. This increase in overall RT can be attributed NF a. Tragisch, dass das Haus in der Provence weinen wird.
to the average length of sentences in Experiment 3, which Tragic that the house in the Provence cry will
increased by 51.5% from Experiment 2 to 3.
(Tragic that the house in the provence is going to cry.)
The overall RT from Experiment 2 to 3 increased by
nearly the same percentage, that is, 49.1%. b. Verstndlich, dass die verfeindeten Nachbarn einander
entsteinen werden.
Like in Experiment 2, RTs tended to be shorter for past-
related (2148 ms) than for future-related (2162 ms) sen- Comprehensible that the antagonized neighbors each
other disstone will
tences, F(1, 96) = 8.07, MSe = 4480.4, p < 0.001, g2 = 0.08.
In addition, RT was signicantly shorter for sensible
R. Ulrich, C. Maienborn / Cognition 117 (2010) 126138 135
Fig. 3. Mean RT and percentage of correct responses as a function of response hand and temporal reference for Experiment 3, separately for sensible
sentences (left panels) and nonsensical sentences (right graphs). The standard error SE of the mean was computed from the mean square error MSe for the
interaction of factor response hand and temporal reference as recommended by Loftus and Masson (1994) and Masson and Loftus (2003). Note that this
standard error is particularly appropriate for assessing the interaction of these two factors. Each point shows Mean 1SE.
136 R. Ulrich, C. Maienborn / Cognition 117 (2010) 126138
6. General discussion cient when salient features of the stimulus (e.g., past and
future) and the response (e.g., left and right) correspond
Recent RT studies (Santiago et al., 2007; Torralbo et al., than when they do not (Proctor & Cho, 2006). In conclu-
2006; Vallesi et al., 2008; Weger & Pratt, 2008) have dem- sion, the results of Experiments 2 and 3 do not call into
onstrated the existence of a mental timeline that runs from question the existence of a mental timeline. The results
the left to the right when people classify single words as of Experiments 2 and 3, however, leave us with two mutu-
past- or future-related in a speeded RT task. Responses ally exclusive possibilities. According to the rst possibil-
are generally faster when the response direction is com- ity, the mental timeline is not automatically activated by
patible with the mental timeline than when it is not. The linguistic information and thus not required in the pro-
present study had two goals. First it examined whether cessing of sentence content. According to the second possi-
this mental timeline is also involved when people process bility, linguistic information automatically activates the
complete sentences instead of isolated words. Second, it mental timeline; this activation is, however, too weak to
assessed whether processing sentences would automati- manifest itself in RT when temporal information is task-
cally activate the mental timeline, which would provide irrelevant. Note that this second possibility is consistent
evidence for the notion that activation of this timeline is with the notion that activation of the mental time is in-
functionally involved in the processing of a sentences volved in the processing of linguistic information.
content. Although the present results cannot unequivocally dis-
In Experiment 1, we combined the experimental para- criminate between these two possibilities, the second pos-
digms of the Santiago et al. (2007) and Glenberg and Kas- sibility appears less likely to us if activation of the
chak (2002) studies to address this question. The results timeline would be automatic, why should it become man-
of this experiment revealed a clear leftright congruency ifest only when temporal information is task-relevant? In
effect. The fact that response positions are irrelevant to this addition, the ubiquity of the SNARC effect in the RT litera-
task of judging the temporal meaning of a sentence sug- ture suggests that automatic activation of the mental num-
gests that thinking about the sentences temporal meaning ber line does easily transfer to the level of RT. Therefore,
activates spatial response patterns, as one would expect why should automatic activation of the mental timeline
from the metaphoric mapping account (Boroditsky, 2000; not elicit an effect analogous to the SNARC effect, espe-
Boroditsky & Ramscar, 2002). cially if it is assumed that similar cortical metrics underlie
Experiment 2 examined two classes of hypotheses these kinds of phenomena (Walsh, 2003)?2
about the congruency effect found in Experiment 1. In agreement with the idea of such a non-automatic
According to the rst one, the temporal meaning of a sen- account, the obtained additive effects of response hand
tence automatically activates a directional spatial code and temporal content on mean RT in Experiments 2
that facilitates the response in the congruent condition and 3 t well with the results reported by Santiago
(e.g., Mattes, Leuthold, & Ulrich, 2002; Vallesi et al., et al. (2007). These authors did not only manipulate
2008). We reasoned that if the leftright congruency effect the timespace mapping but also the spatial location of
is the signature of automatic response activation, the effect their stimulus material on the screen. A time-related tar-
should also emerge in a task in which temporal informa- get word appeared either to the left of the xation point
tion is task-irrelevant, similarly to the SNARC effect (Deh- or to the right, although screen position was a task-irrel-
aene et al., 1993) or the Simon effect (Kornblum, evant dimension. Screen position did not signicantly
Hasbroucq, & Osman, 1990). Since the congruency effect modulate the leftright time congruency effect on RT,
disappeared in Experiment 2, this hypothesis received no suggesting that the effect is not of the Simon-type and
support. thus not automatic.
One might argue, however, that the activation of re- Weger and Pratt (2008) reached a similar conclusion. In
sponse codes by temporal information is non-durable and two additional experiments, they presented either a pro-
thus had decayed by the time when subjects produced spective word (e.g., later) or a retrospective word (e.g.,
their response after having read the complete sentence past) in the middle of the screen. Briey after this word,
(see Taylor & Zwaan, 2008). Experiment 3 was designed
to address this issue. To this end, words that carry tempo-
2
ral information about past or future were moved toward One reviewer of this article suggested that a left-to-right scanning of
the sentences may account for the congruency effect observed in Exper-
the end of a sentence in this experiment. We conjectured
iment 1. This reviewer conjectured that such a scanning process may
that if temporal sentence information produces a transient activate the spatial left-to-right dimension and thus facilitate the interac-
automatic activation of response codes, an inuence of this tion between spatial and temporal dimensions. We have (Ulrich et al., in
activation should manifest in RT when this activation tem- preparation) recently conducted additional experiments that required
porally overlaps with the selection and execution of a re- push/pull movements within the sagittal plane rather then left/right
responses within the horizontal plane as in Experiment 1. In the congruent
sponse. Consequently, we expected a leftright condition, subjects were asked to push/pull a handle in response to a SF/SP
congruency effect in this experiment. The data of Experi- sentence and in the incongruent condition, the SR mapping of these push/
ment 3, however, did not support this hypothesis. pull responses was reversed. Consistent with the idea that the future is
Thus, the data of Experiments 2 and 3 are consistent mentally represented in front of us whereas the past behind us (e.g.,
Boroditsky, 2000, Nez & Sweetser, 2006), faster responses were obtained
with a non-automatic account of the congruency effect
in the congruent condition. Therefore, this result argues against the notion
found in Experiment 1. Following Weger and Pratt that such a left-to-right scanning process is the sole cause of the time by
(2008), we propose that response selection is more ef- space congruency effect observed in our experiments. In addition, this
account cannot explain why this effect is absent in Experiments 2 and 3.
R. Ulrich, C. Maienborn / Cognition 117 (2010) 126138 137
Mattes, S., & Ulrich, R. (1998). Directed attention prolongs the perceived Roeckelein, J. E. (2000). The concept of time in psychology: A resourcebook
duration of a brief stimulus. Perception & Psychophysics, 60, and annotated bibliography. Westport, CT: Greenwood Press.
13051317. Santiago, J., Lupiez, J., Prez, E., & Funes, M. J. (2007). Time (also) ies
Mattes, S., Leuthold, H., & Ulrich, R. (2002). Stimulusresponse from left to right. Psychonomic Bulletin & Review, 14, 512516.
compatibility in intensity-force relations. Quarterly Journal of Santiago, J., Romn, A., Ouellet, M., Rodrguez, N., & Prez-Azor, P. (2010).
Experimental Psychology Section A Human Experimental Psychology, In hindsight, life ows from left to right. Psychological Research, 74,
55, 11751191. 5970.
Mayr, S., Erdfelder, E., Buchner, A., & Faul, F. (2007). A short tutorial of Quellet, M., Santiago, J., Funes, M. J., & Lupiez, J. (2010). Thinking about
GPower. Tutorials in Quantitative Methods for Psychology, 3, 5159. the future moves attention to the right. Journal of Experimental
Mo, S. S., & Michalski, V. A. (1972). Judgment of temporal duration of area Psychology: Human Perception and Performance, 36, 1724.
as a function of stimulus conguration. Psychonomic Science, 27, Simon, J. R., & Rudell, A. P. (1967). Auditory SR compatibility: The effect
9798. of an irrelevant cue on information processing. Journal of Applied
Miller, J. (2009). What is the probability of replicating a statistically Psychology, 51, 300304.
signicant effect? Psychonomic Bulletin & Review, 16, 617640. Smith, L., & Klein, R. (1990). Evidence for semantic satiation: Repeating a
Newell, A. (1990). Unied theories of cognition. Cambridge, MA: Harvard category slows subsequent semantic processing. Journal of
University Press. Experimental Psychology: Learning, Memory, and Cognition, 16,
Nez, R. E., & Sweetser, E. (2006). With the future behind them: 852861.
Convergent evidence from Aymara language and gesture in the Taylor, L. J., & Zwaan, R. A. (2008). Motor resonance and linguistic focus.
crosslinguistic comparison of spatial construals of time. Cognitive Quarterly Journal of Experimental Psychology, 61, 896904.
Science, 30, 401450. Torralbo, A., Santiago, J., & Lupiez, J. (2006). Flexible conceptual
Ono, F., & Kawahara, J. I. (2007). The subjective size of visual stimuli projection of time onto spatial frames of reference. Cognitive Science,
affects the perceived duration of their presentation. Perception & 30, 745757.
Psychophysics, 69, 952957. Tversky, B., Kugelmass, S., & Winter, A. (1991). Cross-cultural and
Pelli, D. G. (1997). The videotoolbox software for visual psychophysics: developmental trends in graphic productions. Cognitive Psychology,
Transforming numbers into movies. Spatial Vision, 10, 437442. 23, 515557.
Price, M. C., & Mentzoni, R. A. (2008). Where is January? The month- Umilt, C., & Nicoletti, R. (1990). Spatial SR compatibility. In R. W.
SNARC effect in sequence-form synaesthetes. Cortex, 44, 890907. Proctor & T. G. Reeve (Eds.), Stimulusresponse compatibility: An
Proctor, R. W., & Cho, Y. S. (2006). Polarity correspondence: A general integrated perspective (pp. 98116). Amsterdam: North-Holland.
principle for performance of speeded binary classication tasks. Vallesi, A., Binns, M. A., & Shallice, T. (2008). An effect of spatialtemporal
Psychological Bulletin, 132, 416442. association of response codes: Understanding the cognitive
Radden, G. (2004). The metaphor TIME AS SPACE across languages. In N. representations of time. Cognition, 107, 501527.
Baumgarten, C. Bttger, M. Motz, & J. Probst (Eds.), bersetzen, Walsh, V. (2003). A theory of magnitude: Common cortical metrics of
Interkulturelle Kommunikation, Spracherwerb und Sprachvermittlung time, space and quantity. Trends in Cognitive Sciences, 7, 483488.
das Leben mit mehreren Sprachen: Festschrift fr Juliane House zum 60. Weger, U. W., & Pratt, J. (2008). Time ies like an arrow: Spacetime
Geburtstag (pp. 225239). Bochum: Aks-Verlag. compatibility effects suggest the use of a mental timeline.
Raaijmakers, J. G. W., Schrijnemakers, J. M. C., & Gremmen, F. (1999). How Psychonomic Bulletin & Review, 15, 426430.
to deal with The language-as-xed-effect fallacy: Common Whitrow, Geoffrey. J. (1980). The natural philosophy of time. Oxford:
misconceptions and alternative solutions. Journal of Memory and Clarendon Press.
Language, 41, 416426. Woodrow, H. (1951). Time perception. In S. S. Stevens (Ed.), Handbook of
Raaijmakers, J. G. W. (2003). A further look at the language-as-xed-effect experimental psychology (pp. 12241236). New York: John Wiley &
fallacy. Canadian Journal of Experimental Psychology, 57, 141151. Sons.
Raposo, A., Moss, H. E., Stamatakis, E. A., & Tyler, L. K. (2009). Modulation Xuan, B., Zhang, D., He, S., & Chen, X. (2007). Larger stimuli are judged to
of motor and premotor cortices by actions, action words and action last longer. Journal of Vision, 7, 15.
sentences. Neuropsychologia, 47, 388396.