You are on page 1of 7

Journal of Safety Research 40 (2009) 239–245

Contents lists available at ScienceDirect

Journal of Safety Research

j o u r n a l h o m e p a g e : w w w. e l s ev i e r. c o m / l o c a t e / j s r

Predicting driver drowsiness using vehicle measures: Recent insights and


future challenges
Charles C. Liu a,⁎, Simon G. Hosking a,b, Michael G. Lenné a
a
Accident Research Centre, Monash University, Building 70, Clayton VIC, 3800, Australia
b
Air Operations Division, Defence Science & Technology Organisation, Fisherman's Bend, VIC, 3207, Australia

a r t i c l e i n f o a b s t r a c t

Available online 14 July 2009 Introduction: Driver drowsiness is a significant contributing factor to road crashes. One approach to tackling
this issue is to develop technological countermeasures for detecting driver drowsiness, so that a driver can be
Keywords: warned before a crash occurs. Method: The goal of this review is to assess, given the current state of
Fatigue knowledge, whether vehicle measures can be used to reliably predict drowsiness in real time. Results: Several
Sleepiness behavioral experiments have shown that drowsiness can have a serious impact on driving performance in
Lane position
controlled, experimental settings. However, most of those studies have investigated simple functions of
Steering wheel
Intelligent Transport Systems
performance (such as standard deviation of lane position) and results are often reported as averages across
drivers, and across time. Conclusions: Further research is necessary to examine more complex functions, as
well as individual differences between drivers. Impact on Industry: A successful countermeasure for
predicting driver drowsiness will probably require the setting of multiple criteria, and the use of multiple
measures.
© 2009 National Safety Council and Elsevier Ltd. All rights reserved.

Driver drowsiness is a significant contributing factor to road as a causal factor in a crash; drowsiness can only be inferred when other
crashes worldwide. NCSDR/NHTSA Expert Panel on Driver Fatigue and potential causes have been eliminated. In a study on sleep-related
Sleepiness (1998) has estimated that there are 56,000 crashes each vehicle accidents in the U.K., Horne and Reyner (1995) used data from
year (in the United States) in which drowsiness or fatigue was cited by police databases and on-site interviews. To identify the subset of
police as a causal factor. These crashes lead to, on average, 40,000 accidents in which sleepiness was a factor, they developed the following
nonfatal injuries and 1,550 fatalities per year. Data from the U.S.-based set of criteria: (a) blood alcohol level below the legal driving limit; (b)
100-car naturalistic driving study indicated that drowsy driving vehicle ran off road or onto the back of another vehicle; (c) no sign of
(compared to alert driving) resulted in a five-fold increase in risk of brakes being applied; (d) no mechanical defect in the vehicle; (e) good
a crash or near-crash (Klauer, Dingus, Neale, Sudweeks, & Ramsey, weather conditions and clear visibility; (f) elimination of “speeding” or
2006). Internationally, MacLean, Davies, and Thiele (2003) concluded “driving too close to vehicle in front” as causes; (g) the police officer at
that “while estimates of the number of crashes due to sleepiness have the scene suspects sleepiness as primary cause; and (h) for several
varied widely, there is converging evidence that about 20% of crashes seconds prior to crash, the driver could have seen the run off point. The
are related to sleepiness” (p. 510). Taken together, these statistics identification of driver drowsiness using these criteria is clearly a
indicate that driver drowsiness imposes a significant burden on difficult, error-prone, and time-consuming task.
society, and constitutes a serious public health issue. Many countermeasures to driver fatigue have been proposed, such as
To address this issue, we need to be able to reliably identify driver the use of bright light, caffeine, or naps. However, these countermeasures
drowsiness so that appropriate countermeasures can be developed. In rely on drivers' self-monitoring of their level of drowsiness, and such
epidemiological research, it can be difficult to identify driver drowsiness subjective measures may be unreliable (Reyner & Horne, 1998). An
alternative related approach has been to develop countermeasures based
⁎ Corresponding author. Tel.: +61 3 9905 4669; fax: +61 3 9905 4363. on objective driver-performance data. These technological counter-
E-mail addresses: Charles.Liu@muarc.monash.edu.au (C.C. Liu), measures have been designed to detect driver drowsiness so that a
Simon.Hosking@dsto.defence.gov.au (S.G. Hosking), driver can be warned before a crash occurs (for reviews of these systems,
Michael.Lenne@muarc.monash.edu.au (M.G. Lenné). see Kecklund et al., 2006; Kircher, Uddman, & Sandin, 2002; Wright,
1
Many researchers in this domain use the terms “drowsiness,” “sleepiness,” and Stone, Horberry, & Reed, 2007). These systems can be based on physio-
“fatigue” interchangeably. There does not appear to be a general consensus on how to
differentiate these three concepts, and any attempt to do so would exceed the scope of
logical measures (e.g., eye movements), vehicle dynamics, or a combina-
this article. Instead, the term “driver drowsiness” will be mostly used throughout, tion of both of these measures. It has been argued that changes in
where this refers, generally, to the driver's tendency to fall asleep at the wheel. physiological and vehicle variables are correlated with driver drowsiness,

0022-4375/$ – see front matter © 2009 National Safety Council and Elsevier Ltd. All rights reserved.
doi:10.1016/j.jsr.2009.04.005
240 C.C. Liu et al. / Journal of Safety Research 40 (2009) 239–245

and can therefore be used to predict when a driver is too drowsy to drive to real-world driving because they are analogous to serious crashes. In
safely. However, the relationship between driver drowsiness and driver all of the studies cited, driver drowsiness increased the likelihood of
performance is complex, and it remains unclear whether drowsiness can lane departures. In future experiments of this kind, driver impairment
be reliably predicted on the basis of such measures. should be assessed by recording lane departures that are defined at
In this article, we present a review of recent behavioral experi- various levels of severity (i.e., from minor to major), rather than at a
ments that have examined the effect of drowsiness on driver perfor- single level (see Stephan, Hosking, Regan, Verdoorn, Young, &
mance; in particular, performance that can be measured according to Haworth, 2006).
vehicle dynamics, rather than physiological measures (cf., Lal & Craig,
2001). The goal of this review is to assess, given the current state of 2.2. Drowsiness manipulation
knowledge, whether vehicle measures can be used to reliably predict
drowsiness in real time. This question is critical to our theoretical Drowsiness can be manipulated by varying a number of factors,
understanding of drowsy driver behavior, as well as to the develop- including duration of sleep deprivation, time-of-day, and time-on-
ment and refinement of technological countermeasures. We conclude task. In the studies cited above, drowsiness was manipulated prima-
with recommendations for future research. rily by partial or total sleep deprivation. Total sleep deprivation
refers to one full night, or more, without sleep, while partial sleep
1. Method deprivation refers to less than one full night without sleep. The
extent of sleep deprivation can be quantified by the total hours of
Articles on relevant behavioral experiments were located by continuous wakefulness. Under the assumption that a full night's
searches in online databases. The terms driver, drowsiness, sleepiness, sleep is 8 hours long, the extent of sleep deprivation typically varied
fatigue (and variations of those words) were entered into databases from none (16 h of wakefulness) to partial (16 to 24 h) to total
including Web of Science, PsycINFO, and PubMed. Only those studies (greater than 24 h). In one extreme manipulation, drivers went for
that were published in peer-reviewed journals were retained for 60 hours, or over 2 days, without sleep (Peters, Wagner, Alicandri, &
further consideration. Furthermore, we restricted our review to Fox, 1999).
studies where an objective vehicle-based measure was reported, or In two of the studies, sleep deprivation was also combined with
where drowsiness had some effect on impairing driver performance caffeine or naps (De Valck & Cluydts, 2001; Horne & Reyner, 1996).
(as would be expected in the real-world). These restrictions were These countermeasures improved the performance of drowsy drivers
necessary to ensure that the studies provided sufficient information to by decreasing the frequency of major lane departures. Although
address the primary goal of this review. caffeine had similar beneficial effects to that of a nap, the effects of
napping were not consistent across drivers because some were not
2. Results able to fall asleep (Horne & Reyner, 1996). In the study by De Valck and
Cluydts (2001), drivers were given a slow-release caffeine dose, which
In all, there were 17 studies in which behavioral experiments were had a prolonged beneficial effect that was still present at 5 hours after
reported or analyzed (see Table 1). In almost all of the reported administration. The researchers argued that slow-release caffeine can
experiments, driving performance was tested in a simulator, although have an important role in combating driver fatigue over long trips,
some experiments involved test tracks, and real-world driving tasks. especially if circumstances do not allow taking a nap.
As shown in Table 1, each of the studies can be described by the The effects of time-of-day on driver drowsiness and driving perfor-
following characteristics: (a) measures of driver impairment; (b) mance were examined in three studies. Moller, Kayumov, Bulmash, Nhan,
drowsiness manipulation; (c) drowsiness measure; and (d) vehicle and Shapiro (2006) found that the frequency of microsleeps was higher
measure. Unfortunately, a quantitative meta-analysis on these data in the afternoon (14:00 to 16:00) than in the morning (10:00 to 12:00),
was not feasible because the studies were too dissimilar to produce and this resulted in a slight increase in number of minor lane departures.
any common measure that could be meaningfully pooled. Further- The finding of a weak association between time-of-day and lane
more, most studies did not report numerical estimates, or did not departure is consistent with that of earlier studies (Lenné, Triggs, &
produce graphs with error bars. Redman, 1997; Lenné, Triggs, & Redman, 1998), in which time-of-day
In almost all experiments, drivers were subjected to various levels of produced small, but statistically significant, changes in vehicle-based
sleep deprivation, and the most common finding was that drowsiness measures.
impaired driver performance in terms of increasing the likelihood of Driver drowsiness can also be manipulated by increasing the
crashes. The magnitude of driver drowsiness was validated by subjec- duration of the driving task. In simulator-based studies that explicitly
tive ratings, and objective physiological measures. Furthermore, drows- examined the effect of driving duration (and sometimes combined
iness induced greater variability in lateral lane position of the vehicle, with sleep deprivation), the number of lane departures increased as
and steering wheel movements, which suggests that these variables participants drove for longer durations (Akerstedt, Peters, Anund, &
may be useful for predicting the onset of drowsiness. These findings are Kecklund, 2005; Otmani, Pebayle, Roge, & Muzet, 2005; Philip,
distilled in more detail below. Sagaspe, Taillard, et al., 2005; Thiffault & Bergeron, 2003). These
lane departures occurred presumably because drivers gradually
2.1. Defining driver impairment became drowsier during the monotonous task (e.g., driving on long,
straight roads that provided little visual stimulation), even though the
The ultimate purpose of detecting driver drowsiness is to prevent driving scenarios were in daytime settings. When the driving scenario
dangerous events that could lead to vehicle crashes. In the reviewed was particularly monotonous, drowsiness-related behavior was
literature, dangerous events were typically defined as some form of observed as early as 20 minutes into the driving task (Thiffault &
lane departure. These lane departures could vary from minor ones Bergeron, 2003). Furthermore, Otmani et al. showed that driving
(e.g., part of the car crossing a lane boundary) to major ones (e.g., duration was the most important factor that contributed to driver
whole car crossing a lane boundary). Both types of lane departures impairment in their study, although the effects of driving duration
appeared to be important indicators of driver impairment. On one appear to be weaker in real-world driving (Philip et al., 2005b).
hand, minor departures occurred frequently (Ingre et al., 2006b), so Results from these “time-on-task” studies are consistent with the
these data provided a more reliable measure of driver impairment. On epidemiological finding that drowsiness-related crashes are more
the other hand, although major departures occurred less frequently likely to occur on (monotonous) motorways than on other roads
(De Valck & Cluydts, 2001), they are of primary interest in applications (Horne & Reyner, 1995). In general, driver drowsiness, whether caused
C.C. Liu et al. / Journal of Safety Research 40 (2009) 239–245 241

Table 1
Summary of studies.

Author (Year) Sample Size Drowsiness Manipulation Drowsiness Measure Driving Task Vehicle Measure Impairment Measure
(number of (Drowsiness (Drowsiness
participants) increased...) increased...)
Arnedt et al. (2001) N = 18 Sleep deprivation: no sleep Stanford Sleepiness 30-mins drive on Average distance from Major lane departures
for Scale simulated motorway - lane center (entire vehicle leaving
- 16 hours no other cars Standard deviation of road)
- 18.5 hours lane position
- 21 hours Standard deviation
- 23.5 hours. of speed
Alcohol
Arnedt et al. (2000) N = 22 Sleep deprivation: no sleep Stanford Sleepiness 30-mins drive on Average distance from Major lane departures
for Scale simulated motorway lane center (entire vehicle leaving
- 16 hours - no other cars Standard deviation of road)
- 20 hours lane position
Alcohol Standard deviation of
speed
De Valck & Cluydts (2001) N = 12 Sleep deprivation: slept for Stanford Sleepiness 45-mins drive on Standard deviation of Major lane departures
- 4.5 hours Scale simulated motorway lane position (entire vehicle leaving
- 7.5 hours the road)
Caffeine - no stop signs or traffic Mean deviation of Multi-vehicle crashes
lights vehicle speed from
- overtaken by two speed limit (100 km/h)
vehicles
Fairclough & Graham (1999) N = 64 Sleep deprivation: slept from Karolinska Sleepiness Three 40 mins drives Steering wheel Minor lane departures
- 12 am to 4 am scale on simulated road reversals (two wheels contacting
- all night boundary)
Alcohol
Hack et al. (2001) N = 12 Sleep deprivation: no sleep for None Three 30 mins drives Standard deviation of Major lane departures
24 hours on simulated road lane position (center of vehicle
Alcohol crossing boundary)
Horne & Reyner (1996) N = 10 Sleep deprivation: slept for Karolinska Sleepiness Two 30 mins drives on None Major lane departures
5 hrs Scale simulated road (entire vehicle leaving
Naps EEG activity road)
Caffeine Blink rate
Ingre et al. (2006a, 2006b); N = 10 Sleep deprivation: shift Karolinska Sleepiness 2 hours on simulated Standard deviation of Major lane departures
Re-analysis of data workers who worked all night, Scale rural road lateral position (vehicle crossing lane
from Akerstedt et al. and drove in the morning with four wheels)
(2005)
Blink durations Minor lane departures
(vehicle crossing lane
with two wheels)
Lenné et al. (1997) N = 11 Time-of-day: Subjective ratings of Six 30 mins drives, Mean deviation from None
- 6 am alertness, sleepiness, every four hours in speed limit
- 10 am and motivation simulator Standard deviation of
- 2 pm lane position
- 6 pm
- 10 pm
- 2 am
Lenné et al. (1998) N = 24 Sleep deprivation: no sleep for Subjective ratings of Five 20 mins drives, Mean deviation from None
24 to 36 hours alertness, sleepiness, every three hours in speed limit
Time-of-day: and motivation simulator Standard deviation of
- 8 am lane position
- 11 am
- 2 pm
- 5 pm
- 8 pm
Moller et al. (2006) N = 31 Time-of-day: Subjective ratings of Four 30 mins drives, Lane position Major lane departures
- 10 am sleepiness and every two hours on (center of vehicle
- 12 pm alertness simulated motorway crossing lane)
- 2 pm EEG
- 4 pm
Otmani et al. (2005) N = 20 Sleep deprivation: slept for Karolinska Sleepiness 90 mins drive on a Standard deviation of Minor lane departures
5 hours Scale EEG simulated motorway lane position (one wheel touching a
Time-on-task: Mean amplitude of lane boundary)
- 10 mins to 90 mins steering wheel
reversals
Peters et al., (1999) N = 12 Sleep deprivation: no sleep None 40 mins drive on Standard deviation of Minor lane departures
for simulated rural road lane position (one wheel touching a
- 9 hours Standard deviation of lane boundary)
- 12 hours steering wheel
- 36 hours movements
- 60 hours
Philip et al. (2005a) N = 22 Sleep deprivation: slept Karolinska Sleepiness 105 mins drive on a None Minor lane departures
for Scale real, open highway. (one wheel touching
- 2 hours lane boundary)
- 8 hours

(continued on next page)


242 C.C. Liu et al. / Journal of Safety Research 40 (2009) 239–245

Table 1 (continued)
Author (Year) Sample Size Drowsiness Manipulation Drowsiness Measure Driving Task Vehicle Measure Impairment Measure
(number of (Drowsiness (Drowsiness
participants) increased...) increased...)
Philip et al. (2005b) N = 12 Sleep deprivation: slept for Karolinska Sleepiness 105 mins drive in None Minor lane departures
- 2 hours Scale simulator (one wheel touching
- 8 hours 105 mins drive on a lane boundary)
real, open highway.
Thiffault & Bergeron (2003) N = 56 Time on task: None Two 40 mins drives in Mean and standard None
- 5 mins to 40 mins simulator deviation of steering
wheel movements
Decreased frequency of
smaller steering wheel
movements
Increased frequency of
larger steering wheel
movements

by sleep deprivation or by long driving duration, impaired perfor- from a rating of 5 (“neither alert nor sleepy”) to a rating of 9 (“very
mance by increasing the probability of lane departures. sleepy, great effort to stay awake”). These average estimates have to be
interpreted with caution, however, because there were considerable
2.3. Drowsiness measures individual differences in the relationship between subjective ratings
and risk of lane departure. (Later in the Discussion, we revisit this issue
Because driver drowsiness is a latent construct that cannot be of individual differences.) Another potential limitation is that the
observed directly, it must instead be inferred on the basis of process of asking for ratings may have stimulated the driver, and
observable measures. In the studies cited above, the measurement therefore reduced the level of drowsiness that is being measured. Thus,
of drowsiness was necessary to achieve two goals. The first goal was physiological measures may be better suited to the validation of
simply to confirm that the manipulations (i.e., sleep deprivation and drowsiness in such experiments.
its countermeasures) reliably produced their intended effects of
increasing or decreasing drowsiness. The second goal was to explore 2.3.2. Physiological measures
the underlying, quantitative relationship between drowsiness and Some studies of driver drowsiness have employed objective,
driver performance. These two goals were achieved, to varying physiological measures of drowsiness, which involve the monitoring
degrees, using both subjective and objective measures of drowsiness. of activity in the brain, the heart, and/or the eyes. Two physiological
measures, in particular, were commonly used: electroencephalographic
2.3.1. Subjective measures (EEG) activity, and eyeblink (or eye closure) duration.
Subjective measures of drowsiness involve some form of intro- EEG analysis was used in two of the behavioral studies. In those
spective assessment by the driver. For example, Moller et al. (2006) studies, indicators of drowsiness were computed by combining the
asked drivers to rate their sleepiness on a scale from 0 to 10. Almost power in the alpha range (8 - 12 Hz) and the theta range (4 - 7 Hz) of
all other studies employed one of the two most common sleepiness EEG activity. While alpha activity is a relatively early sign of sleepiness,
scales: either the 7-point Stanford Sleepiness Scale (SSS), or the 9-point theta activity is associated with more severe sleepiness. EEG activity in
Karolinska Sleepiness Scale (KSS), in which the numeric ratings corres- the alpha and theta ranges increased steadily as driving duration
pond to a unique verbal description for the particular state of sleepiness. increased (Otmani et al., 2005). Conversely, EEG activity in this range
Of these two scales, the KSS appears to be the more common in the was significantly reduced when drowsy drivers took a nap, or were
studies reviewed. In fact, several studies have used KSS ratings to given caffeine (Horne & Reyner, 1996). Although EEG analysis appears
quantitatively predict the probability of lane departures. Horne and to be a reliable tool for validating driver drowsiness, it can be difficult
Reyner (1996) asked drivers to report KSS ratings every 200 seconds to use in practice, because the EEG signal may be contaminated by
during the driving task. They found that a minor lane departure (i.e., artifacts that are caused by body, head, and eye movements.
one car wheel over the lane) never occurred until the reported KSS Eyeblink duration is closely associated with subjective KSS ratings,
was at least 6 (“some signs of sleepiness”). However, once this level as well as the frequency of lane departures (Akerstedt et al., 2005). As
was reached, a minor lane departure occurred, on average, about drivers become drowsier, their eyes remain closed for longer, and their
11 minutes from the onset of self-declared sleepiness. performance suffers as a result. One prominent measure that is related
Horne and Reyner (1996) asked drivers to rate their likelihood of to eyeblink duration is PERCLOS (percentage of eyelid closure), which is
falling asleep at the wheel. This rating was reported on a five-point defined as the proportion of time in a specified time period (e.g., 1 to
scale that ranged from “very unlikely” to “very likely.” The association 3 min) that a participant's eyes are closed. According to one criterion,
between the KSS ratings and the likelihood ratings was analyzed by a driver is considered to be drowsy whenever their PERCLOS measure
the same authors in a later paper (Reyner & Horne, 1998). The two exceeds 80% (Wierwille & Ellsworth, 1994).
types of ratings were correlated, but not perfectly. This meant that for An important limitation of using physiological predictors is that
some drivers, on some occasions, the two types of ratings diverged. driver drowsiness is a very different state to normal drowsiness because
For example, of all the occasions where drivers reported a KSS rating drivers are motivated to stay awake (Horne & Reyner, 1996). The
of 8 (when they were clearly feeling sleepy), drivers reported that the physiological events that occur before falling asleep at the wheel may
likelihood of falling asleep was “unlikely” or “very unlikely” on 18% of therefore be different to those that occur before normal sleep (e.g., at
these occasions. In other words, drivers sometimes underestimated home in bed). Physiological indices of the driver drowsiness state may
the likelihood of falling asleep, despite feeling very sleepy. reflect a mixture of normal drowsiness, and an effortful response to
Ingre, Akerstedt, Peters, Anund, Kecklund, & Pickles (2006b) asked maintain alertness. Furthermore, Horne and Reyner expressed con-
drivers to report KSS ratings every 5 minutes during the driving task. siderable skepticism about the utility of eyeblink measures, because
The researchers estimated that, for the average driver, the risk of a “blinking in the driver is also affected by the outside road lighting,
major lane departure increased by 185 times if sleepiness increased oncoming headlights, and the air temperature and state of the
C.C. Liu et al. / Journal of Safety Research 40 (2009) 239–245 243

ventilation system in the vehicle” (p.292). Thus, although such Given such a task, a drowsy driver cannot maintain lane position by
measures may be adequate for validating a drowsiness manipulation, simply holding the steering wheel still.
they may be not sufficiently reliable for predicting driver drowsiness in
real time (cf., Johns, Tucker, Chapman, Crowley, & Michael, 2007). 3. Discussion

2.3.3. Vehicle-based measures The research reviewed here has shown that drowsiness consistently
Although drowsiness detection can be based on physiological produces a range of effects on vehicle measures. However, this does not
measures such as eyeblink duration, an alternative source of informa- necessarily imply that the inverse is also true: that vehicle measures can
tion is available from the vehicle system. For example, sleep deprivation be used consistently to predict drowsiness. In order to develop a success-
can produce greater variability in driving speed (Arnedt, Wilde, Munt, & ful technological warning device for driver drowsiness, a number of
Maclean, 2000; Fairclough & Graham, 1999). However, the standard outstanding issues need to be addressed: (a) relating simulator and real-
deviation of lane position (SDLP) was the most consistently associated world driving behavior; (b) reducing raw vehicle data; (c) defining
with drowsiness (e.g., Arnedt, Wilde, Munt, & Mclean, 2001; De Valck & critical events; (d) specifying a critical time window; (e) setting an
Cluydts, 2001; Ingre, Akerstedt, Peters, Anund, & Kecklund, 2006a). appropriate criterion; and (f) combining multiple measures. Each of these
One study, in particular, has reported precise numerical estimates of issues, discussed below, present an opportunity for further research in the
SDLP as a function of drowsiness levels measured by KSS ratings (Ingre area.
et al., 2006a). They found that SDLP (in meters) increased gradually
from KSS level 1, where participants report being “very alert” 3.1. Simulated versus real driving conditions
(SDLP = 0.19, SE= 0.06) to KSS level 7, where participants report
being “sleepy but no effort to remain awake” (SDLP = 0.28, SE = 0.04). One future challenge is to better understand the relationship
SDLP increased dramatically at KSS level 8 (SDLP = 0.36, SE = 0.04) and between simulator driving behavior and real-world driving. One study
level 9 (SDLP = 0.47, SE = 0.04). For a typical lane of about 3.6 m width, that has directly compared the effects of drowsiness on simulated and
this degree of SDLP would make lane departures quite likely. It should real-world driving found some discrepancies between the two
be pointed out that those estimates were calculated as average effects conditions (Philip et al., 2005a). In general, the effects of sleep-
across participants, and did not necessarily apply to all drivers: for some deprivation and time on task were more pronounced in simulated
drivers, SDLP never exceeded 0.3 m, even at the highest KSS levels. driving. In the real-world condition, they found no increase in lane
The variability of lane position should, in principle, be a measure departures in the first two hours of driving. This finding contrasts with
of the driver's ability to maintain a straight path (or precision), and those of previous simulator studies, which have found driving
this measure should be independent of those that assess the driver's impairments within the first 20 to 40 minutes. The researchers
ability to track the lane center (or bias). Consider a participant who attributed this discrepancy to the greater level of stimulation in
drove well within the lane boundaries, but was slightly off the lane real-world driving compared to simulated driving. Previous studies
center. This performance should yield low SDLP. It seems intuitive have shown a good correspondence between simulator and real-
that a participant who was driving with such precision would be alert world driving behavior (e.g., Godley, Triggs, & Fildes, 2002). Thus,
and not drowsy. This is the definition of SDLP that was adopted in further research comparing simulated and real-world driving is
most studies. For example, Pilutti and Ulsoy (1999) found that 6 out warranted. More generally, data from naturalistic driving studies
of the 12 drivers in their study naturally maintained a position off should offer further insights; from estimating the prevalence and risk
the lane center (away from the adjacent lane); however, this behavior of driver drowsiness as in the 100-car study (Klauer et al., 2006), to
was unrelated to the degree of variability in lane position. In a few field operational testing of the acceptability of lane departure warning
studies, in contrast, SDLP was defined with respect to the lane center, devices (LeBlanc et al., 2006).
rather than the average position of the vehicle (e.g., Hack, Choi, &
Vijayapalan, 2001; Otmani, et al., 2005). This definition is a composite 3.2. Data reduction
measure of bias and precision. In future experiments, it would be
useful to maintain separate measures of bias and precision, given that The first step toward developing an algorithm to predict driver
they are likely to index different aspects of driver performance (Land & drowsiness is to specify the relevant vehicle measures, such as lane
Horwood, 1995). position or steering wheel movements. In a typical experiment using a
Another important vehicle-based measure is steering wheel simulator or instrumented vehicle, the raw vehicle measures can be
movement (SWM). Fairclough and Graham (1999) found that recorded continually at a high frequency (e.g., 30 Hz). The volume of
sleep-deprived drivers made fewer steering wheel reversals (i.e., this data can be reduced by computing a function of the vehicle
movements that crossed the resting position of the wheel) compared measure, averaged across a short time interval (e.g., one minute) or
to rested drivers. More recently, Thiffault and Bergeron (2003) found road length (e.g., 100 meters). Although most of the studies computed
that this effect depended on the size of the SWM. Specifically, they simple and crude functions, such as SDLP or frequency of SWMs, more
distinguished between small movements (1-5 degrees) and large sophisticated functions may be necessary to capture the underlying
movements (6-10 degrees). As driving duration (and supposedly, regularities in the data.
drowsiness) increased, drivers made fewer small SWMs, but more
large SWMs. These results were attributed to the inability of the 3.3. Critical events
drowsy driver to detect small lane deviations (which can be
corrected by small SWMs), and the necessity of large SWMs to The second step is to define the critical events of interest, that is,
correct for large lane deviations. This explanation implies that the what the countermeasure should predict. These events may include
observed increase in SDLP is due to two distinct actions: drifting and lane departures of different levels of severity: from minor departures
correcting. When a driver loses concentration, the vehicle begins to (e.g., part of the car crossing a lane boundary) to major departures
drift away from the lane center, but once detected, such deviations (e.g., whole car crossing a lane boundary).
are corrected by large SWMs toward the lane center.
The relationship between SDLP and SWMs can be further 3.4. Prediction time window
investigated by adding curved roads or “virtual wind gusts” to the
driving task (Moller et al., 2006; Thiffault & Bergeron, 2003), so that The third step is to precisely specify the prediction time window;
drivers are forced to make corrective SWMs to stay within their lane. that is, how long before a critical event does a warning need to be
244 C.C. Liu et al. / Journal of Safety Research 40 (2009) 239–245

issued? This question is important because vehicle measures 3.6. Combining multiple measures
obviously vary over time. Variability over time was masked in some
studies because results were presented as averages across an entire Methods that are based on a single measure will be unreliable under
test period. Studies that reported measures of drowsiness and certain conditions. One potential problem with the measurement of
performance at several time intervals (e.g., Hack et al., 2001; Thiffault lane position is that it requires a reliable method for processing images
& Bergeron, 2003) found that these variables were not constant across taken from outside the vehicle. For example, computation of lane
time. As driving duration increased, driver drowsiness systematically position may not work well when the roads are wet, or dirty, or when
increased, and driving performance systematically decreased. lanes are not clearly marked. Some have argued that the accuracy of
Although potential vehicle-based measures must be computed as steering wheel information may be less dependent on outside condi-
averages over time, there exists an unavoidable tradeoff between tions (Desai & Haque, 2006; Sayed & Eskandarian, 2001). However,
speed and accuracy in this computation (Kwon & Lee, 2002). On one SWMs can also be affected by changes in the road surface that are
hand, if the time window is too short, the system may be merely unrelated to driver drowsiness. It is likely that a reliable counter-
detecting “noise,” and will therefore generate an excessive number of measure must incorporate multiple measures, but it remains unclear
false alarms. On the other hand, if the time window is too long, the how these measure should be combined in an optimal fashion. While
system may be too slow to be of any practical use. the incorporation of vehicle-based measures may be a necessary first
step for a successful driver drowsiness detection system, such a system
3.5. Criterion setting may not be sufficiently robust without the availability of other (e.g.,
physiological) measures.
One or more criteria need to be set to distinguish drowsy states One study, involving 38 commercial truck drivers, evaluated an
from non-drowsy states. These criteria should yield both high approach that combined multiple measures (Dinges, Maislin, Brew-
sensitivity, and high specificity. High sensitivity means that the ster, Krueger, & Carroll, 2005). In that study, whenever the driver
function should indicate “drowsy” when the driver is actually drowsy, made an abrupt deviation from the lane without signaling, a device
and high specificity means that the function should indicate “not (based on lane position information) provided an auditory warning
drowsy” when the driver is not actually drowsy. signal. Drivers in that study were also provided with three other
The tradeoff between sensitivity and specificity has received little fatigue management devices. The first device was a wrist-worn
attention in the literature, but was discussed at length by Stephan et al. actigraph device, which provided information on the need to sleep.
(2006). They described a drowsiness detection measure, known as the The second device was used to detect excessive eye closure, and was
Johns Drowsiness Scale (JDS), which is based on a number of variables based on the PERCLOS measure described earlier. The third device
relating to eyelid movements (Johns et al., 2007). The score is com- helped to reduce physical fatigue by controlling vehicle stability while
puted minute-by-minute, and the scale varies from 0 to 10, where driving. The explicit purpose of that study was to test whether
higher scores represent greater levels of drowsiness. A score of 4.5 is feedback from all four devices - as a single intervention - could reliably
said to represent a cautionary level of drowsiness. In the study by improve driver performance.
Stephan et al., JDS scores and vehicle-based measures were collected Driver performance was measured during normal, work driving
from sleep-deprived drivers in the simulator. Using the criterion of 4.5, schedules. Each driver underwent the conditions in the same order:
the JDS score predicted lane departures in the following 15 minutes, 2 weeks with no devices, followed by 2 weeks of intervention, in
with 83% sensitivity and 61% specificity. Although many errors (both which they used the four devices simultaneously. The researchers
misses and false alarms) were made, Johns et al. argued that, “we are found that both driver drowsiness (as measured by PERCLOS) and lane
not aware of any other method that could be used regularly by drivers tracking variability were reduced in the intervention condition.
that predicts ‘off-road’ events with greater accuracy several minutes Systematic evaluation of the reliability of such devices (either alone,
before they happen” (p. 240). Whether this error rate would be ac- or in combination) is a priority for future research.
ceptable to drivers, in practice, remains a question for further research.
The setting of a fixed criterion may not be ultimately feasible. 3.7. Summary
Brookhuis, De Waard, and Fairclough (2003) highlighted the important
distinction between absolute and relative criteria. Absolute criteria are The research reviewed here has shown that drowsiness can have a
those that could reasonably apply to all drivers, whereas relative criteria serious impact on driving performance in controlled, experimental
are those that apply only to a subgroup of drivers, or even to a specific settings, as would be expected on the basis of epidemiological studies.
driver. For example, a very high level of SDLP may indicate drowsiness Drowsiness impairs driving performance, by increasing the probability
for all drivers (absolute criterion), whereas a medium level of SDLP may of lane departures (both minor and major). However, while there is
indicate drowsiness for some individuals and not others (relative substantial literature on the topic, few studies have characterized the
criterion). The setting of relative criteria will be necessary whenever precise relationship between drowsiness and driving performance.
individual differences exist for some measure of driving performance. Most of the studies have investigated simple functions of driving
The issue of individual differences was neglected in some studies, performance, such as SDLP or frequency of SWMs. In addition, much of
because the results were presented as averages across participants. the behavioral data were reported as averages: It remains unclear
Where individual results were reported (e.g., Ingre et al., 2006a, 2006b; whether the drowsiness manipulations would produce such robust
Philip et al., 2005a; Otmani et al., 2005), it was clear that the effect of effects if the variability across individual drivers and across time were
drowsiness on driver performance (and on vehicle-based measures) accounted for. Ultimately, it appears that a successful countermeasure
differed across individuals. This suggests that a single, fixed criterion for driver drowsiness detection may require the setting of multiple
will not be equally effective for all individual drivers. A successful criteria, and the use of multiple measures.
countermeasure must be sufficiently flexible to adapt to the behavioral
patterns of a specific driver. 4. Impact on industry
Yet another complication is that multiple criteria may be necessary,
even for a single individual. For example, although it is well-known that Over 10 years ago, Brown (1997) predicted that “there seems no
drowsiness increases SDLP, one could also argue that near-zero SDLP reason why reliable and affordable technological countermeasures
(i.e., holding the steering wheel still) may also indicate impaired against driver fatigue should not be commercially available within 5-
performance. To investigate these possibilities, future experiments 10 years” (p.530). Given the present literature review, this prediction
must analyze behavioral data at the level of the individual driver. may have been too optimistic. We speculate that a successful
C.C. Liu et al. / Journal of Safety Research 40 (2009) 239–245 245

technological countermeasure will require input from vehicle mea- driving study data. Washington, DC: U.S. Department of Transportation, National
Highway Traffic Safety Administration.
sures that are more sensitive than merely SDLP, or frequency of SWMs. Kwon, W., & Lee, S. (2002). Performance evaluation of decision making strategies for an
The growing literature on psychologically-plausible models of driver embedded lane departure warning system. Journal of Robotic Systems, 19, 499−509.
behavior is likely to be relevant to this enterprise (e.g., Salvucci, 2006). Lal, S., & Craig, A. (2001). A critical review of psychophysiology of driver fatigue. Biological
Psychology, 55, 173−194.
Land, M., & Horwood, J. (1995). Which parts of the road guide steering. Nature, 377, 339−340.
LeBlanc, D. J., Sayer, J., Winkler, C., Ervin, R., Bogard, S., Devonshire, J., et al. (2006). Road
Acknowledgements
departure crash warning system field operational test: methodology and results. Ann
Arbor, MI: University of Michigan Transportation Research Institute.
This research was funded through our participation in the Cooperative Lenné, M. G., Triggs, T. J., & Redman, J. R. (1997). Time of day variations in driving performance.
Accident Analysis and Prevention, 29, 431−437.
Research Center for Advanced Automotive Technology (AutoCRC). The
Lenné, M. G., Triggs, T. J., & Redman, J. R. (1998). Interactive effects of sleep deprivation,
views expressed in this article are those of the authors, and do not time of day, and driving experience. Sleep, 21, 38−44.
necessarily represent the views of the AutoCRC. We would like to thank MacLean, A. W., Davies, D. R. T., & Thiele, K. (2003). The hazards and prevention of driving
Karen Stephan for helpful discussions and comments. while sleepy. Sleep Medicine Reviews, 7, 507−521.
Moller, H. J., Kayumov, L., Bulmash, E. L., Nhan, J., & Shapiro, C. M. (2006). Simulator
performance, microsleep episodes, and subjective sleepiness: Normative data using
convergent methodologies to assess driver drowsiness. Journal of Psychosomatic
References Research, 61, 335−342.
NCSDR/NHTSA Expert Panel on Driver Fatigue and Sleepiness. (1998). Drowsy driving
Akerstedt, T., Peters, B., Anund, A., & Kecklund, G. (2005). Impaired alertness and and automobile crashes. DOT HS 808 707, USA. Washington, DC: Author.
performance driving home from the night shift: a driving simulator study. Journal of Otmani, S., Pebayle, T., Roge, J., & Muzet, A. (2005). Effect of driving duration and partial
Sleep Research, 14, 17−20. sleep deprivation on subsequent alertness and performance of car drivers. Physiology
Arnedt, J. T., Wilde, G. J. S., Munt, P. W., & Maclean, A. W. (2000). Simulated driving & Behavior, 84, 715−724.
performance following prolonged wakefulness and alcohol consumption: separate Peters, R. D., Wagner, E. K., Alicandri, E., & Fox, J. E. (1999). Effects of partial and total sleep
and combined contributions to impairment. Journal of Sleep Research, 9, 233−241. deprivation. Public Roads, 62, 2−6.
Arnedt, J. T., Wilde, G. J. S., Munt, P. W., & MacLean, A. W. (2001). How do prolonged Philip, P., Sagaspe, P., Moore, N., Taillard, J., Charles, A., Guilleminault, C., et al. (2005a). Fatigue,
wakefulness and alcohol compare in the decrements they produce on a simulated sleep restriction and driving performance. Accident Analysis and Prevention, 37, 473−478.
driving task? Accident Analysis and Prevention, 33, 337−344. Philip, P., Sagaspe, P., Taillard, J., Valtat, C., Moore, N., Akerstedt, T., et al. (2005b).
Brookhuis, K. A., De Waard, D., & Fairclough, S. H. (2003). Criteria for driver impairment. Fatigue, sleepiness, and performance in simulated versus real driving conditions.
Ergonomics, 46, 433−445. Sleep, 28, 1511−1516.
Brown, I. D. (1997). Prospects for technological countermeasures against driver fatigue. Pilutti, T., & Ulsoy, A. G. (1999). Identification of driver state for lane-keeping tasks. IEEE
Accident Analysis and Prevention, 29, 525−531. Transactions on Systems Man and Cybernetics Part A, 29, 486−502.
Desai, A. V., & Haque, M. A. (2006). Vigilance monitoring for operator safety: A simulation Reyner, L. A., & Horne, J. A. (1998). Falling asleep whilst driving: are drivers aware of
study on highway driving. Journal of Safety Research, 37, 139−147. prior sleepiness? International Journal of Legal Medicine, 111, 120−123.
De Valck, E., & Cluydts, R. (2001). Slow-release caffeine as a countermeasure to driver Salvucci, D. D. (2006). Modeling driver behavior in a cognitive architecture. Human Factors, 48,
sleepiness induced by partial sleep deprivation. Journal of Sleep Research, 10, 203−209. 362−380.
Dinges, D. F., Maislin, G., Brewster, R. M., Krueger, G. P., & Carroll, R. J. (2005). Pilot test of Sayed, R., & Eskandarian, A. (2001). Unobtrusive drowsiness detection by neural network
fatigue management technologies. Transportation Research Record, 1922, 175−182. learning of driver steering. Proceedings of the Institution of Mechanical Engineers, Part D,
Fairclough, S. H., & Graham, R. (1999). Impairment of driving performance caused by 215, 969−975.
sleep deprivation or alcohol: A comparative study. Human Factors, 41, 118−128. Stephan, K., Hosking, S., Regan, M., Verdoorn, A., Young, K., & Haworth, N. (2006). The
Godley, S. T., Triggs, T. J., & Fildes, B. N. (2002). Driving simulator validation for speed relationship between driving performance and the Johns drowsiness scale as measured
research. Accident Analysis and Prevention, 34, 589−600. by the Optalert system. Monash University Accident Research Center, Report No 252.
Hack, M. A., Choi, S. J., Vijayapalan, P., Davies, R. J. O., & Stradling, J. R. (2001). Comparison of the Downloaded from www.monash.edu.au/muarc/reports/muarc252.pdf
effects of sleep deprivation, alcohol and obstructive sleep apnoea (OSA) on simulated Thiffault, P., & Bergeron, J. (2003). Monotony of road environment and driver fatigue: a
steering performance. Respiratory Medicine, 95, 594−601. simulator study. Accident Analysis and Prevention, 35, 381−391.
Horne, J. A., & Reyner, L. A. (1995). Sleep related vehicle accidents. British Medical Journal, 310, Wierwille, W. W., & Ellsworth, L. A. (1994). Evaluation of driver drowsiness by trained
565−567. observers. Accident Analysis and Prevention, 26, 571−581.
Horne, J. A., & Reyner, L. A. (1996). Counteracting driver sleepiness: Effects of napping, Wright, N.A., Stone, B.M., Horberry, T.J., & Reed, N. (2007). A review of in-vehicle sleepiness
caffeine, and placebo. Psychophysiology, 33, 306−309. detection devices. TRL Limited.
Ingre, M., Akerstedt, T., Peters, B., Anund, A., & Kecklund, G. (2006a). Subjective sleepiness,
simulated driving performance and blink duration: examining individual differences.
Journal of Sleep Research, 15, 47−53. Charles Liu, PhD, is a Research Fellow at the Accident Research Centre, Monash University,
Ingre, M., Akerstedt, T., Peters, B., Anund, A., Kecklund, G., & Pickles, A. (2006b). Subjective in Melbourne. He is currently involved in a number of projects relating to human factors
sleepiness and accident risk avoiding the ecological fallacy. Journal of Sleep Research, 15, and road-traffic safety.
142−148.
Johns, M. W., Tucker, A., Chapman, R., Crowley, K., & Michael, N. (2007). Monitoring eye Simon Hosking, PhD, is a research scientist in the Air Operations Division of the Defence
and eyelid movements by infrared reflectance oculography to measure drowsiness Science and Technology Organisation, Australia. His research interests are in visual
in drivers. Somnologie, 11, 234−242. perception and human performance, coordination and control of behavior, and human
Kecklund, G., Akerstedt, T., Sandberg, D., Wahde, M., Dukic, T., Anund, A., et al. (2006). State performance modeling.
of the art review of driver sleepiness. Volvo.
Kircher, A., Uddman, M., & Sandin, J. (2002). Vehicle control and drowsiness. Swedish
National Road and Transport Research Institute. Michael Lenné, PhD, is Team Leader (Human Factors) at the Accident Research Centre,
Klauer, S. G., Dingus, T. A., Neale, V. L., Sudweeks, J. D., & Ramsey, D. J. (2006). The impact of Monash University. His research interests focus around how technology can be used to
driver inattention on near crash/crash risk: An analysis using the 100-car naturalistic improve safety and understanding routes to failure in transportation systems.

You might also like