Professional Documents
Culture Documents
Talent Development
&
Excellence
Articles will be submitted for abstracting and indexing in Academic Search; Australian
Education Index (AEI); British Education Index; Contents Pages in Education; EBSCO
Online; EBSCO CD Rom Database; Education Journal; Educational Research Abstracts
online (ERA); ERIC; e-psyche; ERIH (European Reference Index for the Humanities,
Pedagogical and Educational Research); Gifted and Talented Abstracts; IBR (International
Bibliography of Book Reviews of Scholarly Literature on the Humanities and Social
Sciences); IBZ (International Bibliography of Periodical Literature on the Humanities and
Social Sciences); ISI Social and Behavioural Sciences; National Database for Research into
International Education (NDRI); psycINFO; PsychLit; Psychological Abstracts; Research
into Higher Education Abstracts and Social Science Citation Index.
Editors-in-Chief:
Albert Ziegler, University of Ulm, Germany
Jiannong Shi, Academy of Sciences, Beijng, China
Editorial Assistant:
Bettina Harder, University of Ulm, Germany
Impressum:
V.i.S.d.P.: Albert Ziegler, St.Veit-Str. 25, 81673 München, Germany
Welcome note
Abdullah M. Aljughaiman
President
The International Research Association for Talent Development and
Excellence
Talent Development & Excellence
Volume 1 Number 1 2009
Contents
Editorial 1
A. Ziegler and J. Shi
Editorial
Launching a new scientific journal provokes the question of its raison d’être because of the
now insurmountable flood of publications. As we know, less than 20% of researchers
interested in a given field read more than even 1% of the newly appearing literature.
Nevertheless we believe for several reasons that ‘Talent Development and Excellence’ (TDE)
will play an important role, and in four ways.
As its title says, TDE shall first be a place of engagement for two important research currents
that have been up to now largely separated: Giftedness research and Expertise research. The
former researchers traditionally focus more on talented children, following the development
of their achievement prospectively, while the latter traditionally start above all with persons
who have already excelled, but of course with an interest in how their achievements
developed. We think it is important and desirable for future research to unite these two
branches.
Our second wish in connection with TDE is for interdisciplinary access and a simultaneous
broadening of traditional problems. Typically, talent development and excellence are
investigated by psychologists and pedagogues. By contrast we would like to invite
researchers in further disciplines – (educational) economists, jurists, sociologists, political
scientists, AI researchers, physiologists, neurologists, etc. – to shed light from each of their
specialist perspectives on the process of creativity and achievement development and their
antecedents up to the level of expertise and innovation together. Moreover we explicitly
exclude any limitation to individuals: Excellence can also be an attribute of a group of
persons or a social community, and, in the age of Artificial Intelligence, even the attribute of a
machine or machine network.
While on the one hand publications in modern knowledge societies are more and more
accessible, on the other the necessary expenses of libraries and universities have risen
hugely in the past years. Our third wish is therefore to make TDE freely available, and so the
journal can be read online at www.iratde.org. The print version is generously sponsored by
the King Faisal University in Al-Hassa.
Finally and fourthly, TDE is the official scholarly journal of the International Research
Association for Talent Development and Excellence (IRATDE). We hope that TDE can provide
IRATDE-associated researchers with a bit of intellectual community of their own.
Heiner Rindermann, Michael Sailer and James Thompson present a pioneering study on the
‘smart fraction’ theory. This says that the small share of high-achievers make an
overproportional contribution to societal growth and prosperity. Such a finding would of
course be the best legitimation for society’s support of talent and excellence. The authors
investigated whether there existed relations between the scores of 90 countries in
international educational studies (TIMSS 1995-2007, PISA 2000-2006 and PIRLS 2001-2006)
and a number of societal desiderata such as wealth (GDP), numbers of patents, scientists and
Nobel Prizes, government effectiveness, democracy, but also AIDS and homicides. In
particular they wanted to find out whether the scores of weaker achievers, average achievers,
or of the ‘smart fraction’ could better predict the factors mentioned. And in fact the authors
find clear indications of the prognostic strength of the smart fraction theory: “Our results
emphasize the importance of nurturing the highly gifted.” Could a new scientific journal start
off with any more convincing proof than this of the societal significance of its field of research?
Research areas are only as viable as their methods various. Shane N. Phillipson and Ron Sun
propose a new method for giftedness research, which also expertise research has until now
applied only sporadically: modeling. Their interest is particularly to examine potential
benefits of and problems in modeling the Actiotope Model of giftedness using the cognitive
architecture CLARION. We hope this innovative paper will help make giftedness researchers
ISSN 1869-0459 (print)/ ISSN 1869-2885 (online)
2009 International Research Association for Talent Development and Excellence
http://www.iratde.org
2 A. Ziegler & J. Shi
Albert Ziegler
Jiannong Shi
Talent Development & Excellence Smart fraction 3
Vol. 1, No. 1, 2009, 3-25
Abstract: Smart fraction theory supposes that gifted and talented persons are especially
relevant for societal development. Using results for the 95th percentile from TIMSS 1995-
2007, PISA 2000-2006 and PIRLS 2001-2006 we calculated an ability sum value (N=90
countries) for the upper level group (equivalent to a within country IQ-threshold of 125 or
a student assessment score of 667) and compared its influence with the mean ability and
the 5th percentile ability on wealth (GDP), patent rates, Nobel Prizes, numbers of scientists,
political variables (government effectiveness, democracy, rule of law, political liberty), HIV,
AIDS and homicide. Additionally, using information on school and professional education,
we estimated the cognitive competence of political leaders in N=90 countries. Results of
correlations, regression and path analyses generally show a larger impact of the smart
fractions’ ability on positively valued outcomes than of the mean result or the 5th percentile
fraction. The influence of the 5th percentile fraction on HIV, AIDS and homicide, however,
was stronger. The intelligence of politicians was less important, a longitudinal cross-
lagged analysis could show a positive influence on the cognitive development of nations.
Keywords:
high ability fraction, gifted portion, intelligence, patent rate, growth
A large amount of studies published in the last two decades has shown that cognitive ability
levels of societies are relevant for the development of positively valued aspects of peoples
and countries. Following an economic research tradition “human capital” is relevant for
economic growth and wealth (Hanushek & Kimko, 2000; Lynn & Vanhanen, 2002, 2006; Jones &
Schneider, 2006; Weede, 2006; Rindermann, 2008a). In addition, cognitive ability of nations has
a positive impact on political development, in that it helps building up democracy, the rule of
law and political liberty (Simpson, 1997; Rindermann, 2008b). Intelligence, knowledge and
the intelligent use of knowledge also have beneficial effects on health, for instance they act as
a brake on the spread of HIV (Oesterdiekhoff & Rindermann, 2007; Lakhanpal & Ram, 2008;
Rindermann & Meisenberg, 2009). Finally, cognitive competence is relevant for the
development of modernity as a societal and especially as a cultural phenomenon consisting of
education, autonomy, liberty, morality and rationality (Habermas, 1985/1981; Meisenberg,
2004; Oesterdiekhoff, 2008; Lynn, Harvey & Nyborg, 2009). Societies at a higher ability level
develop more complex, more evidence-based, more ethical and more rational world views.
For some scholars like Georg Oesterdiekhoff (2000) or Michael Hart (2007) intelligence is the
driving force of history.
These broad effects at the cross-national data level are backed in different societies by results
at the individual level for job performance and wealth (Bacharach & Baumeister, 1998; Schmidt
& Hunter, 2004; Irwing & Lynn, 2006; Rindermann & Thompson, 2009), for tolerance, civic
political attitudes and participation in elections (Herrnstein & Murray, 1994; Denny & Doyle,
2008; Deary, Batty & Gale, 2008), for health behavior and health (Goldman & Smith, 2002;
Gottfredson, 2004), moral judgment (Piaget, 1997/1932; Kohlberg, 1987) and more rational
world views (Oesterdiekhoff, 2000; Nyborg, 2009).
1
Institute of Psychology, Karl-Franzens-University Graz, Universitaetsplatz 2, A-8010 Graz,
Austria
∗
Corresponding author. Email: heiner.rindermann@uni-graz.at
2
Department of Psychology, University College London, UK
The mentioned positive and global effects of cognitive competences are also the reason why
international economic or educational organizations like OECD and UNESCO are conducting
studies on education and competence. But the terms used vary, ranging from “human capital”
by economists (also including personality factors relevant for productive behavior like self-
discipline; e.g. Becker, 1993/1964), “literacy” by educationists (OECD, 2003) and
psychometricians’ and cognitive developmentalists’ focus on the concept of “intelligence”
(Cattell, 1987/1971; Piaget, 2001/1947). The measurement of cognitive abilities in these
diverse research traditions is based on mental tasks that can be solved with thinking and
(within the different approaches) with varying amounts of specific knowledge. Students’
scores from all these different measurement approaches highly correlate at the individual
level (Jensen, 1998; Ceci, 1991) and very highly at the national level (Rindermann, 2007a).
Thus, the manifold of positive correlations among ostensibly dissimilar tests (e.g. verbal,
math, science, figural and Piagetian tasks, psychometric and student assessments) is taken as
an evidence that the same underlying latent factor is involved in all complex cognitive
performance (Ceci, 1991). Formal education (years of schooling or degrees) often is used as a
proxy or causal factor for cognitive ability. We use the term cognitive ability and cognitive
competence interchangeably. They stand for intelligence (thinking ability), the disposal of true
and important knowledge and the intelligent use of that knowledge.
In spite of various terms, research methods, disciplines and paradigms different researchers
came to the same result: Cognitive ability of individuals and societies is important for positive
outcomes. This causal assumption is especially backed by the use of longitudinal designs
controlling for the influence of other factors and of backward effects e.g. of wealth or
democracy (Rindermann, 2008a, 2008b). Of course, intelligence and knowledge are not the
only and single determinants of the positive attributes described. There are additional factors
behind (like education, culture and genes) and beneath (like neighbor effects, personality or
chance factors) cognitive ability and between cognitive ability and the positive outcomes
(like the quality of institutions or meritoric principles). There are positively valued attributes
which may not depend (positively) on cognitive competence (like happiness and mating
success). Therefore, high competence is no guarantee for positive outcomes. Finally,
intelligence not guided by ethics and rationality leads to biased, questionable and
destructive results.
A cognitive theory of action can explain the effect mechanism: An increased ability to
understand information, causal relationships, and consequences of somebody’s own and
others’ behavior in everyday life improves one’s own behavior and the behavior of important
others like parents, friends, classmates, teachers, officials, managers, scientists and political
leaders. Additionally, cognitive ability strengthens attitudes oriented towards a more ethical
lifestyle including perspective taking, considerateness and general pensiveness. But cognitive
ability is also connected – meaning leading to, depending on and relying on common
background factors – to better environments (nurturing, training and gate keeper effects) and
a greater appreciation of civic virtues and bourgeois values like appreciation of future life’s
quality, of security, of education, work and individualized love. Thinking ability forms an
integrated part of a global pattern oriented towards a rational, active, self-controlled and
farsighted lifestyle. They all create positive feedback loops: own intelligence and the
intelligence of others enhance environmental (the physical, social and cultural) quality and by
this again cognitive development.
the assumed relevance of gifted and talented persons the Scottish pioneer of intelligence
research, Godfrey H. Thomson (1881-1955), recommended the furthering of intelligent
children (similarly Gelade, 2008; Murray, 2008).
The smart fraction is regarded as responsible for progress in a utilitarian sense (wealth, health
and power), but also for achievements in a non-utilitarian sense (music, literature, art, religion,
ethics, philosophy and world-views).
For many this kind of thesis has an elitist taste. But it is first of all an empirical question, which
could be solved with a rigorous orientation towards scientific standards, based on
philosophically justified epistemic principles: Is it true, that smart fractions are more relevant
for important indicators of societal development like wealth and democracy or scientific and
technological progress? Up to now there is no research on this subject using empirical data.
Gelade (2008) has solely used an assumed ability level, he and the anonymous scholar La
Griffe du Lion (2004) have estimated smart fractions from the mean value. But the student
assessment studies (SAS) TIMSS, PISA and PIRLS give results for the 95th percentile
(comparable to an IQ of 125 or higher, mean around IQ 130) enabling us to directly test a
smart fraction theory. Conversely, SAS makes it possible to prove a “non-smart” fraction
theory (5th percentile, comparable to an IQ of 75 or lower, mean around IQ 70): If the cognitive
level of the lower groups is more relevant for outcomes standing for lower cognitive ability
(and at least partly explainable by this) like HIV and AIDS (Oesterdiekhoff & Rindermann,
2007; Lakhanpal & Ram, 2008; Rindermann & Meisenberg, 2009) or criminality (Thomson,
1937; Herrnstein & Murray, 1994; Ellis & Walsh, 2003; Cunha, Heckman, Lochner & Masterov,
2006).
A group in society especially important are statesmen (or rarely stateswomen). Simonton
(1984, 1985, 2006) has done several studies on the measurement of political leader’s cognitive
ability and its impact on political success. Apart from politically (and for the media)
interesting information (e.g. comparatively low cognitive ability of Bush junior, Simonton,
2006, or comparatively high cognitive ability of Obama, Murray, Cardoso & Mendes, 2008)
Simonton and others (Deary et al., 2007) were able to show that cognitive traits of political
leaders are important for their success. Political leadership is a cognitively demanding task
(Suedfeld, Guttieri & Tetlock, 2003, p. 255), so the influence of politicians’ intelligence and
knowledge on the development of societies (apart from their private success in being
reelected or continuing in power) would be expected.
The opponent hypothesis to the political leader thesis would be that it is not the attributes of
politicians that are important but the ones of peoples themselves (e.g. Chomsky, 2009).
Maybe there is no either-or: Both, the ability of peoples and their leaders are important.
Empirical data will show us.
Method
To reduce problems of poor data quality and to ensure that countries are represented in the
sample at all levels of cultural, social and economic development, an average score was
formed from different measures and measurement points to create one construct for each
country.
Cognitive abilities
Three cognitive competence measures were used: mean results in TIMS-, PISA and PIRL-
studies, mean at 5th percentile in TIMS-, PISA and PIRL-studies and mean at 95th percentile in
TIMS-, PISA and PIRL-studies. Sources were TIMSS 1995, 4th and 8th grade, math and science,
TIMSS 1999, 8th grade, math and science, TIMSS 2003, 4th and 8th grade, math and science,
TIMSS 2007, 4th and 8th grade, math and science; PISA (always around 15 year old students)
2000, 2003 and 2006, verbal, math and science literacy, 2003 also problem solving, PIRLS
verbal literacy in 4th grade 2001 and 2006. All results were originally presented in student
assessment scales (SAS M=500, SD=100).
6 H. Rindermann et al.
Resources had been for TIMSS 1995 (in the order of the grades and scales: Beaton, Mullis,
Martin, Gonzalez, Kelly & Smith, 1996; Beaton, Martin, Mullis, Gonzalez, Smith & Kelly, 1996;
Mullis, Martin, Beaton, Gonzalez, Kelly & Smith, 1997; Martin, Mullis, Beaton, Gonzalez, Smith &
Kelly, 1997), TIMSS 1999 (Mullis, Martin, Gonzalez, Gregory, Garden, O’Connor, Chrostowski &
Smith, 2000; Martin, Mullis, Gonzalez, Gregory, Smith, Chrostowski, Garden & O’Connor, 2000),
TIMSS 2003 (Mullis, Martin, Gonzalez & Chrostowski, 2004; Martin, Mullis, Gonzalez &
Chrostowski, 2004), TIMSS 2007 (Mullis, Martin & Foy, 2008; Martin, Mullis & Foy, 2008), PISA
2000 (OECD, 2003), PISA 2003 (OECD, 2004a, b), PISA 2006 (OECD, 2007a, 2007b), PIRLS 2001
(Mullis, Martin, Gonzales & Kennedy, 2003) and PIRLS 2006 (Mullis, Martin, Kennedy & Foy,
2007).
A sum value of different scales, grades/age groups, studies and study approaches (grade vs.
age level studies; studies trying to measure abilities defined by curriculum like TIMSS vs.
studies trying to measure abilities defined by cognitive demands in modernity like PISA) is
more convincing (say more representative, reliable and valid). High correlations between
scales within and across studies allow to sum up scales to a general sum value (all factor
loadings on an international G-factor were λ >.90; Rindermann, 2007a, 2007b).
To form a common score the results were at first averaged within one grade, year and study
between different scales (e.g. within TIMSS 1995, 4th grade, across math and science),
secondly within one year and study between different grades (e.g. within TIMSS 1995, across
4th and 8th grade), thirdly within one study between different years (e.g. within TIMSS, across
1995, 1999, 2003 and 2007), fourthly within different grade vs. age study approaches across
TIMSS and PIRLS (TIMSS and PIRLS are studies done in grades, PISA is a study done in a single
age group), fifthly and finally between different study approaches (across grade and age
approach studies: TIMSS-PIRLS-mean and PISA-mean). All averaging was done using z-
transformations calculating means and standard deviations in countries which participated in
all samples used for averaging (so z-formula are based on the same countries and over- or
underestimation is avoided). Subsequently the z-results were re-normed using means and
standard deviations obtained by simple arithmetical averaging of all three study results (SAS-
scale with M=500 and SD=100, mean, 5th percentile, 95th percentile) as an orientation. At the
end the values were transformed to the more usual IQ-scale, using Great Britain as reference
country, SAS-SD were simply transformed to an IQ-scale (“Greenwich-IQ”, M=100, SD=15).
Results are provided for N=90 countries. Means in SAS-scale are 453, 304 and 596, in UK-IQ-
scale 90, 68 and 111. The results are not identical with the formally published cognitive ability
values of Rindermann (2007a), because a) psychometric intelligence test results were not
used here (Lynn & Vanhanen, 2006, provided no information on the tails), b) older student
assessment studies like IEA-Reading and IAEP were not used (for IEA-Reading we could not
find information on the tails, IAEP 1991 only published percentages of solved tasks,
additionally samples were seriously biased), c) newer studies were included (PISA 2006,
PIRLS 2006, TIMSS 2007), and d) the results were not corrected for age and grade or sample
quality. Nevertheless the correlations are very high (with former corrected cognitive ability
sum r=.92, with uncorrected r=.95, N=88).
“Normed” values of all variables at international data level are somewhat arbitrary, e.g. the
student assessment scale with M=500 and SD=100. The norms are estimated by the authors of
the student assessment studies in orientation to results in OECD-countries (and sometimes in
accordance with older results). OECD-membership, however, is no scientific criterion. IQ-
norms depend on the secular rise of intelligence and intelligence test results (“Flynn-effect”).
Student assessment results are biased because only youth in school participated, in several
countries pupils had been too old (especially in older studies and in developing countries),
not all regions participated (especially in older studies and in developing countries) etc. (see
Rindermann, 2007a; Wuttke, 2007). We have not applied corrections here because results at
the higher (“smart”, “gifted”, “talented”) or lower (“non-smart”, “imprudent” or “dull”) levels
are differently affected by the distortions, presumably the high level results are nearly not
affected, but the low level results (and less the means). Corrections should be tried in further
Smart fraction 7
studies. But also in the other variables the norms are arbitrary, e.g. in GDP (inflation, Dollar or
Euro), in democracy (which scale?).
The competence levels of smart fractions, average and non-smart fractions are obtained
through student assessment studies. But students do not work, do not win Nobel Prizes nor do
they vote. We assume that the results of students could be generalized to adults, an
assumption that is backed by high correlations with IQ measures (r=.87, N=86, Lynn &
Vanhanen, 2006; often gained in adult samples), with an adult literacy study (r=.68, N=20;
OECD, 2000) and the educational level of societies (r=.67, N=84, r=.75, N=85; measures see
below). OECD is planning an adult literacy study for a larger country sample, by using their
data on tails it would be possible to prove if our results are stable.
Because in high ability societies there is a larger percentage of a cognitive elite at a higher
level (and inverted for the lower level) the three values are correlated (see also Table 2):
mean with high (r=.97), mean with low (r=.97), high with low (r=.90). As a consequence of
these high correlations suppressor effects are expectable in regression analyses.
For repeated measurements with cognitive abilities (Figure 5) old student assessment studies
collected by Lee and Barro (1997) were used (here N=17; for further information see
Rindermann, 2008b).
Henrique Cardoso from Brazil is an example (published several scientific books, professor of
political science, member of or taught at Institute of Advanced Study, Princeton, Collège de
France, Stanford, Brown, etc.). Both overlapping indicators correlate with r=.90 (Cronbach-
α=.95).
Finally we tried following Gottfredson (2004, 2005) to estimate IQ-levels: For no school IQ 80,
for primary school IQ 90, for secondary school IQ 100, for high-school diploma IQ 113, for
university degree 119, for doctorate 129 and for doctorate plus further scientific degree or
achievement 138. For levels in between and different vocational or qualified trainings we gave
values between 80 and 119. The mean of the two educational indicators and our IQ-estimate
correlate with r=.96, IQ with school education r=.99, with professional training r=.88 (N=896).
The mean IQ of politicians across countries is 118 (SD=7, N=90). The mean IQ is increasing
from 1960 to 2000: in the 60s IQ 114, in the 90s IQ 118, in 00s IQ 119 and the variances are
decreasing (from 12 to 7 and 7). Because we mainly include only countries participating also
in student assessment studies the worldwide average could be lower. The sample for analyses
was N=90 countries (for the map, Figure 2, N=95).
medicine and economics. Mean correlations between those are around r=.90 (α=.97, here for
N=87 countries).
Scientist rate: Scientists and engineers in research and development per million people, 1985-
1995 (source: Kurian, 2001, p. 388, here for N=51 countries).
High-technology exports: High-technology exports as percentage of manufacturing exports,
1997 (source: Kurian, 2001, p. 389-390, here for N=61 countries).
Political indicators
Government effectiveness: Government effectiveness 1996-2005 as “the quality of public
services, the quality of the civil service and the degree of its independence from political
pressures, the quality of policy formulation and implementation, and the credibility of the
government’s commitment to such policies” (Kaufmann, Kraay & Mastruzzi, 2006, p. 2). The
estimates are given here for N=88 countries.
Democracy: Democracy 1950-2004 and 1996-2000 from Vanhanen (2005) and Marshall and
Jaggers (2000), α=.95. The estimates are used for N=84 countries.
Rule of law: Rule of law 1970-2000 and 2000 with emphasis on ownership law from Gwartney
and Lawson (2003) and Knack and Keefer (1995), α=.90, here N=76 and 73.
Political freedom: Political liberty or freedom was taken from Freedom House (2004) for the
year 1999 (here N=86).
For further description of political indicators see Rindermann (2008b).
HIV data is sometimes doubted, especially for countries from Eastern Europe, for developing
countries, Muslim countries, and countries from sub-Saharan Africa.
We tried to solve or at least reduce these problems by aggregating data from different years
and by using different indicators for the very construct, e.g. patent rates, Nobel Prizes,
scientist rates and high-technology exports for cognitive excellence of a society (Figure 3).
Statistical methods
At first we calculated correlations between mean, non-smart and smart fraction competence
measures on the one hand and different societal attributes on the other. Higher correlations
for the non-smart or smart fraction indicate their larger relevance for these attributes.
Secondly we present regression analyses showing relative impact of smart fraction ability or
non-smart fraction ability compared to mean values. Finally we present results of cross-
sectional and longitudinal path-analyses. Because of suppressor-effects the smart and non-
smart fraction ability levels are not put together with mean ability in one regression analysis
(only either smart or non-smart and average).
Regression and path analyses are used to calculate direct, indirect and net effects of
variables. In these analyses the standardized path coefficients (β) between different variables
are to be interpreted. Correlations are always added in parentheses. Correlations help to
quickly estimate the influence of other variables in the model (difference between correlation
and path coefficient), they allow the model to be checked (Σrβ=R²=1-error) and the
proportion of the explained variance in each factor to be calculated (R²=Σrβ). “Good” values
for fit indices are SRMR≤.08 (Hu & Bentler, 1998, 1999) or SRMR≤.05 (Schermelleh-Engel,
Moosbrugger & Müller, 2003) and CFI≥.95 (Hu & Bentler, 1998, 1999) or CFI≥.97
(Schermelleh-Engel et al., 2003), and “acceptable” fit is reached with SRMR≤.10 and CFI≥.95
(Schermelleh-Engel et al., 2003). For the analyses, SPSS 16.0 and LISREL 8.80 were used, while
SAS 9.1 was used to produce the maps.
Significance tests were not used for interpretation (see Rindermann, 2008a; for an in-depth
justification e.g. Cohen, 1994; Falk & Greenbaum, 1995; Gigerenzer, 2004; Hunter, 1997).
Especially in comparisons between countries, they are not appropriate for scientific
reasoning. The results of significance tests depend on the number of observations. The
observations here are for a limited number of countries (around 90), but each country-level
observation is based on thousands of individual observations within each country. Possible
causal relationships are not more or less true if they are significant or not (see Rindermann &
Meisenberg, 2009; Rindermann & Ceci, 2009).
Results
Distributions
The results for the most important variables are shown in Table 1. Figures (Maps) 1 and 2
show the distributions of the smart fractions’ and political leaders’ ability levels across the
world. Because average, upper and lower levels are correlated there are at first sight no large
differences: The highest values for the smart fractions are found in East Asia (1. Singapore IQ
127, 2. South Korea IQ 125, 3. Japan IQ 124, 5. Taiwan IQ 123, 9. Hong Kong IQ 122). A similar
result was found in psychometric (average) intelligence or in student assessment studies (see
Rindermann, 2007a). Different from the SAS, Scandinavia reaches in the cognitive elite not
such a good rank (11. Finland IQ 121, 12. Estonia IQ 121 [the Baltics are added here], 16.
Sweden IQ 120, 25. Denmark IQ 118, 34. Latvia IQ 117, 38. Lithuania IQ 116, 39. Iceland IQ 116,
41. Norway IQ 116). Maybe a homogenizing educational policy furthering weaker but
disadvantaging high ability pupils leads to a smaller standard deviation and lower values for
a gifted subgroup. Better are the traditional Commonwealth countries (5. New Zealand IQ 123,
7. Australia IQ 122 and 8. United Kingdom with IQ 122). They are followed by Western and
Eastern European and North American countries, by South European countries, Arab or
Smart fraction 11
Muslim and Latin American countries and finally by sub-Saharan countries. The countries
with the lowest results are 84. Botswana (IQ 96), 85. Saudi-Arabia (IQ 95), 86. Morocco (IQ 95),
87. Kyrgyzstan (IQ 94), 88. Belize (IQ 90), 89. Ghana (IQ 89) and 90. Yemen (IQ 84). Presumably
many not participating countries would have lower values.
Figure 1. World map of cognitive ability level at 95th percentile (mean of TIMSS 1995-07, IGLU 2001-06,
PISA 2000-06, N=90 nations, darker means higher competence, hachured: no data)
Figure 2. World map of leading politicians‘ cognitive ability level 1960-2009, N=95 nations, darker
means higher competence)
12
Table 1. Means of used variables (most important ones)
Country CA- CA- CA- CA- CA- GDP HDI Patent Patent Nobel Nobel Nobel Scien- High Gov. Demo- Rule Politi- HIV
H. Rindermann et al.
mean 5% 95% politi- politi- 2003 2003 rate rate Peace Literat. Science tists techno- eff. cracy of law cal rate
cians cians 1960- 1991- 1901- 1901- 1901- 1985- logy 1996- 1950- 1970- liberty 2001-
60-09 90-09 2007 2007 2004 2004 2004 95 1997 2005 2004 2000 1999 2003
IQ-scale (M=100) ppp $ 0-1 per mill per 10 mill per mill “IQ”-scale (M=100) %
Albania 81.10 55.84 103.56 120.20 122.00 4584 .780 – – 0 0 0 – 1 92.6 90.0 96.3 92.8 0.05
Algeria 80.56 63.23 97.94 106.63 107.75 6107 .722 5.52 5.80 0 0 0 – 22 90.7 87.2 82.7 85.2 0.06
Argentina 81.50 54.72 105.79 117.83 120.67 12106 .863 51.35 21.25 0.79 0 0.30 671 15 100.4 103.8 95.2 108.0 0.61
Armenia 93.06 69.34 116.94 125.33 125.33 3671 .759 20.12 20.76 0 0 0 – – 93.9 107.3 – 96.6 0.12
Australia 101.12 79.06 121.94 115.55 116.75 29632 .955 252.81 320.48 0 0.77 0.77 3166 39 129.7 128.3 125.8 119.4 0.09
Austria 99.65 78.16 119.34 128.20 123.80 30094 .936 305.42 84.45 2.70 1.35 2.70 1631 24 127.4 129.9 127.7 119.4 0.21
Azerbaijan 84.62 73.01 98.84 119.00 119.00 3617 .729 2.81 2.81 0 0 0 – – 86.4 89.5 – 89.0 0.04
Bahrain 84.24 61.99 105.80 107.00 107.00 17479 .846 42.61 43.73 0 0 0 – – 108.7 83.8 103.6 77.6 0.17
Belgium 99.13 75.02 116.53 121.31 121.50 28335 .945 432.19 40.55 3.12 1.04 1.04 1814 23 125.9 132.9 128.5 115.6 0.18
Belize 63.55 40.93 89.95 119.00 119.00 6950 .753 16.00 28.00 0 0 0 – – 97.9 105.5 103.2 119.4 1.93
Bosnia 90.60 69.88 110.07 121.14 121.14 5967 .786 9.46 10.48 – – – – – 89.8 – – – –
Botswana 73.93 50.79 96.15 116.00 115.00 8714 .565 15.23 – 0 0 0 – – 111.3 104.6 110.1 111.8 33.99
Brazil 81.59 58.43 104.65 116.50 116.50 7790 .792 9.38 8.13 0 0 0 168 18 99.0 101.1 103.5 100.4 0.59
Bulgaria 93.46 67.92 117.22 115.92 124.00 7731 .808 45.19 22.78 0 0 0 – – 96.7 93.6 107.8 108.0 0.04
Canada 101.75 79.59 120.32 120.11 119.00 30677 .949 306.43 211.49 0.46 0 0.92 2656 25 130.9 123.1 127.0 119.4 0.27
Chile 83.62 60.95 105.97 122.75 124.00 10274 .854 18.70 12.33 0 2.02 0 – 19 119.6 101.4 93.6 111.8 0.27
Colombia 80.61 58.15 101.38 119.67 119.00 6702 .785 5.88 4.91 0 0.44 0 – 20 98.3 104.3 87.7 96.6 0.51
Croatia 95.96 77.23 115.06 119.67 119.67 11080 .841 20.67 20.82 0 0 0 1978 19 103.1 104.8 107.5 96.6 0.04
Cyprus 91.59 68.65 112.63 122.33 124.00 18776 .891 54.36 59.70 0 0 0 – – 118.0 119.6 100.8 119.4 0.03
Czech Republic 99.96 78.92 119.96 118.25 120.78 16357 .874 67.35 70.75 0 0.97 0.24 1159 13 111.4 102.8 104.7 115.6 0.05
Denmark 98.46 76.86 118.17 115.00 119.00 31465 .941 181.40 67.90 2.03 6.09 3.55 2647 27 132.1 133.0 128.0 119.4 0.17
Egypt 81.14 53.73 107.28 90.00 90.00 3950 .659 3.26 3.23 0.28 0.28 0.07 458 7 97.4 85.6 91.1 85.2 0.04
El Salvador 77.53 59.36 96.19 118.42 120.00 4781 .722 5.45 3.94 0 0 0 19 16 95.6 96.4 84.1 108.0 0.59
Estonia 102.26 84.40 120.75 120.11 120.11 13539 .853 86.90 107.30 0 0 0 2018 24 113.0 116.7 107.4 115.6 0.84
Finland 102.91 84.96 120.92 120.24 119.00 27619 .941 174.86 197.50 0 2.14 0.54 2812 26 131.7 127.3 119.7 119.4 0.08
France 98.17 77.01 117.77 119.67 119.00 27677 .938 219.04 102.56 1.56 2.74 1.17 2584 31 124.7 122.5 114.2 115.6 0.33
Georgia 87.62 66.16 107.50 123.00 123.00 2588 .732 28.04 26.38 0 0 0 – – 90.5 107.3 – 100.4 0.05
Germany 99.08 75.71 119.72 123.25 125.67 27756 .930 118.02 101.35 0.83 1.17 2.50 2843 26 126.4 128.8 131.0 115.6 0.09
Ghana 61.25 32.86 89.38 118.60 122.33 2238 .520 1.23 0.30 0 0 0 – – 98.2 89.7 84.9 104.2 2.73
Greece 94.37 71.45 115.46 123.07 126.50 19954 .912 87.48 54.56 0 2.21 0 774 12 112.4 117.1 102.6 111.8 0.17
Hong Kong 103.66 83.32 121.54 119.00 119.00 27179 .916 155.19 231.93 0 0 0 98 29 123.3 – 117.7 96.6 0.09
Hungary 99.37 78.07 119.77 119.77 125.00 14584 .862 84.62 64.53 0 .99 0.74 1033 39 111.2 95.9 105.9 115.6 0.05
Iceland 96.45 75.34 116.00 120.08 119.00 31243 .956 73.66 115.52 0 47.66 0 – – 131.3 132.2 122.9 119.4 0.19
Indonesia 81.75 62.00 100.93 119.33 117.40 3361 .697 0.85 0.85 0 0 0 – 20 93.9 89.1 91.0 96.6 0.09
Iran 82.83 60.64 104.46 115.38 119.00 6995 .736 4.66 2.41 0.32 0 0 521 – 93.4 86.4 86.7 81.4 0.09
Table 1. (continued)
Country CA- CA- CA- CA- CA- GDP HDI Patent Patent Nobel Nobel Nobel Scien- High Gov. Demo- Rule Politi- HIV
mean 5% 95% politi- politi- 2003 2003 rate rate Peace Literat. Science tists techno- eff. cracy of law cal rate
cians cians 1960- 1991- 1901- 1901- 1901- 1985- logy 1996- 1950- 1970- liberty 2001-
60-09 90-09 2007 2007 2004 2004 2004 95 1997 2005 2004 2000 1999 2003
IQ-scale (M=100) ppp $ 0-1 per mill per 10 mill per mill “IQ”-scale (M=100) %
Ireland 99.92 78.55 119.95 117.75 117.80 37738 .946 133.03 101.43 3.19 9.58 0.80 1871 62 126.1 124.7 128.4 119.4 0.09
Israel 92.57 64.65 117.52 117.00 118.25 20033 .915 147.58 170.02 6.24 3.12 0.78 – 33 117.1 126.8 117.5 115.6 0.08
Italy 96.57 74.09 117.45 125.22 123.00 27119 .934 201.68 53.02 0.18 1.11 0.32 1325 15 113.1 133.4 106.9 115.6 0.41
Japan 104.55 82.85 124.30 117.25 119.00 27967 .943 284.74 501.64 0.09 0.19 0.19 6309 38 118.0 122.4 127.1 115.6 0.04
Jordan 86.08 61.37 108.47 113.35 113.91 4320 .753 6.08 3.93 4.03 0 0 106 26 104.3 85.9 94.9 96.6 0.04
Kazakhstan 101.93 79.52 122.11 113.00 113.00 6671 .761 43.78 43.95 0 0 0 – – 88.1 89.8 102.2 85.2 0.13
Korea (South) 106.37 86.11 125.25 118.11 119.80 17971 .901 0.27 0.34 0.30 0 0 2636 39 112.4 103.1 104.5 111.8 0.04
Kuwait 75.72 53.10 97.77 105.00 105.00 18047 .844 – – 0 0 0 – 4 103.4 84.0 91.5 92.8 0.10
Kyrgyzstan 69.93 45.78 93.36 119.00 119.00 1751 .702 10.25 9.50 0 0 0 703 24 89.7 91.9 – 89.0 0.06
Latvia 97.47 77.07 116.96 121.73 121.73 10270 .836 66.28 48.82 0 0 0 1189 15 106.7 121.1 104.9 115.6 0.46
Lebanon 83.61 61.50 105.99 119.22 119.00 5074 .759 30.77 – 0 0 0 – – 96.2 100.6 101.2 85.2 0.09
Liechtenstein 100.93 78.79 121.21 123.00 123.00 – – – – 0 0 0 – – 124.3 – – 119.4 –
Lithuania 96.96 76.70 116.41 123.00 123.00 11702 .852 26.44 20.50 0 0 0 – 21 107.8 124.9 104.0 115.6 0.09
Luxembourg 98.31 76.19 118.84 127.00 124.00 62298 .949 1489.94 87.96 0 0 0 – – 131.9 130.2 126.3 119.4 0.18
Macau 101.11 84.43 117.94 119.00 119.00 – – 13.82 19.30 0 0 0 – – 117.5 – – – –
Macedonia 84.58 60.08 107.12 122.33 122.33 6794 .797 21.82 21.19 0 0 0 – – 95.0 110.0 – 104.2 0.04
Malaysia 95.54 74.74 115.92 119.67 122.33 9512 .796 24.94 46.22 0 0 0 87 67 113.2 104.8 104.3 89.0 0.35
Malta 92.41 63.40 116.70 126.14 129.00 17633 .867 70.59 249.93 0 0 0 – – 111.7 127.1 100.0 119.4 0.13
Mexico 85.37 64.97 105.47 121.22 124.00 9168 .814 20.83 32.43 0.17 0.17 0.04 213 33 101.7 92.4 92.5 100.4 0.26
Moldova 92.29 70.06 112.71 120.43 120.43 1510 .671 26.39 27.86 0 0 0 1539 9 88.6 108.2 – 104.2 0.18
Montenegro 84.22 63.95 104.36 119.00 119.00 – – – – – – – – – – – – – –
Morocco 71.02 47.48 95.36 118.65 123.86 4004 .631 6.88 9.10 0 0 0 – 27 99.5 85.1 96.1 92.8 0.08
Netherlands 101.89 82.74 119.96 124.82 122.33 29371 .943 94.30 74.07 0.76 0 2.28 2656 44 133.5 132.7 129.6 119.4 0.18
New Zealand 100.11 75.94 122.65 114.40 116.00 22582 .933 432.51 556.67 0 0 .87 1778 11 131.0 126.9 127.2 119.4 0.09
Norway 95.80 73.73 115.83 112.47 120.67 37670 .963 264.38 260.45 5.12 7.68 2.56 3678 24 130.7 129.6 126.6 119.4 0.09
Oman 80.64 55.43 104.12 114.00 113.00 13584 .781 – – 0 0 0 – – 111.3 83.7 108.4 81.4 0.09
Palestine 79.96 52.23 106.04 122.33 122.33 – .729 – – – – – – – – – – – –
Peru 74.03 49.77 97.00 118.27 121.50 5260 .762 7.17 7.53 0 0 0 625 10 95.3 99.3 80.1 92.8 0.40
Philippines 73.55 46.61 101.02 121.57 118.50 4321 .758 5.98 7.08 0 0 0 157 56 100.2 102.6 95.3 108.0 0.07
Poland 96.95 74.99 117.89 121.31 121.53 11379 .858 45.51 32.25 0.52 1.04 0 1299 12 109.7 93.1 97.8 115.6 0.08
Smart fraction
Portugal 92.12 70.89 112.14 121.53 121.00 18126 .904 62.28 20.47 0 1.07 0.27 1185 11 117.6 105.4 105.1 119.4 0.38
Qatar 72.11 49.37 96.20 97.67 101.50 19844 .849 – – 0 0 0 – – 109.9 83.7 – 81.4 –
Romania 89.00 65.77 110.77 117.00 123.77 7277 .792 39.63 24.90 0 0 0 1382 7 94.1 92.7 95.2 111.8 0.05
Russia 97.27 75.66 118.09 116.18 124.00 9230 .795 137.30 70.60 0.10 0.21 0.13 3520 19 92.1 95.2 87.5 92.8 0.82
Saudi Arabia 74.40 53.11 95.40 90.00 90.00 13226 .772 3.24 4.21 0 0 0 – 29 97.0 83.7 107.5 73.8 0.05
13
14
Table 1. (continued)
Country CA- CA- CA- CA- CA- GDP HDI Patent Patent Nobel Nobel Nobel Scien- High Gov. Demo- Rule Politi- HIV
mean 5% 95% politi- politi- 2003 2003 rate rate Peace Literat. Science tists techno- eff. cracy of law cal rate
cians cians 1960- 1991- 1901- 1901- 1901- 1985- logy 1996- 1950- 1970- liberty 2001-
H. Rindermann et al.
60-09 90-09 2007 2007 2004 2004 2004 95 1997 2005 2004 2000 1999 2003
IQ-scale (M=100) ppp $ 0-1 per mill per 10 mill per mill “IQ”-scale (M=100) %
Singapore 104.56 78.86 127.22 119.00 119.00 24481 .907 433.42 910.35 0 0 0 2728 71 135.7 95.4 125.8 89.0 0.18
Slovakia 97.59 75.61 117.83 125.67 125.67 13494 .849 327.11 58.58 0 0 0 1821 15 107.2 124.7 108.7 111.8 0.04
Slovenia 98.57 78.13 118.27 121.00 121.00 19150 .904 87.20 78.02 0 0 0 2544 16 112.9 127.4 113.0 115.6 0.05
South Africa 63.26 35.69 100.06 114.17 110.40 10346 .658 115.57 – 1.24 0.83 0.10 938 – 108.8 103.7 116.7 115.6 18.64
Spain 95.65 75.36 115.19 122.43 119.00 22391 .928 98.04 25.06 0 1.44 0.07 1210 17 124.9 106.4 114.0 115.6 0.53
Sweden 100.14 79.21 119.98 117.73 116.60 26750 .949 327.75 125.43 4.99 7.48 4.99 3714 34 130.1 129.9 121.1 119.4 0.09
Switzerland 99.83 77.25 120.07 122.33 119.00 30552 .947 559.78 72.71 4.93 3.28 6.16 – 28 135.3 130.0 134.9 119.4 0.37
Syria 80.57 64.91 104.84 120.71 121.00 3576 .721 4.56 – 0 0 0 – 1 85.8 86.0 83.7 73.8 0.04
Taiwan. RoCh 102.93 80.92 122.57 121.33 125.67 – – – – 0 0 0 – – 118.9 91.6 116.0 111.8 –
Thailand 90.11 71.12 109.99 117.12 118.11 7595 .778 3.37 5.45 0 0 0 119 43 104.9 93.7 104.5 108.0 1.07
Trinidad/Tobago 84.55 57.61 110.05 121.50 122.33 10766 .801 46.10 26.89 0 10.03 0 – – 107.3 113.9 102.4 115.6 2.17
Tunisia 80.81 60.33 100.63 109.50 100.00 7161 .753 10.57 7.85 0 0 0 388 11 109.9 84.7 97.8 85.2 0.04
Turkey 87.06 65.69 110.17 120.30 124.00 6772 .750 5.25 8.27 0 0 0 261 9 100.1 112.1 96.1 92.8 0.05
Ukraine 92.99 70.91 113.33 124.00 124.00 5491 .766 51.74 63.53 0 0 0 3173 – 89.3 118.6 89.9 100.4 0.68
United A. Emirates 91.91 67.76 115.05 92.50 91.67 22420 .849 – – 0 0 0 – – 110.3 84.3 91.5 85.2 –
United Kingdom 100.00 76.14 121.92 115.10 116.00 27147 .939 239.84 72.43 1.63 1.45 3.08 2417 41 131.6 126.7 126.6 115.6 0.13
United States 98.41 74.90 120.30 119.36 121.50 37562 .944 168.81 272.74 0.90 0.48 2.03 3732 44 127.3 124.4 134.1 119.4 0.40
Uruguay 87.99 61.08 112.19 118.87 124.00 8280 .840 27.96 13.48 0 0 0 688 8 108.7 115.1 102.4 115.6 0.20
Yemen 63.52 43.27 84.10 100.00 100.00 889 .489 0.28 – 0 0 0 – 0 88.4 85.4 – 85.2 0.09
Yugoslavia/Serbia 90.20 67.81 111.03 117.58 122.27 – – 30.04 10.74 0 0.48 0 – – 91.1 88.9 – 89.0 0.11
89.83 67.53 111.21
M 117.72 118.51 15331 .824 113.11 83.24 0.53 1.37 0.45 1667 24.08 109.4 106.9 107.0 105.0 0.91
(453) (304) (596)
10.95 12.00 9.54
SD 7.14 7.50 11399 .104 197.59 141.55 1.31 5.40 1.10 1301 15.46 14.4 16.6 14.5 13.8 4.24
(73) (80) (64)
Note: As country names the normally used names; all standardized and unstandardized scales are somewhat arbitrary (e.g. GDP and inflation, IQ and reference
groups); CA-mean: cognitive ability mean normed according to UK (“Greenwich-norm”) M=100, as SD used students assessment results (SD=100) transformed into
IQ-scale (SD=15), means calculated across countries, for student assessment results are also reported original mean in SAS-scale (M=500, SD=100); CA-5%:
cognitive ability mean at 5th percentile; CA-95%: cognitive ability mean at 95th percentile; CA-politicians 60-09: estimated cognitive ability of leading politicians
(1960-2009) of a country according to their formal education; CA-politicians 90-09: estimated cognitive ability of leading politicians (1990-2009); GDP 2003: GDP per
capita in purchasing power parity (ppp) US Dollars; HDI 2003: Human Development Index 2003, scale 0 (low) to 1 (high); Patent rate 1960-2007: average annual
patents per 1 million people 1960-2007; Patent rate 1991-2007: average annual patents per 1 million people 1991-2007; Nobel Peace, Literature and Science 1901-
2004: sum of Nobel Prizes in Peace, Literature and Science per 10 million people 1901-2004; Scientists 1985-95: scientists and engineers in research and
development per million people, 1985-1995; High technology 1997: high-technology exports as percentage of manufacturing exports, 1997; Gov. eff. 1996-2005,
Democracy 1950-2004, Rule of law 1970-2000 and Political liberty 1999: government effectiveness 1996-2005, democracy value across 1950-2004, rule of law value
across 1970-2000 and political liberty in 1999 in IQ-scale with M=100 and SD=15 (in world samples, here positively selected by having data in student assessment
results); HIV rate 2001-2003: HIV rate 2001-2003 of adults in percent.
Smart fraction 15
Some astonishing results are observable like the high level of Kazakhstan (6., IQ 122) and the
comparatively low for Israel (31., IQ 118, mean 93). For Kazakhstan we have only results from
TIMSS 2007 (4th grade); Mullis et al. (2008, p. 34) describe sample anomalies, a correction
would be necessary. Israel has participated in several studies, compared to older studies and
Jews in the Western World the results are deteriorating (e.g. Lynn & Longley, 2006). Most
probably multiple reasons are responsible and not only the 20% fraction of Arabs (a thorough
analysis would be necessary).
There are also characteristic differences between mean, upper and lower levels. For instance
between Canada and USA there is no difference in the upper level (IQ 120 and 120), but in the
lower level (IQ 80 and 75). The past history of slavery and a different immigration policy (or
different success of migration policies and geographical distance to societies with lower
mean abilities) may be reflected into this difference. A similar pattern could be found for
Finland and Germany: The difference in the upper level is only 1.20 IQ-points (IQ 121 and
120), but at the lower level 9.60 IQ-points (IQ 85 and 76). Most likely different immigration
histories are reflected here, furthermore differences in educational policy (age of tracking, in
Germany between age 10 and 12, in Finland at age 16). Early tracking increases ability
variance. Using regression analysis (as predictors mean and lower level) the largest residual
(standing for difference between upper level and the rest) is found in South Africa (with its
heterogeneous population of European, Asian and African descent), inverted the largest
residual (standing for difference between lower level and the rest) is found in Belgium
(probably a result of immigration and educational policy).
The highest cognitive ability values (measured by education and educational degrees) of
leading politicians are found in 1. Austria (IQ 128), 2. Luxembourg (IQ 127) and 3. Malta (IQ
126), the lowest in Arab countries: 82. Tunisia (IQ 110), 83. Bahrain (IQ 107), 84. Algeria (IQ
107), 85. Kuwait (IQ 105), 86. Yemen (IQ 100), 87. Qatar (IQ 98), 88. Emirates (IQ 93), 89. Egypt
(IQ 90) and 90. Saudi-Arabia (IQ 90). In all these countries the leaders are not elected by their
population. Austria has the highest statesman cognitive ability level because up to the early
70s it was common (and almost universal) to complete studies with a doctorate (as it is still the
case with medicine in Germany and Austria).
Cross-sectional analyses
The upper and lower levels are highly correlated with the means (r=.97), among each other
with r=.90 (see Table 2). The correlation of the 95th percentile with cognitive ability of political
leaders is slightly higher (r=.364 and .365) than of the average competence values (r=.361
and .354) or of the 5th percentile (r=.345 and .324), indicating that the politicians’ ability
depend more on the smart fraction value. Political leaders most likely stem from this fraction
(and considering the complexity of political tasks this is a reasonable result; s. Suedfeld et al.,
2003). A regression analysis (criterion: IQ of politicians) increases this pattern (for politicians
1960-2009, average ability βaA→PIQ=.13, β95%→PIQ=.24; for politicians 1990-2009, same time
ability measures βaA→PIQ=.00, β95%→PIQ=.37, N=90).
H. Rindermann et al.
2007 2007 2004 2004 2004 95 1997 2005 2004 2000 2000 1999 2003
CA-mean (average) .61 .79 .40 .45 .21 .13 .34 .61 .38 .61 .60 .62 .62 .59 .49 -.30 -.21
CA-5% .56 .74 .35 .37 .15 .13 .31 .57 .35 .55 .55 .55 .56 .53 .42 -.31 -.24
CA-95% .61 .78 .42 .50 .23 .13 .34 .64 .40 .63 .62 .65 .66 .63 .53 -.24 -.20
CA-politicians 60-09 .13 .27 .22 .03 .02 .06 .10 .10 .15 .19 .52 .58 .22 .12 .55 -.05 .08
CA-politicians 90-09 .08 .25 .13 .04 .01 .04 .07 .16 .12 .12 .45 .57 .13 .02 .52 -.10 .05
N 84 85 81 76 87 87 87 51 61 88 84 84 76 73 86 82 83
Note: See Table 1; AIDS 1995-2000: percentage of people suffering on AIDS 1995-2000.
Table 4: Regression analyses, predictors: cognitive ability indicators, criteria: indicators of the development of societies
GDP HDI Patent Patent Nobel Nobel Nobel Scien- High Gov. Demo Demo- Rule Rule Politi- HIV AIDS
2003 2003 rate rate Peace Literat. Science tists techno- eff. cracy cracy of law of law cal rate 1995-
1960- 1991- 1901- 1901- 1901- 1985- logy 1996- 1950- 1996- 1970- 2000 liberty 2001- 2000
2007 2007 2004 2004 2004 95 1997 2005 2004 2000 2000 1999 2003
CA-mean (average) .22 .47 -.13 (-.75) -.35 .09 .13 -.12 -.29 -.12 .02 -.13 -.30 -.35 -.41 .03 .15
CA-5% -.34 -.36
CA-95% .40 .33 .55 (1.23) .57 .04 .22 .76 .68 .75 .59 .77 .95 .97 .93
N 84 85 81 76 87 87 87 51 61 88 84 84 76 73 86 82 83
The smart fraction (or gifted or high ability fraction) is not only more relevant than the average
cognitive ability level or the non-smart fraction’s level for the cognitive competence levels of
politicians, but also for wealth (GDP; see Tables 3 and 4). For the general human development
level of a society, the 95th is less important than the average, but more than the 5th level.
Even stronger are the effects on all indicators of high intellectual achievement from patent
rates, over Nobel Prizes to the rates of scientists and high technology exports. Only for Nobel
Prizes in Literature the impact is lower, presumably because of the low reliability and validity
of this judgement process (if it should rate literature quality) and because of political
considerations in giving this award (sometimes it seems to be an award given to nations not
receiving science Nobel Prizes, aiming at equal distribution across different cultures and
continents).
Also impressive is the high impact of the smart fraction (exactly: variance in indicators
between different countries statistically explained by differences in cognitive levels of the
95th percentile groups) on all political variables: on government effectiveness, democracy, rule
of law and political liberty. The political development of nations seems to depend heavily on
the cognitive ability of their smart fraction.
On the other hand the development in indicators standing for undesired outcomes (HIV and
AIDS) depends on the cognitive level of the lower fraction. This is a strong support for all
studies demonstrating that health and especially HIV depends on cognitive ability, leading to
more or less risky behavior resulting in the long run in health or death (e.g. Goldman & Smith,
2002; Gottfredson, 2004; Rindermann & Meisenberg, 2009). Additionally, the opposite effects
of the high ability fraction on intellectual outcomes and of the low ability fraction and their
abilities on anti-intellectual outcomes strongly support the theoretical framework: Cognitive
ability specifically matters through a cognitive effect mechanism. Finally, similar results for
crime (homicide) substantiate the pattern: Homicide is higher (negatively) correlated with
the ability level of the 5th percentile than with the average or even with the ability of the 95th
percentile (5th r=-.34, average r=-.33, 95th r=-.23; N=80). The regression analysis strengthens
the result: β5%→Hi=-.35, βaA→Hi=-.01, N=80). Because of this opposite effect pattern an objection,
that the results are a consequence of different reliability (high for 95th percentile ability, mean
for the average value, low for 5th percentile), could be ruled out.
The results for political leaders and their ability levels across the countries are less impressive:
Correlations are always low except for democracy and political freedom. For both variables
political leaders’ competence could explain the variance beneath the general educational
level of society (democracy: βEdu→Dem=.54, βPIQ→Dem=.27, N=83; political freedom: βEdu→PoF=.47,
βPIQ→PoF=.32, N=84).
.44 .12
Figure 3. Standardized path coefficients (and correlations in parentheses) between cognitive ability of
nations, high intellectual achievement and wealth (error term as unexplained variance), N=48 nations
18 H. Rindermann et al.
For a path analysis four indicators of intellectual excellence in STEM subjects were used
(patent rate, Nobel Prizes in science rate, scientist rate and high technology export rate),
wealth was measured by GDP 1998 and 2003 (latent variables in circles, measured/manifest
in boxes; see Figure 3). Only countries with data in all measures were used (N=48), the
pattern of results is similar to the larger samples (see Tables 3 and 4). The fit indices are good
(SRMR=.04, CFI=.99). For high STEM achievement the cognitive competence of the smart
fraction rate is more important (β95%→IE=.43, βaA→IE=.32). The impact of cognitive ability on
wealth goes completely through intellectual excellence (βIE→GDP=.94), a further direct effect
would be small and even negative (βaA→GDP=-.05 and β95%→GDP=-.16), indicating, that cognitive
ability not going through STEM-like achievement has no positive impact on wealth (similar:
Schofer, Ramirez & Meyer, 2000).
Longitudinal analyses
Student assessment studies with information on the tails do not allow longitudinal analyses,
the time interval between the 90s and the first decade of 21st century is too short. But we can
do these analyses with political leaders’ cognitive ability from the 60s to the 00s. In the Tables
3 and 4 high correlations and a cross-sectional impact of politicians’ ability on democracy
were observable. Maybe this relationship does not include an effect of ability on democracy,
but of democracy on politicians’ ability. This could be tested by a cross-lagged panel analysis.
Democracy Democracy
1960-64 1996-2000
The relation between politicians’ ability and democracy could be analyzed between the early
60s and the 00s (see Figure 4; the fit of the model is perfect). The years for political leaders
are somewhat misleading because the majority of leaders in 1960-64 had ruled the country
also for several years before, the same is true for 2000-09. The cognitive ability of politicians
has only a small impact on the development of democracy (βPIQ1→Dem2=.04), but democracy
leads to more educated and competent politicians (βDem1→PIQ2=.18). The low competence
levels of Arab leaders described above could at least be partly explained by their
nondemocratic (self-)appointment (and only under rare circumstances non-democratic
leaders like Mohammed VI in Morocco and bin Said in Oman could push their societies
forward).
But politicians’ ability has a positive impact on cognitive development of a society
(βPIQ1→CA2=.21; see Figure 5; SRMR=.01, CFI=1.00). The reverse effect is smaller
(βCA1→PIQ2=.03). Unfortunately the sample with 17 countries is small, but after wealth and rule
of law it is the third factor that longitudinally seems to influence cognitive development at the
country data level. In the long run smart politicians increase their nations’ abilities.
Table 5: Correlations between cognitive ability indicators and attributes of educational policy
N 66 74
Note: See Table 1; Young tracking age: tracking age inverted; Class size: large class size and pupil-
teacher-ratio.
20 H. Rindermann et al.
Discussion
As other studies before have shown, there are large cognitive ability differences between
societies. They are reflected in the upper and lower levels, but East Asian and Commonwealth
countries seem to have comparatively stronger smart fractions than Scandinavian or other
First-World-countries. Maybe these countries not only benefit from their educational policies
and, especially in East-Asia, from harsh educational efforts with very extensive studying times
per day, week, year and youth, but also from a more successful migration policy. Beneath
cultural background factors relevant for education in family and school genetic factors could
be important, but genes for cognitive ability are not known up to now.
The ability value (intelligence, knowledge and the intelligent use of knowledge) of the smart
fraction (95th percentile, comparable to an IQ 125 or higher in within-country norms) is more
important for country differences in wealth, nations’ intellectual excellence (in STEM fields:
patents, Nobel Prices in science, scientists, high technology exports) and political attributes
of societies (government effectiveness, democracy, rule of law and political liberty) than the
average ability or the ability level of a non-smart fraction (5th percentile, comparable to an IQ
75 or lower in within-country norms). But the cognitive ability level of the non-smart fraction is
more important for country differences in HIV, AIDS and homicide. Wealth differences
between countries could be completely explained through differences in high intellectual
achievement in STEM fields, which itself largely depends on differences in smart fractions
ability. The smart fraction is essentially relevant for beneficial societal development.
The cognitive ability of political leaders is far less important. We could only find higher
correlations to democracy and political liberty, in a longitudinal analysis democracy has a
positive impact on cognitive ability of political leaders. People, if they have the chance to
elect their leaders, prefer more educated ones. Political leaders have, in the long run, a
positive influence on countries’ cognitive ability, presumedly by creating better educational
and social environments increasing cognitive ability.
This study could show how in former studies discovered mean cognitive ability effects on
growth could work: In societies with a higher cognitive average the smart fraction reaches a
higher cognitive level (resp. is also larger from a “real” threshold of high ability on – see
below). This smart fraction pushes growth through excellence in areas relevant for economic
affluence, like in technology and science. We did not expect such a high impact of the smart
fraction on the destiny of societies. The current data do not allow us to present a historical
analysis of modernization processes from the ancient past up to 1960. We can only use our
findings on present day comparisons between countries in terms of cognitive ability as an
analogy to surmise that the same cognitive effects occurred during historical periods. It
seems very likely that the achievements of cognitively eminent persons coming from the
smart fraction, and stimulated by their peers, was decisive for the betterment of their
societies.
But the results are somewhat contradictory: On one hand, international differences in
important attributes of societies (and, we would argue, in the historical development of
nations) depend on the cognitive ability of an elite. On the other hand these differences do
not depend on the cognitive ability levels of politicians. Peoples and nations themselves seem
to be important for the destiny of their countries and societies, more so than politicians.
Leaders stem by a majority from smart fractions of their societies and they seem to reflect
social attributes and especially their cognitive ability levels, rather than influencing them.
One possibility is that in developed societies with a large smart fraction, political leadership
is drawn from somewhat less intelligent elite members (see Cox, 1926, p. 84), willing to earn
less intellectual merits or money in return for the possibility of fame. Another possibility is
that the cognitive ability of politicians is less important because they have competent
consultants and experts who give advice (the first author discussed this in 2006 at an ISIR-
meeting in San Francisco with Dean Keith Simonton, his reply was, that politicians also need to
understand them). Maybe formal education is not the best estimate, better would be real life
criteria like used by Simonton. But we should not use verbal ability here. Rhetorical brilliance
Smart fraction 21
is not solving problems. Verbal fluency could be a dangerous competence, a seduction to talk
people into believing or doing something that they would not do by the use of thinking and
rationality. In the Greek tradition, Plato (Gorgias) similarly assessed rhetorical competence in
a very critical manner. Finally, in German analyses political and “weltanschauliche”
orientations are showing more explanative strength than education of politicians.
One remark on Singapore: Its long-term Prime Minister Lee Kuan Yew has in our data set only
as highest degree “university degree”, no doctorate or an additional scientific degree. But he
has studied at London School of Economics and in Cambridge and finished his studies with
exceptional “Double Starred First Class Honours”. Our assessment procedure seems to
underestimate his cognitive ability level. Furthermore, Singapore has reached the highest
rank in the smart fraction ability (IQ 127) in our list and the second highest rank in average
ability (IQ 105), but “only” the 14th rank in the lower non-smart fraction ability ranking (IQ 79).
In patents (1991-2007) Singapore has the first place. And, that is especially remarkable,
Singapore has reached the first place in government effectiveness. Singapore seems to have
the best government in the world. Lee Kuan Yew’s ability – indicated by his success – seems to
be underestimated again by the solely use of formal education. Of course, Singapore was and
still is no standard-bearer of liberty and democracy and Lee Kuan Yew has attracted criticism
because of this. But, he stands apart from other leaders in terms of his exceptional success for
Singapore in growth, modernization, technology and since several years also in science (up to
now only STEM including biotechnology). Lee is also apparently the only politician who has
read and used the results of intelligence research in his politics. In speeches he has cited
Thomas Bouchard and Richard Lynn (Chan & Chee, 1984), and he is the only statesman, who
has seen that intelligence enhancement not only needs an improvement in the environment
(like in educational policy) but also in demographic policies, because parents transfer
cognitive ability to their children by creating a stimulating environment (especially by
education and modeling) and by transmission of their genes.
Further research should not only use as an indicator for smart fractions a value like the 95th
percentile and the ability at this level, but also a defined threshold of cognitive ability like IQ
130 or SAS 700 and the percentage of population above this threshold. The present editing of
TIMSS, PISA and PIRLS results complicates this. Research using different ability levels seems
to be a fruitful approach. Also further indicators of high achievement like Fields Medal or of
low achievement like traffic accidents should be used as indicators to stand for high or low
intelligence (Dagona, 1994; O‘Toole & Stankov, 1992). Migrations and their impact on
countries’ cognitive ability and development should be analyzed (so Singapore benefits from
a smart fraction import, similarly to Switzerland, Australia and Canada, but Eastern Europe
and less so Germany suffer from a brain flight, others from a low brain immigration; e.g.
Levels, Dronkers & Kraaykamp, 2008; te Nijenhuis, de Jong, Evers & van der Flier, 2004). The
possibilities of education for cognitive enhancement are still not sufficiently explored (e.g.
Heckman, 2000; Nisbett, 2009; Rindermann & Ceci, 2009). Our results emphasize the
importance of nurturing the highly gifted. Their support will be beneficial in the long run not
only for themselves but even more through general effects on societal development including
wealth, health, politics, science, ethics and culture for the less smart and non-smart fractions.
Finally, at the level of societies, there is an integrative theoretical framework on causes and
mechanisms of cognitive competence still missing. By showing the influence of ability on
wealth through high intellectual STEM achievement we hope to provide some further building
block in development of such a theory.
22 H. Rindermann et al.
References
Bacharach, V. R., & Baumeister, A. A. (1998). Direct and of general intelligence (pp. 343-365). Oxford:
indirect effects of maternal intelligence, Pergamon.
maternal age, income, and home environment Falk, R., & Greenbaum, Ch. W. (1995). Significance
on intelligence of preterm, low-birth-weight tests die hard. The amazing persistence of a
children. Journal of Applied Developmental probabilistic misconception. Theory &
Psychology, 19, 349-363. Psychology, 5, 75-98.
Beaton, A. E., Mullis, I. V. S., Martin, M. O., Gonzalez, E. Freedom House (2004). Freedom in the world.
J., Kelly, D. L., & Smith, T. (1996). Mathematics Washington: www.freedomhouse.org.
achievement in the middle school years.
Chestnut Hill: TIMSS Study Center. Gelade, G. A. (2008). IQ, cultural values, and the
technological achievement of nations.
Beaton, A. E., Martin, M. O., Mullis, I. V. S., Gonzalez, E. Intelligence, 36, 711-718.
J., Smith, T., & Kelly, D. L. (1996). Science
achievement in the middle school years. Gigerenzer, G. (2004). Mindless statistics. Journal of
Chestnut Hill: TIMSS Study Center. Socio-Economics, 33, 587-606.
Becker, G. S. (1993/1964). Human capital: A Goldman, D. P., & Smith, J. P. (2002). Can patient self-
theoretical and empirical analysis with special management help explain the SES health
reference to education. Chicago: University of gradient? Proceeding of the National Academy of
Chicago Press. Sciences, 99, 10929-10934.
Cattell, R. B. (1987/1971). Intelligence: Its structure, Gottfredson, L. S. (2004). Life, death, and intelligence.
growth and action. Amsterdam: Elsevier. Journal of Cognitive Education and Psychology, 4,
23-46.
Ceci, S. J. (1991). How much does schooling influence
general intelligence and its cognitive Gottfredson, L. S. (2005). Implications of cognitive
components? Developmental Psychology, 27, differences for schooling within diverse
703-722. societies. In C. L. Frisby & C. R. Reynolds (Eds.),
Comprehensive Handbook of Multicultural
Chan, Ch. K. & Chee, H. L. (1984). Singapore 1984: School Psychology (pp. 517-554). New York:
Breeding for Big Brother. In Ch. K. Chan & H. L. Wiley.
Chee (Eds.), Designer genes: IQ, ideology and
biology (pp. 4-13). Kuala Lumpur: Gwartney, J., & Lawson, R. (2003). Economic freedom
Selangor/Institute for Social Analysis (INSAN). of the world. 2003 annual report. Vancouver:
Fraser Institute.
Chomsky, N. (2009). Politics, society, and Obama:
Change we can believe in? The Owl, 15, 16-21. Habermas, J. (1985/1981). The theory of communi-
cative action. Boston: Beacon.
Cohen, J. (1994). The earth is round (p<.05). American
Psychologist, 49, 997-1003. Hanushek, E. A., & Kimko, D. D. (2000). Schooling,
labor-force quality, and the growth of nations.
Cox, C. M. (1926). The early mental traits of three American Economic Review, 90, 1184-1208.
hundred geniuses. Stanford: Stanford University
Press. Hart, M. H. (2007). Understanding human history.
Augusta: Washington Summit.
Cunha, F., Heckman, J. J., Lochner, L., & Masterov, D. V.
(2006). Interpreting the evidence on life cycle Heckman, J. J. (2000). Policies to foster human capital.
skill formation. In E. A. Hanushek, & F. Welch Research in Economics, 54, 3-56.
(Eds.), Handbook of the economics of education Herrnstein, R. J., & Murray, Ch. (1994). The bell curve.
(I, pp. 697-812). Amsterdam: North-Holland. Intelligence and class structure in American life.
Dagona, Z. K. (1994). Substance use and road traffic New York: Free Press.
accidents among Nigerian commercial motor Hu, L., & Bentler, P. M. (1998). Fit indices in covariance
cyclists. Ife PsychologIA, 2, 81-93. structure modeling. Psychological Methods, 3,
Deary, I. J., Batty, G. D., & Gale, C. R. (2008). Childhood 424-453.
intelligence predicts voter turnout, voting Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit
preferences, and political involvement in indexes in covariance structure analysis.
adulthood. Intelligence, 36, 548-555. Structural Equation Modeling, 6, 1-55.
Deary, I. J., Ferguson, K. J., Bastin, M. E., Barrow, G. W. Human Development Report of the United Nations
S., Reid, L. M., Seckl, J. R., Wardlaw, J. M., & (HDR) (2005). Human Development Report 2005.
Maclullich, A. M. J. (2007). Skull size and New York. Retrieved May 25, 2007 from
intelligence, and King Robert Bruce‘s IQ. http://hdr.undp.org/reports/global/2005/pdf/h
Intelligence, 35, 519-525. dr05_HDI.pdf.
Denny, K., & Doyle, O. (2008). Political interest, Hunter, J. E. (1997). Needed: A ban on the
cognitive ability and personality: Determinants significance test. Psychological Science, 8, 3-7.
of voter turnout in Britain. British Journal of
Interpol (2004). International Crime Statistics. Lyon.
Political Science, 38, 291-310.
Retrieved October 22, 2004 from
Ellis, L., & Walsh, A. (2003). Crime, delinquency and www.interpol.int/Public/Statistics/ICS/
intelligence: A review of the worldwide downloadList.asp.
literature. In H. Nyborg (Ed.), The scientific study
Smart fraction 23
Irwing, P., & Lynn, R. (2006). The relation between TIMSS & PIRLS Study Center.
childhood IQ and income in middle age. Journal Martin, M. O., Mullis, I. V. S., Gonzalez, E. J., &
of Social, Political and Economic Studies, 31, 191- Chrostowski, S. J. (2004). TIMSS 2003
196. international science report. Chestnut Hill: TIMSS
Jensen, A. R. (1998). The g factor. The science of & PIRLS International Study Center.
mental ability. Westport: Praeger. Martin, M. O., Mullis, I. V. S., Gonzalez, E. J., Gregory, K.
Jones, G., & Schneider, W. J. (2006). Intelligence, D., Smith, T. A., Chrostowski, S. J., Garden, R. A., &
human capital, and economic growth. Journal of O’Connor, K. M. (2000). TIMSS 1999 international
Economic Growth, 11, 71-93. science report. Chestnut Hill: TIMSS Study
Kaufmann, D., Kraay, A., & Mastruzzi, M. (2006). Center.
Governance matters V: Aggregate and individual Meisenberg, G. (2004). Talent, character, and the
governance indicators for 1996-2005. Worldbank. dimensions of national culture. Mankind
Retrieved November 28, 2006 from Quarterly, 45, 123-168.
www.worldbank.org/wbi/governance. Mullis, I. V. S., Martin, M. O., Beaton, A. E., Gonzalez, E.
Knack, S., & Keefer, Ph. (1995). Institutions and J., Kelly, D. L., & Smith, T. (1997). Mathematics
economic performance. Economics and Politics, achievement in the primary school years.
7, 207-227. Chestnut Hill: TIMSS Study Center.
Kohlberg, L. (1987). Child psychology and childhood Mullis, I. V. S., Martin, M. O., & Foy, P. (2008). TIMSS
education. A cognitive-developmental view. 2007 international mathematics report. Chestnut
New York: Longman. Hill: TIMSS & PIRLS Study Center.
Krueger, A. B. (1999). Experimental estimates of Mullis, I. V. S., Martin, M. O., Gonzalez, E. J., Gregory, K.
education production functions. Quarterly D., Garden, R. A., O’Connor, K. M., Chrostowski,
Journal of Economics, 114, 497-532. S. J., & Smith, T. A. (2000). TIMSS 1999
Kurian, G. Th. (2001). The illustrated book of world international mathematics report. Chestnut Hill:
rankings. Armonk: Sharpe. TIMSS Study Center.
La Griffe du Lion (2004). Smart fraction theory II. 6(2). Mullis, I. V. S., Martin, M. O., Gonzalez, E. J., &
Retrieved July 13, 2009 from Chrostowski, S. J. (2004). TIMSS 2003
www.lagriffedulion.f2s.com/sft2.htm. international mathematics report. Chestnut Hill:
TIMSS & PIRLS International Study Center.
Lakhanpal, M., & Ram, R. (2008). Educational
attainment and HIV/AIDS prevalence: A cross- Mullis, I., Martin, M. O., Gonzales, E. J., & Kennedy, A.
country study. Economics of Education Review, M. (2003). PIRLS 2001 international report.
27, 14-21. Chestnut Hill: IEA.
Lee, J.-W., & Barro, R. J. (1997). Schooling quality in a Mullis, I., Martin, M. O., Kennedy, A. M., & Foy, P.
cross-section of countries. New York. Retrieved (2007). PIRLS 2006 international report. Chestnut
November 18, 2004 from Hill: IEA/TIMSS & PIRLS International Study
www.nber.org/papers/W6198. Center.
Levels, M., Dronkers, J., & Kraaykamp, G. (2008). Murray, Ch. (2008). Real education: Four simple truths
Immigrant children’s educational achievement for bringing America’s schools back to reality.
in Western countries. American Sociological New York: Crown Forum.
Review, 73, 835-853. Murray, Ch., Cardoso, R., & Mendes, D. (2008).
Lynn, R., Harvey, J., & Nyborg, H. (2009). Average Miscigenação diminui o QI dos brasileiros.
intelligence predicts atheism rates across 137 Istoé, 2032(15-10-08), 9-11.
nations. Intelligence, 37, 11-15. Nisbett, R. E. (2009). Intelligence and how to get it.
Lynn, R., & Longley, D. (2006). On the high Why schools and cultures count. New York:
intelligence and cognitive achievements of Jews Norton.
in Britain. Intelligence, 34, 541-547. Nyborg, H. (2009). The intelligence-religiosity nexus.
Lynn, R., & Vanhanen, T. (2002). IQ and the wealth of Intelligence, 37, 81-93.
nations. Westport: Praeger. OECD (2000). Literacy in the information age. Final
Lynn, R., & Vanhanen, T. (2006). IQ and global report of the International Adult Literacy Survey.
inequality. Athens: Washington Summit. Paris: OECD.
Marshall, M. G., & Jaggers, K. (2000). Polity IV Project. OECD (2003). Literacy skills for the world of
Political regime characteristics and transitions, tomorrow. Further results from PISA 2000. Paris:
1800-1999. University of Maryland: OECD.
www.bsos.umd.edu/cidcm/inscr/polity. OECD (2004a). Learning for tomorrow‘s world. First
Martin, M. O., Mullis, I. V. S., Beaton, A. E., Gonzalez, E. results from PISA 2003. Paris: OECD.
J., Smith, T., & Kelly, D. L. (1997). Science OECD (2004b). Problem solving for tomorrow‘s
achievement in the primary school years. world. Paris: OECD.
Chestnut Hill: TIMSS Study Center. OECD (2007a). PISA 2006. Science competencies for
Martin, M. O., Mullis, I. V. S., & Foy, P. (2008). TIMSS tomorrow‘s world. Volume 1: Analysis. Paris:
2007 international science report. Chestnut Hill: OECD.
24 H. Rindermann et al.
OECD (2007b). PISA 2006. Volume 2: Data/Données. effects of science on national economic
Paris: OECD. development, 1970-1990. American Sociological
Oesterdiekhoff, G. W. (2000). Zivilisation und Review, 65, 866-887.
Strukturgenese. Frankfurt: Suhrkamp. Simonton, D. K. (1984). Genius, creativity and
Oesterdiekhoff, G. W. (2008). Magic and animism in leadership. Cambridge: Harvard University
old religions: The relevance of sun cults in the Press.
world-view of traditional societies. Croatian Simonton, D. K. (1985). Intelligence and personal
Journal of Ethnology and Folklore Research, 45, influence in groups: Four nonlinear models.
43-66. Psychological Review, 92, 532-547.
Oesterdiekhoff, G. W., & Rindermann, H. (2007). The Simonton, D. K. (2006). Presidential IQ, openness,
spread of AIDS in developing countries: A intellectual brilliance, and leadership: Estimates
psycho-cultural approach. Journal of Social, and correlations for 42 US chief executives.
Political and Economic Studies, 32, 201-222. Political Psychology, 27, 511-526.
O‘Toole, B. I., & Stankov, L. (1992). Ultimate validity of Simpson, M. (1997). Informational inequality and
psychological tests. Personality and Individual democracy in the new world order. In M.
Differences, 13, 699-716. Midlarsky (Ed.), Inequality, democracy, and
Piaget, J. (1997/1932). Moral judgement of the child. economic development (pp. 156-176).
New York: Free Press. Cambridge: Cambridge University Press.
Piaget, J. (2001/1947). The psychology of intelligence. Statistisches Bundesamt (2002). Statistisches Jahrbuch
London: Routledge. 2002 für das Ausland. Suttgart: Metzler-Poeschel.
Rindermann, H. (2007a). The g-factor of international Suedfeld, P., Guttieri, K., & Tetlock, Ph. E. (2003).
cognitive ability comparisons: The homogeneity Assessing integrative complexity at a distance.
of results in PISA, TIMSS, PIRLS and IQ-tests In J. M. Post (Ed.), The Psychological assessment
across nations. European Journal of Personality, of political leaders (pp. 246-270). Ann Arbor: The
21, 667-706. University of Michigan Press.
Rindermann, H. (2007b). The big G-factor of national te Nijenhuis, J., de Jong, M.-J., Evers, A., & van der
cognitive ability. European Journal of Personality, Flier, H. (2004). Are cognitive differences
21, 767-787. between immigrant and majority groups
diminishing? European Journal of Personality, 18,
Rindermann, H. (2008a). Relevance of education and 405-434.
intelligence at the national level for the
economic welfare of people. Intelligence, 36, Thomson, G. H. (1937/1936). Intelligence and
127-142. civilisation: A Ludwig Mond lecture delivered at
the University of Manchester on October 23rd,
Rindermann, H. (2008b). Relevance of education and 1936. Journal of the University of Manchester, 1,
intelligence for the political development of 18-38. Reprinted in: Deary, I. J., Lawn, M., Brett,
nations: Democracy, rule of law and political C. E., & Bartholomew, D. (2009). „Intelligence
liberty. Intelligence, 36, 306-322. and Civilisation“. Intelligence, 37, 48-61.
Rindermann, H., & Ceci, S. J. (in press). Educational UNAIDS/WHO (2003). AIDS epidemic update.
policy and country outcomes in international Geneva: WHO/www.unaids.org.
cognitive competence studies. Perspectives on
Psychological Science. Vanhanen, T. (1997). Prospects of democracy. London:
Routledge.
Rindermann, H., & Heller, K. A. (2005). The benefit of
gifted classes and talent schools for developing Vanhanen, T. (2005). Measures of democracy 1810-
students’ competences and enhancing 2004. Finnish Social Science Data Archive (FSD).
academic self-concept. Zeitschrift für Retrieved January 17, 2006 from www.fsd.uta.fi/
Pädagogische Psychologie, 19, 133-136. english/data/catalogue/FSD1289.
Rindermann, H., & Meisenberg, G. (2009). Relevance Weede, E. (2006). Economic freedom and
of education and intelligence at the national development. Cato Journal, 26, 511-524.
level for health: The case of HIV and AIDS. Weiss, V. (2009). National IQ means transformed from
Intelligence, 37, 383-395. Programme for International Student
Rindermann, H., & Thompson, J. (2009). Parents’ Assessment (PISA) scores, and their underlying
education, and not their money, nurtures the gene frequencies. Journal of Social, Political and
intelligence of their children. Manuscript Economic Studies, 34, 71-94.
submitted for review. World Intellectual Property Organization (WIPO)
Schermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2009). Patent applications by patent office (1883-
(2003). Evaluating the fit of structural equation 2007), by resident and non-resident. Geneva.
models. Methods of Psychological Research, 8, Retrieved June 22, 2009 from
23-74. www.wipo.int/ipstats/en/statistics/patents.
Schmidt, F. L., & Hunter, J. E. (2004). General mental Wuttke, J. (2007). Uncertainties and bias in PISA. In S.
ability in the world of work. Journal of Personality Th. Hopmann, G. Brinek & M. Retzl (Eds.), PISA
and Social Psychology, 86, 162-173. zufolge PISA - PISA according to PISA (pp. 241-
263). Wien: LIT.
Schofer, E., Ramirez, F. O., & Meyer, J. W. (2000). The
Smart fraction 25
The authors
Michael Sailer (born 1984) graduated from Secondary School in Leoben and
studied psychology in Graz 2003-2009. He is currently working on his thesis
about the “Impact of politicians and the cognitive ability of smart fractions on
social development.” Since 2007 he is a member for the KFU-Graz students’
association.
Abstract: The challenges facing research into giftedness are considerable, including the
lack of a clear meta-theoretical framework and agreement on terminology. If giftedness, in
broad terms, refers to the interactions between complex patterns of actions, the
psychological aspects of self and the social environment toward the attainment of
achievement excellence, then it is not surprising that the study of giftedness presents a
number of conceptual and practical difficulties. Using mathematical achievement as an
example, this article explores the potential benefits and problems of modeling the
Actiotope Model of giftedness using the cognitive architecture CLARION. In using
simulation studies to explore giftedness, the meta-theoretical framework, including
terminologies, is clearly defined, helping to direct future field studies using the more
traditional methods of research.
Keywords:
achievement excellence, Actiotope Model of Giftedness, CLARION, cognitive architecture,
mathematics, modeling
Introduction
The current state of research into giftedness has been described by a number of researchers
as fragmented and contradictory. The aim of this article is to argue that the Actiotope Model of
Giftedness (AMG) (Ziegler, 2005) provides a much needed sense of coherence and unity to
this research. The AMG focuses on the development of action repertoires necessary for the
attainment of excellence. In broad terms, the development of action repertoires is dependent
on physiological, psychological and environmental (or social) variables, and excellence is
viewed within social contexts.
Although the AMG is difficult to test experimentally using traditional research methods
because of its reliance on these different conceptual levels, we also argue that it is possible to
simulate the AMG using techniques developed by researchers currently working in the area
of cognitive modeling. Using excellence in the domain of mathematics as an example, we
describe the CLARION cognitive architecture as one possible way to model the development
of higher forms of mathematical thinking from its antecedents of innate number sense. In
describing the general principles of both the AMG and CLARION, this preliminary discussion
then shows how the two can be mapped onto each other and the immediate challenges in
using this approach and thereby providing some suggestions for future research.
Conceptions of giftedness
In reviewing the status of research into giftedness, Eyre (2009) pointed out that, despite the
many decades of work, conceptions of giftedness amongst psychologists are fragmented and
often contradictory. Recent volumes that specifically address different conceptions of
giftedness (Phillipson & McCann, 2007; Shavinina, in press; Sternberg, 2004b; Sternberg &
Davidson, 2005), the related topics of intelligence (Sternberg, 2000), creativity (Kaufman &
Baer, 2006; Kaufman & Sternberg, 2006) and terms such as “high ability”, “talent” and
1
Shane N. Phillipson, Department of Educational Psychology, Counselling and Learning
Needs, The Hong Kong Institute of Education, 10 Lo Ping Road, Tai Po, NT Hong Kong
*
Corresponding author. Email: shane@ied.edu.hk
2
Ron Sun, Cognitive Science Department, Rensselaer Polytechnic Institute, Troy, NY, USA.
“precocity”, for example, would tend to confirm this impression. Given this status, it is not
surprising that the broad field appears confusing to researchers working either within or
outside the field. It is this confusion that provides detractors with ample opportunity to
criticize and, in some cases, deride the research into giftedness altogether (Marsh, 1998;
Seaton et al., 2008).
If conceptions of giftedness amongst psychologists are numerous and fragmented, it is not
surprising that the practice of gifted education is fragmented. The reasons for the
development of the three broad “educational paradigms” (Eyre, 2009) in gifted education lie
partly in the different agendas of the various educational systems around the world, and
partly in the different conceptions of giftedness that are adopted by the policy makers
working within these systems. In Hong Kong, for example, policy documents supporting
gifted education, either explicitly or implicitly, simultaneously refer to multiple intelligences,
creativity, the Marland report, IQ and Gagné’s Differentiated Model of Giftedness and Talent
as conceptions of giftedness. The documents also mention disabilities and underachievement
as characteristics of some gifted individuals (Phillipson et al., in press).
Using the Hong Kong context again, the policy of including as many conceptions of giftedness
is politically attractive. Being “inclusive” means that the cohort of gifted students can be as
wide as possible, reducing the likelihood of alienating certain members of the community
(Eyre, 2009). As Eyre pointed out, the cohort approach depends on the prior identification of
students who are gifted in some way and depend, therefore, on psychological and/or
personality commonalities amongst these students. Perhaps the best known examples of
research involving the cohort paradigm are those that centre on mathematical precocity
(Lubinski & Benbow, 2006). Significantly, this research has identified some of the important
environmental and personal components that work together to enable the attainment of
mathematical excellence.
Eyre (2009) has identified “definitions” as one of the key questions for future research in
gifted education. It is timely that psychologists researching in the field of giftedness begin to
think about how to bring coherence to the diversity of conceptions of giftedness. This
coherence needs to take into account cultural diversity as well as personality variables such
as differences in measured intelligence, creativity and motivation, for example, and
differences in conceptions of achievement. As Eyre concluded, the field must reorganize itself
if it is to move beyond the “educational margins” and take its rightful place in identifying the
“conditions that enable and encourage exceptional ability to flourish” (pp. 17, 18).
Eyre’s (2009) concerns are not new. Ziegler (2005) has argued that most of the theoretical
conceptions of giftedness do not have a sufficient empirical basis, that the relationship
between gifts and achievement is often unclear, and that research methods and definitions are
often characterized by tautologies. In discussing the relationship between intelligence and
giftedness, for example, Callahan (2000) observed that the commonly cited conceptions of
giftedness such as Renzulli’s three-ring definition, Tannenbaum’s psychosocial definition,
Sternberg’s triarchic and WICS models, and Gardner’s multiple intelligences model rely on
different explanatory levels, such as cognitive skills, expressions of appropriate sets of
behaviors, production of knowledge, bio-physical potential, personality, luck and culture.
Furthermore, combinations of these different explanatory levels sometimes exist in the one
model. Of course, models that rely on different explanatory levels are not easily falsifiable.
Last, Ziegler and Heller (2000) pointed out that much of the reported research to date lacks
the rigor normally expected of scientific research, such as appropriate control groups. Heller
and Schofield (2000) also concluded from their content analysis of international trends on
research on giftedness that the field is overwhelmingly dominated by applied rather than
basic research, and that there was an urgent need for improvements in the “quality of
research designs and measurement techniques …[and] … most importantly, basic research
… [requiring] the intensification of cooperation with researchers” (pp. 136-137). Although
there is an urgent need for a systematic analysis of research since 1999, Eyre (2009)
concluded that the situation has probably not changed very much since that time.
Modelling mathematical Actiotopes with CLARION 29
Development,
learning processes
CS a
Environmental conditions CS n
Figure 1. Achievement excellence in Domain X originates from one of Critical State (CS) a , CS b … CS
n under optimal boundary conditions for each critical state. Each CS operates independently of the
others and the gift, a psychological process, fulfills the inus condition of Postulate 2. (Adapted from
Ziegler & Heller, 2000, p. 15).
30 S. N. Phillipson & R. Sun
Nature of gifts
Within each CS, the components of interest are the psychological processes. Ziegler and
Heller (2000) referred to these processes as gifts, hence the study of giftedness should focus
on the processes that lead to AE. The gift is a necessary but in itself insufficient for AE.
According to Ziegler and Heller (2000), gifts must satisfy four postulates:
Postulate 1 is that the gift temporally precedes the AE and there must be a causal and non-
trivial relationship between the gift and the achievement. Postulate 2 is the fulfillment of the
inus condition. In other words, the psychological process is in itself an “…insufficient but non-
redundant part of an unnecessary but sufficient condition” (p. 13). Gifts are therefore
necessary but in themselves do not guarantee the AE. Ziegler and Heller pointed out that the
gifts are one component within the CS, and all components must be present if there is a
chance of achieving AE. Postulate 3 is that gifts are personal (i.e. psychological processes) and
not environmental variables. To use the example provided in Ziegler and Heller, intelligence
does not qualify as a gift because a direct and causal relationship between it and AE is not
easily determined. At best, the relationship between intelligence and AE can only be
described as correlational. Postulate 4 is that the gift must hold some significance in the
explanation of the AE, and that a probabilistic rather than deterministic relationship between
the gift and AE is made explicit.
To conclude, the critical state view of giftedness (CSG) clearly defines the nature of giftedness
and how it might be researched. Although Ziegler and Heller (2000) focused on the
psychological processes within the CS, it is clear that any understanding of the development
of AE must also be directed toward the interactions between the various components. The
CSG suggests that the research focus should centre on the psychological processes, termed
gifts, which contribute directly to the achievement of excellence. When applying the CSG, a
number of guiding questions can be formulated (Ziegler & Heller), including:
• What is the domain of excellence and in how many ways can it be defined?
• What are the components of the critical state that lead to AE?
• What are the psychological processes which contribute directly and non-trivially to the
AE?
• What interactions between the psychological, personality and environmental conditions
are likely to contribute to AE?
• Under which conditions is the psychological relationship between CS and AE valid?
Of these questions, the first question is perhaps the easiest to answer. Excellence within a
domain is defined by persons working within that domain and, hence, varies across cultures
and time. The psychological processes that contribute to AE will also be different from
domain to domain, as will the interactions between the processes, the personality and the
environment. These interactions are not easy to describe.
and, in turn, affect the environment and so undergo a series of progressive adaptations – but
only as long as the person is pursuing excellence.
Not surprisingly, the terminology in the AMG is consistent with that of the CSG, including the
use of the terms talent, gifted and expert. In the CSG, a gift is a psychological process that
satisfies the four postulates. In the AMG, a gift is also a psychological process and its nature is
dependent on the observer and context. Whether or not actions satisfy the four postulates can
only be answered through research.
The components of the Actiotope, including the psychological components, actions, goals and
personality variables (such as motivation and self-efficacy) are described as a dynamic
system in accordance with the requirements of the critical state (CS) within the CSG. Since
these components, by definition, directly interact with the environment in a purposeful way
toward the AE, the Actiotope has a clear developmental trajectory.
Of these three, Phases 1 and 2 are more likely to correspond with the individual’s
development through their formal education, although it is clear that the domain(s) in which
future AE occurs is likely to be unknown and that the domain may or may not correspond with
the immediate aims of education. Phases 1 and 2 are, however, critical periods in the
development of action repertoires necessary for AE.
The probabilistic relationship between an individual’s Actiotope and AE is not, however,
clearly articulated in Ziegler (2005). In this regard, modeling the development of the
Actiotope from talent through to expert stage using Structural Equation Modeling (SEM) may
at first glance offer one way to more precisely describe this relationship (McCoach, 2003).
There are two related problems, however, that limit the usefulness of SEM to model the
development of AE. First, SEM requires a sample size of at least 100 if the modeling is to
produce reliable results. This means that we need to identify at least 100 individuals with a
trajectory toward the same AE. If these individuals are at the expert stage then this
identification is made much easier. If the individuals are at the talent or gifted stage, then it is
almost impossible to identify these individuals since they have not, by definition, reached AE.
One possible solution would be to identify the action repertoires of a number of experts
within a domain, and then use these as markers for actions within individuals at the talent and
gifted stage. There is the complication that some of these individuals will exercise their free
will and choose different domains to be an expert. The situation is in fact much more complex
than this because the AMG proposes that different Actiotopes may develop the same AE.
The second problem is that the AMG focuses primarily on the individual rather than a
population (Ziegler, 2005; Ziegler & Stöger, 2004). Hence, the AMG is a model of individual
differences, albeit at a systems level. The development of an action repertoire, together with
the subjective action space, goals and environment do not guarantee AE. An individual’s
Actiotope, therefore, is an unnecessary but sufficient condition, with the action itself being
both insufficient and non-redundant. In other words, the action within a successful Actiotope
does not in itself guarantee AE since the other components are also necessary, even though
AE without the action is impossible. It is this variability that renders the SEM a conceptually
inappropriate tool.
32 S. N. Phillipson & R. Sun
Gardner’s theory of multiple intelligences (Gardner, 1993) is often criticized for its lack of
heuristic value (Anderson, 1992; Klein, 1997; Morgan, 1996). Anderson’s criticism is based on
the observation that multiple intelligences theory is derived using evidence from a number of
different conceptual levels, including culture, environment, personality, cognition and
neurobiology. Similarly, the AMG is dependent on a very broad conceptual framework,
including environment (for both defining actions and domains), meta-cognitive regulation,
self-evaluation, psychological structures, skills and IQ, rendering it susceptible to the same
criticism.
Despite the difficulties in the heuristic potential of the AMG, it is a unique approach to
understanding the nature of giftedness. The theory is pleasing because of its focus on the
development of an individual’s action repertoire rather than unitary (or pluralistic) views of
intelligence. The AMG takes a holistic perspective of giftedness, focusing on the development
of these action repertoires within a changing and interactive environment. Although it is
possible to identify the action repertoires and subjective action space of an individual at any
given time (Ziegler & Stöger, 2004), modeling the interactions of the many different
components of the Actiotope present greater research challenges.
The CLARION4 cognitive architecture (Sun, 2006b) was devised in the late 1990s to model
the cognitive processes of individual cognitive agents within a social context. According to
Sun, CLARION is a modular system “intended to capture the essential cognitive processes
within an individual agent” required for learning (p. 82). To date, CLARION has been used to
simulate a variety of cognitive tasks, including the collective processes of academic
publication (Naveh & Sun, 2006), food distribution and enforcement of law in a tribal society
(Sun & Naveh, 2007), and organizational decision making (Sun & Naveh, 2004).
34 S. N. Phillipson & R. Sun
The following description of the overall structure of architecture is derived from Sun (Sun,
2001, 2003, 2006b, 2007; Sun & Naveh, 2007; Sun & Zhang, 2004, 2006; Sun, Zhang, & Mathews,
2006). The essential features of CLARION in relation to the present work include:
1. The relationship between cognition and the environment;
2. The social orientations of both needs and motivations;
3. Two separate dichotomies, including the interactions of declarative processes and
procedural learning processes, and the interactions of explicit (rule based) and implicit
(trial and error) processes;
4. Its focus on both top-down approaches to skill development, where, for example,
procedualization of explicit knowledge leads to skilled performance (implicit
knowledge), and bottom-up approaches, where explicit knowledge can arise from
implicit skills or knowledge;
5. The development of implicit knowledge is gradual and incremental, and as a result, the
development of explicit knowledge may often be graduate and incremental as well;
6. The development of domain specific (abstract) knowledge is possible;
7. Explicit knowledge of needs/desires/motivations can be acquired through bottom-up
learning;
8. The inclusion of innate biases and behavioural propensities (individual differences);
9. The continual interactions of the subsystems;
10. The opportunities of social interactions, for example, through the reflective possibilities
of meta-cognition; and
11. Agents can cooperate with others often because agents can understand the
motivational structures of other agents.
Top level
Reinforcement
Goals
Goal setting
Drives
Filtering goal setting
regulation
Bottom
level
Figure 2. The CLARION architecture. Adapted from Sun (2006, p. 80) and reproduced with permission.
Modelling mathematical Actiotopes with CLARION 35
The four subsystems of CLARION are shown in Figure 2 with each having two levels of
knowledge representation, namely explicit (top-level) knowledge and implicit (bottom-level)
knowledge, where:
1. Implicit representational processes are meant to represent the inaccessible nature of
implicit knowledge, including implicit procedural knowledge; and
2. Explicit representational processes represent accessible knowledge.
In CLARION, learning occurs through both top-down (implicit knowledge from explicit
knowledge) and bottom-up processes (explicit knowledge from implicit knowledge).
Implicit knowledge is represented by sub-symbolic, distributed representations, and
captured by backpropagation neural networks. A multi-layered neural network is used to
implement a mapping function, where the parameters of the mapping function are adjusted to
change the input/output mappings through trial-and-error interactions.
Explicit knowledge can be learned in many ways. One-shot learning, based on hypothesis
testing, is preferred when interacting with the world5. Explicit knowledge can be derived
from implicit knowledge (bottom-up), and it can be assimilated into implicit knowledge (top-
down).
Action-centred subsystems (ACS) represent knowledge that is important in action decision
making, where actions change the world in some way. The role of the ACS is to control actions
(physical movements and internal mental operations). The ACS receives information from the
NACS. When comparing the changed state with the original state, the agent learns.
In the ACS, the bottom level is termed the Implicit Decision Networks (IDNs). The top level is
referred to as the Action Rule Store (ARS). The overall algorithm for deciding on an action is:
1. Observe current state x.
2. In the bottom level (the IDNs), compute the Q-values6 of x associated with all possible
actions ai’s: Q(x, a1), Q(x, a2), ... Q(x, an). (The set of all possible actions along with the
process of deciding on an action in the bottom level constitutes the IDNs.)
3. At the top level, find all possible actions (b1, b2, … bm ) (the ARS) based on the rules in
place.
4. Consider values of ai and bj, and choose an action b.
5. Perform b, and observe next state y, and (possibly) reinforcement r.
6. Update bottom level according to Q-learning-backpropagation.
7. Update top level using Rule-Extraction-Revision (RER).
8. Go to Step 1.
(Sun, 2006b, pp. 84-85)
One example is Q-learning, where an evaluation of the “quality” of an action a is calculated
for a given state x as described by a sensory input. One way to choose an action is to use
maximum Q-values, i.e. choose a if Q(x, a) = maxi Q(x, i). To ensure adequate exploration of
potential actions, a stochastic decision process7 based on the Boltzmann distribution8 can be
used.
Bottom level learning allows for both input and output of information. Input to the bottom
level consists of three sets of information:
1. Sensory input. The sensory input has a number of dimensions, each with a number of
possible values.
2. Working memory items. The working memory items have a number of dimensions, each
with a number of possible values.
3. The selected item of the goal structure. The goals have a number of dimensions, each
with a number of possible values.
Thus, the input state x is represented by a set of dimension-value pairs: (d1, v1), (d2, v2) … (dn,
vn).
Output of the bottom level consists of action choices, working memory actions (for temporary
storage of information or removal of information), goal actions, and external actions.
36 S. N. Phillipson & R. Sun
Note that the combination of Q-learning and backpropagation enables the development of
implicit knowledge based solely on the agent exploring the world and does not require an
external teacher or a priori domain-specific knowledge.
Top level learning allows for the development of explicit knowledge through rules and
chunks. The condition of rules consist of three sets of information, namely
1. Sensory input;
2. Working memory; and
3. Current goal.
The output of a rule is an action choice (working memory actions, goal actions, and external
actions). The condition of a rule and the conclusion of a rule constitute a distinct entity known
as a chunk.
Bottom-up learning is captured using Rule-Extraction-Refinement (RER) algorithm. Here, the
rules at the top level are learned by using information from the bottom level.
• If an action of the bottom level is successful, then an explicit rule is extracted and later
refined.
• If the outcome is not successful, then the condition of the rule is made more specific.
Top-down learning may happen when the agent relies on explicit rules at the top level for
making decisions. As more knowledge is acquired by the bottom level through observing
actions directed by explicit rules, the agent becomes less reliant on the top level and more
reliant on the bottom level.
In addition, a set of response time equations specifies the response times of different
components of the ACS, as well as overall response times. Response time equations are based
on “base-level activations” (Anderson & Lebiere, 1998).
Non-action centred subsystem (NACS) represents knowledge that is static, declarative and
generic: That is, it stores general knowledge about the world. The role of the NACS is to
maintain implicit and explicit general knowledge. Information is stored as associative rules
and associative memory. The NACS is under the control of the ACS.
At the top level knowledge is stored as associative rules. At this level, general knowledge
stores (GKS) encode explicit non-action-centred knowledge. At the bottom level, knowledge
is stored as associative memory. Associative memory networks (AMNs) encoded non-action-
centred knowledge by mapping input with output, using, for example, backpropagation
learning algorithms.
As well as associative memory and associative rules, similarity based reasoning may be
employed, whereby a known chunk can be compared with another chunk. If there is sufficient
similarity then the latter chunk can be inferred.
In order to allow for complex patterns of reasoning to emerge, thereby capturing the essential
features of human thinking, similarity and rule based reasoning can be mixed. Furthermore, a
set of response time equations specifies the response times of different components of the
NACS, as well as overall response times. Response time equations are based on “base-level
activations”.
A key point in the AMG is the development of action repertoires and subjective assessments
of their effectiveness by the individual. According to Ziegler (2005), an action within this
repertoire includes schemas that reflect knowledge and rules, both implicit and explicit.
Schemas related to mathematical thinking change and adapt in response to learning. Clearly,
there is a match between the requirements of the AMG and the capabilities of CLARION.
Goal
goal to
actions goal stimulus
ACS and
from ACS
MCS
and MCS
Low-level drives
Figure 3. The structure of the motivational subsystems (MS). Adapted from Sun (2006, p. 91) and
reproduced with permission.
A dual system of motivational representations is used, where the explicit goals (“find water”)
of an agent are based on internal drives (“being thirsty”). CLARION refers to primary drives
as those that are essentially “hard-wired” to begin with. They include, for example:
• Get-water Strength is proportional to .95*(water-deficit, water-deficit*water-stimulus). The
actual strength depends on the water-deficit felt by the agent and water-stimulus
perceived by it.
• Get-food Strength is proportional to .95*(food-deficit, food-deficit*food-stimulus). Again,
the actual strength depends on the food-deficit felt by the agent and food-stimulus
perceived by it.
• Avoid-danger Strength is proportional to .98*(danger-stimulus*danger-certainty). It is
proportional to danger signal (its distance, severity) and certainty. Danger signal is
captured by danger-stimulus, and danger certainty captured by danger-certainty.
(Sun, 2006b, p. 92)
These drives implemented as hard-wired instincts using backpropagation neural networks. In
addition, higher level drives include belongingness, esteem, self-actualization, and more can
also be hard-wired. Secondary drives can also be implemented. They are derived mostly
through the satisfaction of primary drives as well as being gradually acquired or externally
set (Sun, 2006b, p. 92).
38 S. N. Phillipson & R. Sun
evaluation reinforcement
state
goal setting
goal
goal action
drives
level selection
reasoning selection
filtering,
learning selection selection
and
Monitoring input selection
regulation
buffer
output selection
goal change
parameter setting
Figure 4. The structure of the meta-cognitive subsystem (MCS). Adapted from Sun (2006, p. 94) and
reproduced with permission.
The MCS consists of a number of modules in two levels: The bottom level consists of goal
setting network, reinforcement function network, input selection network, output selection
network, parameter setting network and so on, whereas the top level consists of explicit rules
(if they exist) and is similarly divided.
The AMG describes the importance of motivational and metacognitive states, and goal
orientations in the development of action repertoires, including those in the domain of
mathematical thinking. This motivational and metacognitive states change in response to the
needs of the individual and the pressures of the environment. Success, for example, is highly
motivating to the individual. For some social groups, however, motivation can be externally
imposed and just as successful. Goal orientations are also “programmed” within CLARION.
Once again, there is a clear match between the requirements of the AMG and the capabilities
of CLARION.
CLARION parameters describe the constraints of the learning processes as being of two
sets. The fundamental properties of Set 1 include:
• Learning rate of neural network;
• Reliance on top vs. bottom level learning (expressed as probability of choosing each
level);
• Temperature (degree of randomness); as well as others.
In Set 2, the parameters concerning rule-extraction learning include:
• RER positivity threshold (which must be exceeded to count a step as positive),
• RER generalisation threshold (which must be exceeded for a rule to be generalised),
• RER specialisation threshold, as well as other performance metrics.
The AMG describes aspects of the psychological state as being important in the
development of Actiotopes. Manipulating these parameters offers the researcher
opportunities to change learning parameters related to speed and ways of learning, matching
individual differences in the aspects of the psychological self in the AMG with CLARION.
variance (SD2). Hence the numbers “1” and “2” are represented as:
• approx-1: (total, 1)(1, ND), with fixed SD2; and
• approx-2: (total, 2)(2, ND), with fixed SD2 respectively,
where “total” refers to total number of items and ND is a normal distribution.
On the other hand, exact representations of numbers are represented as positions on a line
with a logarithmic scale. Hence the fixed rules for “1” and “2” are represented as
• exact-1: (total, 1)(1, log1).
• exact-2: (total, 2)(2, log2), respectively.
where “total” refers to total number of items.
Representations of the various types of number sense may present the most challenging
aspects of modeling the development of higher forms of mathematical thinking using
CLARION. However, its success may provide important clues as to the possible pathways and
important milestones in Phase 1 of this development. More importantly, the model may
provide clues regarding the influence of other psychological states such as speed of
information processing and working memory, and other environmental factors such as
nutritional state and schooling on this development.
CLARION can be employed to simulate the interactions between individuals and their social
environment. Simulations can provide the testable hypotheses that are required for the
advancement of research, not only because they generate data, but because the simulations
themselves depend on a clearly defined meta-theoretical framework.
Acknowledgments
The authors acknowledge a number of helpful discussions with Prof. Dr. Heidrun Stöger at the
University of Regensburg in the development of these ideas. The comments made by the
anonymous reviewers of this article are gratefully appreciated
Notes
1
Number sense refers to a number of innate arithmetic abilities (or schemas) and include
numerosity (Wood & Spelke, 2005) (capacity to make representations of numbers of
objects), use of number words (Lipton & Spelke, 2006), additive and subtractive
expectations (Bisanz, Sherman, Rasmussen, & Ho, 2005) ordinal numerical knowledge
(Brannon, 2005), magnitude (Dehaene, 2003), and arithmetic expectations (Kobayashi,
Hiraki, Mugitani, & Hasegawa, 2004).
2
Recently, Halberda, Mazzocco and Feigenson (2008) established a relationship between
numerosity and mathematical achievement amongst junior high school students.
3
The first (or deductive) approach to conducting social science is to construct mathematical
models of social phenomenon in order to make deductions about changes in variables
within the models. The second (or inductive) approach is to make generalizations from a
large number of observations. According to Sun (2006), the insights from such observations
are mostly qualitative in nature (p. 6).
4
CLARION stands for Connectionist Learning with Adaptive Rule Induction.
5
In this model, an agent explores the world, acquires, representations of the world, and
modifies the representations as needed.
6
Q-learning algorithm used to calculate Q-values. In the algorithm, Q(x, a) estimates the
maximum (discounted) cumulative reinforcement the agent receives from the current state x
on. The updated Q(x, a) is based on:
(x, a) = (r + e(y) – Q(x, a)),
where is a discount factor, e(y) is maxaQ(y, a) and y is the new state resulting from action a.
7
Stochastic decision process describes a framework for modeling optimization problems
involving uncertainty,
1
Q ( x ,a )
α
p (a x ) =
e
1
,
∑e
Q ( x ,a )
α
References
Anderson, M. (1992). Intelligence and development: A discontinuity designs: Evaluations of gifted and
cognitive theory. Oxford, UK: Blackwell talented programs Journal of Experimental
Publishers. Education, 66(2), 163.
Anderson, J. & Lebiere, C. (1998). The atomic McCoach, D. B. (2003). SEM isn’t just the Schoolwide
components of thought. Mahwah, NJ: Lawrence Enrichment Model anymore: Structural equation
Erlbaum. modeling (SEM) in gifted education. Journal for
Bisanz, J., Sherman, J. L., Rasmussen, C., & Ho, E. the Education of the Gifted, 27, 36-61.
(2005). Development of arithmetic skills and Morgan, H. (1996). An analysis of Gardner's Theory of
knowledge in preschool children. In J. I. D. Multiple Intelligence. Roeper Review, 18, 263-
Campbell (Ed.), Handbook of mathematical 269.
cognition (pp. 143-162). New York, NY: Naveh, I., & Sun, R. (2006). Simulating a simple case of
Psychology Press. organizational decision making. In R. Sun (Ed.),
Brannon, E. M. (2005). What animals know about Cognition and multi-agent interaction:From
numbers. In J. I. D. Campbell (Ed.), Handbook of cognitive modeling to social simulation (pp. 124-
mathematical cognition (pp. 85-107). New York, 150). Cambridge: Cambridge University Press.
NY: Psychology Press. Phillipson, S. N., & Callingham, R. (in press).
Callahan, C. M. (2000). Intelligence and giftedness. In Understanding mathematical giftedness:
R. J. Sternberg (Ed.), Handbook of intelligence Integrating self, action repertoires and the
(pp. 159-175). Cambridge, UK: Cambridge environment. In L. V. Shavinina (Ed.), The
University Press. International Handbook on Giftedness.
Dehaene, S. (2003). The neural basis of the Weber- Amsterdam: Springer Science and Business
Fechner law: A logarithmic mental number line. Media.
TRENDS in Cognitive Science, 7(4), 145-147. Phillipson, S. N., & McCann, M. (Eds.). (2007).
Eyre, D. (2009). Introduction. In D. Eyre (Ed.), Gifted Conceptions of giftedness: Sociocultural
and talented education: Major themes in perspectives. Mahwah, NJ: Lawrence Erlbaum
education (Vol. 1, pp. 1-22). London: Routledge. Associates.
Gardner, H. (1993). Multiple intelligences. New York: Phillipson, S. N., Shi, J., Zhang, G., Tsai, D.-M., Quek, C.
Basic Books. G., Matsumura, N., et al. (in press). Giftedness in
Halberda, J., Mazzocco, M. M. M., & Feigenson, L. East Asia. In L. V. Shavinina (Ed.), The
(2008). Individual differences in non-verbal International Handbook on Giftedness.
number acuity correlate with maths Amsterdam: Springer Science and Business
achievement. Nature, 455(7213), 665-668. Media.
Heller, K. A., & Schofield, N. J. (2000). International Sawyer, K. R. (2003). Artificial societies: Multiagent
trends and topics of research on giftedness and systems and the micro-macro link in
talent. In K. A. Heller, F. J. Mönks, R. J. Sternberg & sociological theory. Sociological Methods
R. F. Subotnik (Eds.), International handbook of Research, 31, 325-363.
giftedness and talent (2 ed., pp. 123-137). Seaton, M., Marsh, H. W., Dumas, F., Huguet, P.,
Oxford, UK: Elsevier Science. Monteil, J.-M., Regner, I., et al. (2008). In search
Holme, P., & Grönlund, A. (2005). Modeling the of the big fish: Investigating the coexistence of
Dynamics of Youth Subcultures [Electronic the big-fish-little-pond effect with the positive
Version]. Journal of Artificial Societies and Social effects of upward comparisons. British Journal of
Simulation, 8 from http://jasss.soc.surrey.ac.uk Social Psychology, 47(1), 73-103.
/8/3/3.html. Shavinina, L. V. (Ed.). (in press). The International
Kaufman, J. C. & Baer, J. (Eds.). (2006). Creativity and Handbook on Giftedness. Amsterdam: Springer
Reason in Cognitive Development. New York: Science and Business Media.
Cambridge University Press. Sternberg, R. J. (Ed.). (2000). Handbook of intelligence.
Kaufman, J. C. & Sternberg, R. J. (Eds.). (2006). The New York: Cambridge University Press.
International Handbook of Creativity. New York: Sternberg, R. J. (2004a). Introduction to definitions
Cambridge University Press. and conceptions of giftedness. In R. J. Sternberg
Klein, P. D. (1997). Multiplying the problems of (Ed.), Definitions and conceptions of giftedness
intelligence by eight: A critique of Gardner's (pp. xxiii-xxvi). Thousand Oaks, CA: Corwin
theory. Canadian Journal of Education, 22, 377- Press.
394. Sternberg, R. J. (Ed.). (2004b). Definitions and
Kobayashi, T., Hiraki, K., Mugitani, R., & Hasegawa, T. conceptions of giftedness. Thousand Oaks, CA:
(2004). Baby arithmetic: One object plus one Corwin Press.
tone. Cognition, 91(2), B23-B34. Sternberg, R. J., & Davidson, J. E. (Eds.). (2005).
Lipton, J. S., & Spelke, E. S. (2006). Preschool children Conceptions of giftedness (2 ed.). New York:
master the logic of number word meanings. Cambridge University Press.
Cognition, 98(3), B57-B66. Sun, R. ( 2001). Cognitive science meets multi-agent
Lubinski, D., & Benbow, C. P. (2006). Study of systems: A prolegomenon. Philosophical
mathematically precocious youth after 35 years. Psychology, 14, 5-28.
Perspectives on Psychological Science, 1(4), 316- Sun, R. (2003). A Tutorial on CLARION 5.0. from
345. http://www.cogsci.rpi.edu/~rsun/sun.tutorial.pdf
Marsh, H. W. (1998). Simulation study of Sun, R. (2006a). Prolegomena to integrating cognitive
nonequivalent group-matching and regression - modelling and social simulation. In R. Sun (Ed.),
Modelling mathematical Actiotopes with CLARION 43
Cognition and multi-agent interaction: from Upal, M. A. (2005). Simulating the emergence of new
cognitive modeling to social simulation (pp. 3- religious movements [Electronic Version].
26). Cambridge: Cambridge University Press. Journal of Artificial Societies and Social
Sun, R. (2006b). The CLARION cognitive architecture: Simulation, 8. Retrieved June 12, 2009 from
Extending cognitive modeling to social http://ideas.repec.org/a/jas/jasssj/2004-35-
simulation. In R. Sun (Ed.), Cognition and multi- 2.html.
agent interaction: from cognitive modeling to Wilensky, U., & Rand, W. (2007). Making models
social simulation (pp. 79-99). Cambridge: match: Replicating an agent-based model
Cambridge University Press. [Electronic Version]. Journal of Artificial Societies
Sun, R. (2007). The motivational and metacognitive and Social Simulation, 10 from
control in CLARION. In W. Gray (Ed.), Modeling http://ideas.repec.org/a/jas/jasssj/2007-7-
integrated cognitive systems (pp. 63-75). Oxford 2.html.
University Press: New York. Wood, J. N., & Spelke, E. S. (2005). Infants'
Sun, R., & Naveh, I. (2004). Simulating organizational enumeration of actions: Numerical
decision-making using a cognitively realistic discrimination and its signature limits.
agent model. [Electronic Version]. Journal of Developmental Science, 8(2), 173-181.
Artificial Societies and Social Simulation, 7, from Ziegler, A. (2005). The Actiotope Model of Giftedness.
http://jasss.soc.surrey.ac.uk/7/3/5.html In R. J. Sternberg & J. Davidson (Eds.),
Sun, R., & Naveh, I. (2007). Social institution, cognition, Conceptions of Giftedness (pp. 411-436). New
and survival: a cognitive-social simulation Mind York: Cambridge University Press.
& Society, 6(2), 115-142. Ziegler, A., & Heller, K. A. (2000). Conceptions of
Sun, R., & Zhang, X. (2004). Top-down versus bottom- giftedness from a meta-theoretical perspective.
up learning in cognitive skill acquisition. In K. A. Heller, F. J. Mönks, R. J. Sternberg & R. F.
Cognitive Systems Research, 5, 63-89. Subotnik (Eds.), International handbook of
Sun, R., & Zhang, X. (2006). Accounting for a variety of giftedness and talent (2 ed., pp. 3-21). Oxford,
reasoning data within a cognitive architecture UK: Elsevier Science.
Journal of Experimental & Theoretical Artificial Ziegler, A., & Stöger, H. (2004). Identification based
Intelligence, 18, 169-191. on ENTER within the conceptual frame of the
Sun, R., Zhang, X., & Mathews, R. (2006). Modeling actiotope model of giftedness Psychology
meta-cognition in a cognitive architecture. Science 46, 324-341.
Cognitive Systems Research, 7, 327-338.
The authors
Dr Shane N. Phillipson is an Associate Professor in the Department of
Educational Psychology Counselling and Learning Needs, in the Hong Kong
Institute of Education. His research interests include cultural conceptions of
giftedness and models of achievement.
He has been awarded a number of research grants, resulting in research
publications in many international peer reviewed journals, including High
Ability Studies and Educational Psychology. His books include Phillipson, S. N.
(2007). Learning diversity in the Chinese classroom: Contexts and practice
for students with special needs. Hong Kong: The Hong Kong University Press,
and Phillipson, S. N., & McCann, M. (2007). Conceptions of giftedness: Socio-
cultural perspectives. Marwah, NJ: Lawrence Erlbaum Associates.
Abstract: Relative age effects (RAEs) refer to differences among individuals in age-based
cohorts typically used in sport. These effects usually favour relatively older members of
the cohort and are thought to result from differences in maturation and experience among
athletes of different chronological age. Recently, researchers suggested that relatively
younger participants may not be as disadvantaged as previously thought. In two studies,
we examined whether relatively younger athletes who were able to survive in a system
that advantages their relatively older counterparts would develop superior technical skills.
In study one, participants aged 13-15 years (n=140) drawn from a regional handball talent
selection camp in Germany demonstrated a general relative age effect but no differences
between relatively older and relatively younger athletes in physical body size (i.e.,
height/weight) or technical skills. In study two, similar tests were considered with a larger
sample (n=478) and revealed similar results. Furthermore, there were no differences
between those selected for the national youth team and those not selected. Differences in
RAEs do not seem to be due to technical skills or body size variables. Moreover, the
homogeneity of these results suggests causes of the relative age effect occur early in
development.
Keywords:
birth-date, maturation, expertise, skill acquisition
There are a range of primary and secondary factors influencingg the development of
expertise in sport (Baker & Horton, 2004). One secondary factor believed to affect access to
high quality training and coaching is relative age. Relative age effects (RAEs) refer to
chronological age differences between individuals within annually age-grouped cohorts
(Barnsley, Thompson, & Barnsley, 1985). In most youth sports, annual or biannual age-
groupings, which are thought to create homogenous groups within the competition system of
each sport, unfortunately create a sport structure that perpetuates RAEs. For example,
consider a youth competing in a talent-development program for athletes 10 years of age. If
the youth is born very early in the competition year (i.e., is relatively older), he would be ten
percent older than relatively younger opponents born at the end of the competition year (cf.
Helsen, Starkes, & van Winckel, 2000).
First to report RAEs in sport were Grondin, Deschaies, and Nault (1984), who presented data
for Canadian ice-hockey and volleyball demonstrating an unequal distribution across birth
quartiles. At recreational, competitive, and senior professional levels more players were born
shortly after the cut-off date for their respective sports. Similar findings have been noted in
Canadian ice-hockey within developmental leagues (Barnsley & Thompson, 1988; Barnsley et
al., 1985). In many sports, RAEs are not new phenomena. Wattie, Baker, Cobley, and
Montelpare (2007) found RAEs in Canadian ice-hockey hall of fame athletes going back over
1
Institute for Sport Science, Westfälische Wilhelms-University Münster, Horstmarer Landweg
62b,48149 Münster, Germany
2
Research Group Handball
*
Corresponding author. Email: jschorer@wwu.de
3
School of Kinesiology and Health Science, York University, Toronto, Canada
4
Institute for Applied Training Science, Leipzig, Germany
5
Institute for Sport Science, Christian-Albrechts-University Kiel, Germany
four decades. For professional soccer in Germany, Cobley, Schorer, and Baker (2008)
demonstrated RAEs for players and coaches (but not for referees) since the beginning of the
Bundesliga (Highest Federal league) in the early 1960s. In more recent years, RAEs have been
confirmed internationally for male athletes on many different levels of competition and in a
variety of sports, including Australian Rules football (Abernethy & Farrow, 2005), baseball
(Thompson, Barnsley, & Stebelsky, 1991), basketball (Delorme & Raspaud, 2009), soccer
(Helsen, Starkes, & Van Winckel, 1998, 2000; Helsen, Van Winckel, & Williams, 2005; Jimenez &
Pain, 2008), handball (Schorer, Cobley, Büsch, Bräutigam, & Baker, in press; Schorer, Baker,
Lotz, & Büsch, in press), ice-hockey (Wattie et al., 2007), rugby (Till et al., in press), and
volleyball (Barnsley et al., 1985). Findings for female athletes are less consistent. Vincent and
Glamser (2006) found marginal RAEs at the National level for female soccer players but not at
the state level. Schorer, Cobley, et al. (in press) observed a significant over-representation of
relatively older athletes (i.e., from the first quartile) in young female handball players, but
these effects were smaller than for male athletes. In general, RAEs are confirmed with few
exceptions for a variety of sports for both genders over a range of competition and
development levels (Cobley, Baker, Wattie, & McKenna, 2009).
Our understanding of the mechanisms behind RAEs is much less developed. To date, two
hypotheses have been forwarded to explain relative age differences. Most often cited are
maturational differences (e.g., Barnsley & Thompson, 1988), which assumes that greater
height and mass provide an advantage for relatively older athletes in sports where size is
important (Malina, 1994; Malina, Bouchard, & Bar-Or, 2004; Norikazu, Atsushi, & Toru, 2007).
The relevance of height and weight in youth sport is supported by a study of Brewer, Balsom,
Davis, and Ekblom (1992), who found that elite junior soccer players were above the 95th
percentile of normative data for their population.
A second, related, hypothesis considers the role of selection processes. The above mentioned
maturational differences, which are stronger in the early years of athlete development, lead to
an increased probability of selection by coaches for higher tiers of competition (Schorer,
Cobley, et al., in press; Sherar, Baxter-Jones, Faulkner, & Russell, 2007), which perpetuates a
vicious cycle for the relatively younger. Because they are less likely to make it into the
selection, relatively younger athletes have less access to training with highly qualified
coaches and better medical resources (Helsen et al., 1998). Additionally, they are less likely to
gain match experience at higher levels of competition (considered essential to developing
expertise, Baker & Horton, 2004), thereby increasing the differences between relatively older
and relatively younger athletes. Recently, researchers have discovered that relatively younger
participants may not be as disadvantaged as previous research suggested. One study by
Ashworth and Heyndels (2007) found that relatively younger soccer players had higher
salaries than their relatively older counterparts. Further, Baker and Logan (2007) found that
relatively younger ice-hockey players were more highly sought after during the National
Hockey League draft. In the study by Schorer, Cobley, et al. (in press) relatively younger
athletes had a higher probability of becoming members of the adult national team. More
specifically, early selections (i.e., the first regional and national selections) showed clear RAEs
with significant over representations of relatively older athletes; however, the adult national
team had approximately the same percentage of players born in the first and fourth quartiles
indicating an over representation of relatively younger players relative to the population from
which players were drawn. Although the specific mechanisms of these effects are not known,
Schorer, Cobley, et al. (in press) proposed that systems that perpetuate relative age effects
may turn out to be beneficial for some relatively younger players who develop superior
technical or tactical skills in order to compete successfully against their older, generally
bigger opponents. Ultimately, they hypothesize, relative age effects result in those relatively
younger players who survive the system having a larger repertoire of skills and therefore
demonstrating superior performance. We explore this idea in the present study.
Below we summarize two studies examining these relationships in German handball. Overall,
our objectives were to a) establish relative age effects in two samples of handball players
being considered for national team selection, b) consider differences between relatively
Relative age effects and technical skills 47
older and relatively younger players on variables related to body size and technical skill
development, and c) consider differences between those selected for the National team
versus those not-selected.
Study 1
In this first study, we consider the above relationships with a sample of participants being
considered for national handball team selection in Germany. During this preparation camp
for national selection, five regional D-squads tested their teams (Wohlrab, Landgraf, &
Feldmann, 1998). By the end of the week, an All-Star-team was selected by the coaches based
on their impressions over the week. Based on the preliminary research done to date (Baker &
Logan, 2007; Schorer, Cobley, et al., in press), we hypothesized that the sample would show an
overall relative age effect and that the relatively youngest players would have higher scores in
technical skills while relatively older ones would have larger body sizes, although these
hypotheses were largely exploratory.
Methods
Athlete data were acquired during the “Südcamp 2008” of the Southern German Handball
Federation in Tailfingen. Participants were between 13-15 years of age and most of them
passed two selection levels (district and region/state). For this study, 69 female and 71 male
athletes provided their birth-date, height (in cm), and weight (in kg). Their height ranged
from 1.54-1.81m for the female and from 1.66-1.96m for the male players. Their body mass
was between 46-73kg for females and 52-88kg for males. To test for RAEs, birth-months of the
players were re-coded to reflect the athlete’s birth quartile (Q). Because the handball annual
age-grouping starts with the 1st of January, quartiles were calculated accordingly: Q1: January-
March, Q2: April-June, Q3: July-September; and Q4: October-December. As with most of the
previous research, comparisons were drawn on the assumptions of an equal distribution (see
Cobley et al., 2008). For Germany, a recent study by Schorer, Baker, et al. (in press)
demonstrated equal distributions between quartiles. Chi-square analyses were conducted to
test for differences in quartile distributions among the overall sample as well as between
players selected for the All-Star-team and those not selected.
In addition to these tests we conducted a technical talent assessment where respondents
were required to throw ten balls as precisely and as quickly as possible alternating between
the upper two corners of the goal. This task was chosen by the national coaches because it
represents one of the main skills athletes at this age need to have acquired since it is the basis
for most throwing skills in handball. The players had to pick up the ball from a box positioned
twelve meters away from the goal in the middle of the field and then throw the balls after
three approaching steps from approximately nine metres. The duration of these ten throws
was measured by an electronic watch. Due to time limitations during the camp only 43 male
and 48 female players were able to perform the test. During these ten throws two
independent raters evaluated the over arm throw (German: Schlagwurf) in four different
categories (run up, shooting position, throwing movement, and final position). Scores
demonstrated a high degree of inter-rater-reliability (ρ(overall)=.97) and the ratings for both
judges were amalgamated into a general technical rating (Pabst, Büsch, Wilhelm, & Schorer,
2009). Additionally, the speed of throws was measured by Speed-Trac (Sport Thieme,
Germany) and the percentage of correct hits to the goal corners provided a measure of throw
accuracy. This task resulted in four dependent variables (1) test duration, (2) expert ratings,
(3) throw speed, and (4) throw accuracy.
Instead of using a descriptive statistical approach, a more exploratory data analysis was
conducted for physiognomic data and technical skill data, because cell sizes were small and
varied among the quartiles (cf. Sedlmeier, 1996). Figures are presented as boxplots, based on
a rank scale, which are less influenced by outliers. The line in the middle of the box is the
median. The box shows 25% and 75% quartiles and the lines above and below show the
48 J. Schorer et al.
highest and lowest values that are not outliers. Circles (1.5 to 3.0 standard deviations) and
asterisks (more than 3.0 standard deviations) above or below these lines indicate outliers. The
width of the boxes allows a relative comparison of cell sizes per group (cf. Benjamini, 1988;
Sedlmeier, 1996).
For the inferential statistical analysis, a conservative Exact Test by Kruskal-Wallis for
independent samples was calculated, which works well with small samples and rank scales.
For the Monte Carlo sampling the default values corresponding to a sample size of 10,000 and
confidence levels of 99% were used. Due to the small sample size, the exact or asymptotic p-
value seemed inappropriate; therefore, Monte Carlo p-values are reported. When applicable,
post-hoc comparisons of independent samples were calculated using Mann-Whitney-U-Tests
(alpha criterion set on .05 and for technical skills alpha was Bonferroni adjusted). For
calculating effect sizes and power, G*Power 3.0.10 was used (Faul, Erdfelder, Lang, & Buchner,
2007).
Results
The results are presented in three sections. First, we provide the analyses of overall relative
age effect. Second, we test birth quartile differences in physiognomic variables (i.e., weight
and height). In the final section, we investigate differences between quartiles in the technical
skill test. For all three sections, we differentiate those selected for the all-star game and those
not selected, to test whether the selection affected the strength of the RAE (as hypothesized
by Musch & Grondin, 2001)
The analysis of the overall sample revealed a significant relative age effect, ²(3, n=140) =
24.29, p<.01, w=.42. Differentiating between selected and not-selected players, significant
differences from the normal distribution were found for selected players, ²(3, n=43) = 6.76,
p=.04, w=.40, and for not-selected players, ²(3, n=97) = 18.59, p<.01, w=.44. Comparing
distributions of not-selected players to selected players, no significant differences were
found, ²(3, n=97) = 3.51, p=.33, w=.19, 1 – =.45 (see Figure 1).
45
40
Player per quartile (in %)
35
30
25
20
15
10
0
Overall (n = 140) Selected (n = 43) Not selected (n = 97)
Figure 1. Distribution of players’ birth quartiles overall (n=140) as well as differentiated between
selected (n=43) and non-selected (n=97) for study 1.
Relative age effects and technical skills 49
200 90 70
58
190 80
180 70
170 60
160 50
150 40
Birth-quartiles Birth-quartiles
58
35 30
72
62
57
28
30
Ratings by experts (in points)
26
Duration of test (in ms)
24
25
22
20
20 26
18 101
15
Birth-quartiles Birth-quartiles
100 8
90
6
Accuracy of throws (in n of hits)
Speed of throws (in km/h)
80
70
2
60
50 0
Birth-quartiles Birth-quartiles
Figure 2. Boxplots for height (in cm/upper left), weight (in kg/upper right), test duration (in
secs/middle left), expert ratings (in points/middle right), throw speed (in km/h/lower left), and throw
accuracy (in n of hits/lower right) differentiated by birth quartile.
50 J. Schorer et al.
As can be seen in Figure 2 (upper row), there were no differences among the birth quartiles
for either height, H(3)=1.20, p=.76, or weight, H(3)=0.55, p=.91. Further, differentiating
between selected and not-selected players revealed no differences between the groups;
height, selected: H(3)=6.31, p=.09, not-selected: H(3)=2.87, p=.41, and weight, selected:
H(3)=2.14, p=.56, not-selected: H(3)=0.59, p=.90. Finally, we considered differences between
players from different quartiles concerning their technical skills. As can be seen in Figure 2
(middle and lower rows), there were no differences among the groups for any of the four
technical variables. Inferential statistics confirmed no significant differences for (1) expert
ratings, H(3)=3.10, p=.38, (2) throw accuracy, H(3)=1.77, p=.64, (3) throw speed, H(3)=1.46,
p=.70, and (4) test duration, H(3)=0.90, p=.83. Similarly, no differences were found between
selected and not-selected players, (1) expert ratings, selected: H(3)=0.95, p=.83, not-selected:
H(3)=4.39, p=.22, (2) throw accuracy, selected: H(3)=0.22, p=.98, not-selected: H(3)=3.35,
p=.35, (3) throw speed, selected: H(3)=1.48, p=.71, not-selected: H(3)=1.51, p=.68, and (4) test
duration, selected: H(3)=2.94, p=.42, not-selected: H(3)=4.46, p=.22.
Discussion
Analyses indicated very little difference among the birth quartiles for the study outcomes
(height, weight, or technical skills). Furthermore, these variables did not differentiate who
was selected versus who was not-selected. While these results are intriguing from a
theoretical point of view, one main methodological limitation in this study needs to be
considered that warrants caution in our discussion of the results. The sample size of this study
was rather small, which resulted in cell sizes of five or less especially for the relatively
younger and selected athletes. This small number is reached even without differentiating
between genders, a known moderator of RAEs (Cobley et al., 2009; Schorer, Cobley, et al., in
press). For the comparisons of birth quartile distributions to normal distributions these
limitations are not as important as for testing the difference hypothesis on physiognomic
factors (Malina, 1994; Malina et al., 2004; Norikazu et al., 2007) and technical skills (Schorer,
Cobley, et al., in press).
Based on the limitations noted above, a replication of this study was needed with a larger
number of participants. While replications are often not seen as an attractive alternative for
researchers, their necessity for the consolidation and improvement of a scientific disciplines
is unquestionable (Amir & Sharon, 1990). We undertake this task in Study Two.
Study 2
The national handball try-outs in Germany provide the opportunity to collect data from up to
480 young athletes. Out of this sample, up to 80 players are chosen for a second selection
camp out of which the German national youth team is selected. This larger sample should
allow for hypothesis testing inferential statistics, at least for the combined data set.
The aims of Study Two were the same as in Study One. We investigated whether a sample of
female and male players considered for the youth national team would show an overall RAE
and whether body seize and technical skill measures would differ between relatively older
and younger athletes or predict who was selected for the National team. In addition to these
objectives from the first study, we examined differences between male and female sub-
groups. Based on the preliminary research done to date (i.e., Baker & Logan, 2007; Schorer,
Cobley, et al., in press) and similar to Study 1, we hypothesized that the sample would show an
overall relative age effect and that the relatively youngest players would have higher scores in
technical skills and the relatively older ones would have larger body seizes. We also
hypothesized that these effects would be smaller in female than in male players.
Methods
Athlete data were acquired during the 2009 try-outs for the female and male German national
youth teams. Participants in these camps were between 13-15 years of age and most of them
Relative age effects and technical skills 51
passed through two previous selection levels (district and region/state). Their height ranged
from 1.53-1.86m for the female players and from 1.62-1.98m for the males. Their body mass
ranged from 43-85kg and from 55-106kg for the females and males respectively. By the end of
these try-outs, lists of female and male candidates for the national youth teams were
aggregated. For this study, 238 female and 240 male athletes provided their birth-date, height
(in cm), and weight (in kg). To test for RAEs, birth-months of the players were re-coded to
reflect the athlete’s birth quartile (Q). Similar to Study One, quartiles were calculated as Q1:
January-March, Q2: April-June, Q3: July-September; and Q4: October-December and
comparisons were drawn on the assumption of an equal distribution (Cobley et al., 2008;
Schorer, Baker, et al., in press). Chi-square analyses were conducted to test for differences in
quartile distributions among the overall sample as well as between players selected for the
second national selection level and those not selected. Additionally, the technical skill test
described in Study One was performed by 469 out of the 478 try-outs participants. Nine
participants were not able to fulfil this test due to injuries. Due to the amount of time
necessary to evaluate the technique of the throws it was impossible to conduct this rating
during the try-outs. Therefore, only accuracy and mean speed of throwing were utilized as
dependent variables for the technical test.
Results
As in Study One, results are presented in three main sections: overall RAEs, differences
between the birth quartiles for height and weight, and differences for technical skills (i.e.,
throwing speed, throwing accuracy, and test duration). In each section we also consider males
and females separately.
As expected, significant overall RAEs were revealed, ²(3, n=478) = 41.72, p<.01, w=.29. As
can be seen in Figure 3, RAEs were also found in the female, ²(3, n=238) = 20.49, p<.01,
w=.29, and male sub-groups, ²(3, n=240) = 24.23, p<.01, w=.32.
50
Player per quartile (in %)
40
30
20
10
0
Overall (n = 240) Selected (n = 50) Not selected (n = 190) Overall (n = 238) Selected (n = 39) Not selected (n = 198)
Male Female
Figure 3. Distribution of male players’ birth quartiles (left side) overall (n=240) as well as differentiated
between selected (n=50) and non-selected (n=190) and female players birth quartiles (right side)
overall (n=238) as well as differentiated between selected (n=39) and non-selected (n=198) for study
2.
normal distribution were revealed for selected players, ²(3, n=50) = 18.00, p<.01, w=.60, and
not-selected players, ²(3, n=190) = 12.53, p<.01, w=.26; further, significant differences were
also found between these distributions, ²(3, n=190) = 36.36, p<.01, w=.39.
Because there were few players in the third and fourth quartile for the selected players (as
small as only 3 players), only differences between quartiles in the combined group were
considered for height, weight and technical skills. For the physiognomic variables Kruskal-
Wallis-tests revealed no significant differences between birth quartiles for height, H(3)=1.00,
p=.80, or for weight, H(3)=0.72, p=.87, for males. As can be seen in Table 1, similar results
were found for the females. There were no significant differences between birth quartiles for
height, H(3)=1.32, p=.72, or for weight, H(3)=0.57, p=.90.
For males, no significant differences between groups could be revealed for mean speed of
throws, H(3)=3.72, p=.29, and accuracy of throwing, H(3)=1.55, p=.67. For females, no
significant differences between birth quartiles were revealed for mean speed of throws,
H(3)=2.08, p=.56, or for accuracy of throwing, H(3)=2.79, p=.43.
Table 1. Comparison of means (standard deviations) per birth quartiles concerning height (in m),
weight (in kg), accuracy of throws (n out of ten), and mean speed of throw (in km/h).
Mean speed of throws 63.7 (6.8) 64.8 (7.3) 62.3 (6.4) 64.8 (8.4)
Mean speed of throws 54.3 (5.5) 54.3 (5.7) 53.8 (5.5) 52.8 (5.1)
Discussion
As expected (Schorer, Cobley, et al., in press), young handball talents showed a general
relative age effect; however, contrary to our hypotheses, there were no relative age
differences in any of the player-specific outcomes examined in this study. Players across the
birth quartiles were similar in height, weight, and technical skills (i.e., test duration, expert
rating, throw speed and accuracy). Moreover, there were no differences between players
selected for the national youth team and those not selected.
While we were able to overcome one of Study One’s limitations by differentiating between
genders, the small number of selected athletes limited the sophistication of our analyses. As
in Study One, the cell sizes for the third and fourth quarter within the selected male and
female groups became too small to conducted differentiated parametric analyses. An attempt
to use data from the previous selection year was not possible, because the technical test was
altered for the selection of 2009. This analysis may be possible in the future, provided the test
remains constant for the next two to three years. By choosing random comparison samples,
null-hypothesis testing – as suggested by our results – should be possible.
Relative age effects and technical skills 53
General Discussion
Taken together, results from these studies support previous work (e.g., Cobley et al., 2008;
Schorer, Cobley, et al., in press) suggesting that the primary mechanism driving relative age
effects acts early in the athlete development process and that latter levels of selection, such as
being selected for the national youth team, do not add to the effect. If this result bears out in
further research, it provides important information for reducing or eliminating relative age
effects. Specifically, that the earliest levels of talent identification and selection need to be
targeted and modified to provide a more balanced selection process.
On the other hand, these results do little to explain the preliminary work by Baker and Logan
(2007) as well as by Ashworth and Heyndels (2007) indicating that relatively younger athletes
are more highly valued than their relatively older counterparts. The clear similarities among
the birth quartiles in this study indicates either that relatively younger athletes are superior
on some other outcome not measured in this study (e.g., tactical or decision-making skill) or
that a similar advantage for relatively younger athletes is not present in handball (which
would be contrary to Schorer, Cobley et al., in press). Both explanations might be influenced
by missing moderator variables. Playing position, for instance, has been seen as important for
understanding the RAE in handball (Schorer, Cobley, et al., in press), soccer (Ashworth and
Heyndels, 2007) and ice hockey (Edwards, 1994; Grondin & Koren, 2000). As a result, the
expected difference between relatively younger and relatively older would need to be
considered relative to playing position, which, unfortunately, was not possible with the sample
investigated here.
It is also possible that a very homogenous group of players is being considered as ‘talented’
right from the first regional level of selection (which in handball occurs around 10 years of
age). As the present results indicate, they have similar stature and weight (similar results have
been noted in ice-hockey by Baker, Cobley, Montelpare, Wattie, & Faught, in press; Sherar et
al., 2007). It is possible that compensation for the relatively younger occurs during earlier
selection levels since the developmental differences are typically much larger pre-puberty
than post-puberty. Additionally, it would be helpful to expand the measures of growth and
maturation beyond simple measures of height and weight to more objective measures of
biological maturity. These measures would rule out whether relatively younger athletes are
simply maturing more quickly than their relatively older peers.
Another reason for the homogeneity of the groups in technical skills might be the consistency
in types and amounts of training after the first selection. As Helsen et al. (1998) hypothesized
more qualified training on technical skills might happen in their selection team training
resulting in similar movement patterns for the players, although the ‘homogeneity of training’
hypothesis does not explain the results by Baker and Logan (2007) or Ashworth and Heyndels
(2007). Furthermore, observation of individual players at most levels of play clearly suggests
a degree of individual difference even among players with the same coach (reflecting a given
coach’s ‘signature’). It is possible that the technical skill examined in the present study
(throwing) was too simple and as a result a large degree of homogeneity across the birth
quartiles is not surprising. Future work may consider more sophisticated measures of
technical skills to consider whether these differences are affected by RAEs.
Overall, future studies considering differences between relatively younger and older athletes
should investigate the very first selection level, to investigate why relatively younger athletes
are selected for further talent developmental programmes as well as later levels of selection
to determine why specific selection decisions are being made. Especially helpful would be
longitudinal data showing the development of technical as well as perceptual and tactical
skills in players across the selection process. From a broader perspective, recent studies
(including the data presented here) reinforce the need for a more elaborate theory of RAEs,
which considers the complex interaction among moderator variables and main effect
predictors. A comprehensive understanding of this phenomenon would facilitate behavioural
and policy changes to eliminate this inequality.
54 J. Schorer et al.
Acknowledgements
We would like to thank the German Handball Federation for their cooperation. Additionally,
we would like to express our gratitude to Sebastian Bagats, Christina Janning, Rebecca
Rienhoff, Lennart Fischer and all the students from the seminar “talent detection in handball”
for their helping hand with the data collection. This study was in part funded by the Federal
Institute of Sport Science, Germany, IIA1-070704/09.
References
Abernethy, B., & Farrow, D. (2005). Contextual factors Delorme, N., & Raspaud, M. (2009). The relative age
influencing the development of expertise in effect in young French basketball players: a
Australian athletes. Proceedings of the 11th World study on the whole population. Scandinavian
Congress of Sport Psychology, Sydney, Australia. Journal of Medicine and Science in Sport, 19, 235-
Amir, Y., & Sharon, I. (1990). Replication Research: A 242.
"must" for the scientific advancement of Edwards, S. (1994). Born too late to win? Nature, 370,
psychology. In J. W. Neuliep (Ed.), Handbook of 186.
replication research in the behavioral and social Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A.
sciences (pp. 51-69). Corte Medera, CA: Select. (2007). G*Power 3: A flexible statistical power
Ashworth, J., & Heyndels, B. (2007). Selection bias and analysis program for the social, behavioral, and
peer effects in team sports: The Effect of Age biomedical sciences. Behavior Reseach Methods,
Grouping on Earnings of German Soccer 39, 175-191.
Players. Journal of Sports Economics, 8, 355-377. Grondin, S., Deschaies, P., & Nault, L. P. (1984).
Baker, J., Cobley, S., Montelpare, W. J., Wattie, N., & Trimestres de naissance et rendement scolaire.
Faught, B. (in press). Exploring proposed Apprentissage et Socialisation, 16, 169-174.
mechanisms of the relative age effect in Grondin, S., & Koren, S. (2000). The relative age effect
Canadian minor hockey. International Journal of in professional baseball: A look at the history of
Sport Psychology. major league baseball and at current status in
Baker, J., & Horton, S. (2004). A review of primary and Japan. Avante, 6, 64-74.
secondary influences on sport expertise. High Helsen, W. F., Starkes, J. L., & Van Winckel, J. (1998).
Ability Studies, 15, 211-228. The influence of relative age on success and
Baker, J., & Logan, A. J. (2007). Developmental dropout in male soccer players. American
contexts and sporting success: birth date and Journal of Human Biology, 10, 791-798.
birthplace effects in national hockey league Helsen, W. F., Starkes, J. L., & Van Winckel, J. (2000).
draftees 2000-2005. British Journal of Sports Effect of a change in selection year on success
Medicine, 41, 515-517. in male soccer players. American Journal of
Barnsley, R. H., & Thompson, A. H. (1988). Birthdate Human Biology, 12, 729-735.
and success in minor hockey: the key to the Helsen, W. F., Van Winckel, J., & Williams, A. M. (2005).
NHL. Canadian Journal of Behavioural Science, 20, The relative age effect in youth soccer across
167-176. Europe. Journal of Sports Sciences, 23, 629-636.
Barnsley, R. H., Thompson, A. H., & Barnsley, P. E. Jimenez, I. P., & Pain, M. T. G. (2008). Relative age
(1985). Hockey success and birthdate: The RAE. effect in Spanish association football: Its extent
Canadian Association for Health, Physical and implications for wasted potential. Journal of
Education, and Recreation, 51, 23-28. Sports Sciences, 26, 995-1003.
Benjamini, Y. (1988). Opening the box of a boxplot. Malina, R. M. (1994). Physical growth and biological
The American Statistician, 42, 257-262. maturation of young athletes. Exercise and Sport
Brewer, J., Balsom, P. D., Davis, J. K., & Ekblom, B. Sciences Reviews, 22, 389-434.
(1992). The influence of birth date and physical Malina, R. M., Bouchard, & Bar-Or, O. (2004). Growth,
development on the selection of a male junior maturation, and physical activity Champaign
international soccer squad. Journal of Sport Illinois: Human Kinetics.
Science, 10, 561-562.
Musch, J., & Grondin, S. (2001). Unequal competition
Cobley, S., Baker, J., Wattie, N., & McKenna, J. M. as an impediment to personal development: A
(2009). Annual age-grouping and athlete review of the relative age effect in sport.
development: A meta-analytical review of Developmental Review, 21, 147-167.
relative age effects in sport. Sports Medicine, 39,
Norikazu, H., Atsushi, H., & Toru, F. (2007).
235-256.
Relationship between date of birth, skeletal age,
Cobley, S., Schorer, J., & Baker, J. (2008). Relative age and anthropometric characteristics in
effects in elite German soccer: a historical adolescent elite soccer players. Paper
analysis. Journal of Sports Sciences, 26, 1531- presented at the 12th Annual Congress of the
1538. ECSS 2007.
Relative age effects and technical skills 55
Pabst, J., Büsch, D., Wilhelm, A., & Schorer, J. (2009). 879-886.
Haben es gute Handballer (selbst) in der Hand? Thompson, A. H., Barnsley, R. H., & Stebelsky, G.
[Can good handball players be identified by (1991). Born to Play Ball - the Relative Age Effect
hand?], Manuscript in preparation. and Major-League Baseball. Sociology of Sport
Schorer, J., Baker, J., Lotz, S., & Büsch, D. (in press). Journal, 8, 146-151.
Influence of early environmental constraints on Till, K., Cobley, S., Wattie, N., O'Hara, J., Cooke, C., &
achievement motivation in talented young Chapman, C. (in press). The Prevalence,
handball players. International Journal of Sport Influential Factors and Mechanisms of Relative
Psychology. Age Effects in UK Rugby League. Scandinavian
Schorer, J., Cobley, S., Büsch, D., Bräutigam, H., & Journal of Medicine and Science in Sport.
Baker, J. (in press). Influences of competition Vincent, J., & Glamser, F. D. (2006). Gender
level, gender, player nationality, career stage differences in the relative age effect among US
and playing position on relative age effects. Olympic Development Program youth soccer
Scandinavian Journal of Medicine and Science in players. Journal of Sports Sciences, 24, 405-413.
Sports.
Wattie, N., Baker, J., Cobley, S., & Montelpare, W. J.
Sedlmeier, P. (1996). Jenseits des Signifikanztest- (2007). Tracking relative age effects over time in
Rituals: Ergänzungen und Alternativen. Methods Canadian NHL players. International Journal of
of Psychological Research Online, 1, 41-63. Sport Psychology.
Sherar, L. B., Baxter-Jones, A. D. G., Faulkner, R. A., & Wohlrab, S., Landgraf, L., & Feldmann, K. (1998).
Russell, K. W. (2007). Do physical maturity and Talentcamp - Erlebnis-Event und Ausbildungs-
birth date predict talent in male youth ice Check. Handballtraining, 20, 27-31.
hockey players? Journal of Sports Sciences, 25,
The authors
Dr. Joe Baker is an associate professor in the School of Kinesiology and Health
Science at York University, Canada and a visiting researcher at Leeds
Metropolitan University in the UK. His research examines the factors affecting
athlete development across the lifespan. Dr. Baker is the current president of
the Canadian Society for Psychomotor Learning and Sport Psychology.
PD Dr. Dirk Büsch is head of the Department of Game and Combat Sports and
has responsibility for elite youth sports at the Institute for Applied Training
Science University of Leipzig, Germany.
56 J. Schorer et al.
Prof. Dr. Andreas Wilhelm is currently working at the Institute for Sport and
Sport Science at the Christian-Albrechts-University Kiel, Germany. His
research interests include topics like groups, leadership, coaching, and sport
games.
Dr. Jan Pabst is currently employed as the Head of the Research Group
Handball at the Institute for Applied Training Science in Leipzig, Germany.
Talent Development & Excellence Gifted Learners’ Epistemological Beliefs 57
Keywords:
Learning, conceptual development, giftedness, epistemological beliefs
There are significant gaps in our knowledge of how children understand the educational
enterprise, and of how this understanding may impact their adjustment to school and
realization of their talents. In particular, it is imperative that we understand how children
with significantly developmentally advanced ability profiles understand their own
learning. Familiar norms do not apply to these children. Significant adaptations need to be
made to curricula and educational programming to meet their needs (Robinson, Zigler, &
Gallagher, 2000). Listening to children and providing environments and educational
strategies that engage them in understanding and directing their own learning are critical
to the notion of “gift-creation” advocated by Hymer (2009) and Huxtable (2009) and
consonant with the vision of contemporary classrooms where growth, enquiry, and
personally relevant education are the focus (Hymer, Whitehead, & Huxtable, 2009).
Harter (1996) pointed out how important it is to know how children perceive different
aspects of school life, in order that we can take these perceptions into account in
supporting them through the school years. However, education typically disregards
learners' perspectives on knowledge and their understanding of their capacity for
learning (Bruner, 1996). Children are thinkers (Bruner) with competent and legitimate
ways of making sense of the world. Children's understanding of learning is a necessary
starting point for pedagogy. Children's understandings are rarely engaged in this way,
but when they are, the result for children is deeper and more meaningful learning
(Bransford, Brown, & Cocking, 2000; Fosnot, 1996; Griffin & Case, 1996; McKeough, 1992).
Epistemic beliefs, or beliefs about knowledge and knowing, are related to self-regulated
learning and achievement (Muis, 2007) and intellectual performance (Kuhn, Cheney, &
Weinstock (2000).
What do children understand about learning and knowledge? This paper investigates the
epistemological beliefs of gifted learners, concentrating on how they understand the
relationship between themselves as knowers/learners and knowledge (Burr & Hofer,
2002). Following Burr and Hofer, ‘personal epistemology’ is the focus rather than
‘epistemology’ in the philosophical sense.
1
Faculty of Education, The University of British Columbia, 2125 Main Mall, Vancouver, BC,
Canada V6T 1Z4
*
Corresponding author. Email: marion.porath@ubc.ca
2
University of Alberta
Research on epistemological beliefs has been conducted primarily with adults and some
hypothesize that epistemological reasoning is not possible before the acquisition of
formal thinking (Hofer & Pintrich, 1997). There may, however, be developmental
precursors to epistemological thought, with abstract conceptions building on first
thoughts about what it means to learn, as suggested by Burr and Hofer (2002), Kitchener
(2002), and Kuhn et al. (2000). Very little research has been done on children’s
epistemological beliefs; the “origins of epistemological awareness” (Burr & Hofer, p. 200)
are not well understood. Studies on children include Burr and Hofer’s study of 3- to 5-year-
olds focused on the relationship of theory of mind and epistemological beliefs and Kuhn
et al.’s studies of 7- and 8-year-olds and 10-year-olds. The former suggested a relationship
between ability to predict and justify what others will think and do and theory of mind
ability characterized by development from inability to do either set of tasks, to the ability
to predict and justify in a relevant way, to the ability to coordinate both abilities
successfully. Burr and Hofer saw their study as only beginning to address a critical
developmental connection and call for more fine-grained, developmental studies that
investigate process. Similarly, they note the need to connect such studies to education,
highlighting that another gap in our understanding is that learners’ beliefs and the school
context have not been linked in any practical way (Ziegler, Stoeger, & Mundi, 2004). Kuhn
et al.’s work, while tangentially related to education in its articulation of development of
conceptions of knowledge from childhood to adulthood, also does not address the
educational implications of the influence of different views of knowledge on the process
of learning.
Mansfield and Clinchy’s (2002) study focused on children aged 10, 13, and 16, finding an
increasing ability to coordinate events with the “inner worlds of individual knowers” (p.
225). While they included a vignette featuring a teacher, the focus was on justifications for
why the child thought the teacher was nice or mean. Their identification of the age-related
increase in complexity and nature of epistemological position is important in
understanding the general nature of epistemological development but needs practical
translation to be meaningful in schools and the education of gifted learners.
Neo-Piagetian theory is the framework for the work presented in this paper. Neo-
Piagetian theories allow for the mapping of "precise changes in the development of
academic skills and understandings" (Mascolo, Li, Fink, & Fischer, 2002, p. 120). Because
of its articulation of the structure and content of children’s representations of the academic
and social dimensions of school, and the developmental course of these representations,
Case’s (1992; Case & Okamoto, 1996) neo-Piagetian theory provides an appropriate
framework for this study. Case (1992) described children’s central conceptual structures in
a number of domains (mathematical, spatial, social narrative; see Case & Okamoto, 1996).
These structures are “blueprints” of children’s understanding, the internal mental entities
that consist of the relations among a number of concepts. Because the relations are
semantic, articulating the meanings children assign to concepts, structures are conceptual.
Structures are considered central to a domain because they form the basis for
understanding a wide range of related tasks within that domain.
Studies of gifted learners framed within Case’s (1992) neo-Piagetian theory have found
development to be relevant to the level of conceptual understanding they demonstrate
(see, for example, McKeough, Genereux, & Jeary, 2006; Okamoto, Curtis, Jabagchourian, &
Weckbacher, 2006; Porath, 2006). That is, maturation is a factor in the level of conceptual
complexity demonstrated, even among highly able learners, when responses are
considered from the perspective of central conceptual structures. For this reason, work
with children who represented a typical range of abilities was used to inform this study of
gifted learners’ conceptions of learning.
Gifted Learners’ Epistemological Beliefs 59
Method
This study focused on gifted children's perspectives on learning. The task and analyses
reported are from a larger study focused on gifted children’s understanding of learning
and teaching, their learning identities, and social aspects of education (Porath & Lupart,
2007). Eighty-one students from Grades 1 through 12 (43 boys; 38 girls) identified as
gifted participated in the larger study. Seventeen of the participants were enrolled in a 2-
year program that facilitated early entrance to university (11 in Year 1; 6 in Year 2). All
grades except 8, 9, and 11 were represented in the sample. (Canada’s school systems
comprise twelve grades, preceded by kindergarten.) The study included public and
parochial schools in two large western Canadian cities. The students were identified in
different ways, as is characteristic across school districts in western Canada. Identification
strategies included combinations of teacher nomination, superior academic achievement,
and/or superior intelligence or cognitive ability test scores. The participants attended a
variety of programs for gifted learners, including segregated classes and pullout
programs.
60 M. Porath et al.
2 • Gaining knowledge through a variety of To do … no, not to do but to think about what
modes and learning in different ways something means.
• Understanding/meaning is key Learning can mean different things like my one
• Rudimentary notion of knowledge example is probably you can learn about
• Future-oriented yourself, like what…yourself means to you,
• General idea of brain’s role in learning what is really inside you…or you can learn
knowledge based like… math, and reading,
and drawing, PE, all sorts of learning …to do
with knowledge well actually PE isn’t to do with
knowledge but whatever …and…I guess
learning can also mean learning about…
relationships like sometimes you might have
problems with your friends like you might get
into a fight but you always learn from your
mistakes…so… I think that’s what learning
means.
3 • Acquisition of competence – increasing I’m finding out new things, researching things,
knowledge; learning new things and … basically passing on what others have
• Awareness of interests, weaknesses, learned. It doesn’t always happen to a kid.
boredom, curiosity Learning doesn’t stop when you become an
• Multiple modes of learning adult, so being a scientist … it’s always
• Learning as continuous learning new stuff.
4 • Links you to knowledge traditions Learning to me means to find new things, new
• Transformative understandings of things.
• Awareness of the breadth of learning You absorb information from others and you
(variety of sources, vicarious learning) try to use it in your own life.
5 • Views of learning and knowledge related Changing behaviour through experience and
to personal preferences and goals applying the knowledge.
• Recognition of ideas and different It’s a function of mind.
perspectives on knowledge There is a spark when you are happy about
• Characterization of learning as abstract what you are learning, asking questions, and
• Recognition of neuropsychological factors making your own connections.
in learning (perception, associative It’s interesting to learn new things and open
learning) your point of view.
Putting information together to see if it can be
combined to come up with an idea.
Conceptions of Learning
This task was the first of a series of research tasks completed by the participants. Each
child participated in an individual semi-structured interview, using the questions below as
a framework for discussing their perspectives on learning. Their responses were recorded
and transcribed for analysis.
• What does learning mean?
• What is happening when you are learning?
• Where does learning come from? (Bickerton, 1994)
Coding guidelines for responses to the first two questions were devised based on
inductive analyses of children’s responses and Case’s (1992) theoretical framework. The
Gifted Learners’ Epistemological Beliefs 61
scheme also drew on McKeough’s (1992; McKeough & Genereux, 2003) work on
development in the narrative domain, viewing learning, generally and specifically, as an
intentional act focused primarily on knowledge acquisition during middle childhood and
an interpretive epistemological act in adolescence (Table 1). Coding guidelines were the
result of an iterative process in which data were examined in light of Case’s (1992) neo-
Piagetian theory of development; prototypical characteristics of stages in child and
adolescent development defined; and children’s best responses assigned to a level of
development. Coding was done first by four individual coders who were research
assistants on the project; codes were then compared and discussed in pairs; the final
stage involved comparing and discussing codes in the group of four to reach consensus.
The process used was a “constructivist revision of grounded theory” (Henwood &
Pidgeon, 2003, p. 134); the data guided interpretation within the conceptual framework of
developmental theory using the steps of open coding, constant comparison, and
theoretical integration (Henwood & Pidgeon). Analyses were primarily qualitative in
nature. However, following other neo-Piagetian studies, a numerical score was assigned to
levels of development and used in a statistical analysis of developmental trend.
Responses to the question regarding the source of learning were content analyzed,
focusing on whether the source was external, internal, or a combination of the two and the
degree of sophistication evident in the response. This analysis was also informed by
Case’s (1992) theory of development; however, no numerical scores were assigned.
Results
Development of Conceptions of Learning
Participants were grouped by grades; these groupings approximated the age ranges
specified by Case (1992) for each of his hypothesized developmental stages (Grades 1
and 2, n=6; Grades 3 and 4, n=12; Grades 5 and 6, n=24; Grade 7, n=12; Early Entrance 1
and 2 with Grade 10, n=23; and Grade 12, n=4). Mean (SD) learning scores by group are
reported in Table 2. Learning scores were analyzed for age effect using a oneway ANOVA.
A significant between groups effect was found, F(5, 76)=6.73, p=.000. The linear trend was
significant, F(1,80)=26.02, p=.000, with no significant deviation from a linear trend, F(4,
77)=1.90, p=.119. Post hoc comparisons were not done due to the unequal group sizes.
a
Average age is an estimate based on the usual age of Grade 12 students. Age for these students was
not noted during data collection.
62 M. Porath et al.
Sources of Learning
Children’s attributions for the sources of learning developed from external sources, often
with little relationship to learning, in young children to a blend of internal and external
sources later in middle childhood. Through adolescence a trend was observed that saw
movement from primarily internal to primarily external to a blend of the two, all in more
sophisticated statements that reflected growing recognition of the complexity of learning
(Table 3).
Discussion
While the research was limited by unequal sample sizes, with few participants at the
youngest and oldest points in the age range, and the cross-sectional design, it provides a
beginning to articulating how gifted learners think about learning and knowledge. The
youngest children’s responses suggest that there are developmental precursors to
epistemological beliefs and that these earliest understandings lay the foundations for
more sophisticated understandings of learning and knowledge. As the research was
conducted in school settings, a bridge was made to what learning and knowledge mean
to children in schools, contributing to our knowledge of how personal epistemologies are
relevant to school learning. The children’s responses also offer insight into how some of
our brightest students conceive of learning.
Educational Implications
Understanding the epistemological underpinnings of students’ approaches to learning
and academic subjects can help educators to support students to consolidate their
64 M. Porath et al.
Acknowledgements
A version of this paper was presented in the symposium, Developmental Trajectories in
Narrative Thought: Contributing Factors and Underlying Mechanisms, XIIth European
Conference on Developmental Psychology, University of La Laguna, Tenerife.
This research was made possible by a grant from the Social Sciences and Humanities
Research Council of Canada.
References
Bickerton, G. (1994, June). Narrative knowledge as Campbell, R. L. (1993). Commentary.
revealed in children’s perceptions of learning. Epistemological problems for neo-Piagetians.
Paper presented at the Canadian Society for In A. Demetriou, A. Efklides, & M. Platsidou,
the Study of Education, The University of The architecture and dynamics of developing
Calgary. mind (pp. 168-191). Monographs of the Society
Bransford, J. D, Brown, A. L. & Cocking, R. C. for Research in Child Development, 58(5-6,
(Eds). (2000). How people learn: Brain, mind, Serial No. 234).
experience, and school. Washington, DC: Case, R. (1992). The mind’s staircase: Investigating
National Academy Press. the conceptual underpinnings of children’s
Bruner, J. (1986). Actual minds, possible worlds. thought and knowledge. Hillsdale, NJ:
Cambridge, MA: Harvard University Press. Erlbaum.
Bruner, J. (1996). The culture of education. Case, R., Demetriou, A., Platsidou, M., & Kazi, S.
Cambridge, MA: Harvard University Press. (2001). Integrating concepts and tests of
Burr, J. E., & Hofer, B. K. (2002). Personal intelligence from the differential and
epistemology and theory of mind: developmental traditions. Intelligence, 29,
Deciphering young children’s beliefs about 307-326.
knowledge and knowing. New Ideas in Case, R., & Okamoto, Y. (1996). The role of central
Psychology, 20, 199-224. conceptual structures in the development of
Gifted Learners’ Epistemological Beliefs 65
Robinson, N. M., Zigler, E., & Gallagher, J. J. Ziegler, A., Stoeger, H., & Mundi, M. (2004). The
(2000). Two tails of the normal curve: epistemic learner model. In Tourón, J. (Ed.),
Similarities and differences in the study of Educational technology for gifted education:
mental retardation and giftedness. American From information age to knowledge era (pp.
Psychologist, 55, 1413-1424. 13-20). European Council for High Ability:
Pamplona, Spain.
The authors
Judy L. Lupart is a Professor and Canada Research Chair in Special Education, beginning
January 2003, in the Department of Educational Psychology at the University of Alberta.
She has served as the Founding Director of the University of Calgary Centre for Gifted
Education, and the Founding Editor of the journal Exceptionality Education Canada. Her
research, publication and teaching interests include inclusive education and school
transformation; cognition, transfer and educational applications; learning disabilities,
giftedness and at-risk learners; and girls, women and achievement.
Dr. Jennifer Katz has recently joined the Department of Educational Administration,
Foundations and Psychology in the Faculty of Education at the University of Manitoba,
Canada. Dr. Katz received her PhD in 2008 from the University of British Columbia and is
currently writing a book on “Teaching to Diversity: Universal Design for Learning and
Inclusive Learning Communities” for Pearson Education Press. Dr. Katz has been a
successful special education teacher, sessional lecturer, educational consultant,
classroom teacher, editor, and guidance counselor. Following her early years as an
elementary teacher, her work as an advocate of inclusive education is evident by her
written works and conference presentations. Dr. Katz brings to the faculty broad research
interests in the areas of: Inclusive special education, teaching to diversity, assessment,
and social and emotional learning development.
Abstract: This article presents a short-term program, The Leonardo Laboratory, for
children with coexisting learning disabilities and spatial gifts. The program was
developed in collaboration with a museum and administered as an after-school
program to a group of elementary-school children (20 boys and 5 girls) so that its
effectiveness could be evaluated preliminarily. Although the students in the program
did not demonstrate statistically significant gains in academic skills, they
demonstrated gains in self-efficacy and improvements in organizational skills. Thus,
the program we developed has promise for certain kinds of skills and attitudinal
development. Our work shows the importance of addressing the needs of children
with disabilities and gifts (twice exceptional children).
Kewords:
Twice exceptional children, learning disabilities, spatial gifts, after-school program
Students with coexisting learning disabilities and special talents (twice exceptional
children) are an often under-identified and under-served segment of the school-age
population (Baum, 2004; Dix & Schafer, 2005; Kalbfleisch & Iguchi, 2008). Although some of
these students are provided services for either their gifts or their learning difficulties,
very few are identified for services that both develop their areas of weakness and allow
them to explore their areas of strength (Bianco, 2005; Brody & Mills, 1997). This oversight
may have significant consequences, both direct and indirect, on students’ opportunities to
succeed in careers that utilize their areas of strength (Johnsen & Kendrick, 2005). Directly,
the students have little or no opportunity to develop their abilities and learn to
compensate for their disabilities. Indirectly, this lack of services may create a lessened
sense of self-efficacy. Ultimately, successfully intelligent individuals both capitalize on
strengths and compensate for or correct weaknesses, so instruction should address both
strengths and weaknesses (Sternberg & Grigorenko, 2007).
Given that these students require services both for their gifts and for their learning
disabilities, there have been a number of documented interventions aimed at developing
services specifically for this group of students. Predominantly, these programs are
described in literature that covers case studies and anecdotal reports (e.g., Hua, 2002;
Thrailkill, 2005; Turk & Campbell, 2005; Volker, Lopata, & Cook-Cottone, 2006); yet, there
are a few illustrations of small-scale group-administered programs (see below).
In terms of their objectives, these programs can be classified into three groups. First,
some are designed to address specific weaknesses these students possess. For example,
1
Yale University, Child Study Center, 230 South Frontage Road, New Haven, CT 06519-
1124,USA
2
The Eli Whitney Museum, USA
3
Syracuse University, USA
#
At Yale University during the completion of the Leonardo Lab project
4
Moscow State University, Russia
5
Tufts University, USA
6
Columbia University, USA
*
Corresponding author. Email: elena.grigorenko@yale.edu
ISSN 1869-0459 (print)/ ISSN 1869-2885 (online)
2009 International Research Association for Talent Development and Excellence
http://www.iratde.org
68 T. M. Newman et al.
one program utilizes a process-based remediation strategy to improve the reading skills
of three students who have both gifts and learning disabilities (Crawford & Snart, 1994).
Second, other programs address areas of weakness but are primarily designed to develop
areas of strength through enrichment activities (e.g., Baum, 1988; Cooper, Baum, & Neu,
2004). One such intervention, Project High Hopes, sought to identify and develop
scientific talents in students with special needs (Cooper et al. 2004). Finally, a number of
programs are designed to develop areas of strength while remediating weaknesses (e.g.,
Bees, 1998; Weinfeld, Barnes-Robinson, Jeweler, & Shevitz, 2002). For example, the Wings
program (Weinfeld et al., 2002) was developed to ensure that students with both gifts and
learning disabilities have access to an enriched and accelerated curriculum, while also
receiving instruction, adaptations, and accommodations in their areas of weakness
through a cascade of services from integrated to self-contained classes, depending on
each student’s needs.
In addition to focusing on academic and cognitive skills, many programs acknowledge an
additional goal of increasing student self-efficacy and self-regulation. Both the literature
on students with gifts and the literature on students with learning disabilities describe
children who are at risk for socio-emotional difficulties, such as poor self-concept and
high levels of frustration and anxiety (Baldwin, 1999; Dole, 2000). Thus, a significant
benefit can be provided by programs designed to increase students’ self-efficacy.
While limited in number and scale, the literature on interventions for twice exceptional
students provides some generalizations regarding advisable approaches to educating
such students. One focal finding has been the importance of providing these students with
a curriculum relevant to their gifts and talents (Baum, Cooper, & Neu, 2001; Neilsen &
Mortoff-Albert, 1989; Weinfeld et al., 2002). The benefits of gifted-and-talented
programming have been seen in both academic achievement and self-concept. For
example, in a study of 76 grade 3 to 5 twice exceptional students, researchers (Neilsen &
Mortoff-Albert, 1989) found that those receiving a combination of gifted-and-learning-
disability services or only gifted services reported higher self-concept than those
students receiving interventions exclusively focused on remediating weaknesses.
Another finding in the literature has highlighted the importance of having an
individualized education plan that sets both strength-building and weakness-correcting
goals (Baum et al., 2001; Cooper et al., 2004; Shevitz, Weinfeld, Jeweler, & Barnes-
Robinson, 2003; Weinfeld et al., 2002). For example, the Wings program ensures that
students have individualized and appropriate instruction and accommodations in their
area of disability, while securing access to gifted programs or mentorships depending
upon need (Weinfeld et al., 2002).
Pedagogical programs for students with both gifts and learning disabilities have not been
rigorously evaluated. Yet, the preliminary evidence suggests that approaches addressing
both strengths and weaknesses appear to have a positive impact on students’ attitudes
toward school and their commitment to academic work.
Prompted by the success of programs for students with learning disabilities whose gifts
are in the analytical domain, and recognizing that strengths in other areas can promote
success in life, we developed and implemented the Leonardo Laboratory program. This
program was designed to address the creative and practical gifts of children who
experience difficulties in academic subjects, but who have strong spatial abilities. Gifts
that allow people to be successful in life can be found in a variety of domains, including
strengths in visual-spatial skills or creativity and innovation (Aaron, Joshi, & Ocker, 2004;
Mann, 2006; VonKarolyi & Winner, 2004). One goal of the Leonardo Laboratory program
was to develop an enrichment curriculum that allows students to develop their identified
strengths while at the same time identifying and remediating areas of weakness
(Sternberg & Grigorenko, 2007). A second goal was to increase self-efficacy and enhance
the self-regulation of these students, whose combination of gifts and disability has often
not led to the development of adequate related skills.
The Leonardo Lab 69
The present project was designed to (1) identify students who have academic difficulties
in reading, spelling, or math, while also displaying exceptional abilities in the creative arts
(e.g., drawing, painting, or design) or in practical/spatial skills (e.g., model building); (2)
develop an after-school program designed to address both the strengths and weaknesses
of these students; and to (3) preliminarily evaluate the effectiveness of this program. Thus,
we wanted to appraise findings from prior case-study and small-group research
suggesting that when children with both gifts and learning disabilities are provided with a
program that addresses their strengths, they demonstrate growth in areas of weakness
that are targeted within the program (e.g., task approach and follow-through), even
though they might not demonstrate improvement in areas of weakness that are not
targeted (e.g., reading-related and math skills). We also wanted to validate a claim from
prior research that students with both gifts and learning difficulties demonstrate growth in
self-efficacy and self-regulation when provided with an intervention program that
highlights their strengths and gives them opportunities to meet other students with
similar learning profiles.
To summarize, this project was conceived to develop an intervention for children with
coexisting spatial gifts and difficulties in reading/writing and/or math. In this article, we
describe the intervention, comment on the feasibility of its implementation in after-school
settings, and present some pilot data reflecting the promise of the intervention. Of note is
that, although there are no formal estimates of the prevalence of double exceptionalities,
the literature suggests that the number of twice exceptional children is low. Given this fact,
recruiting a second group of twice exceptional children to serve as controls was not
feasible, while a group of more typical students would not serve as adequate controls,
being drawn from too different a population. Hence our study was done as a preliminary
study only to assess whether there were any effects apparently associated with the
program, with plans for a future controlled study if these minimal conditions showed any
effects.
Method
Participants
The participating students were recruited through a brochure sent out to local elementary
schools and families who had previously participated in programs at the Eli Whitney
Museum (http://www.eliwhitney.org/) asking teachers and parents to nominate students
in grades 4 through 6 who demonstrated, simultaneously, both learning difficulties and
talents in drawing or building activities. A total of 33 students were nominated by their
teachers and parents; of those, 30 students attended an evaluation session. Of these
students, 11 were in grade 4, 14 in grade 5, 3 in grade 6, and 2 were being homeschooled.
There were 24 male students and 6 female students, and the average age of the
participants was 10 years 2 months (SD=.81). The program inclusion criteria were (1)
reading, writing, or mathematics difficulties and (2) talent in at least one other area of
endeavor (building, practical problem-solving, drawing). Of the 30 students assessed, one
was reported as not having any learning difficulties at school, and one was not interested
in the initial building project, and therefore deemed not well matched to the program. A
total of 28 students began the program; 25 students completed the program. Table 1
presents the group by age, gender, and ethnicity.
Table 1. Means and Standard Deviations of Age, Grade, Gender, and Ethnicity of Program
Participants
Project Site
The intervention program was designed in collaboration with and implemented by the Eli
Whitney Museum (http://www.eliwhitney.org/). The Museum is founded on the ideas of
industrial revolutionist Eli Whitney and seeks to encourage the resourcefulness,
innovation, and entrepreneurship exhibited by its namesake through a unique tradition of
learning via self-guided, hands-on problem-solving and experiences beyond the
conventional classroom.
The Museum offers projects that begin in play and grow into art, architecture, engineering
and science, and they include Japanese Toys and Technology, Rubber-Band Powered Cars,
Aeromodeling, and Boat Building. The intervention program at the Eli Whitney Museum
featured here was based on the works of Leonardo DaVinci and was led by the director of
the museum, William Brown.
Procedure
To collect pilot data on the outcomes of the intervention, participants were assessed
before beginning the Leonardo Laboratory program (Time 1, Pretest), then re-evaluated
again at the completion of the program (Time 2, Posttest). The tests used were group-
administered measures of nonverbal reasoning, math calculation, phonological and
orthographical knowledge, and perception of task approach and follow-through skills. For
performance assessment, students were asked to build a rubber-band powered car and
their projects were assessed on two dimensions: (1) practical problem-solving and (2)
creativity. In addition, parents completed a rating scale assessing their child’s task
approach and follow-through skills.
Targeted Skills
In designing the intervention program, the primary goal was to focus on students’
strengths while developing areas of weakness. In a recent surge of research in developing
self-regulated learning skills for children with learning disabilities (Harris, Reid, &
Graham, 2004), self-regulation and the related concept of metacognition are described as
encapsulating a number of skills, including (1) setting goals; (2) developing strategies to
meet those goals (planning) (Butler, 1998); (3) consciously monitoring progress (Butler &
Winne, 1995); (4) adjusting approaches as required (Butler & Winne, 1995); and (5) using
motivation to cope with setbacks or obstacles (Corno, 1993). There is evidence that
students with learning disabilities in postsecondary education continue to have
difficulties with these task-approach and follow-through strategies, and that those college
students with learning disabilities who employ self-regulation strategies are more
successful (Butler, 1998; Trainin & Swanson, 2005).
The purpose of this intervention was to help students develop these self-regulation
strategies – specifically task approach and follow through – while they completed projects
that capitalized on their strengths and helped them practice compensating for
weaknesses, including elements of reading/writing and doing math. The program also
intended to increase children’s self-efficacy.
Materials
Pretest measures included (1) a measure of nonverbal cognitive skills, (2) baseline
measures of academic skills that were areas of difficulty for students as specified in the
recruitment inclusion/exclusion criteria, and (3) a performance-based measure of
practical problem-solving and creativity. For the academic skills, specifically, we assessed:
(1) reading and reading-related skills (phonological processing, orthographical
processing, and print exposure); (2) math calculation skills; and (3) achievement as
indicated by a parental rating. We also collected measures on target areas that are often
challenging for students with learning difficulties, including parent and child ratings of
task approach and follow-through skills. We also administered a hands-on performance
The Leonardo Lab 71
a measure developed for this project that asks students to rate their own behavior on a 5-
point scale. The scale consists of 36 items measuring self-perception of task approach and
follow-through skills such as planning, preparing, and completing tasks at home and
school. This measure was administered at both pretest and posttest.
Performance measures. The Rubber-band-powered car task, developed by the Eli Whitney
Museum, gives students the parts and instructions for building a basic car powered by
rubber-bands. The task was assessed on two factors (1) function (practical) and (2) form
(creative). For the functional assessment, the student had to compete to see how far their
car could travel compared with the cars of other students. The students were given trial
and revision opportunities for testing their car. These trial and revision opportunities were
limited in time but not in number, so students could try their car and revise as many times
as they chose during a time period that was set for everyone. For the form assessment,
students were provided with resources to make their car unique.
Qualitative measures. Qualitative feedback was solicited from both parents and students
following the completion of the program. Parents were given a feedback form asking
three questions: (1) please describe any benefits of the program for your child; (2) please
describe any negative outcomes of the program for your child; and (3) please provide any
additional information that you feel may be important for us in evaluating this program.
Students were also given a feedback form with three questions: (1) please describe three
things that made this program good for you; (2) please describe anything about the
program that was not so good for you; and (3) please describe anything else about the
program that you think was great or not so great.
Intervention
General overview. The program included a series of ten workshops that invited students to
complete experimental building projects derived from Leonardo DaVinci’s notebooks.
Using activities initially sketched by DaVinci and further developed for the purposes of
this intervention, the program integrated exercises developing important learning skills
such as: (1) following the demands of the instructor while making projects on their own;
(2) coping with environmental constraints, such as availability of materials and tools; (3)
progressing through steps of the projects, i.e., planning, preparation, time scheduling,
exploring, and follow-through; and (4) specific skills in following directions, overcoming
obstacles, and recognizing their own successes.
Specific application of the goals. Each assignment allowed students to take responsibility
and realize the choices available in directing or ‘steering the project’. It also
acknowledged the restrictions that can be placed on an assignment by facilitators (i.e.,
museum staff members), reminding the student that in most learning situations, there are
boundaries that must be considered. Each project was also subject to environmental
constraints, such as resources and time constraints that can push an endeavor forward,
backward or in a different direction. At the start of each project, students were provided
with the basic materials and instructions for completing the project. A demonstration of
the steps for completing the basic model and examples of different ways of
individualizing the project were provided. Additional resources were provided (e.g., bins
of markers, scraps of wood, pieces of cloth, pipe cleaners, pieces of wire), and students
were reminded that they could use any other resources found at the museum. During
project building, facilitators circulated among the students, asking them about their plans,
how they were going to reach their goal, and what they were going to need. The
facilitators also reminded the students to consider the time available. No specific ideas
were provided to the students, although they were free to talk amongst themselves and
were encouraged to make the project their own. Each obstacle was presented as an
opportunity for choice, a time for decision-making, or a lesson to be learned. In deciding
how to overcome obstacles, students were supported by choices such as back-tracking
and finding alternate ideas, methods, and materials. At the end of each session, students
were taken aside individually and encouraged to consider the obstacles they had
The Leonardo Lab 73
encountered and overcome, the opportunities that had arisen, the opportunities captured,
the set-backs faced, the discoveries or successes, the disappointments, and the lessons
learned in their projects.
Results
Descriptive Statistics
To determine any significant effects of age and gender on the results, correlations were
calculated between these three variables and the rating scales and the academic-skills
measures. No significant correlations were found for age or grade with the Child-Report
measure, the Parent-Report measure, or any of the academic-skills measures
(phonological, orthographical, title recognition, or calculation) at either pretest or
posttest.
Intervention Outcomes
The Parent-Report Organizational Rating Scale and The Child-Report Organizational Rating
Scale were two new measures developed for this study. As these rating scales were new,
we wanted to ensure their reliability across time. The child and parent scales showed a
high degree of consistency with each other, indicating that children and parents tended to
agree on the abilities of the children. With respect to the internal consistency of the items,
the Child Rating Scale had a Cronbach’s alpha of 0.88 and the Parent Rating Scale had a
Cronbach’s alpha of 0.91, demonstrating a high degree of internal consistency.
Given the pre/post design of this pilot study and the small sample size, paired-sample t-
tests were conducted to determine any significant differences between the pre- to post-
test academic skills and the pre/post child and parent-ratings on task approach and
follow-through skills.
Academic skills assessed by group-administered tests of reading-related skills and math
calculation skills showed no significant differences from pre to post test, neither on the
omnibus, nor on individual tests. As these were not areas of intervention, this finding was
expected (see Table 2 for descriptive and inferential statistics).
Table 2. Means, Standard Deviations, and T-test Data of Pretest and Posttest Measures of Reading-
and Math-Related Skills
M SD M SD t-score p-value
The parent-rating scale and child-rating scale assessed skills that were targeted in the
intervention, and therefore, differences between pre and post ratings of parents’ and
children’s perceptions of task approach and follow-through skills were expected. The
parent rating scale showed a significant difference between pre and post ratings, with
74 T. M. Newman et al.
scores rising following the intervention, indicating that, overall, parents saw an
improvement in their children’s task-approach and follow-through skills. In particular, the
following items showed a significant positive change or approached a significant change
in rating from pretest to posttest: (1) overcoming obstacles in completing a homework
task; (2) leaving the house on time for school with minimal prompting; (3) following
multiple steps to complete a household chore; (4) overcoming obstacles in completing a
household chore; and (5) following instructions to complete a one-step household chore.
The child-rating scale demonstrated no comparable rise (see Table 3), however, given
that parents are the ones who provide all the support and/or reminders, they are likely the
ones who notice change first. Of note also are the dynamics of the correlations between
parent and child ratings at pre- and posttests (see Table 4).
Table 3. Means, Standard Deviations, and T-test Data of Pretest and Posttest Parent and Child Rating
Scales of Task Approach and Follow-Through Skills
M SD M SD t-score p-value
Table 4. Correlations of the Pre and Post Administrations of the Parent and Child Rating Skills
Pre Parent -
Qualitative feedback from parents converged on three themes: (1) the development of
areas of weakness, for example, “he is more willing to sit down and do homework, less
resistant, more persevering”; (2) the development of areas of strength, for example, “he
continued to work on each project when he got home”; and (3) the development of self-
efficacy, for example, “he doesn’t shrug off his accomplishments.” In general, parent
qualitative feedback confirmed the findings of the parent rating scale that children
showed improvement in areas of weakness. In addition, parents also indicated that
children experienced benefits to their self-efficacy and developed further their areas of
strength. Qualitative feedback from the students reflected primarily themes of self-
efficacy, for example, “showed me I could do good things that people love and want.”
The Leonardo Lab 75
Discussion
The results of the current study are consistent with the literature that suggests that
students who have both gifts and learning disabilities benefit from programs targeted to
developing their areas of strength. Although very preliminary and based only on
informants’ reports, this study provides some quantification of positive effects on the
improvement of targeted skills by the intervention. The students who participated in this
study diverged from those in previous studies in the fact that the focus was not on students
who demonstrated cognitive gifts, but on those whose gifts were in the creative and
visual-spatial domains. The intervention offered also differed in that students were
delivered a program out of the typical school curriculum, focused on developing not only
their strengths but also on areas of weakness that impact school performance. In
particular, the intervention targeted skills in task initiation and follow-through, areas often
found to be weak in students with learning difficulties. To quantify these skills, new
measures were devised to obtain ratings from parents and students on the application of
these skills from the intervention setting to outside settings, specifically, the home
environment and especially homework tasks.
The new measures offered a way to capture parents’ perceptions of students’ strengths
and weaknesses in task approach and follow-through. Parents reported significant
improvement on a number of items. Finally, parent and student qualitative statements
corroborated these findings.
One of the most important findings reported by both parents and students was the growth
in self-efficacy and self-recognition of an area of strength. At pretest, many of these
students were reported as experiencing social and emotional difficulties, including
anxiety and sadness. Parents reported concerns that their children were exhibiting
indications of learned helplessness in their school environments and were demonstrating
less effort in their schoolwork. At the time of the posttest, both parents and students
reported a re-engagement in goal-directed tasks and a sense that the student could
accomplish something worthwhile. One indicator of this program’s positive benefit to
these students is the number of students who have continued to engage in programs at the
Eli Whitney museum as both students and, later, facilitators, after first being introduced to
the Leonardo Laboratory.
Yet, although this work resulted in the development of a new and engaging program, the
data we present here are only preliminary and, though encouraging, should be
interpreted with caution. To validate and strengthen our claims about the potential of the
Leonardo Laboratory, a number of steps need to be taken. First, a formal effectiveness
study with a large sample of participants and a control group needs to be carried out.
Second, a battery of performance-based assessments capturing the skills targeted by the
program needs to be administered using the pre-/posttest design. Here we used
convergent information, provided by parents and the students themselves, but, as
indicated above, this is only the first step in carrying out an evaluation of the program.
Clearly, other adults, such as students’ teachers and museum personnel can be included
as additional informants. The positive feedback from parents and students might be
indicative of wishful thinking for change, rather than change itself. Finally, the
relationships that a number of the students subsequently built with the museum after their
participation in the Leonardo Laboratory, although encouraging, should also be
interpreted with caution: their comfort and satisfaction with the atmosphere of the
museum might not be indicative of learning and change.
In summary, this report is only an initial presentation of a promising intervention program
for children who have coexisting gifts and disabilities. With the program developed, the
next step is to formally evaluate it. Hopefully, there will be future opportunities for that
step to be made.
76 T. M. Newman et al.
Acknowledgements
This research was supported by Grant R206R950001 under the Javits Act program as
administered by the Office of Educational Research and Improvement, U.S. Department of
Education. Grantees undertaking such projects are encouraged to express freely their
professional judgment. This article, therefore, does not necessarily represent the position
or policies of the U.S. Department of Education, and no official endorsement should be
inferred. We express our gratitude to Ms. Mei Tan for her editorial assistance.
References
Aaron, P. G., Joshi, R. M., & Ocker, E. S. (2004). Education, 15, 162-169.
Dyslexia and visual-spatial talents: Are they Corno, L. (1993). The best laid plans: Modern
connected? In T. M. Newman & R. J. conception of volition and educational
Sternberg (Eds.), Students with both gifts research. Educational Researcher, 22, 14-22.
and learning disabilities: Identification, Crawford, S., & Snart, F. (1994). Process-based
assessment, and outcomes (pp. 199-234). remediation of decoding in gifted LD
New York, NY: Kluwer Academic/ Plenum students: Three case studies. Roeper Review,
Publishers. 16, 247-252.
Baldwin, A. Y. (1999). Learning disability: The Cunningham, A. E., & Stanovich, K. E. (1990).
mysterious mask - The USA perspective. In Assessing print exposure and orthographic
A. Y. Baldwin & W. Vialle (Eds.), The many processing skill in children: A quick
faces of giftedness (pp. 103-134). Belmont, measure of reading experience. Journal of
CA: Wadsworth Publishing. Educational Psychology, 82, 733-740.
Baum, S. M. (1988). An enrichment program for Dix, J., & Schafer, S. (2005). From paradox to
gifted learning disabled students. Gifted performance: Practical strategies for
Child Quarterly, 32, 226-230. identifying and teaching Gifted/LD
Baum, S. M. (Ed.). (2004). Twice-exceptional and students. In S. K. Johnsen & J. Kendrick
special populations of gifted students. (Eds.), Teaching gifted students with
Thousand Oaks, CA: Corwin Press. disabilities (pp. 153-159). Waco, TX: Prufrock
Baum, S. M., Cooper, C. R., & Neu, T. W. (2001). Dual Press.
differentiation: An approach for meeting Dole, S. (2000). The implications of the risk and
the curricular needs of gifted students with resilience literature for gifted students with
learning disabilities. Psychology in the learning disabilities. Roeper Review, 23, 91-
Schools, 38, 477-490. 96.
Bees, C. (1998). The GOLD program: A program for Gayan, J., & Olson, R. K. (2001). Genetic and
gifted learning disabled adolescents. environmental influences on orthographic
Roeper Review, 21, 155-161. and phonological skills in children with
Bianco, M. (2005). The effects of disability labels reading disabilities. Developmental
on special education and general education Neuropsychology, 20, 483-507.
teachers’ referrals for gifted programs. Harris, K. R., Reid, R. R., & Graham, S. (2004). Self-
Learning Disability Quarterly, 28, 285-293. regulation among students with LD and
Brody, L. E., & Mills, C. J. (1997). Gifted children ADHD. In B. Wong (Ed.), Learning about
with learning disabilities: A review of the learning disabilities (3rd ed., pp. 167-195).
issues. Journal of Learning Disabilities, 30, San Diego, CA: Elsevier Academic Press.
282-296. Hua, C. B. (2002). Career self-efficacy of the
Butler, D. L. (1998). The strategic content learning student who is gifted/learning disabled: A
approach to promoting self-regulated case study. Journal for the Education of the
learning. In B. J. Zimmerman & D. Schunk Gifted, 25, 375-404.
(Eds.), Developing self-regulated learning: Johnsen, S. K., & Kendrick, J. (Eds.). (2005).
From teaching to self-reflective practice (pp. Teaching gifted students with disabilities.
160-183). New York, NY: Guilford Press. Waco, TX: Prufrock Press.
Butler, D. L., & Winne, P. H. (1995). Feedback and Kalbfleisch, M. L., & Iguchi, C. M. (2008). Twice-
self-regulated learning: A theoretical exceptional learners. In J. A. Plucker & C. M.
synthesis. Review of Educational Callahan (Eds.), Critical issues and practices
Research(65), 245-281. in gifted education: What the research says
Cattell, R. B., & Cattell, A. K. S. (2002). Culture Fair (Vol. 707-719). Waco, TX: Prufrock Press.
Intelligence Tests. Champaign, IL: Institute Mann, R. L. (2006). Effective teaching strategies for
for Personality and Ability Testing, Inc. gifted/learning-disabled students with
Cooper, C. R., Baum, S. M., & Neu, T. W. (2004). spatial strengths. The Journal of Secondary
Developing scientific talent in students with Gifted Education, 17, 112-121.
students with special needs: An alternative McBride-Chang, C., Manis, F. R., Seidenberg, M. S.,
model for identification, curriculum, and Custodio, R. G., & Doi, L. M. (1993). Print
assessment. The Journal of Secondary Gifted
The Leonardo Lab 77
The authors
William Brown, MSW, is the Director of the Eli Whitney Museum and Workshop in
Hamden, Connecticut. He is a designer, educator, and social worker who trained
in child development at Columbia University in New York. In addition to directing
all aspects of the Eli Whitney Museum’s programs, Mr. Brown runs an
apprenticeship program and designs and teaches core summer workshops.
Dr. Hart received her Ph.D. in cognitive psychology from the University of
Pittsburgh, with a concentration in neuroscience through the Center for the
Neural Basis of Cognition. Currently, Dr. Hart is an Associate Research Scientist at
the Yale University Child Study Center. Her research interests focus on reading
development, skilled reading performance, and impairments in language and
reading processes.
78 Tina M. Newman et al.
Niamh Doyle is originally from Dublin, Ireland where she received a B. Ed in Elementary
Education from St. Patrick's College (Ireland) and a B.Sc in Psychology from Open
University (U.K.). Niamh received her MA in Psychology and is currently in her 5th year of a
doctoral program in School Psychology at Syracuse University (USA). Prior to pursuing
graduate studies, she was an elementary school teacher in Ireland and Australia and a
research assistant at the Yale University Child Study Center and PACE center. Research
interests include school and family integration, parent-teacher relationships, early
detection of developmental disabilities, and transitions from pre-k to kindergarten for
children with disabilities. Niamh’s master's thesis examined parents’ perspectives on
education and teacher quality and levels of involvement in school life. Niamh hopes to
extend that line of research examining the validity of parents’ perspectives on teacher
quality and its relationship to classroom quality.
Manuscript
• Length: A paper submitted should not exceed 6000 words including abstract,
references, illustrations and appendixes.
• Abstract: An abstract should consist of a maximum 125 words. The abstract must, if it
is the result of an empirical research, briefly outline theoretical basis, research
question/s, methodology and instrumentation, sample/s and important characteristics
(e.g. number, gender and age) as well as the main findings of the study. Also, it should
include main conclusions. An abstract for a theoretical article or a review should
describe the topic, the objective or thesis and the scope of the article. It should also
outline the main conclusions.
• Footnotes should be numbered consecutively with superscript Arabic numerals.
• If reporting statistics, sufficient information must be included according to the APA
Manual.
If you have any questions about references or formatting your article, please contact the
Editors-in-Chief.
Copyright
It is a condition of publication that authors assign copyright or licence the publication
rights in their articles, including abstracts, to the International Research Association for
Talent Development and Excellence. Authors are themselves responsible for obtaining
permission to reproduce copyright material from other sources.
ISSN 1869-0459 (print)/
ISSN 1869-2885 (online)