Professional Documents
Culture Documents
Technology Education
To cite this article: Bekele Gashe Dega & Nadaraj Govender (2016): Assessment of Students
Scientific and Alternative Conceptions of Energy and Momentum Using Concentration
Analysis, African Journal of Research in Mathematics, Science and Technology Education, DOI:
10.1080/18117295.2016.1218657
Article views: 14
Download by: [Ryerson University Library] Date: 10 October 2016, At: 22:46
African Journal of Research in Mathematics, Science and Technology Education, 2016
http://dx.doi.org/10.1080/18117295.2016.1218657
2016 Southern African Association for Research in Mathematics, Science and Technology
Education (SAARMSTE)
This study compares the scientic and alternative conceptions of energy and momentum of university rst-
year science students in Ethiopia and the US. Written data were collected using the Energy and Momentum
Conceptual Survey developed by Singh and Rosengrant. The Concentration Analysis statistical method
was used for analysing the Ethiopian data from 72 students and extending the analysis of the American
data from 352 students in the Singh and Rosengrant study. Low levels of scientic conceptions of
students responses were identied for both groups of respondents. A three-level categorisation of
students responses showed that the distribution of responses to 80% (ETH) and 52% (US) of the items
represented the null-model or random state. The distribution of responses to 20% (ETH) and 48% (US) of
the items represented the bi-model state and none of the items was responded to in a purely correct or
alternative conception one-model state. The analysis of the data revealed a variety of students
alternative conceptions and phenomenological primitives (p-prims) regarding energy and momentum.
The ndings imply that teachers should explore the use of the Concentration Analysis method in
identifying alternative conceptions and p-prims in physics to support their students learning.
Keywords: Alternative conceptions; concentration analysis; energy and momentum; response states; scientic
conceptions
Research indicates that physics undergraduate students have difculties in understanding physics
concepts (Wieman & Perkins, 2005). In this study, we investigated students scientic and alternative
conceptions of energy and momentum. Singh and Rosengrant (2003) developed a research-based
test, the Energy and Momentum Conceptual Survey (EMCS), to assess American (US) introductory
university students conceptual understanding of energy and momentum. This study focused on the
Ethiopian context, where science students have limited practical hands-on experiences at secondary
school (Bekalo & Welford, 1999; Bradley, 2016) that could affect negatively their understanding of
science concepts. In contrast, US students generally have access to laboratories and technologies
at school level.
While Singh and Rosengrants (2003) study has additional information from interviews on students
understanding, it does not explicitly focus on the distribution of students alternative conceptions. It is
not easy to get information on the nature of students alternative answers from traditional test score
analysis, as such an analysis often depends solely on frequencies of students giving the correct
African Journal of Research in Mathematics, Science and Technology Education is co-published by Unisa Press and Routledge, Taylor & Francis Group
2 Dega and Govender
answer. Traditional test analysis lacks rigorous statistical analysis to assess the concentration of stu-
dents responses to the correct and alternative answers.
Concentration analysis, a statistical method, incorporates information on students scientic and
alternative conceptions and describes their associated response level as well (Bao & Redish,
2001). Thus, more nuanced insight can be obtained about students thinking. Concentration analysis
used as a diagnostic tool can inform teachers on the range of alternative conceptions and phenomen-
ological primitives (p-prims) (diSessa, 1993) they need to address in their teaching. p-Prims originate
from common experiences of ready schemata in terms of which one sees and explains the world
(diSessa, 1993, p. 112) and once identied teachers can design appropriate instructional approaches
for conceptual change.
This study explored to what extent Ethiopian introductory undergraduate students perform differently
from US students in terms of conceptual understanding of energy and momentum. The research ques-
tions are: how are the Ethiopian students scientic and alternative conceptions of energy and momen-
tum categorised into levels using concentration analysis; and how do these results compare with US
students EMCS test results?
Literature Review
Teaching for conceptual development of science concepts arose from research in the 1980s on stu-
dents alternative conceptions (Driver, 1989). An essential part of both assessment of and teaching
for conceptual development was to clarify students existing ideas and to help them construct the scien-
tically accepted ideas. Both strategies have a benecial impact on students conceptual change,
either directly or indirectly, by modifying their motivation beliefs which, in turn, inuence conceptual
change (Yin et al., 2008).
Students hold a number of alternative conceptions when describing energy and momentum ideas in
real situations. For example, several students think that energy is a concrete entity and not an abstract
idea. They often confuse the concepts of energy and force (Kruger, Palacio, & Summers, 1992), kinetic
energy and momentum (Bryce & MacMillan, 2009) and energy, power and energy conservation (Goldr-
ing & Osborne, 1994). Questions involving workenergy and impulsemomentum theorems are typi-
cally perceived to be more difcult than those involving their special cases, momentum and energy
(Lawson & McDermott, 1987). Singh and Rosengrant (2003) found that many students have difculty
in using the conservation of energy and momentum principles appropriately in a variety of practical situ-
ations. University students also have difculties with energy concepts in that they fail to recognise the
implications of a particular choice of system (Lindsey, Heron, & Shaffer, 2012) and their application to
everyday situations (Jewett, 2008; Lindsey et al., 2012). In some cases, students do not believe that
particular groupings of objects can even be considered a system. This failure reects a tendency to
assume that the energy of any system remains constant because energy is conserved. In other
cases, students reasons for changes in kinetic and potential energies are over-generalised in that
they do not recognise situations when changes are inadequate. Differentiation of fundamental con-
cepts in physics is also problematic. For example, several introductory physics students are unable
to answer basic questions involving collisions of objects because of their failure to differentiate the
scalar quantity kinetic energy from the vector quantity linear momentum (Close & Heron, 2010).
They also categorise work and energy as vector quantities because of the positive or negative sign
attached to the work done by or against gravity and work done by or against friction. The literature
review conrms that students understanding of energy and momentum is often fraught with multiple
difculties viewed from both teaching and learning perspectives.
Methodology
A quantitative research method was used to collect and analyse data from 72 undergraduate calculus-
based physics students at a university in Ethiopia prior to their exposure to introductory physics. The
EMCS diagnostic test of 25 items (see Appendix) developed by Singh and Rosengrant (2003) was
Assessment of Students Scientic and Alternative Conceptions of Energy and Momentum Using Concentration Analysis 3
used to assess students conceptual knowledge of energy and momentum concepts. It is a Multiple
Choice Questions (MCQ) test with a combination of scientic conceptions as correct answers and
alternatives as distractors. The EMCS test has been used in many other studies throughout the litera-
ture and its validity has been established.
where m stands for the number of multiple options and ni is the number of students responses to the ith
option, where i varies from 1 to m, and N is the total number of students who wrote the test. The value of
the concentration factor also varies from 0 to 1. For example, if an MCQ single-response question with
ve choices (AE) was given to 100 students, then three possible distributions of the students
responses to the question as adapted from Bao and Redish (2001) would be given, as in Table 1.
In Table 1, a type I distribution represents an extreme case (Cf = 0) where the responses are evenly
distributed among all the choices, such as for the results of random responses. Type II is a more typical
distribution that may occur in many situations where students responses to a test item show a higher
concentration for some choices than for others (0 < Cf < 1). Type III is the case where every student has
selected the same choice (Cf = 1).
Type A B C D E S Cf
I 20 20 20 20 20 0.2 0
II 40 30 20 5 5 0.4 if A is correct, 0.3 if B is correct, 0.2 if C is correct, >0 and <1
0.05 if D or E is correct
III 100 0 0 0 0 1 if A is correct otherwise 0 1
4 Dega and Govender
concepts, they may act as if they have no models at all, or as if they would choose from a wide variety of
different conceptions (null-model). In this case, their response model state level is LL. In the bi-model
state, the response model states levels range from two popular to two non-popular levels. The way in
which the students responses are distributed can provide useful information about the students
response model states.
Analysis methods
Permission was obtained from the authors to use the EMCS items. We reconceptualised part of Singh
and Rosengrants (2003) data (pre-test A, p. 610) from a calculus-base class of 352 US introductory
physics students who took the EMCS test. We incorporated the percentage responses, S, Cf and
model state for each EMCS question. The purpose was to make justiable comparisons with the
results of our study. The scores and concentration factors were calculated, represented and analysed
using equation (1) and Tables 1 and 2. The corresponding response model states were categorised
using Table 3.
Results
For analytic purposes, we categorised the 25 EMCS items into ve conceptual clusters (Table 4). The
results for each of these clusters are presented in Tables 59. The correct choices of EMCS items are
indicated in bold.
Table 5. Percentage distribution of students responses, score, concentration factor, levels and response model
state on items of conservation of mechanical energy
faster with two variations, namely, a dominant the acceleration of a falling object depends upon its
weight and less dominant the greater the mass the faster it falls. For the same question (15), the
US students MM state suggests one correct and one alternative modela dominant variation of
the p-prim, namely option C. The difference in the p-prims lies in the concept of acceleration,
which is more dominant for both groups than time. This observation can be explained by the
familiarity with F proportional to a in Newtons Second Law (more frequently tested in class), rather
than F proportional to 1/t. The bi-model states of both groups suggest that the students hold two
popular models involving conservative forces in CME, namely, the mechanical energy conservation
model and kinematic reasoning model compounded by the p-prim of larger mass causes larger
acceleration.
The US students responses to questions 9, 17 and 22 indicate fragmented ideas as reected in the
LL model state. However, responses to questions 2, 4 and 15 represent the bi-model state, i.e. a better
response than from the Ethiopian students LL model state suggesting Ethiopians students lesser
exposure to problems of this kind, either quantitatively or qualitatively. For question 2, the US students
response model state is MMone correct and one alternative conceptual model. The correct model
choice is based on CME and their alternative model on kinematics. Both groups selected a popular
incorrect choice of constant and higher slope (C). Probably the students used the mathematical
slope idea, the larger the slope, the larger the value of the quantity (speed) at the bottom of the
slide (p-prim). These students could also have interpreted the graph as a velocitytime
graph (where the tangent to the curve gives acceleration) rather than an xy position graph. The
ETH students LL state indicates that they also chose the distractor that described the longer the dis-
tance, the greater speed (p-prim) (B). The ML response model state for the responses to question 4
indicates that a prevailing conception amongst the US sample group is the scientic model for the
CME.
6 Dega and Govender
Table 6. Percentage distribution of students responses, score, concentration factor, levels and response model
state on items of work done by conservative and non-conservative forces
Momentum conservation
The response distributions for items 5, 10, 14 and 21 on momentum conservation in elastic and inelas-
tic collisions are presented in Table 7. ETH students responses to all questions of this cluster except
question 5 reect a random response stateLL. ETH students ML response state for question 5
suggests that they hold two non-popular models. The rst is the dominant conservation of momentum
model (correct answer D), suggesting that they associate an elastic collision with bouncing off as the
bullet does from the steel block. The other model relates to inelastic collision where students only use
Newtons second law (option C) while ignoring conservation of momentum. There is an increase in
mass of the wooden block as the bullet embeds in it, but the students reason that the force increases
and causes an acceleration. This student conception probably resulted in them deducing the incorrect
Assessment of Students Scientic and Alternative Conceptions of Energy and Momentum Using Concentration Analysis 7
Table 7. Percentage distribution of students responses, score, concentration factor, levels and response model
state of items on momentum conservation
answer that the wooden block travels faster than the steel block. For this item, the ETH students were
found to perform better than the US students in differentiating between elastic and inelastic collisions in
momentum conservation. The US students related the block travels faster after collision to only the
speed of the bullet (choice B). This students view shows a p-prim that momentum corresponds to
speed only rather than to the product of mass and speed.
The US students responses to all questions in this cluster reect the LL state apart from responses
to questions 14 and 21. Question 14 tests both momentum and CME. The MM state for this inelastic
collision item suggests two popular modelsone correct model based on conservation of momentum
selected by most students (D) and the other incorrect (B) model based on kinetic energy of the system.
These students did not consider work done or transfer of energy during the collision as a change in
kinetic energy resulting in the carts being stuck together and remaining stationary with zero momen-
tum and kinetic energy of the system just after collision. Question 21 also involves an inelastic inter-
action. The US students correct choice (C) results in the ML model state reecting a dominant
scientic concept. Although the concept of variable mass during collision seems difcult to physics stu-
dents, the familiar context of a rain-cart system motion helped them to understand the problem. The bi-
model MM and ML states for questions 14 and 21, respectively, reect correct responses, suggesting
that the US students were better than the ETH students in differentiating between elastic and inelastic
collisions, conservation of momentum and CME.
Table 8. Percentage distribution of students responses, score, concentration factor, levels and response model
state of items on impulse and momentum
Table 9. Percentage distribution of students responses, score, concentration factor, levels and response model
state of items on energy and momentum
information needed to state that either the motorcycle or the truck has a larger momentum. For this
item, the LM state for ETH students suggests a possible alternative momentum conception (choice
D), namely, moving faster and having an acceleration, resulting in a larger momentum while ignoring
the mass effect; the p-prim identied is momentum is associated with changes in speed only. For US
students, their MM state suggests a correct conception by just over half of the sample as both mass
and speed are considered necessary to compare the momentum of the truck and motorcycle. Momen-
tum being the product of mass and instantaneous velocity seems to be an elusive concept and extre-
mely difcult, especially for ETH students, as only 8% selected the correct answer.
Question 18 is concerned with simple denitions and units related to linear momentum and impulse.
The ETH students bi-model ML state reects one correct model of the unit of measurement for
momentum and impulse being the same. For question 19, the US students ML state reects the scien-
tically correct model of changes in momentum over a longer time (option B). Although the distribution
of responses for questions 18 and 19 indicates the prevalence of the scientic conception of impulse
and momentum for one of the groups, the distribution of responses of the other group is considerably
different. A pattern emerges that abstract concepts comprising the product of two concrete concepts
are not understood easily.
Discussion
We categorised levels of the Ethiopian students scientic and alternative conceptions of energy and
momentum using concentration analysis and compared these results with US students EMCS test
results. A three-level categorisation of students responses showed that the distribution of responses
to 80% (ETH) and 52% (US) of the items represented the null-model or random state. The distribution
of responses to 20% (ETH) and 48% (US) of the items represented the bi-model state and none of the
items was responded to in a purely correct or alternative conception one-model state.
The results in this study are in agreement with Singh and Rosengrants (2003) study showing that
students lack a coherent understanding of the principles related to energy and momentum. Most stu-
dents did not use the principle of conservation of energy and momentum to answer the questions but
Assessment of Students Scientic and Alternative Conceptions of Energy and Momentum Using Concentration Analysis 9
relied more on a kinematical reasoning model. Few students of both groups held scientic conceptions
about work done by conservative and non-conservative force; hence they were unable to differentiate
conditions for work done. For the US students, prevalent scientically accepted models were reected
for several items testing conceptual clusters of CME, momentum conservation and systems of energy
and momentum conservation.
It seems that the students in Ethiopia are not explicitly exposed to some of the research on alternative
conceptions and conceptual change, like Force Concept Inventory research (Hestenes, Wells, & Swac-
khamer, 1992). Their responses attest to the tenacity of p-prims as universal alternative concepts
amongst school students (Dykstra & Sweet, 2009), university students at all levels (Hestenes et al.,
1992) and even teachers (Bayraktar, 2009). diSessa (1993) characterised prior intuitive knowledge in
terms of p-prims as minimal abstractions of common phenomena (p. 114) originating from interactions
of the daily physical world. Many of these are expressed as qualitative proportionalities such as the More
effort implies more result (p. 126) and observed in questions 2 and 15 as the greater the weight, the
faster the object falls. Lateral alternative conceptions (Dega et al., 2013) such as incorrect categorisation
of velocity as speed, momentum as force, work as force and a poor discrimination of the relationships
between work, energy and momentum concepts were revealed from their responses. In addition, the stu-
dents alternative conception revealed momentum as a scalar, rather than a vector, and ignored the com-
bination of the product of mass and velocity (Lawson & McDermott, 1987).
The methods of teaching physics in school and university in Ethiopia are mostly lecture-based with a
focus on mathematical problem-solving with occasional demonstrations and fewer laboratories and
technologies. The students also experience physics as a subject that is abstract and theoretical
(Semela, 2010) such that they cannot see the application in their daily lives. In Semelas study,
reports of observations of an Ethiopian university physics laboratory sessions conrm constraints
such as the shortage of equipment, the limited individual opportunities for hands-on practice and
lack of integration of theory and practical in terms of curriculum sequencing. It seems that the lack
of sufcient exposure to practical work as well as simultaneously elucidating the relevant theory has
impacted on students learning of concepts in energy and momentum as evidenced in the many
random LL states arising from questions involving practical and conceptual questions in Tables 59.
As English is a second language and is underdeveloped in Ethiopia, Ethiopian students may have
additional difculty in differentiating common daily words such as work and normal and abstract
words such as conservative and non-conservative, conservation and impulse amongst others, as
they are employed differently in physics. The use of local language context-based problems may
afford improved linkages between physics concepts and their everyday life experiences.
Conclusion
A quantitative research method was used to collect data from 72 rst-year Ethiopian university science
students who completed 25 multiple-choice items of the EMCS prior to their exposure to introductory
physics. The analysis showed low levels of the students scientic conceptions in energy and momen-
tum concepts. The Ethiopian students results were also compared to US students results from Singh
and Rosengrants (2003) study. A three-level concentration analysis categorisation of students
response distributions showed that the vast majority of the response distributions for the Ethiopian stu-
dents and the majority of those for the US students exhibited a random state. The signicance of this
categorisation is that the students response distributions showed neither a pure correct model nor an
incorrect model. The results of the study revealed a variety of students alternative conceptions and p-
prims, but mostly a fractured understanding regarding the principles of conservation of mechanical
energy, work done by conservative and non-conservative forces, the workenergy theorem and
momentum.
Implications
The study implies that teachers should engage their students more often with questions and familiar
contextual examples such as those of the EMCS that reveal conceptual difculties in the work
10 Dega and Govender
energy theorem. A workenergy approach to problem solving should be attempted rst rather than
kinematical reasoning. Teachers should address language difculties by highlighting different mean-
ings of words in different contexts and consolidate concepts such as kinetic energy, momentum and
impulse. More frequent individual exposure of practical work including ICT resources such as simu-
lations should be made available to Ethiopian students. Furthermore, the use of the Concentration
Analysis method is recommended to assess students possible categorisation of response model
states of particular concepts as it provides a deeper analysis for formative assessment by identifying
p-prims.
Funding
This work was supported by the University of KwaZulu-Natal, College of Humanities for post-doctoral
research.
References
Bao, L., & Redish, E. (2001). Concentration analysis: A quantitative assessment of student states. American Journal
of Physics, 69(S1), S45S53.
Bayraktar, S. (2009). Misconceptions of Turkish pre-service teachers about force and motion. International Journal
of Science and Mathematics Education, 7(2), 273291.
Bekalo, S., & Welford, A. (1999). Secondary pre-service teacher education in Ethiopia: Its impact on teachers com-
petence and condence to teach practical work in science. International Journal of Science Education, 21(12),
12931310.
Bradley, J. (2016). Achieving the aims of school practical work with microchemistry. African Journal of Chemical
Education, 6(1), 216.
Bryce, T., & MacMillan, K. (2009). Momentum and kinetic energy: Confusable concepts in secondary school
physics. Journal of Research in Science Teaching, 46(7), 739761.
Close, H. G., & Heron, P. R. (2010). Research as a guide for improving student learning: An example from momen-
tum conservation. American Journal of Physics, 78(9), 961969.
Dega, B. G., Kriek, J., & Mogese, T. F. (2013). Categorization of alternative conceptions in electricity and magnet-
ism: The case of Ethiopian undergraduate students. Research in Science Education, 43(5), 18911915.
diSessa, A. (1993). Towards an epistemology of physics. Cognition and Instruction, 10(23), 105225.
Driver, R. (1989). Students conceptions and the learning of science. International Journal of Science Education, 11
(5), 481490.
Dykstra Jr, D., & Sweet, D. (2009). Conceptual development about motion and force in elementary and middle
school students. American Journal of Physics, 77(5), 468476.
Goldring, H., & Osborne, J. (1994). Students difculties with energy and related concepts. Physics Education, 29
(1), 2632.
Hestenes, D., Wells, M., & Swackhamer, G. (1992). Force concept inventory. The Physics Teacher, 30, 141158.
Jewett Jr, J. W. (2008). Energy and the confused student I: Work. The Physics Teacher, 46(1), 3843.
Kruger, C., Palacio, D., & Summers, M. (1992). Surveys of English primary teachers conceptions of force, energy,
and materials. Science Education, 76(4), 339351.
Lawson, R., & McDermott, L. (1987). Student understanding of the workenergy and impulsemomentum theories.
American Journal of Physics, 55(9), 811817.
Lindsey, B., Heron, P., & Shaffer, P. (2012). Student understanding of energy: Difculties related to systems.
American Journal of Physics, 80(2), 154163.
Semela, T. (2010). Who is joining physics and why? Factors inuencing the choice of physics among Ethiopian uni-
versity students. International Journal of Environmental and Science Education, 5(3), 319340.
Singh, C., & Rosengrant, D. (2003). Multiple-choice test of energy and momentum concepts. American Journal of
Physics, 71(6), 607617.
Wieman, C., & Perkins, K. (2005). Transforming physics education. Physics Today, 58(11), 36.
Yin, Y., Shavelson, R., Ayala, C., Ruiz-Primo, M., Brandon, P., Furtak, E., Tomita, M. & Young, D. (2008). On the
impact of formative assessment on student motivation, achievement, and conceptual change. Applied
Measurement in Education, 21(4), 335359.
Assessment of Students Scientic and Alternative Conceptions of Energy and Momentum Using Concentration Analysis 11
12 Dega and Govender
Assessment of Students Scientic and Alternative Conceptions of Energy and Momentum Using Concentration Analysis 13