Professional Documents
Culture Documents
On Being a Scientist
Committee on the Conduct of Science
National Academy of Sciences
On Being a Scientist,
1989, National Academy Press,
Washington, D.C. Copyright 1989
by the National Academy of Sciences.
Reprinted with permission.
9053
9054
Report
Designer
Frank Papandrea
Report
..l
Mary-Dell Chilton
CIBA-Geigy Biotechnology
Gerald Holton
Professor of Physics and Professor of the History of Science
Harvard University
David Hull
Philosophy Department
Northwestern University
Kumar Patel
Executive Director,
Research, Materials Science, Engineering and
Academic Affairs Division
AT&T Bell Labs
Frank Press
President
National Academy of Sciences
Michael Ruse
Philosophy Department
University of Guelph, Canada
Phillip Sharp
Center for Cancer Research and
Department of Biology
Massachusetts Institute of Technology
Consultant Writer
Steve Olson
Staff
Barbara Candland
Lawrence McCray
9055
9056
Report
Preface
his booklet is written primarily for students who are beginning to
do scientific research. It seeks to describe some of the basic
features of a life in contemporary research and some of the
personal and professional issues that researchers will encounter
in their work.
Traditionally, young scientists have learned about the methods and values of
scientific research from personal contact with more experienced scientists, and
such interactions remain the best way for researchers to absorb what is still a
largely tacit code of professional conduct. Any beginning researcher who has
not worked closely with an experienced scientist is missing one of the most
important aspects of a scientific education. Similarly, any experienced researcher who does not pass on to younger scientists a sense of the methods and
norms of science is significantly diminishing his or her contribution to the
field's progress. However, the informal transmission of values is not always
enough. Changes in science in recent years, including the growing size of
research teams and the quickening pace of research, sometimes have had the
effect of reducing contact between senior and junior researchers. The increasing social importance and public visibility of science and technology also make
it essential that beginning researchers know how important they are to safeguarding the integrity of the scientific enterprise.
Some of the topics discussed in this document, such as sources of error in
science, scientific fraud, and misappropriation of credit, have received a great
deal of attention over the past decade, both within the scientific community and
outside it. In preparing this booklet, the governing council of the National
Academy of Sciences hopes to contribute to the discussion and to stimulate researchers to identify and uphold the procedures that keep science strong and
healthy.
One of the most appealing features of research is the great degree of personal
freedom accorded scientists-freedom to pursue exciting opportunities, to
exchange ideas freely with other scientists, to challenge conventional knowledge. Excellence in science requires such freedoms, and the institutions that
support science in the United States have found ways to safeguard them.
However, modern science, while strong in many ways, is also fragile in
important respects. For example, efforts to restrict the reporting of research
results can be devastating.
Most Americans see a strong science as essential to a successful future. Yet
that generous social support is based on the premise that science will be done
honestly and that mistakes will be routinely identified and corrected. The
mechanisms that operate within science to maintain honesty and self-correction
must therefore be honored and protected. Research institutions can support
these mechanisms, but it is the individual researcher who has both the capability and the responsibility to maintain standards of scientific conduct.
T
Frank Press
President
National Academy of Sciences
Report
Acknowledgments
The project was supported by a grant from the Richard Lounsbery Foundation.
Dissemination costs were supported by the Basic Science Fund of the National
Academy of Sciences, whose contributors include the AT&T Foundation,
ARCO Foundation, BP America, Dow Chemical Co., E. I. du Pont de Nemours
and Co., IBM, Merck Sharp & Dohme Research Laboratories, Monsanto, and
Shell Companies Foundation; and the consortium funds of the National
Research Council, consisting of contributions from the following private
foundations: the Carnegie Corporation of New York, the Charles E. Culpeper
Foundation, the William and Flora Hewlett Foundation, the John D. and
Catherine T. MacArthur Foundation, the Andrew W. Mellon Foundation, and
the Rockefeller Foundation.
9057
9058
Report
On Being a Scientist
Contents
9060
The Nature of Scientific Research
Is There a Scientific Method?, 9060
The Treatment of Data, 9061
The Relation Between Hypotheses and Observations, 9061
The Risk of Self-Deception, 9061
Methods and Their Limitations, 9062
Values in Science, 9062
Judging Hypotheses, 9063
Peer Recognition and Priority of Discovery, 9064
9065
Social Mechanisms in Science
The Communal Review of Scientific Results, 9065
Replication and the Openness of Communication, 9065
Scientific Progress, 9067
Human Error in Science, 9067
Fraud in Science, 9068
The Allocation of Credit, 9069
Credit and Responsibility in Collaborative Research, 9070
Apportioning Credit Between Junior and
Senior Researchers, 9071
Plagiarism, 9071
Upholding the Integrity of Science, 9072
The Scientist in Society
9072
Bibliography
9074
Report
9059
9060
Report
Report
9061
90762
Report
lieved that they were clouds of gas within our own galaxy.
One astronomer in the latter group, Adriaan van Maanen
of the Mount Wilson Observatory, sought to resolve the
issue by comparing photographs of the nebulae taken
several years apart. After making a series of painstaking
measurements, van Maanen announced that he had found
roughly consistent unwinding motions in the nebulae. The
detection of such motions indicated that the spirals had to
be within the Milky Way, since motions would be impossible to detect in distant objects.
Van Maanen's reputation caused many astronomers to
accept a galactic location for the nebulae. A few years
later, however, van Maanen's colleague Edwin Hubble,
using the new 100-inch telescope at Mount Wilson, conclusively demonstrated that the nebulae were in fact
distant galaxies; van Maanen's observations had to be
wrong. Studies of his procedures have not revealed any intentional misrepresentation or sources of systematic error.
Rather, he was working at the limits of observational
accuracy, and he saw what he expected to see.
Self-deception can take more subtle forms. For example,
a researcher may stop a data run too early because the observations conform to expectations, whereas a longer run
might turn up unexpected discrepancies. Insufficient
repetitions of an experiment are a common cause of
invalid conclusions, as are poorly controlled experiments.
largely defy rational analysis, yet they are among the tools
that scientists bring to their work.
Although methods are an integral part of science, most of
them are not the product of scientific investigation. They
have been developed and their use is required in science
because they have been shown to advance scientific
knowledge. However, even if perfectly applied, methods
cannot guarantee the accuracy of scientific results. Experimental design is often as much an art as a science; tools
can introduce errors; and judgments about data inevitably
rest on incomplete information.
The fallibility of methods means that there is no cookbook approach to doing science, no formula that can be
applied or machine that can be built to generate scientific
knowledge. But science would not be so much fun if there
were. The skillful application of methods to a challenging
problem is one of the great pleasures of science. The laws
of nature are not apparent in our everyday surroundings,
waiting to be plucked like fruit from a tree. They are
hidden and unyielding, and the difficulties of grasping
them add greatly to the satisfaction of success.
Values in Science
Report
9063
N RAYS
Self-delusion is not a danger only for individual scientists. Sometimes a number of scientists can get caught up in
scientific pursuits that later prove to be unfounded.
One of the most famous examples of such "pathological science" is the history of N rays. In the first few years of the
twentieth century, shortly after the discovery of X rays by the German physicist Wilhelm Roentgen, the distinguished
French physicist Rene Blondlot announced that he had discovered a new type of radiation. Blondlot named the new
radiation N rays after the University of Nancy, where he was professor of physics. The rays were supposedly produced
by a variety of sources, including electrical discharges within gases and heated pieces of metal; they could be refracted
through aluminum prisms; and they could be detected by observing faint visual effects where the rays hit phosphorescent
or photographic surfaces. Within a few years, dozens of papers describing the properties of N rays had been published in
journals by eminent scientists.
Other scientists, however, found it impossible to duplicate the experiments. One such scientist was the American
physicist Robert W. Wood, who traveled to Blondlot's laboratory in 1904 to witness the experiments for himself. After
viewing several inconclusive experiments, Wood was shown an experiment by Blondlot in which N rays generated by a
lamp were bent through an aluminum prism and fell on a phosphorescent detector. At one point in the experiment,
Wood took advantage of the room's darkness to surreptitiously remove the aluminum prism from the apparatus. Nevertheless, Blondlot continued to detect the visual signals that he believed were caused by N rays.
In an article in Nature published shortly after his visit, Wood wrote that he was "unable to report a single observation
which appeared to indicate the existence of the rays." Scientific work on N rays soon collapsed, and previous results
were shown to be experimental artifacts or the result of observer effects. Yet Blondlot continued to believe in the
existence of N rays until his death in 1930.
9064
Report
(1989)
Report
common knowledge are scientists free to use them without
attribution.
In deciding when to make a result public, a scientist
weighs several competing factors. If a result is kept
private, researchers can continue to check its accuracy and
use it to further their research. But researchers who refrain
from publishing risk losing credit to someone else who
publishes first. When considerations such as public
acclaim or patent rights are added to the mix, decisions
about when to publish can be difficult.
9065
Bypassing the standard routes of validation can shortcircuit the self-correcting mechanisms of science. Scientists who release their results directly to the public-for
example, through a press conference called to announce a
discovery-risk adverse reactions later if their results are
shown to be mistaken or are misinterpreted by the media
or the public. Publication in a scientific journal includes
important aspects of quality control-particularly, critical
review by peers who can detect mistakes, omissions, and
alternative explanations. If information transmitted
through the mass media cannot be substantiated later, the
public may not believe other, more careful researchers.
For this reason, many journals do not accept papers whose
results have been previously publicized by their authors.
When a press release is warranted, it should be scheduled
only when peer review is complete (normally, in conjunction with publication in a scientific joumal).
While publication in a peer-reviewed journal remains the
standard means of disseminating scientific results, other
methods of communication are subtly altering how
scientists divulge and receive information. The increased
use of preprints, abstracts, and proceedings volumes and
technologies such as computer networks and facsimile
machines are simultaneously increasing the speed of communication and loosening the network of social controls
imposed on formal publication. These new methods of
communication are often simply elaborations of the
informal exchanges that pervade science. But reliance on
such means of information exchange should not be
allowed to weaken the mechanisms of quality control that
operate so effectively in science.
9066
Report
Report
Scientific Progress
If there is one thing on which almost all scientists would
agree, it is that science is a progressive enterprise. New
observations and theories survive the scrutiny of scientists
and earn a place in the edifice of scientific knowledge
because they describe the physical or social world more
completely or more accurately. Relativistic mechanics is a
more thorough description of what we observe than Newtonian mechanics. The DNA molecule is a double helix.
Our apelike ancestors walked erect before brain sizes
greatly increased.
Given the progressive nature of science, a logical
question is whether scientists can ever establish that a
particular theory describes the empirical world with
complete accuracy. The notion is a tempting one, and a
number of scientists have proclaimed the near completion
of research in a particular discipline (occasionally with
comical results when the foundations of that discipline
shortly thereafter underwent a profound transformation).
But the nature of scientific knowledge argues against our
ever knowing that a given theory is the final word. The
reason lies in the inherent limitations on verification.
Scientists can verify a hypothesis, say by testing the validity of a consequence derived from that hypothesis. But
verification can only increase confidence in a theory, never
prove the theory completely, because a conflicting case
can always turn up sometime in the future.
Because of the limits on verification, philosophers have
suggested that a much stronger logical constraint on
scientific theories is that they be falsifiable. In other
words, theories must have the possibility of being proved
wrong, because then they can be meaningfully tested
against observation. This criterion of falsifiability is one
way to distinguish scientific from nonscientific claims. In
this light, the claims of astrologers or creationists cannot
be scientific because these groups will not admit that their
ideas can be falsified.
Falsifiability is a stronger logical constraint than
9067
verifiability, but the basic problem remains. General statements about the world can never be absolutely confirmed
on the basis of finite evidence, and all evidence is finite.
Thus, science is progressive, but it is an open-ended
progression. Scientific theories are always capable of
being reexamined and if necessary replaced. In this sense,
any of today's most cherished theories may prove to be
only limited descriptions of the empirical world and at
least partially "erroneous."
9068
Report
Fraud in Science
There is a significant difference between preventable error
in research, whether caused by honest mistakes or by
sloppy work, and outright fraud. In the case of error, scientists do not intend to publish inaccurate results. But
when scientists commit fraud, they know what they are
doing.
Of all the violations of the ethos of science, fraud is the
Report
9069
"We thus begin to see that the institutionalized practice of citations and references in the sphere oflearning is not a
trivial matter While many a general
reader-that is, the lay reader located
outside the domain of science and scholarship-may regard the lowlyfootnote or
the remote endnote or the bibliographic
parenthesis as a dispensable nuisance, it
can be argued that these are in truth
central to the incentive system and an
underlying sense of distributive justice
that do much to energize the advancement
ofknowledge. "
Robert K. Merton, "The Matthew Effect in Science, II: Cumulative Advantage and the Symbolism of Intellectual Property," Isis
79(1988):621
PATENT PROCEDURES
In some areas of research, a scientist may make a discovery that has commercial potential. Patenting is a means of
protecting that potential while continuing to disseminate the results of the research.
Patent applications involve such issues as ownership, inventorship, and licensing policies. In many situations,
ownership of a patent is assigned to an institution, whether a university, a company, or a governmental organization.
Some institutions share royalty income with the inventors. Universities and government laboratories usually have a
policy of licensing inventions in a manner consistent with the public interest, at least in cases in which federal funds have
supported the research.
Scientists who may be doing patentable work have an obligation to themselves and to their employers to safeguard
intellectual property rights. Particularly in industry or in a national laboratory, this may involve prompt disclosure of a
valuable discovery to the patent official of the organization in which the scientist works. It also entails keeping accurately dated notebook records written in ink in a bound notebook, ideally witnessed and signed by a colleague who is not
a coinventor. Data scribbled in pencil on scraps of paper interleaved in loose-leaf notebooks, besides being professionally undesirable, are of no use in a patent dispute.
Under U.S. patent law, a person who invents something first can be granted a patent even if someone else files a claim
first so long as witnessed laboratory records demonstrate the earlier invention. Any public disclosure of the discovery
prior to filing for a U.S. patent can jeopardize worldwide patent rights.
9070
Report
"Whether or not you agree that trimming and cooking are likely to lead on to
downrightforgery, there is little to support the argument that trimming and
cooking are less reprehensible and more
forgivable. Whatever the rationalization
is, in the last analysis one can no more be
a little bit dishonest than one can be a
little bit pregnant. Commit any of these
three sins and your scientific research
career is in jeopardy and deserves to be."
C. Ian Jackson, Honor in Science, New Haven, Conn.: Sigma
Xi, The Scientific Research Society, 1984, p. 14
Report
the implied contribution, but conventions differ greatly
among disciplines and among research groups. Sometimes
the scientist with the greatest name recognition is listed
first, whereas in other fields the research leader's name is
always last. In some disciplines, supervisors' names rarely
appear on papers, while in others the professor's name
appears on almost every paper that comes out of the lab.
Well-established scientists may decide to list their names
after those of more junior colleagues, reasoning that the
younger scientists thereby receive a greater boost in
reputation than they would if the order were reversed.
Some research groups and journals avoid these decisions
by simply listing authors alphabetically.
Frank and open discussion of the division of credit
within research groups, as early in the process leading to a
published paper as possible, can avoid later difficulties.
Collaborators must also have a thorough understanding of
the conventions in a particular field to know if they are
being treated fairly.
Occasionally a name is included in a list of authors even
though that person had little or nothing to do with the
genesis or completion of the paper. Such "honorary
authors" dilute the credit due the people who actually did
the work and make the proper attribution of credit more
difficult. Some scientific journals now state that a person
should be listed as the author of a paper only if that person
made a direct and substantial contribution to the paper. Of
course, such terms as "direct" and "substantial" are themselves open to interpretation. But such statements of
principle help change customary practices, which is the
only lasting way to discourage the practice of honorary
authorships.
As with citations, author listings establish responsibility
as well as credit. When a paper is shown to contain error,
whether caused by mistakes or fraud, authors might wish
to disavow responsibility, saying that they were not
involved in the part of the paper containing the errors or
that they had very little to do with the paper in general.
However, an author who is willing to take credit for a
paper must also bear responsibility for its contents. Thus,
unless responsibility is apportioned explicitly in a footnote
or in the body of the paper, the authors whose names
appear on a paper must be willing to share responsibility
for all of it.
9071
Plagiarism
9072
Report
for a halt to whole areas of scientific research or individuals who use a few events to question the entire ethos of
science can undermine the public's confidence in science,
with potentially serious consequences. Just as scientists
need to protect the workings of science from internal
erosion, they have an obligation to meet unjustified or exaggerated attacks from without with sound and persistent
arguments.
Report
society's problems, and scientists will be called upon to
make those contributions.
Scientists who become involved with the public use of
scientific knowledge have to take time away from work to
meet with community groups, serve on committees, talk
with the press. Many scientists enjoy these activities;
others see them simply as distractions from research. But
dealing with the public is a fundamental responsibility for
the scientific community. Concern and involvement with
the broader uses of scientific knowledge are essential if
scientists are to retain the public's trust.
Interacting with nonscientists also serves a less tangible
but still important function. Many people harbor misconceptions about the nature and aims of science. They
believe it to be a cold, impersonal search for a truth devoid
of human values. Scientists know these misconceptions
are mistaken, but the misconceptions can be damaging.
They can influence the way scientists are treated by others,
discourage young people from pursuing interests in
science, and, at worst, distort the science-based decisions
that must be made in a technological society.
Scientists must work to counter these feelings. They
should not disguise the human factors that motivate and
sustain research or the value judgments that inevitably
influence science. They should explain and defend the
scientific worldview, a prospect of great beauty and
grandeur that ought to be a part of how people think about
themselves and their place in nature. Scientific research is
an intensely human endeavor. This humanity must not be
lost in the face science presents to the world.
9073
9074
Report
Bibliography
An early but still excellent book on experimental design and statistical methods
for data reduction is E. Bright Wilson's
An Introduction to Scientific Research
(New York: McGraw-Hill, 1952). A
more general book from the same period
that remains popular today is Ahe Art of
Scientific Investigation by W. I. B.
Beveridge (New York: Vintage Books,
Third Edition, 1957).
9, 1974):1391-1410.
Harriet Zuckerman gives a thorough,
scholarly analysis of scientific misconduct
in Deviant Behavior and Social Control in
Science (pages 87-138 in Deviance and
Social Change [Beverly Hills, Calif.: Sage
Publications, 1977]). The Committee on