You are on page 1of 18

Essay

This year marks the 20th edition of the KIDS COUNT Data Book,
Counting What Counts: the 20th time that the Annie E. Casey Foundation has amassed
Taking Results Seriously critically important data on the well-being of our nation’s children
for Vulnerable Children and families into a single, easy-to-access volume that is now
and Families backed by an extensive online data system.

Our Foundation has invested millions of dollars over two decades


not only to produce the annual KIDS COUNT volumes, but
also to distribute them far and wide (more than 1 million copies
to date) and to underwrite an array of advocacy efforts aimed
at bringing these data to the public’s attention and promoting
appropriate policy responses.

The Casey Foundation has made these investments based on our


conviction that data-driven decision-making offers a powerful—and
sorely underutilized—tool to improve results for children. Results
matter, and achieving positive results requires us to keep our eyes
on the prize: carefully measuring the well-being of children; setting
meaningful goals for their care and development; identifying those
who are suffering or being left behind; strategically publicizing the
performance of public programs; and maintaining society’s focus
on the evolving, objectively measured needs of the next generation.

 The Annie E. Casey Foundation www.aecf.org


Essay

Results always matter. But they take on added to increase the quantity and quality of available data, more than 500 separate state-level data books and
importance in this time of economic crisis. The better utilize data to improve policy and practice, hundreds of briefs exploring the policy implica-
combination of increasing joblessness and mush- hold public agencies accountable for results, and tions of KIDS COUNT data. Each year, our KIDS
rooming home foreclosures is putting unprecedented mobilize states and communities to take data-driven COUNT website receives hundreds of thousands
pressure on millions of families. The threat is action on behalf of vulnerable children and families. of visits, from which users generate more than
especially dire for children born to families mired Despite the budgetary shortfalls facing all levels 1 million specific data tabulations.1
in poverty, as well as for kids facing special risks, of government, now is the wrong time to scale back Surveys find that 75 percent of state legislators
whose well-being depends on the quality of support data gathering and analysis. Improving the volume nationwide are aware of KIDS COUNT, and more
provided by government-financed systems that are and accessibility of good, timely, widely used, and than half say that they read KIDS COUNT reports
increasingly strapped for cash. easily understood data can lead to better-informed and find the data useful and relevant. Likewise,
These challenging circumstances demand that policies, more focused programming, and more effi- surveys find high levels of awareness and appre-
we do more with less. They demand accountabil- cient use of taxpayer dollars. Better and better-used ciation for KIDS COUNT among business leaders,
ity. And at the heart of accountability, both literally data can also provide the basis for a robust cycle county officials, congressional staff members, and
and figuratively, is the word “count.” Accountability of continuous improvement in our efforts to support other data users.2 The release of the KIDS COUNT
requires counting. children, families, and communities. Although some Data Book generates more than 1,000 news stories
In this 2009 KIDS COUNT Data Book essay, we may argue the cost of this investment, it amounts per year in newspapers with total readership exceed-
examine our nation’s progress in this crucial count- to a tiny fraction of current public expenditures on ing 50 million, plus television news coverage seen
ing process. How well are we as a nation, and in our children and families, with a potentially immense by 15 million to 20 million viewers.3
states and communities, marshalling the available payoff in reduced waste and improved results. This response to KIDS COUNT is just one
information to address pressing needs and create “What gets measured gets done,” says the old sign of a broad shift in the past two decades toward
meaningful opportunities for vulnerable children? truism, and what gets measured and fed back gets stronger measurement and a greater focus on out-
How well are we keeping track of children’s well- done well. In these difficult times, with millions comes accountability. To begin, there has been a
being, measuring the impact of public programs, of children’s well-being on the line, we simply must growing interest in capturing and publicizing data.
and holding ourselves collectively accountable for do a better job of counting what counts. For example, in the years following our inaugural
the healthy development of children? How effec- publication, the Federal Interagency Forum on Child
tively are we using new information technology Twenty Years of Important But and Family Statistics was established and initiated
to improve outcomes for those in need? Insufficient Progress an annual report, America’s Children, that presents
Although we see isolated advances, we mostly Since KIDS COUNT was inaugurated 20 years ago, national data on dozens of child well-being indicators
find that America’s efforts on these fronts remain the United States has made noteworthy progress compiled by 22 federal agencies.4 Similarly, a number
seriously wanting. This essay documents a per- in the collection of data related to children and of private organizations—including Child Trends
sisting inattention to results in many services and families, and our appreciation for data-driven policy- and the Foundation for Child Development—
systems designed to assist children and families, making has grown substantially. Evidence of this also initiated or expanded their efforts to compile
and an unfortunate array of missed opportunities can be seen in the response to the KIDS COUNT and analyze data on children’s well-being.
to improve outcomes through better use of infor- initiative itself. In addition to distributing 1 million- At the federal level, the heightened interest
mation and technology. Looking ahead, the Casey plus copies of the national Data Book since 1990, the in data has prompted significant improvements in
Foundation recommends a series of action steps Casey Foundation and its partners have published government efforts to collect information on the

The Annie E. Casey Foundation www.aecf.org 


Essay

circumstances and well-being of U.S. residents. Likewise, many state governments have begun
For example, for years, most data were compiled measuring systems and programs against quanti-
only once every decade through the constitutionally tative performance goals, often establishing both
mandated census. Although a small number of state-level children’s cabinets to monitor trends
surveys and studies funded by federal agencies sup- and set concrete benchmarks for advancing the
plemented the census, the data were at best limited well-being of families and issuing local-level report
in their depth and timeliness, making more precise cards to assess progress.
measurement of many important indicators chal- These developments are encouraging, but
lenging, if not impossible. nowhere near sufficient. We have embraced the
Today, this situation is much improved. The language of accountability and the rhetoric of
U.S. Census Bureau now conducts the American results-oriented programming, but we’ve made We have embraced the language of
Community Survey that collects detailed information much less headway toward putting these aspirations
accountability and the rhetoric of results-
from 3 million U.S. households every year and into effective practice. Our progress in harnessing
includes many measures related to children. In addi- the power of data to optimize outcomes for vulner- oriented programming, but we’ve made
tion, the federal government also issues several new able children and families falls far short of what
much less headway toward putting
surveys to better monitor children’s health, behavior, is possible, far short of what is needed, and
educational progress, civic engagement, and alcohol- far short of what private industry has achieved these aspirations into effective practice.
tobacco-drug use, thereby providing state- and in its efforts to maximize profits.
local-level information on important areas of well- Over the past two decades, advances in
being that were not previously researched. computer and telecommunications technology
In addition to a heightened federal interest in have radically changed how people all over the
data collection about the well-being of children and world spend their time, communicate with friends
families, we’ve also seen an increased focus on mea- and colleagues, and gather their news. The infor­
suring the impact of government programs designed mation revolution has also reshaped the way
to help them. In 1993, Congress enacted the Gov- business gets done in virtually every sector
ernment Performance and Results Act, requiring of our economy. New information technologies
every federal agency to develop and monitor quanti- and data-driven decision-making techniques
tative measures for their performance, a process that are demonstrating powerful results.
has continued (in modified form) ever since.
Also, Congress has increased data and reporting n In business, millions of American managers

requirements for many programs receiving federal now turn on their computers and see a “data
support and established high-stakes performance goals dashboard”—an interactive and continually
for several programs and systems that affect children’s updated graphic scorecard measuring their orga-
well-being, including the No Child Left Behind nization’s progress on a range of key performance
Act, the Temporary Assistance for Needy Families indicators, from employee turnover to sales per
(TANF) program, and state child welfare systems. square foot of shelf space.

The Annie E. Casey Foundation www.aecf.org 


Essay

n In medicine, according to a recent study, hos- had generated little attention in the state capitol.
pitals employing electronic health records and To highlight the consequences of lead poisoning
other automated information technology are seeing on cognitive development and school success, RI
significantly better results and lower costs than KIDS COUNT created a new indicator reflecting
hospitals that still rely on paper records.5 the percentage of children entering kindergarten
who had ever registered an elevated level of lead
n In professional sports, the Oakland Athletics in their blood. It also used the new, lower threshold
made the major league baseball playoffs for 4 from the Centers for Disease Control to define
straight years (2000 through 2003) despite a below- lead poisoning—a level common among Rhode
average payroll by applying a sophisticated new Island’s children that posed a significant risk for
In our own experiences and those approach to statistical analysis that enabled the cognitive impairment.7 A 1997 issue brief found
team to consistently identify underpriced talent6 — that one-fifth of all children entering kindergarten—
of our grantees, we’ve seen how good
and ushered in a new data- and statistics-driven and more than one-third of children in the state’s
data, when used properly, can powerfully generation of sports coaching and management. poorest cities—had a history of elevated blood
lead levels.8 By updating the lead poisoning
boost the effectiveness of government-
n In political campaigning, superior voter and indicator annually in its state-level data book and
financed human service programs and volunteer databases and the innovative use of Web- publishing a second issue brief on lead poisoning
based social networks were critical factors in Barack in 2003,9 RI KIDS COUNT has had a profound
improve the lives of vulnerable children—
Obama’s success in the 2008 presidential campaign. impact: Since 1997, the percentage of Rhode Island
particularly when tied to a purposeful children entering kindergarten with a history of
The Merits of Measuring elevated blood lead levels has shrunk from 28 per-
advocacy campaign.
At the Annie E. Casey Foundation, we believe that cent to 5 percent, and in the state’s central cities,
the effective use of information also offers immense the rates have fallen from 38 percent to 7 percent.10
promise in the realm of public services—including By publicizing existing data and advocating for
abundant opportunities to improve child and family appropriate responses, other state-level KIDS
well-being. In our own experiences and those of COUNT organizations achieve similar data-driven
our grantees, we’ve seen how good data, when used policy reforms every year, as do other policy
properly, can powerfully boost the effectiveness of research and advocacy organizations.
government-financed human service programs and
improve the lives of vulnerable children—particularly n Since 2001, a dedicated team of Casey Founda-

when tied to a purposeful advocacy campaign. tion specialists, the Casey Strategic Consulting
Some examples follow. Group (CSCG), has provided expert assistance
at no cost to state and local jurisdictions striving
n Until the Rhode Island KIDS COUNT organiza- to reform their child welfare and juvenile justice
tion began sounding the alarm about lead poisoning systems. Each of their projects has begun with
among young children in the mid-1990s, the issue intensive data analysis, often yielding eye-opening

10 The Annie E. Casey Foundation www.aecf.org


Essay

conclusions that crystallized consensus for funda- youth appear to be impacted differently from white Dimensions of the Data Deficit
mental reforms. Following the widely publicized youth. Site teams then review policies and proce- Unfortunately, the successes described in the earlier
death of a 5-year-old foster child in 2001, Maine dures in stages where disparities are apparent to section remain exceptions, while a persistent and
reached out to the Consulting Group for help in ferret out their underlying sources. In some cases, unnecessary data deficit continues to compromise our
reforming its embattled child welfare agency, the risk-assessment instruments might include items efforts to improve outcomes for children and families.
Office of Children and Family Services. By examin- that disadvantage minority youth. For example, in In metaphorical terms, long after the invention of
ing the agency’s performance data and comparing some communities, minority youth are more likely radar and GPS, we continue to fly blind in many
them to a dozen other states, CSCG (and its part- than whites to rely on public defender services that or most of our efforts to improve the lives of our
ners at the Chapin Hall Center for Children) found may be understaffed and poorly trained. In others, neediest children.
systemic problems: Too many foster children were a lack of detention alternatives in minority neigh- In particular, this data deficit remains glaring
living in group homes and other congregate care borhoods might increase the odds that youth of for two types of information essential to improved
settings; many children were spending too long in color will be confined pending trial. By using data decision-making: population data on the needs,
foster care before being reunified with their families to illuminate these situations, some JDAI sites have characteristics, and well-being of vulnerable chil-
or placed with adoptive families or relatives. Maine made encouraging progress in reducing disparities.11 dren and families and performance data measuring
has since reformed its child welfare system from the outcomes of government-funded programs and
top to bottom, embracing a family-centered practice As these examples suggest, the creative and services to support this population. In addition to
approach and developing a new user-friendly data­ far-sighted use of data has the potential to vastly these data quality issues, human service systems also
base that tracks progress on a weekly basis. The improve outcomes for children, families, and com- lag behind in the use of sophisticated management
results have been dramatic: a 67 percent drop in munities. Data-driven advocacy can help illuminate information tools that can spur rigorous analysis and
the number of Maine children in congregate care, the need for new programs and better policies and put usable information into the hands of decision-
a 35 percent drop in the total foster care population, foster a more targeted distribution of public resources. making practitioners. Below, we explore each
and a sizable increase in the number of children Rigorous data analyses and effective use of modern of these issues.
placed with relatives. In March 2009, Maine’s child information technologies can increase worker pro-
welfare system was named a semi-finalist for a pres- ductivity, reduce waste, diagnose and solve common Population Data
tigious Innovations Award in Children and Family problems, and help authorities understand and Despite significant improvements in recent years,
System Reform. begin eliminating the racial disparities that plague large gaps remain in our ability to usefully measure
public systems serving minorities and the poor. the overall well-being of children, families, and
n Rigorous attention to data has also been a crucial Seizing these opportunities, however, is neither communities. The deficiencies in our national
success factor in the Annie E. Casey Foundation’s automatic nor inevitable. Rather, progress requires poverty measure and the ways in which we collect
Juvenile Detention Alternatives Initiative ( JDAI). purposeful investment to collect the necessary data, critical demographic data through the decennial
This model is now being replicated in more than and it demands that leaders in both the public and census are two key examples.
100 jurisdictions nationwide and has sharply private sectors build the capacity to put those data A Dysfunctional Poverty Measure. Perhaps the
reduced detention populations in most sites without to effective use. But achieving this is challenging single most glaring shortfall comes in our efforts to
compromising public safety. One core JDAI practice in light of a number of factors that we examine measure poverty, the “key performance indicator”
is to analyze each decision point in the juvenile in the following section. that rises above all others in its impact on children’s
court process to identify stages where minority futures. Overwhelming research finds that growing

The Annie E. Casey Foundation www.aecf.org 11


Essay

up in poverty—especially deep and/or sustained A Skewed Census. Another critical gap comes
poverty, particularly in the first years of life—has in the decennial census, which consistently fails
crippling and lifelong consequences. Childhood to count millions of U.S. residents—most often
poverty is negatively correlated with school success, children and residents of low-income urban com-
future earnings, and both physical and mental munities. The U.S. Census Bureau’s own analyses
health. Children raised in poverty are far more showed that as in prior decades, the 1990 Census
likely than affluent or middle-class children to involved a widespread undercount of less affluent
suffer abuse or neglect. They are many times more minorities, coupled with an overcount of whites.14
likely than other children to become ensnared In 2000, the Census Bureau undertook new
in the justice system and less likely to find stable procedures, including engaging state, local, and
employment or form durable families.12 community organizations as partners and invest- Our system for defining and monitoring
Yet, our system for defining and monitoring ing in a public awareness campaign. These steps
poverty is thoroughly outdated. Developed
poverty is thoroughly outdated. Developed in the reduced the estimated number of undercounts
1960s, the official U.S. poverty measure is calculated and overcounts—but the final tally still missed in the 1960s, the official U.S. poverty
by summing the cost of a rudimentary grocery millions of people and duplicated millions more.
measure is calculated by summing the
budget and multiplying the total by three—because The Census Bureau analysis showed that minorities
food represented roughly one-third of a typical and young children continued to be missed cost of a rudimentary grocery budget
1960s family budget. The poverty threshold has at higher rates than others in the 2000 Census.15
and multiplying the total by three—
never been recalculated since that time—only Because the funding formulas for many federal
adjusted for inflation—even though food now programs are based on census population totals, because food represented roughly one-
consumes about one-seventh of a typical family’s undercounting low-income urban families means
third of a typical 1960s family budget.
budget. The outdated formula takes no account fewer services and less support in our most needy
of child care, transportation, health insurance, communities. Each undercounted resident means
and other expenses that consume a far greater share $12,000 less in federal support to a community over
of families’ incomes today, nor does it account for 10 years.16 Meanwhile, skewed census data for dis-
significant regional differences in the cost of living. tressed communities undermine our understanding
Perhaps even more important, poverty calcu­ of the very neighborhoods where children face the
lations exclude non-cash benefits, such as the longest odds of success.
earned-income and other refundable tax credits, Unfortunately, preparations for the 2010
housing assistance, and food stamps. All have Census have been riddled with difficulties. The
grown rapidly and represent the bulk of government Census Bureau cut short its scheduled “dress
support to low-income families. In other words, rehearsal” in 2008 —a crucial step for ensuring a
our nation’s so-called poverty measure provides smooth count—due to glitches with new handheld
absolutely no gauge of the impact of our major technologies. In 2008, the Governmental Account-
anti-poverty programs on reducing poverty.13 ability Office, the investigative arm of Congress,
added the 2010 Census to its list of 30 “high-risk

The Annie E. Casey Foundation www.aecf.org 13


Essay

areas” capable of undermining the effectiveness financial assets are virtually uncollected. For
of the federal government and wasting taxpayer example, with the exception of homeownership,
dollars.17 As late as June 2009, the Census Bureau the American Community Survey (ACS) doesn’t
still lacked a director. include questions about assets or debts. Although
Other Gaps in Well-Being Data. Although some national surveys do offer information about
issues around poverty measurement and the census family assets, they have far smaller sample sizes
are critical, there are also significant—and, in some than the ACS —thereby providing no valid state-
cases, growing—problems that plague other federal or local-level estimates. In sum, we have limited
data on child and family well-being. Consider the information on the assets, savings, and financial
following examples. stability of less affluent families.20
Although attention to the performance
n Nationally, we collect scant information on the Government Performance Data
of public systems that serve children
circumstances of younger children (infancy through Although attention to the performance of public
and families has intensified in recent age 10) and on teen dropouts (since many youth systems that serve children and families has intensi-
surveys are school-based). Similarly, we collect fied in recent years, we still don’t routinely collect
years, we still don’t routinely collect
less information about the positive development crucial outcome information from some of our
crucial outcome information from some of young people—such as school engagement, civic most important (and costly) public programs and
engagement, and social competence—than we do services. In addition, we too often assess perfor-
of our most important (and costly) public
on such problem-focused outcomes as delinquency, mance using measures that are incomplete, unclear,
programs and services. truancy, and substance abuse.18 or otherwise problematic.
Unmeasured Outcomes. In some systems,
n Due to budget shortfalls at the National Center especially those not subject to meaningful national
for Health Statistics (NCHS ) and recent changes to reporting requirements, performance measurement
birth certificate forms, substantial gaps and delays is highly uneven and often weak. For instance, few
have emerged in compiling data about teen and out- state or local juvenile justice systems report (or even
of-wedlock births, low-birthweight babies, infant collect) data on the educational progress or labor
mortality, and other critical indicators. Indeed, 5 market success of court-involved youth. Likewise,
of the 10 measures used to rank states in the KIDS despite substantial federal funding, state children’s
COUNT Data Book rely on these vital statistics data. mental health systems are not measured against
Budget woes have also led NCHS to decrease the any national performance indicators, and few states
sample sizes for national surveys related to children’s systematically monitor outcomes of children served
health—reducing the accuracy of many measures.19 by taxpayer-funded mental health providers.
In other systems, performance measurement
n Finally, despite growing recognition that what is robust for some core goals, but lacking for others.
a family owns and how much it owes are at least In child welfare, for example, state and local agen-
as important as its annual income, data on family cies are held accountable for performance measures

14 The Annie E. Casey Foundation www.aecf.org


Essay

related to children’s safety and well-being while the calculated recidivism rates, making cross-state cal data are not compiled electronically. When they
in care and after their placement into permanent comparisons difficult or impossible. are, this information is frequently inaccurate or
families. Few jurisdictions, however, collect or In other systems, performance measures have unusable by frontline service providers. Sometimes,
report data on the academic performance of these limited utility because they are not clear or easily this occurs because data collection is a low priority
children. Likewise, few track the long-term out- understandable. For instance, the Child and Family for frontline workers, with little or no value in their
comes of youth—college attendance, employment, Service Reviews process, which is used to evaluate day-to-day activities with children and families.
parenting, or contact with the criminal justice state child welfare systems, employs complex, artifi- Other times, it’s a function of outdated software sys-
system—after leaving care. cially constructed composite measures. One measure tems that make entering and updating data tedious.
Problematic Outcome Measures. Even when aggregates results from five goals related to duration Even when detailed information on participants
human service agencies systematically collect in foster care and the timeliness of adoptions and and programs is compiled and computerized, human
outcome data, they may be of limited or no value reunifications. For a state to learn that its composite service and education agencies will derive little
if the performance measures employed are not clear score is 101.7, versus a federal standard of 106.4, benefit unless they put the data to productive use.
and valid—and if they are not comparable against conveys much less meaning to policymakers or child Unfortunately, most public agencies have neither
other jurisdictions or against the benchmarks welfare staff than direct performance scores showing the inclination nor capacity to do so. Few states
of an agency’s own prior performance. that foster children are waiting too long for adoptions, and local jurisdictions rigorously analyze their data
One of the most glaring examples of this is or that too many are being placed into institutional to identify key performance indicators or critical
in education. Under the No Child Left Behind group homes, rather than with foster families. success factors—and too few have forged ties with
Act, which governs federal support for elementary In some cases, poorly crafted performance universities or other potential research partners
and secondary education, states develop their own measures can be counterproductive. The Child and to help analyze the data for them.
assessment tests and set the “proficiency levels” Family Service Reviews (referenced above) empha- One of the most important benefits of strong data
required to earn a passing score. The result has been size how quickly children are reunified or adopted is the opportunity to track each child’s progress (or
wide disparities in the rigor of the state tests that more than how many ever achieve these positive problems) over time—for example, from one level of
render cross-state comparisons meaningless,21 since outcomes. Consequently, states where small num- school to the next, or from one instance of reported
virtually every state’s proficiency levels are set well bers of children are adopted quickly will rank higher abuse to another, or from one delinquency arrest to
below those of the federal government’s National than those where overall adoption rates are higher, the next. However, public agencies often lack this
Assessment of Educational Progress.22 Similarly, but placements take longer to complete. crucial capacity. In child welfare, not enough states
in juvenile justice, although more and more states track cases over multiple years, leaving them unable
now report on the recidivism of youthful offenders Problems in Managing, Analyzing, to capture the full range of experiences and outcomes
released from juvenile corrections facilities, the and Using Databases for all children who pass through the foster care sys-
methodologies employed to calculate recidivism The continuing weaknesses in population and per- tem. Instead, when child welfare agencies report on
vary widely. Some states measure the percentage formance data described above are disappointing. the average length of time in foster care, or the aver-
of rearrested youth, others the percentage found However, just as important—perhaps even more age time to adoption, they often base their figures
guilty of a new offense, and still others the per­ so—is the failure of public systems to accumulate, on a point-in-time snapshot of children in care on a
centage of youth who return to correctional maintain, and actually use data—even when such given date, or the subset of children who have exited
custody. Such variables can significantly impact valuable information on their clientele, services, and care in the previous year—yielding a distorted portrait
other factors may influence success. Too often, criti- of their child welfare system’s actual performance.

The Annie E. Casey Foundation www.aecf.org 15


Essay

Likewise, most systems and agencies lack the in our efforts to safeguard the well-being of children
ability to access important data from multiple and families, then we must adopt and adhere to
sources. As a result, frontline workers (or teachers) far more rigorous standards for the collection and
in one system typically can’t obtain information utilization of data. Whether they’re population data
on the full range of their clients’ (and students’) assessing the well-being of children and families, per­
needs and circumstances: Child welfare workers formance data measuring the outcomes of programs
don’t have children’s education data; juvenile justice and systems, or management databases aggregating
workers don’t have child welfare records, or health all relevant information about participants and
records, and so on. Only a handful of jurisdictions services provided, we must upgrade all of our data
nationwide integrate administrative data sets from collection efforts to meet four cross-cutting tests:
several systems, even though this is crucial for We must compile better and more
understanding the complex needs of children and n Are the data sufficient? Are we collecting all
complete data. If we are going to take
families with multiple issues and those who are of the necessary data to fully understand the
involved with two or more systems simultaneously. needs of children and families, clearly assess the results seriously in our efforts to safeguard
Finally, our human service systems tend not effectiveness of our efforts, and support creative
the well-being of children and families,
to invest in emerging information technologies that problem-solving? Are we generating these data
have become the norm in other fields. Few public frequently enough and in sufficient detail to inform then we must adopt and adhere to far
agencies routinely purchase laptops or handheld good policy and practice? And, are there enough
more rigorous standards for the collection
devices for frontline staff. Few have created data data being collected to allow us to measure dispari-
dashboards that allow administrators and frontline ties in outcomes by income level, race, and other and utilization of data.
workers to track progress on key performance indica- socioeconomic indicators?
tors and examine underlying trends. New technologies
like these and others have the potential to vastly n Are the data clear and comparable? Are we com-

expand the information available to frontline workers, piling these data using carefully defined and uniform
engage parents in efforts to boost their children’s measures that are clear, readily understandable, con-
well-being, and accelerate the feedback loop by sistently applied, and comparable across jurisdictions?
which workers and supervisors can assess their prog-
ress. Sadly, that potential remains largely unrealized. n Are the data accessible and easy to use? Are

the data readily available to all of the relevant


Counting What Counts: Essential Building audiences—policymakers, managers, supervisors,
Blocks for Data-Driven Progress frontline staff, participants, advocates—both after
The data deficits described here are daunting, the fact for evaluation and in real time to support
but not insurmountable. The formula for progress wise decision-making and continuous improvement?
begins with two essential steps.
First, we must compile better and more com- n Are the data integrated? Can data from one pro-

plete data. If we are going to take results seriously gram or system be integrated with data from other

The Annie E. Casey Foundation www.aecf.org 17


Essay

sources to assess the full range of circumstances targeted surveys, the federal government is the pri- combined with an ever-increasing immigrant popu-
affecting children and families, as well as to identify mary collector of data on the well-being of children lation (many with powerful fears of government),
opportunities for better coordinating services to and families nationwide. Washington also has the will further complicate census-taking in 2010.
those with multiple needs? key role of defining and requiring performance Fortunately, the Obama administration has
accountability and data reporting from state and nominated a highly qualified statistician, Dr. Robert
Second, we must vastly improve our capacity local human service systems and in bringing experts Groves, to head the Census Bureau, and Congress
to analyze and utilize data to improve outcomes together to build consensus around uniform data included $1 billion in additional support for the
for children and families. Specifically, with federal standards and outcome measures. In all of these 2010 Census in the American Recovery and Rein-
support, states and localities should strengthen ways, the federal government plays a crucial role vestment Act of 2009—including $ 250 million
the analytic capacities of public agencies; develop in shaping and subsidizing the development of high- to support community partnerships and outreach
constructive partnerships with universities and other quality data systems in state and local education efforts in minority communities. However, more
freestanding centers to utilize data and conduct and human service agencies. funding may be needed in the Bureau’s 2010 budget
research; and incorporate information technologies Though federal officials have made progress to ensure that outreach efforts equal or surpass the
that increase the information available to workers in recent years toward increasing the availability intensity levels achieved in 2000, and strong leader-
at every level. of high-quality data, several additional steps are ship will be required from census administrators
However, simply combining these elements— urgently needed to help reduce the data deficit. to solidify plans and streamline procedures before
better data, stronger data analysis, and greater use Many of them are now well within our grasp. counting begins next April. Looking to the future,
of information technology—is still not enough. We Congress and the president should ensure continuity
must also make a national commitment to counting Better Information on Child and in census planning by appointing the Bureau’s
what counts in our efforts to meet the needs and Family Well-Being director to a fixed 5-year term.
boost the outcomes of less fortunate children. As The first focus of federal authorities should be to Update the Poverty Measure. Equally crucial
the following recommendations detail, this needed further strengthen the availability of data on the well- is to update the nation’s obsolete poverty measure.
data revolution will require action at every level being of children and families by ensuring a strong The new poverty measure should account for costs
of government, as well as from those outside groups census, updating the poverty measure, expanding related to work, child care, taxes, and out-of-pocket
that share a common commitment to improving what is currently collected on children and families, medical expenses, and it should adjust for regional
the lives of vulnerable children. and shoring up the vital records system. differences in the cost of living. It must also recog­
Fully Fund, Properly Manage, and Successfully nize non-cash benefits, such as earned-income tax
Action Agenda: Intensify Federal Leadership Promote the Census. Job number one is to ensure credits, food stamps, and housing vouchers provided
In the three decades since Ronald Reagan assumed a complete count in the 2010 Census, which will be through federal and state anti-poverty programs.
the presidency, promoting a doctrine of “New used in allocation formulas to distribute more than Fortunately, the National Academy of Sciences
Federalism,” our nation has seen a significant shift $ 400 billion annually in federal funding throughout developed (in the 1990s) an excellent template
in responsibilities for social programs away from the next decade.23 This will be especially challenging for just such an improved poverty measure. The
Washington and toward the states. When it comes in 2010 because of difficulties in initial planning Measuring American Poverty Act of 2009, which
to data, however, the federal government retains and the lack of a census director for many months, is expected to be introduced in both the House and
a clear leadership role. Through the census, the following the presidential transition. Housing dislo- Senate this summer, would implement the National
American Community Survey, and a host of more cations caused by the foreclosure crisis and recession, Academy of Sciences’ recommendation. In addition,

18 The Annie E. Casey Foundation www.aecf.org


Essay

Congress should enact legislation shifting responsi- Address Problems in the Vital Records System.
bility for calculating poverty away from the Office As noted earlier, budget cuts and problems associated
of Management and Budget, where it has long been with new reporting requirements have seriously
burdened by political cross-pressures, and place it undermined the integrity and timeliness of vital
instead in a non-partisan statistical agency like the records data—a crucial source of information on
Census Bureau, where it can be periodically refined infant mortality, prenatal health, low-birthweight
and updated by qualified, non-political experts. babies, and other key indicators. To solve these
Increase Data Collection on Child and Fam- problems, Congress should make a one-time appro-
ily Well-Being. To fill gaps in information on basic priation of $30 million to help states complete the
well-being available to state and local policymakers, transition to the new vital records forms and then
To fill gaps in information on basic the federal government should initiate annual provide $8 million to $10 million in additional
collec­tion of detailed state-level data on aspects annual funding to support this essential data stream.
well-being available to state and local
of children’s general condition and development,
policymakers, the federal government including mental health, socio-emotional develop- Stronger Leadership on Program Data
ment, peer influences, and neighborhood effects. Collection and Outcome Measurement
should initiate annual collec­tion of
The survey should pay special attention to children Over the next 2 years, the pending reauthorization
detailed state-level data on aspects from infancy through age 10, as well as out-of- of several major programs serving children and
school adolescents, about whom we currently have families—including the Juvenile Justice and Delin-
of children’s general condition and
inadequate information. For less than $20 million quency Prevention Act, Temporary Assistance for
development, including mental health, per year, this survey could expand upon the existing Needy Families, the No Child Left Behind Act, and
National Survey of Children’s Health, which is the Workforce Investment Act—provide important
socio-emotional development, peer
administered every 4 years. Legislation has been opportunities to strengthen data collection and utili-
influences, and neighborhood effects. introduced in the Senate, The State Child Well- zation. So, too, do the new child welfare regulations
Being Research Act of 2009 (S. 1151), and a that must be promulgated soon for implementation of
companion bill has been introduced in the House the Fostering Connections to Success and Increasing
(H.R. 2558) that would expand the current survey Adoptions Act, which was signed into law in 2008.
into a National Survey of Children’s Health and Congress and the Obama administration should
Well-Being to collect data annually on how children use these opportunities to address disappointing and
are faring, state by state. The proposals have strong, persistent data limitations by developing or refining
bipartisan support, and we anticipate that they performance indicators and data collection/reporting
will be adopted. Likewise, increasing the sample size requirements for public systems. Care must be taken
of each year’s American Community Survey—for to ensure that the data we collect accurately reflect
a relatively modest investment—would significantly these systems’ most important goals and that they
enhance the accuracy of data available to policy- capture the full range of program-related informa-
makers and planners working in high-poverty urban tion needed to conduct meaningful research and
neighborhoods and rural communities. support improved decision-making.

20 The Annie E. Casey Foundation www.aecf.org


Essay

In child welfare, for instance, new regulations In juvenile justice, the federal Office of Juve- systems—child welfare, public education, juvenile
should correct flaws in the Child and Family Service nile Justice and Delinquency Prevention should justice, welfare, job training, mental health—
Reviews process by requiring states to track and report convene experts from across the country to develop must acquire the tools and master the techniques
data for all children who enter the foster care system a common set of performance measures, beginning of data-driven decision-making.
in a given year, rather than just those who are in with a uniform definition of recidivism for youth As we have observed, most systems still have
care at the end of the year. Also, new regulations released from juvenile corrections facilities. Over a long road to travel. To complete the journey,
should replace hard-to-understand composite scores time, common performance measures should the dedicated professionals who staff and supervise
with simple, easy-to-comprehend measures directly be developed for community safety (helping these agencies will need to fundamentally overhaul
tied to child outcomes. Furthermore, they should all court-involved youth to avoid re-offending), their approach. For decades, data collection has
ensure that scores reflect actual changes in system and meaningful guidelines (with strict monitoring) been widely viewed within these systems as an
performance, rather than shifts in the population should also be established for the safety and con­ activity to satisfy reporting requirements. Data’s
served. To shed light on racial disparities in these ditions of confinement for youth in custody. primary (or only) purpose has been to justify bud-
systems, states should be required to disaggregate In seeking to improve the quality and utili- gets, quantify processes, or measure work effort.
key data by race and ethnicity. Finally, Congress zation of data in these and other systems, federal For most direct service providers working with
should provide funding for states to implement authorities should capitalize on their unique children and families on the front lines, data com­
recently released (but long-delayed) regulations capacity to convene experts and to finance database pilation has largely remained a burden, an extra
requiring states to report services to and long-term development and research. They should play chore, with little immediate value for improving
outcomes for youth aging out of foster care. a catalytic role in forging consensus on high-priority the lives of their clients, students, patients, or wards.
In K–12 education, the No Child Left Behind performance indicators and crucial data collection What’s needed today, as the business sector
Act (NCLB) should be amended to promote adop- needs. On issues of utmost importance, and for learned a decade ago, is an awakening to the value
tion of meaningful, consistent academic proficiency systems into which the federal government provides of data. This will require a new commitment and
standards in every state, as well as new standards robust financial support, federal authorities should capacity to make data a useful tool—not only for
for student attendance. NCLB should also require impose rules requiring stronger data collection administrators, elected officials, the media, and
states to correct the common flaws and disparities and reporting, and they should insist that states other watchdogs, but also for workers up and down
in calculating graduation rates. There is also growing employ common measures that allow for meaning- these organizations. While the need for this data
consensus that the definition of “adequate yearly prog- ful analysis and cross-state comparisons. awakening has gained adherents in many systems,
ress” in schools should include not only the percentage real change remains slow. To accelerate the shift,
of students achieving a passing rate on state assess- Action Agenda: A Data Awakening in State state and local agencies must move aggressively
ment tests, but also a measurement of “value added” and Local Systems to improve performance measurement, strengthen
or “continuous progress” that captures students’ year- Ultimately, the job of compiling the needed pro- administrative databases, improve data analysis,
to-year improvement. Finally, given the compelling gram and performance data will fall to state and promote data-driven practice improvements,
research showing how profoundly early reading affects local agencies responsible for educating, protecting, and expand use of new information technologies.
future academic success, NCLB should be amended treating, training, employing, and counseling
to add a new national goal on 3rd grade reading vulnerable children and their families. If we hope Improve Performance Measurement
proficiency, the time when children make the crucial to realize the full benefits of the data revolution Strong outcome measurement can focus an agency’s
transition from “learning to read” to “reading to learn.” for children and families, as well as taxpayers, these work and stimulate an ongoing stream of practice

The Annie E. Casey Foundation www.aecf.org 21


Essay

improvements, leading to better results. However, Public education agencies should follow the
those benefits will accrue only when leaders define lead of 6 states—Alabama, Arkansas, Delaware,
outcome measures that are clear, comparable to other Florida, Louisiana, and Utah—whose data sys-
jurisdictions, easy to understand, readily collectible, tems possess all 10 elements considered essential for
and crafted to avoid the all-too-real danger of creating effective educational planning by the Data Quality
counterproductive incentives. One state that is Campaign. This national collaborative effort sup-
improving their odds of success by creating perfor- ports state policymakers to improve the availability
mance measures that accurately capture progress and use of high-quality education data to boost stu-
toward key goals is Utah. dent achievement.25 Many states, however, still face
In response to a class action suit over substandard considerable work bringing their educational data
States and local jurisdictions must also care in the 1990s, Utah’s child welfare agency initi- systems up to speed. For example, 8 states (and the
ated a process of Quality Case Reviews to assess both District of Columbia) continue to lack the capacity
build their capacity to integrate data
the status of children and families served by the agency to reliably calculate graduation rates.26
sets and track the circumstances of youth and caseworkers’ adherence to a new family-centered Child welfare agencies have several options to
practice model. Every year, in each of the state’s six upgrade their data capabilities. They can contract
involved in multiple systems. One option
regions, state child welfare officials and professionals with university-based researchers like the University
is to create virtual “data warehouses” working in related fields review two dozen or more of California’s Center for Social Services Research,
cases. Reviewers score each case against child and which maintains a sophisticated longitudinal data
with access to records from multiple state
family status indicators, such as safety, stability, and system that provides detailed quarterly reports to
systems, as well as census, vital records, physical and emotional health, and on case workers’ child welfare authorities in every California county.
adherence to 11 core principles of the practice model. They can also build data capacities internally or, as
and other data streams.
Since the first round of reviews in 2000, scores have 23 states have, they can participate in the Chapin
improved dramatically. The share of Utah casework- Hall Center for Children’s Multistate Foster Care
ers achieving an acceptable rating for following the Data Archive, which also tracks data longitudinally
practice model rose from 42 percent in 2000 to 90 and conducts wide-ranging data analyses.
percent and 89 percent, respectively, over the past States and local jurisdictions must also build
2 years. Utah has also seen corresponding improve- their capacity to integrate data sets and track the
ments in the status of children and families.24 circumstances of youth involved in multiple systems.
One option is to create virtual “data warehouses”
Strengthen Administrative Databases with access to records from multiple state systems,
As we have noted, public systems cannot realize the full as well as census, vital records, and other data streams.
benefits of the information revolution until they build For instance, Florida has one data warehouse that
and maintain effective databases. Specifically, they combines pre-kindergarten through university-level
must develop data systems with the capacity to track education information and another that ties together
cases longitudinally, integrate with other data sets, a host of data sets related to employment and earn-
and answer crucial questions of policy and practice. ings. These two data warehouses can be linked and

22 The Annie E. Casey Foundation www.aecf.org


Essay

connected to administrative data from other state Like a number of other cities, Chicago has revo- staff. Although that remains far from the norm in
systems.27 South Carolina has used its extensive data lutionized its dropout prevention efforts in recent most agencies today, some pioneering jurisdictions
warehouse to examine special health care needs fac- years by employing data to develop early warning are increasingly putting data to use on the front line.
ing children statewide, identify communities with indicators that pinpoint the common pathways For example, as part of the Casey Foundation’s
large numbers of uninsured children, and profile leading to school failure—particularly academic Juvenile Detention Alternatives Initiative, juvenile
the population of infants and toddlers at highest problems and absenteeism in 9th grade—and to justice leaders in Oregon’s Multnomah County have
risk for school failure.28 identify students at extreme risk of dropping out. long utilized a daily population report, summarizing
More than 80 percent of Chicago students who are the case details of each young person held in the
Improve Data Analysis on track at the end of 9th grade graduate within 4 detention center. The report enables staff to deter-
Some human service agencies have grown adept at years, compared to just 22 percent of students not mine which youth may be appropriate for alternative
compiling lots of data and generating required reports, on track.29 Chicago has begun providing detailed supervision and ensure that youth do not languish
but most remain weak in analyzing information and spreadsheets for every public high school, showing unnecessarily in detention. More recently, Mult-
putting it to productive use. They have become data grades, attendance, and other data about all incom- nomah officials have developed a daily “Caseload
rich, but remain knowledge poor. Developing the ing 9th graders, including a watch list of students Quick Facts” data printout, detailing whether each
capacity to analyze data effectively—identify key at risk of failure. Summer enrichment classes are young person under probation supervision is on
indicators, isolate critical success factors, or uncover offered to incoming 9th graders, a range of credit- track for achieving key objectives in terms of school
the hidden dynamics underlying significant trends— recovery courses are provided during the school year, enrollment, contact with probation officers, and
is a pressing challenge throughout the field. and attendance intervention efforts assist students restitution activities. These reports help frontline
As some states have seen, meeting that challenge with a history of unexcused absences.30 These actions staff organize their workloads, allow supervisors
can yield important rewards. In 2007, Virginia invited are yielding promising results. Unlike many other to monitor how well individual workers are meeting
the Casey Strategic Consulting Group to study its big city school districts, Chicago has seen a steady performance goals, and help administrators assess
child welfare system and identify opportunities to rise in graduation rates in recent years.31 the effectiveness of the entire agency.
improve permanency outcomes. The resulting anal- Racial disparities are another important focus In California, the San Diego County Office
ysis revealed that nearly a quarter of Virginia’s foster for data analysis. In virtually all of our public sys- of Education developed an Internet-based informa-
children were living in group placements, well above tems, outcomes diverge for children and families of tion system to track the educational progress
the national average, while the share of children different races, with African Americans most often of foster children enrolled in public schools.
living in foster homes was dwindling rapidly due to experiencing less favorable outcomes. Disaggregat- The service, known as the Foster Youth–Student
low rates paid to foster parents and a lack of financial ing outcomes by race at each decision point offers Information System, stores detailed records on
incentives for counties to place children with families. a valuable tool for determining the factors underly- foster children’s placement history, health, educa-
Meanwhile, the share of foster children achieving ing these disparities and sparking the development tional progress, and delinquency history. It can be
permanence was far below the national average. of new strategies to reduce racial disparities. accessed anytime by authorized users in the schools,
These findings helped galvanize Virginia officials, child welfare system, and juvenile court, as well as
and in 2008, the state’s legislature passed a reform Promote Data-Driven Practice Improvements by children’s attorneys and foster families—though
bill creating a new funding formula that reimburses Ultimately, the most important opportunities for some information is restricted to protect privacy.
counties at a higher rate for placements into foster program improvement will be realized when data The Web-based system has made it far easier for
families than for placements into congregate care. become integral to the everyday work of frontline schools and child welfare staff to streamline new

24 The Annie E. Casey Foundation www.aecf.org


Essay

school placements for foster children, offer needed workers to retype notes taken in meetings with
support services, and ensure that credits from previ- children, families, and others in the community.
ous schools are transferred correctly.32 The tablets are also Web-enabled, allowing work-
ers to check their e-mail and work from any remote
Expand Use of New Information Technologies location.34 Similarly, West Virginia’s child welfare
New information technologies have become ubiq- agency has procured “digital pens” for its workers
uitous in the business world—BlackBerrys, laptops, to automatically input handwritten notes into
and tablet PCs. Despite their obvious potential for the state’s automated database.35
the human services field, little has changed tech-
nologically for many or most frontline workers in Beyond these isolated innovations, the human
recent years. Beyond the use of e-mail, few agencies services field has the opportunity to transform Juvenile justice leaders in Oregon’s
have even begun to explore opportunities created by practice more fundamentally by using new plat-
Multnomah County have long utilized
the Internet to disseminate information, network, forms that combine several modern information
and boost productivity. Closing this gap is critical— tools. Currently, the Annie E. Casey Foundation a daily population report, summarizing
especially considering the positive results already is developing such a platform—tentatively called
the case details of each young person
being reaped by innovative agencies that have taken Casebook—for use in child welfare. Like a social
advantage of new technology. networking website, Casebook will be built around held in the detention center. The report
individualized online profiles that can be accessed
enables staff to determine which youth
n “Family Finding” is a program model that uses only by authorized users. Each Casebook profile will
the search capabilities of the Internet to locate encompass the entire family of any child involved may be appropriate for alternative
and engage relatives of longtime foster children— in the child welfare system. Casebook will automati-
supervision and ensure that youth do
producing powerful results not just in identifying cally create and update the case files for every family
relatives, but also in nurturing strong relationships by linking electronically to the administrative data not languish unnecessarily in detention.
that lead to permanent family connections. In systems of multiple child service agencies—schools,
Tacoma, Washington, social workers found one foster care agencies, Medicaid, TANF, and others.
or more relatives for all but 1 of 500 children. By Communicating online through Casebook, staff
engaging family members, developing case plans, from these agencies will be able to discuss any case,
and providing needed support, Tacoma social work- and details from their conversations will be entered
ers helped 85 percent of these children to reunify into the file to inform every authorized person
with their parents or move in with other relatives.33 working on the case. Casebook will issue alarms
when any aspect of a case becomes problematic, and
n Since 2007, Oklahoma’s child welfare agency has it will generate reminders to prompt needed action.
distributed more than 3,000 tablet PCs to frontline Finally, the Casebook system will employ digi-
child welfare workers. By recognizing and automati- tal dashboards, allowing supervisors and other staff
cally entering workers’ handwritten notes into case to track progress on such key performance indica-
files, the tablet technology eliminates the need for tors as rapid responses to abuse reports, placement

The Annie E. Casey Foundation www.aecf.org 25


Essay

stability, and timely reunification. From these digital tucky’s 2- to 4-year-olds had untreated cavities and program. As of last year, P/PV was collecting and
dashboards, users will be able to further explore that two-thirds of children covered by government- analyzing data from 129 organizations. By 2012, it
the data to identify the factors that might influence funded health insurance were not receiving any plans to have 1,000 organizations submitting data
success or failure on any of the indicators tracked. dental care.36 The report revealed that many areas and participating in a “learning community,” where
This Casebook approach represents a significant in Kentucky had too few dentists, especially pediat- they will analyze their results, compare themselves
Foundation investment that is also designed to facil- ric dentists, and that fewer than half of the dentists with like organizations, and use the data to improve
itate our commitment to securing permanence for in the state participated in the Medicaid program. services and boost success.39
the most challenged children and youth in the child In response to the report, plus a follow-up pub- Data-Focused Campaigns to Build Awareness
welfare system. It will be beta tested later this year lication in 2005, Kentucky’s legislature approved and Mobilize Action. Children’s advocates can also
by Casey Family Services, the Foundation’s direct a 30 percent increase in reimbursement rates for employ data to raise public awareness of trends
services agency that has divisions in Connecticut, dentists serving low-income patients in 2006, and affecting children’s well-being and then set goals
Maine, Maryland, Massachusetts, New Hampshire, it expanded benefits to include two cleanings per and mobilize public opinion to address crucial
Rhode Island, and Vermont. year instead of one. In 2008, Kentucky’s legislature needs and improve outcomes. As of 2008, 24 states
began requiring dental screenings or exams for had established permanent children’s cabinets
Action Agenda: Engage Children’s Advocates every child enrolling in public schools.37 (or similar committees) to track and respond to
and Other Concerned Leaders Leadership in Identifying Benchmarks. On the emerging needs of children. Typically compris-
Most of the responsibility for collecting and using important emerging issues where no public system ing state agency heads, legislators, and community
data falls to state and local service agencies, or is well positioned to respond, advocates and scholars leaders, these bodies aim to coordinate strategies
to the federal government. There is also a crucial can provide leadership by documenting the prob- and programs, develop common goals, and set
role for others with a stake in the well-being of lems and identifying benchmarks to monitor priorities for state efforts on behalf of children.40
vulnerable kids and families, including state and progress. Historically, the government has paid little Often, they produce high-profile reports that track
local elected officials, scholars, civic and religious attention to asset poverty. Nonprofit policy research progress on key indicators of child and family well-
leaders, foundation staff, and other children’s organizations and university scholars reached being. Likewise, many communities now publish
advocates. By engaging in data-driven advocacy, a consensus on the importance of financial assets report cards—developed by local government or
identifying critical benchmarks, and using com­ in the economic success of families and the well- civic organizations—that educate residents about
munity mapping techniques, child advocates can being of children. The U.S. Department of Health the needs of children and families, while garnering
build awareness and mobilize action to improve and Human Services now funds a series of studies support for concerted action.
the lives of children and families. on this issue by researchers at the Urban Institute, Neighborhood Indicators and Community
Data-Driven Advocacy. As state-level KIDS New America Foundation, and the Center for Mapping. To capitalize on the growing wealth
COUNT grantees have been doing for years, advo- Social Development at Washington University.38 of local-area data on child and family well-being,
cates can mount data-driven advocacy campaigns In workforce development, where services are many cities are mobilizing “neighborhood indicators
to bring ignored data to public attention and to offered by myriad providers funded through mul- projects” to clarify challenges and identify opportu-
press for timely and commensurate responses. For tiple systems without any common performance nities to improve results for children and families
instance, Kentucky Youth Advocates produced indicators, the policy research firm Public/Private at the neighborhood, city, and county levels.
a report in 2003 trumpeting previously published, Ventures (P/PV) has developed benchmarks that In Indianapolis, the Polis Center at Indiana-
but little noticed, data showing that half of Ken- can be applied to any training or employment Purdue University examined childhood obesity

The Annie E. Casey Foundation www.aecf.org 27


Essay

in local neighborhoods using data on income, the meaningful opportunities continue to fall far short
prevalence of parks and recreation programs, crime of what is possible, what is needed, and what is
rates, and other variables. The study found that demanded by the current technology environment.
children in neighborhoods with very low average Systems and organizations charged with helping
incomes were far more likely than other children disadvantaged families and communities succeed
to be obese, and it led to a community-wide plan- must capitalize on new opportunities afforded
ning process to address the obesity problem.41 by today’s information revolution to bolster their
Likewise, the Greater New Orleans Data efforts to measure and improve outcomes.
Center played a key role in planning recovery efforts This imperative comes at a time when our
following Hurricane Katrina. The Data Center has economy may seem least able to take on potentially
It is more critical now than ever to have created detailed maps showing where child care costly reforms needed to build the technology infra-
programs are operating, how many residents have structure and human capacity required to achieve
accurate data that show how American
returned to city neighborhoods, and how much this goal. Despite budget shortfalls, now is the wrong
families are faring in the current economic money will be required to repair storm damage time to scale back investments that will yield a
in different wards in the city and in surrounding long-range and long-lasting payoff in reduced waste
downturn and have systems that are
parishes.42 A number of communities also employ and improved efficiency. In fact, it is more critical
equipped to use this information to community mapping to meet the challenge of rein- now than ever to have accurate data that show how
tegrating ex-offenders returning home from prison. American families are faring in the current economic
improve the well-being of those children
downturn and have systems that are equipped
and families most in need. Conclusion to use this information to improve the well-being
In the 20 years since the Casey Foundation of those children and families most in need.
launched our annual, state-by-state collection of As we’ve shared in this essay, many promising
indicators and rankings on child well-being, the efforts have already been demonstrated, and worthy
nation has indeed made important progress in efforts proposals have been introduced that advance the
to gather, analyze, share, and utilize data to promote merits of measuring progress and mastering the use
improved prospects for vulnerable children and fam- of new technologies to sustain it. But there is still
ilies. We have seen an encouraging groundswell of much work to be done. The Annie E. Casey Foun-
support and actions that reinforce our core convic- dation plans to continue our commitment to
tion that data-driven decision-making is critical to data-based accountability by investing in the
achieving real and lasting results for kids. Enabling improvement and use of data by systems that serve
and enhancing America’s ability to count what counts vulnerable children. We call upon our partners
is key to improving accountability for the programs and our leaders at all levels to do the same.
and policies designed to work on their behalf.
However, the advances made at the federal, Douglas W. Nelson
state, and community levels to effectively collect President and CEO
and use data to address challenges and create The Annie E. Casey Foundation

28 The Annie E. Casey Foundation www.aecf.org


Endnotes

1. O’Hare, W., December 2008, 11. Hoytt, E.H., Schiraldi, 17. Government Accountability 23. Reamer, A., February 30. Gewertz, C., March 11, 2009, 36. Kentucky Youth Advocates,
“Measuring the Impact of Child V., Smith, B.V., & Zeidenberg, Office, March 5, 2008, 2010 17, 2009, Tempest Over the “9th Grade, By the Numbers,” December 2003, Open Wide
Indicators,” Child Indicators Re­ J., 2002, “Reducing Racial Dis­ Census: Automation Problems Census, Brookings Institution, Education Week. or Lock Jaw? Children’s Dental
search, Vol. 1, No. 4, pp. 387–396. parities in Juvenile Detention,” and Uncertain Costs and Plans online commentary, available Health Access in Kentucky,
Pathways to Juvenile Detention May Jeopardize the Success of the at www.brookings.edu/opin- 31. According to the Chicago available at www.kyyouth.org/
2. Ibid. Reform, Vol. 8, Annie E. Casey Decennial and Warrant Immediate ions/2009/0217_census_reamer. Public Schools Office of Research, Publications/documents/03pub_
Foundation, available at www. Attention, available at www.gao. aspx (accessed 5/18/09). Evaluation, and Accountability, DentalAccessBrief.pdf (accessed
3. Ibid. aecf.org/upload/publicationfiles/ gov/highlights/d08550thigh2_ the city’s 5-year graduation rate 5/6/09).
reducing%20racial%20disparities 1.pdf (accessed 5/11/09). 24. Office of Services Review, has improved in each of the past 5
4. Federal Interagency Forum on Utah Department of Human years, climbing from 47.0 percent 37. Kentucky Youth Advocates,
Child and Family Statistics, 2008, .pdf (accessed 5/11/09).
18. For more information on these Services, August 2008, Fiscal Year in 2002 to 55.1 percent in 2007. 2008, 2008 Kentucky KIDS
America’s Children in Brief: Key 12. Brooks-Gunn, J. & Duncan, problems, see Brown, B. & Moore, 2008: A System Review of the Divi­ Data available at http://research. COUNT County Data Book,
National Indicators of Well-Being, G.J., Summer/Fall 1997, “The K.A., January 2009, What Gets sion of Child and Family Services, cps.k12.il.us/cps/accountweb/­ available at www.kyyouth.org/
2008, available at www.childstats. Effects of Poverty on Children,” Measured Gets Done: High-Priority available at www.hsosr.utah.gov/ Reports/citywide.html (accessed documents/08pub_CountyData-
gov/pdf/ac2008/ac_08.pdf The Future of Children, available Opportunities to Improve Our pdf/FY2008OSRAnnualReport. 5/6/09). book.pdf (accessed 5/6/09).
(accessed 5/6/09). at www.futureofchildren.org/ Nation’s Capacity to Monitor pdf (accessed 5/18/09).
pubs-info2825/pubs-info_show. Child and Youth Well-Being, 32. Smith, S., Staub, D., Mysle- 38. McKernan, S.-M. & Sher-
5. Amarasingham, R., et al., 25. Data Quality Campaign, 2008 wicz, M., & Laird, E., October raden, M., September 2007,
2009, “Clinical Information htm?doc_id=72141 (accessed Child Trends, available at
5/11/09). www.childtrends.org/Files// State Survey, results available at 2007, Linking Education and Poor Finances: Assets and Low-
Technologies and Inpatient www.dataqualitycampaign.org/­ Social Services Data to Improve Income Households, The Urban
Outcomes: A Multiple Hospital Child_Trends-2009_02_10_
13. For an excellent review of FR_WPaperChildWBeing.pdf survey (accessed 5/18/09). Child Welfare, Data Quality Institute, available at http://aspe.
Study,” Archives of Internal Medi­ problems with the current poverty Campaign, available at www. hhs.gov/hsp/07/PoorFinances/
cine, Vol. 169, No. 2, pp. 108–114. (accessed 5/18/09).
measure, see Blank, R.M. & 26. Data Quality Campaign, avail- dataqualitycampaign.org/files/ (accessed 5/18/09).
Greenberg, M.H., December 19. Ibid. able at www.dataqualitycampaign. meetings-dqc_quarterly_issue_
6. Lewis, M., 2003, “Money­ball: org/survey/compare/elements 39. Miles, M.A., July 2006, Good
The Art of Winning an Unfair 2008, “Improving the Measure- brief_091807.pdf (accessed
ment of Poverty,” Discussion Paper 20. Ratcliffe, C., Chen, H., et al., (accessed 5/18/09). 5/18/09), and Legal Center Stories Aren’t Enough: Becoming
Game,” W.W. Norton & Co., September 2007, Assessing Asset Outcomes-Driven in Workforce
New York, NY. 2008-17, The Hamilton Project, for Foster Care & Education,
available at www.brookings.edu/~/ Data on Low-Income Households: 27. Florida data warehouses are 2008, Solving the Data Puzzle: A Development, Public/Private
media/Files/rc/papers/2008/12_ Current Availability and Options described in Kugle, C. & Smith, How-To Guide on Collecting and Ventures, available at www.ppv.
7. Rhode Island KIDS COUNT, N., August 2006, Florida Case
February 1997, “Childhood Lead poverty_measurement_blank/12_ for Improvement, The Urban Sharing Information to Improve org/ppv/publications/assets/203_
poverty_measurement_blank.pdf Institute and Center for Study: Building a Student-Level Educational Outcomes for publication.pdf (accessed
Poisoning,” Issue Brief No. 3, Longitudinal Data System, Data
available at www.rikidscount.org/ (accessed 5/18/09). Social Development, available Children in Out-of-Home Care, 5/18/09).
at http://aspe.hhs.gov/hsp/07/ Quality Campaign, available available at www.abanet.org/
­matriarch/documents/IssueBrief_ at http://3d2know.cosn.org/ 40. Pittman, K., Gaines, E.,
3.pdf (accessed 5/18/09). 14. Harrison, R., September 23, PoorFinances/data/­report.pdf child/education/publications/
2008, “Reducing the Undercount (accessed 5/18/09). 2006FloridaSiteVisit.pdf solvingthedatapuzzle.pdf & Faigley, I., December 2007,
8. Ibid. in the 2010 Census,” Testimony (accessed 5/18/09). (accessed 5/18/09). State Children’s Cabinets and
before the Subcommittee on 21. Cronin, J., Dahlin, M., Xiang, Councils: Getting Results for
9. Rhode Island KIDS COUNT, Federal Financial Management, Y., & McCahon, D., February 19, 28. Bailey, W.P., September 2003, 33. Shirk, M., February 2006, Children and Youth, The Forum
February 2003, “Childhood Lead Government Information, Federal 2009, The Accountability Illusion, Integrated State Data Systems, “Hunting for Grandma: ‘Fam- for Youth Investment, available
Poisoning,” Issue Brief No. 16, Services, and International Thomas B. Fordham Institute Agency for Healthcare Research ily Finding’ Strategy Connects at www.forumfyi.org/files/
available at www.rikidscount. Security, Committee on Home- and Kingsbury Center at North- and Quality, U.S. Department Foster Kids With Relatives and Getting%20Results%20Final.pdf
org/matriarch/documents/ land Security and Governmental west Evaluation Association, of Health and Human Services, Permanent Homes,” Youth Today, (accessed 5/18/09).
Lead%20Issue%20Brief.pdf Affairs, U.S. Senate. available at http://edexcellence. available at www.ahrq.gov/data/ available at www.ussearch.com/
(accessed 5/18/09). net/accountability_­illusion/ safetynet/bailey.htm (accessed others/consumer/reunion/ 41. Guernsey, E.H. & Pettit,
15. Ibid. Executive%20Summary.pdf 5/18/09). youthtoday.html. K.L.S., December 2007, NNIP
10. Rhode Island KIDS COUNT, (accessed 5/11/09). Data Inventory 2007: A Picture of
April 2009, 2009 Rhode Island 16. The Census Project, March 4, 29. Allensworth, E. & Easton, 34. Shakibai, S., June 13, 2008, Local Data Collection Across the
KIDS COUNT Factbook, available 2009, Federal Domestic Assistance 22. Hull, J., June 17, 2008, J.Q., July 2007, What Matters “Increasing Worker Productivity Country, National Neighbor-
at www.rikidscount.org/matriarch/ Allocated on the Basis of Statistics At a Glance: The Proficiency for Staying on Track and Graduat­ With Inno­vative Technology,” hood Indicators Partnership and
documents/2009_Rhode_Island_ Based on the Decennial Census, Debate, Center for Public ing in Chicago Public High Schools, INPUT, available at www.input. The Urban Institute, available at
KIDS_COUNT_Factbook_ U.S. and States, FY2007, available Education, available at www. Consortium on Chicago School com/blogs/public/index.cfm/ www2.urban.org/nnip/Inventory/
Website_Version.pdf (accessed at www.thecensusproject.org/ centerforpubliceducation.­org/ Research, available at http:// 2008/6/13/Increasing-­Worker- Data_Inventory_Final_Report.
5/18/09). factsheets/brookings-factsheet- site/c.kjJXJ5MPIwE/b.4177975/ ccsr.uchicago.edu/content/ Productivity-with-Innovative- pdf (accessed 5/18/09).
federaldomesticassistance.pdf. k.35A6/At_a_glance_The_ publications.php?pub_id=116.pdf Technology (accessed 5/18/09).
proficiency_debate.htm (accessed (accessed 5/6/09). 42. Ibid.
5/11/09). 35. Ibid.

The Annie E. Casey Foundation www.aecf.org 29

You might also like