Archives:

Select:

Guest blog: Q&A with an afterschool researcher

READ FULL STORY

Guest blog: Q&A with an afterschool researcher

In May, the proposed FY2018 budget eliminated funding for the 21st Century Community Learning Centers (21st CCLC), the only federal funding stream dedicated to before-school, afterschool, and summer learning programs. In the budget, a justification given for the elimination of funding was that there is no demonstrable evidence that 21st CCLC programs have a positive impact on the students attending the programs. Although we have highlighted the existing body of research underscoring the difference 21st CCLC programs are making in the lives of students participating in programs, we decided to go directly to the source, asking someone who has conducted evaluations on 21st CCLC programs for 14 years. 

We posed a few questions to Neil Naftzger, American Institutes for Research (AIR), about his evaluation work related to 21st CCLC programs specifically, and the afterschool field broadly. Below are answers to two of the questions we asked, with our emphasis added in bold, which establish that there is in fact clear evidence demonstrating that 21st CCLC work for students. 

What are the strongest findings across your research on 21st CCLC programs? Do you see any important non-academic benefits from afterschool and summer learning programs?

Between 2011 and 2016, AIR completed a series of analyses designed to explore the relationship between regular participation in the 21st CCLC program and youth performance on a variety of outcomes pertaining to academic achievement and positive behaviors. These analyses were undertaken as part of a series of statewide 21st CCLC evaluation contracts held by AIR in five states—New Jersey, Oregon, Rhode Island, Texas, and Washington. The purpose of these analyses was to assess the manner in which regular participation in the program was related to school-related outcomes by comparing youth that participated in 21st CCLC programming for 60-days or more during a given school year with similar youth attending the same schools that did not attend programming. The hypothesis underpinning these analyses was that youth participating in 21st CCLC at 60-days or more would demonstrate more desirable school-related outcomes relative to similar youth attending the same schools that did not participate in the program.

In relation to academic achievement-related outcomes, this hypothesis—that youth regularly participating in 21st CCLC programs would perform better academically than their peer counterparts who did not participate in programs—was supported in terms of state assessment scores in mathematics, cumulative GPA, and credits earned toward graduation. Program effects were small, but largely commensurate with what would be expected given how much time youth spent in programming. These findings were replicated across multiple samples and years.

For example, of the fifteen analyses conducted to assess the relationship between regular program participation and mathematics state assessment scores, twelve were found to be statistically significant and indicative of 21st CCLC potentially having a positive effect on state assessment scores in mathematics. By comparison, few potential positive effects were found in relation to state assessment scores in reading, and one negative effect was found in relation to this particular outcome.

Our hypothesis was also supported in relation to youth regularly participating in 21st CCLC demonstrating fewer school-day absences and disciplinary referrals relative to similar youth not participating in programming. The potential program effects ranged from relatively small to large depending upon the state and year the analyses were completed. For example, youth participating in programming for 60-days or more demonstrated anywhere from 15 percent to 70 percent fewer absences than similar youth not enrolled in programming, with an average of 40 percent fewer absences across the domain of analyses under consideration. Only one analysis of the six conducted yielded a non-significant result related to school-day absences.

Results for disciplinary referrals were similar. All five of the analyses done to assess the potential relationship between regular program participation and fewer school-day disciplinary incidents were found to be significant and indicative of 21st CCLC-funded programs potentially supporting fewer school-day absences. Youth participating in programming for 60-days or more demonstrated anywhere from 5 percent to 72 percent fewer disciplinary incidents than similar youth not enrolled in programming, with an average of 24 percent fewer incidents across the domain of analyses under consideration.

Overall, these results suggest that there is a positive relationship between regular participation in 21st CCLC and positive school-related outcomes related to academic achievement and positive behaviors.

How are studies like yours best used (e.g., by policymakers, by program managers, by the field)?

I think the evaluation work we have done in relation to the 21st CCLC program can be used by key stakeholders to gain an understanding of what impact recent implementation of the program may be having on participating youth, especially in light of how the field has grown and developed during the span of the past decade as states have crafted and deployed quality improvement systems. Our work also highlights where data collection and analysis efforts should be targeted to more fully understand how the program may be contributing to the positive development of participating youth. With this understanding, federal, state, and local stakeholders can formulate more meaningful expectations for how these programs are likely to impact youth and support data collection and analysis efforts that look for evidence of positive outcomes in the places where they are likely to occur.

In addition, some of our work has been focused on examining the relationship between (a) observed program quality using some of the tools previously referenced [this information can be found in the full Q&A] that states are using as the foundation of their quality improvement systems (i.e., the YPQA, the APT-O) and (b) school-related outcomes. The hypothesis guiding this work was that youth who participated regularly in higher quality afterschool programs would demonstrate better functioning on a variety of youth outcomes as compared to similar youth attending lower quality programs. This hypothesis was largely born out in terms of participation in higher quality programs being associated with longer duration of attendance in afterschool programs, fewer school-day disciplinary referrals, and better academic achievement. In light of these findings, key stakeholders associated with the design and implementation of 21st CCLC would seemingly be well served to further support and incentivize program participation in quality improvement processes underpinned by these types of tools.

These are only two of the questions we posed to Neil. Next week, we'll publish his answers to our other questions, including what changes he would like to see in 21st CCLC data collection and what he sees for the future of afterschool evaluation.  

Mapping afterschool in New Mexico

By May Sagbakken, executive director of the New Mexico Out-of-School Time Network All children and youth deserve access to high-quality afterschool and summer learning programs that prepare them for school, college, careers, and life. While many students across the country are receiving valuable...

BY: Guest Blogger      06/05/18

New resources! National and state-level fact sheets on afterschool

As spring finally arrives in Washington, D.C., so does a suite of new resources highlighting key facts and stats on afterschool!   The first resource is a new fact sheet on afterschool, which summarizes positive outcomes for students who participate in programs, as well as the supports...

BY: Nikki Yamashiro      04/13/18

Experts weigh in on the value of afterschool

Last month, we saw afterschool programs across the country open their doors to host Lights On Afterschool events, providing a firsthand look at the broad array of fun, enriching, and engaging activities students take part in at the program and the vital role programs play in their community. A...

BY: Nikki Yamashiro      11/27/17

Looking for evidence on the impact of afterschool?

Look no further! Adding to the research conversation discussing the value of afterschool and summer learning programs, the Afterschool Alliance has released two new fact sheets that provide a sampling of evaluation findings demonstrating the positive impact programs have on students, with subjects...

BY: Nikki Yamashiro      11/09/17

Evaluating afterschool: What my toddler taught me about evaluation

By Allison Riley, PhD, MSW, Senior Vice President, Programming and Evaluation at Girls on the Run International. Girls on the Run is a physical activity-based positive youth development program that inspires girls to be joyful, healthy, and confident using a fun, experience-based curriculum that...

BY: Guest Blogger      09/08/17

New poll finds 9 in 10 parents support schools providing afterschool programs

Last night, the Institute for Educational Leadership (IEL) released the 2017 Phi Delta Kappa International (PDK) Poll of Public's Attitudes Towards Public Schools. The overall takeaway from this report, which is PDK’s 49th annual report on Americans’ views toward public...

BY: Nikki Yamashiro      08/29/17

Guest blog: Q&A with an afterschool researcher, part II

Welcome to part II of our Q&A with Neil Naftzger, American Institutes for Research (AIR), about his evaluation work related to 21st CCLC programs specifically and the afterschool field broadly. Below are answers to oneof the questions we asked, with our emphasis added in bold, which...

BY: Guest Blogger      08/18/17

Guest blog: Q&A with an afterschool researcher

In May, the proposed FY2018 budget eliminated funding for the 21st Century Community Learning Centers (21st CCLC), the only federal funding stream dedicated to before-school, afterschool, and summer learning programs. In the budget, a justification given for the elimination of funding was that...

BY: Guest Blogger      07/28/17

Evaluating afterschool: Building an evaluation advisory board

By Jason Spector, Senior Research & Evaluation Manager at After-School All-Stars The Afterschool Alliance is pleased to present the sixth installment of our "Evaluating afterschool" blog series, which answers some of the common questions asked about program evaluation and...

BY: Guest Blogger      07/05/17

Evaluating afterschool: Answering questions about quality

By Jocelyn Michelsen, Senior Research Associate at Public Profit, an Oakland, California-based evaluation consultancy focused on helping high-performing organizations do their best, data-driven work with children, youth, and families. The Afterschool Alliance is pleased to present the fifth...

BY: Charlotte Steinecke      06/06/17

New issue brief showcasing afterschool promoting civic engagement

Earlier this week on my way into work, a father and his daughter, who couldn’t have been older than an elementary schooler, were at the bottom of the metro escalator greeting metro riders with a huge sign that read “VOTE!” That sight brought a huge smile to my face; it was...

BY: Nikki Yamashiro      11/01/18

New issue brief: A big-picture approach to wellness

From empowering students to take charge of their health to training staff to model healthy behaviors, afterschool and summer learning programs across the country are offering safe and supportive environments that promote young people’s healthy eating and physical activity, as well as build...

BY: Nikki Yamashiro      09/07/18

Afterschool after 30 years: Q&A with Dr. Milbrey McLaughlin, part II

By Sam Piha, founder and principal of Temescal Associates, a consulting group dedicated to building the capacity of leaders and organizations in education and youth development who are serious about improving the lives of young people.  Milbrey McLaughlin has been a leading...

BY: Guest Blogger      06/26/18

"Building Workforce Skills in Afterschool" highlights promising practices for all ages

The next generation of the American workforce is growing up right now and afterschool programs are vital partners in helping young people discover new passions and work towards their dreams. As in so many other subjects, the variety and versatility of afterschool programming offers opportunities...

BY: Nikki Yamashiro      11/14/17

How does afterschool contribute to military readiness?

In 2016, the Council for a Strong America released America Unprepared, showing data that more than 70 percent of young adults in the United States would not qualify for military service due to obesity and other health issues, poor academic performance, drug abuse, or involvement in crime. As a...

BY: Leah Silverberg      08/14/17

5 ways afterschool prepares kids to succeed in the workplace

Cultivating tomorrow’s workforce remains a central part of the discussion about America’s economic future. As today’s children begin to develop the skills they will need in the workplace, experts in the education and afterschool fields are turning their attention to the ways that...

BY: Charlotte Steinecke      05/04/17

What is "The State of Girls" in 2017?

Since the Great Recession, the United States has experienced many demographic, social, economic, and technological changes. A new report from the Girl Scout Research Institute, "The State of Girls 2017: Emerging Truths and Troubling Trends," tracks resulting trends in...

BY: Leah Silverberg      02/17/17

When talking about social and emotional learning, what language works best?

We all know that high quality afterschool and summer learning programs provide kids with the skills that they need to succeed in school and life. While the concept sounds simple, finding the best way to describe these skills and their development is anything but. Some people use phrases such...

BY: Dan Gilbert      01/05/17

New polling shows America is for afterschool

Just in time for Lights On Afterschool, the only national rally celebrating afterschool, a new national poll is out that shows strong public support for afterschool. Nearly 9 in 10 adults (89 percent) agree that afterschool programs are important to their community, with bipartisan and nationwide...

BY: Nikki Yamashiro      10/22/18

Why invest public funds in afterschool?

A new infographic released by RAND draws our attention to the key benefits of public funding for afterschool and summer learning programs. Based on their 2017 research report The Value of Out-of-School Programs, which we covered here last year, the infographic reflects the evident need for...

BY: Rina Moss      10/05/18

Mapping afterschool in New Mexico

By May Sagbakken, executive director of the New Mexico Out-of-School Time Network All children and youth deserve access to high-quality afterschool and summer learning programs that prepare them for school, college, careers, and life. While many students across the country are receiving valuable...

BY: Guest Blogger      06/05/18

New resources! National and state-level fact sheets on afterschool

As spring finally arrives in Washington, D.C., so does a suite of new resources highlighting key facts and stats on afterschool!   The first resource is a new fact sheet on afterschool, which summarizes positive outcomes for students who participate in programs, as well as the supports...

BY: Nikki Yamashiro      04/13/18

AFT poll shows opposition to federal funding cuts to education

The clear message coming out of a recent national poll on attitudes toward federal education spending is that voters are overwhelmingly opposed to the federal government cutting funds for public education. In the poll, conducted by Hart Research Associates for the American Federation of...

BY: Nikki Yamashiro      08/02/17

Guest blog: Q&A with an afterschool researcher

In May, the proposed FY2018 budget eliminated funding for the 21st Century Community Learning Centers (21st CCLC), the only federal funding stream dedicated to before-school, afterschool, and summer learning programs. In the budget, a justification given for the elimination of funding was that...

BY: Guest Blogger      07/28/17

New issue brief: A big-picture approach to wellness

From empowering students to take charge of their health to training staff to model healthy behaviors, afterschool and summer learning programs across the country are offering safe and supportive environments that promote young people’s healthy eating and physical activity, as well as build...

BY: Nikki Yamashiro      09/07/18

An Ideal Opportunity: The Role of Afterschool in Social and Emotional Learning

High school students in The Possibility Project, New York, N.Y., tackle issues close to their heart, taking on leadership roles to enact change in their communities through performing arts and community action. At Girls on the Run councils located in all 50 states, plus D.C., girls run with their...

BY: Nikki Yamashiro      05/04/18

New research on easy, affordable SEL practices

As the prominence of social and emotional learning (SEL) to support students’ development in school and beyond continues to grow in education circles, challenges implementing SEL programming have also arisen. The latest issue brief in a series supported by The Wallace Foundation, Kernels of...

BY: Nikki Yamashiro      02/20/18

Research shows the benefits of early childhood programs

Over the years, research surrounding participation in early childhood programs—such as preschool, home visiting programs, and parent education programs—has continuously shown improved outcomes for children and families. A research report...

BY: Leah Silverberg      01/25/18

"Building Workforce Skills in Afterschool" highlights promising practices for all ages

The next generation of the American workforce is growing up right now and afterschool programs are vital partners in helping young people discover new passions and work towards their dreams. As in so many other subjects, the variety and versatility of afterschool programming offers opportunities...

BY: Nikki Yamashiro      11/14/17

New report from the Wallace Foundation: Strategies to scale up

The question of how to scale up—taking a successful program, project, or policy and growing it to expand its reach and therefore its impact—has been an important one when thinking about systems change. It is a key component in efforts to make sustainable, positive social gains; a...

BY: Nikki Yamashiro      10/06/17

New polling shows America is for afterschool

Just in time for Lights On Afterschool, the only national rally celebrating afterschool, a new national poll is out that shows strong public support for afterschool. Nearly 9 in 10 adults (89 percent) agree that afterschool programs are important to their community, with bipartisan and nationwide...

BY: Nikki Yamashiro      10/22/18

Looking for evidence on the impact of afterschool?

Look no further! Adding to the research conversation discussing the value of afterschool and summer learning programs, the Afterschool Alliance has released two new fact sheets that provide a sampling of evaluation findings demonstrating the positive impact programs have on students, with subjects...

BY: Nikki Yamashiro      11/09/17

Guest blog: Q&A with an afterschool researcher, part II

Welcome to part II of our Q&A with Neil Naftzger, American Institutes for Research (AIR), about his evaluation work related to 21st CCLC programs specifically and the afterschool field broadly. Below are answers to oneof the questions we asked, with our emphasis added in bold, which...

BY: Guest Blogger      08/18/17

AFT poll shows opposition to federal funding cuts to education

The clear message coming out of a recent national poll on attitudes toward federal education spending is that voters are overwhelmingly opposed to the federal government cutting funds for public education. In the poll, conducted by Hart Research Associates for the American Federation of...

BY: Nikki Yamashiro      08/02/17

Guest blog: Q&A with an afterschool researcher

In May, the proposed FY2018 budget eliminated funding for the 21st Century Community Learning Centers (21st CCLC), the only federal funding stream dedicated to before-school, afterschool, and summer learning programs. In the budget, a justification given for the elimination of funding was that...

BY: Guest Blogger      07/28/17

New issue brief: A big-picture approach to wellness

From empowering students to take charge of their health to training staff to model healthy behaviors, afterschool and summer learning programs across the country are offering safe and supportive environments that promote young people’s healthy eating and physical activity, as well as build...

BY: Nikki Yamashiro      09/07/18

An Ideal Opportunity: The Role of Afterschool in Social and Emotional Learning

High school students in The Possibility Project, New York, N.Y., tackle issues close to their heart, taking on leadership roles to enact change in their communities through performing arts and community action. At Girls on the Run councils located in all 50 states, plus D.C., girls run with their...

BY: Nikki Yamashiro      05/04/18

The prevalence of adverse childhood experiences

Close to half of children (45 percent) in the U.S. have experienced at least one adverse childhood experience (ACE)—an experience that could have negative and lasting effects on one’s health and wellbeing, such as depression, drug abuse, and poor physical health. One in 9 children...

BY: Nikki Yamashiro      03/09/18

"Building Workforce Skills in Afterschool" highlights promising practices for all ages

The next generation of the American workforce is growing up right now and afterschool programs are vital partners in helping young people discover new passions and work towards their dreams. As in so many other subjects, the variety and versatility of afterschool programming offers opportunities...

BY: Nikki Yamashiro      11/14/17

Afterschool suppers and afterschool programs key to student success

By Clarissa Hayes, child nutrition policy analyst at the Food Research and Action Center (FRAC). Research shows that afterschool programs provide measurable benefits to students academically, socially, and behaviorally, and serve as an important resource for families and communities. In addition...

BY: Guest Blogger      10/12/18

New issue brief: A big-picture approach to wellness

From empowering students to take charge of their health to training staff to model healthy behaviors, afterschool and summer learning programs across the country are offering safe and supportive environments that promote young people’s healthy eating and physical activity, as well as build...

BY: Nikki Yamashiro      09/07/18

How does afterschool contribute to military readiness?

In 2016, the Council for a Strong America released America Unprepared, showing data that more than 70 percent of young adults in the United States would not qualify for military service due to obesity and other health issues, poor academic performance, drug abuse, or involvement in crime. As a...

BY: Leah Silverberg      08/14/17

New report sees how state policies can promote Healthy Eating and Physical Activity

This post was originally published by the Healthy Out-of-School Time Coalition. A new report from RTI International examines an emerging trend that uses state policy to promote healthy eating and physical activity in afterschool and other out-of-school-time (OST) programs. Based on...

BY: Robert Abare      11/28/16