Skip to main content
  • Work at WestEd
  • Subscribe
  • Contact Us
  • Twitter LinkedIn Facebook

Don't Miss Out!

Subscribe to the E-Bulletin for regular updates on research, free resources, solutions, and job postings from WestEd.

Subscribe Now

WestEd E-Bulletin

close

WestEd

WestEd
Improving learning, healthy development, and equity in schools and communities
  • Areas of Work
    • Areas of Work

      Building leadership, skills, and knowledge across critical topics.

      • College & Career
      • Early Childhood Development & Learning
      • English Language Learners
      • Health, Safety, & Well-Being
      • Literacy
      • Schools, Districts, & State Education Systems
      • Science, Technology, Engineering, & Mathematics
      • Special Education
      • Standards, Assessment, & Accountability
      • Teachers & Leaders
      • Featured Initiative
      • Charters & Choice
      • COVID-19 Resources for Educators
      • Online Professional Development
      • Strategic Resource Planning & Implementation
      • Trauma-Informed Practice & Resiliency
  • Professional Development
  • Research & Evaluation
    • Research & Evaluation

      Conducting research and evaluation studies to help improve education and other important outcomes for children, youth, and adults.

      • What We Do
      • How We Can Help
      • WestEd Insights
      • Reports & Publications
      • Other Pages of Interest
      • National TA Centers
      • Consulting & Policy Support
  • Technical Assistance
    • Technical Assistance

      Build systemwide capacity to plan and implement research-informed solutions that ensure positive outcomes.

      • Technical Assistance Services
      • National Support Networks
      • Policy Analysis & Other Support
  • Resources
    • Resources

      A rich portfolio of resources that promote educator effectiveness, inform policy, and support positive outcomes for all learners.

      • Resources Home
      • New Releases
      • Best Sellers
      • Top Downloads
      • Research
      • Free Resources
      • Webinars
      • Catalogs
      • R&D Alert Articles
      • Reprint Permissions
      • Customer Support
      • Contact Publications Center
      • Login/Create Account
  • Events
  • About Us
    • About Us

      Trust unparalleled expertise from WestEd to help all learners succeed.

      • Overview
      • Board of Directors
      • Leadership
      • Staff
      • Offices

      • Work at WestEd
      • Work with WestEd
      • News
      • Events
      • Subscribe
      • Contact Us
  • Work at WestEd
Menu

WestEd Insights / research and innovations

Read about significant research findings and impact from WestEd experts related to teaching, learning, and human development.

Student working on art

WestEd i3 Evaluations Meet Evidence Standards

This post was written by Jonathan Nakamoto, Research Associate in WestEd’s Health & Justice Program, and Tony Fong, Senior Research Associate in WestEd’s Regional Educational Laboratory West (REL West).

WestEd works with districts, states, the federal government, and other organizations nationwide to conduct educational evaluations that meet rigorous standards. For example, WestEd designed, implemented, and reported on several evaluations that were conducted as part of the Investing in Innovation (i3) Fund, which was a federal grant program designed to promote innovative educational practices.

A recent report found that the three WestEd grant evaluations reviewed by the authors that were conducted as part of the i3 Fund were implemented according to What Works Clearinghouse (WWC) evidence standards. The WWC, which is a U.S. Department of Education initiative, aims to be a “trusted source of scientific evidence for what works in education” and assesses the quality of studies that examine the impact of educational interventions. WestEd’s three grant evaluations are summarized below and highlight our continued success conducting educational evaluations that meet the field’s most rigorous standards.

The Beaverton School District Arts for Learning (A4L) Lessons Project, An Investing in Innovation (i3) Development Grant: Student Impact Findings from Years 1, 2, and 3

The Arts for Learning (A4L) Lessons Project is an intervention designed to improve elementary students’ reading and writing achievement by integrating arts into the language arts curriculum. The study’s lead authors, Jonathan Nakamoto and Sandy Sobolew-Shubin, used a cluster-randomized trial to examine the impact of A4L on 3rd, 4th, and 5th graders’ achievement on Oregon’s reading/literature state assessment. As part of the study, WestEd randomly assigned 32 elementary schools to either receive the intervention or the business-as-usual condition. The results of the cluster-randomized trial did not show an impact of A4L on student achievement, but exploratory analyses suggested the intervention can impact students’ literacy and life skills. This study received a rating of Meets WWC Standards without Reservations, the highest WWC rating.

Evaluation of the Expository Reading and Writing Course: Findings from the Investing in Innovation Development Grant

The goal of the Expository Reading and Writing Course (ERWC) is to improve the academic literacy of high school seniors and reduce the need for students to enroll in remedial English in college. This study’s lead authors, Tony Fong and Neal Finkelstein, used a quasi-experimental design to compare academic achievement for 12th graders enrolled in the ERWC with academic achievement for a matched comparison group of similar 12th graders not enrolled in the course. WestEd found that enrollment in the ERWC had a statistically significant positive impact on the English Placement Test, which was the placement test used by the California State University system to place students into either a remedial English course or a credit-bearing English course. This study received a rating of Meets WWC Standards with Reservations.

Pathways to STEM Initiative (PSI): Evaluation Report for an Investing in Innovation (i3) Development Grant

The goal of the Pathways to STEM Initiative (PSI) is to improve middle school science achievement using project-based science, technology, engineering, and math (STEM) coursework; extracurricular opportunities for students to explore STEM concepts; and teacher professional development. To assess the impact of PSI, the study’s lead authors, Jonathan Nakamoto and Juan Carlos Bojorquez, used a quasi-experimental design that relied on a group of matched comparison schools that did not participate in the initiative. WestEd did not find that PSI had an impact on 6th, 7th, and 8th graders’ science achievement. However, the implementation evaluation component of the study indicated that PSI may not have been implemented with sufficient fidelity to lead to achievement gains. This study received a rating of Meets WWC Standards with Reservations.

The ratings of the i3 evaluations, which were completed by Abt Associates, are unofficial at this time for the A4L Lessons Project and the PSI evaluation, because they were not conducted by the WWC. The ERWC evaluation has been reviewed by the WWC and can be found here. Given one of the goals of the i3 Fund was to increase the number of studies that meet the WWC standards, it is likely that WestEd’s two studies with unofficial ratings will receive official WWC ratings in the future.

Additional i3 Studies

In addition to the three studies summarized above, WestEd is currently the evaluator for two other i3 grants. Staci Wendt and Rebeca Cerna are evaluating the impact of Santa Ana Unified School District’s Positive School Climate Model and Linlin Li is leading the evaluation of Learning by Making: STEM Success for Mendocino County.

WestEd has also led several other i3 grants, including Kirsten Daehler’s investigation of the impact of the Making Sense of Science and Literacy professional development, Pamela Spycher’s project on English Learner Professional Learning, and the Strategic Literacy Initiative’s project for the Reading Apprenticeship program.

To learn more about how WestEd can help your organization design and implement a rigorous research design to answer questions about the impact of educational programs, visit our website or email us at research@WestEd.org.

Posted on October 1, 2018

View More

 

Contact Us

Ask a question, request information, make a suggestion, or sign up for our newsletter.

Areas of Work

  • Areas of Work
  • College & Career
  • Early Childhood Development & Learning
  • English Learners
  • Health, Safety, & Well-Being
  • Literacy
  • Schools, Districts, & State Education Systems
  • Science, Technology, Engineering, & Mathematics
  • Special Education
  • Standards, Assessment, & Accountability
  • Teachers & Leaders
  • Featured Initiatives

Professional Development

  • Professional Development

Research & Evaluation

  • Research & Evaluation
  • What We Do
  • How We Can Help
  • Reports & Publications
  • WestEd Insights

Technical Assistance

  • Technical Assistance
  • Technical Assistance Services
  • National Support Networks
  • Policy Analysis and Other Support

Resources

  • Resources
  • Resources Home
  • New Releases
  • Best Sellers
  • Top Downloads
  • Free Resources
  • Research
  • Catalogs
  • Webinars
  • R&D Alert Articles

About Us

  • About Us
  • Overview
  • Board of Directors
  • Leadership
  • Staff
  • WestEd Offices
  • Our Clients and Funders
  • Work with WestEd
  • WestEd Insights
  • News
  • Events
  • Making a Difference
  • Work at WestEd
  • Contact Us
  • Facebook
  • Twitter
  • LinkedIn
Also of Interest:
  • Insights /Research and Innovations
  • Latest Research and News on Education
  • Upcoming Events

Copyright ©1995 - 2021 WestEd | Privacy Policy | Disclaimer

Return to top of page