The Investing in Innovation Fund: Only 12 out of 67 had a significant positive impact on at least one student academic outcome

A new report finds that 49 of the first 67 completed i3 grant evaluations were implemented consistent with What Works Clearinghouse (WWC) evidence standards and 12 of the evaluations found a positive impact on at least one student academic outcome.

The Institute of Education Sciences released a report today (June 11th) titled: The Investing in Innovation Fund: Summary of 67 Evaluations. The report, from the National Center for Education Evaluation and Regional Assistance (NCEE), assesses the quality of the 67 i3 grant evaluations completed by May 2017. The report also summarizes the implementation fidelity and impact findings of the evaluations.

Key findings include:

• Almost three-quarters of the i3 evaluations were implemented consistent with WWC evidence standards with or without reservations (49 of 67, or 73 percent).
• Sixty percent of the evaluations met all of the goals i3 set for evaluation quality. In addition to consistency with WWC evidence standards, these goals included: independence, high-quality implementation measurement, and including a sample that adequately represents those served under the grant.
• Eighteen percent (12 of 67) of the i3 evaluations found a statistically significant positive impact on at least one student academic outcome.
• Thirteen percent (9 of 67) of the i3 evaluations found evidence of both adequate implementation fidelity and positive impacts on student academic outcomes.