IDinsight—General Support (2016) | GiveWell

# IDinsight—General Support (2016)

Published: August 2016

[Added December 19, 2016: GiveWell's experimental work is now known as GiveWell Incubation Grants.]

## Risks and reservations

The main risks we see in relation to this grant have to do with the probability that IDinsight will produce research in the future that GiveWell can use in our own research to recommend top charities. More detail:

• Our impression is that IDinsight has not yet produced much research of the kind that we expect to be valuable to us. However, we believe this is likely to change as IDinsight grows.
• We think there is some risk that IDinsight could choose to focus on interventions or organizations whose evaluations do not provide enough useful data for us to make this grant worthwhile.
• IDinsight’s evaluations appear to us to often be designed to assess a program’s effectiveness at achieving its proximate goal, without necessarily evaluating the additional assumptions that would need to be true for the intervention to have a positive impact. For example, IDinsight’s evaluation of a program aimed at increasing institutional delivery by pregnant women in Zambia does not also attempt to assess how effective institutional delivery is at reducing maternal or neonatal mortality.2
• We expect the most useful result of this grant for us to be IDinsight growing its staff in order to conduct more evaluations relevant to GiveWell's work. We think IDinsight may not plan to prioritize this growth as highly as we would like relative to its plans for idea dissemination, since we see the latter as less likely to be directly beneficial to our work (though we do expect idea dissemination to have some positive effects).

## Goals for the grant

The ideal outcome of this grant from our perspective would be for IDinsight to become one of our main partners on an ongoing basis. This might happen in one of two ways:

1. IDinsight creates a GiveWell-focused team that helps evaluate interventions or organizations that we are interested in but currently do not have the necessary data to evaluate. For example, GiveWell is interested in evaluating UNICEF's maternal and neonatal tetanus (MNT) campaign, but we lack data on 1) the baseline MNT mortality rate, 2) the baseline immunization rate, and 3) the campaign's success at vaccinating people. A partner team at IDinsight could potentially obtain this data.
2. IDinsight conducts evaluations for our top charities. Our understanding is that Neil Buddy Shah (CEO and Founding Partner of IDinsight) has discussed potential collaborations with Paul Niehaus of GiveDirectly and Jeff Brown of Evidence Action.

## Key questions for follow-up

One year from now (i.e. around July 2017), we plan to check in with IDinsight on the following:

• Growth: How many staff has IDinsight added? How many projects is it implementing?
• Idea dissemination: Has IDinsight's work led at least one major evaluation funder to support decision-focused evaluation? How have IDinsight's white papers and blog posts been received, and what influence have they had? What are IDinsight's plans for idea dissemination going forward?
• Innovation: Has IDinsight decided on any new project types to pursue? What are its plans for innovation going forward?

## Our process

We have been in contact with Neil Buddy Shah periodically for a couple of years. We previously attempted a project with IDinsight (which ultimately did not go forward) to evaluate the Schistosomiasis Control Initiative, one of our current top charities. Over the last few months, we have had several conversations with Dr. Shah about how IDinsight would plan to use additional unrestricted funds. We have also discussed IDinsight with other people that we respect in the field.

## Sources

Document Source
IDinsight, Funding Narrative Source
IDinsight, Mama Kits to Increase Institutional Delivery Source (archive)
IDinsight, The Future of Impact Evaluation Source (archive)
Pritchett 2015 Source (archive)