You are here

2018 Cost-Effectiveness Analysis Changelog

This page provides details about changes that were made to our cost-effectiveness analysis (CEA) in 2018.

Version 3 — Published May 3, 2018

Link to the cost-effectiveness analysis file: 2018 CEA — Version 3

Change 1: Updated the Transfers as a percentage of total cost parameter

We updated the Transfers as a percentage of total cost parameter in the "Cash" tab from a value of 81.5% to 83.0%. We made this update to incorporate information about GiveDirectly's spending from August 2017 through February 2018. The calculations behind the new value can be seen here.



Charity
Median [Charity]
vs. cash before
Median [Charity]
vs. cash after
Percent
change
Deworm the World 12.4x 12.2x -1.8%
Schistosomiasis Control Initiative 9.8x 9.7x -1.8%
Sightsavers 4.8x 4.7x -1.8%
Against Malaria Foundation 5.8x 5.7x -1.8%
Malaria Consortium 7.2x 7.1x -1.8%
Helen Keller International 8.8x 8.7x -1.8%
The END Fund 4.2x 4.2x -1.8%
No Lean Season 5.3x 5.2x -1.8%

Version 2 — Published April 26, 2018

Link to the cost-effectiveness analysis file: 2018 CEA — Version 2

Change 1: Renamed the "Parameters" tab to "User inputs"

This change did not affect the model's results.

Change 2: Replaced items on the "User inputs" tab with default values

We removed the majority of items from the "User inputs" tab and began using a single default value for these parameters. The parameters and default values are listed below, separated by intervention. Items marked "Removed" were deleted from the CEA. Removing values was mathematically equivalent to setting their values to 100%. Our reasoning behind the default values can be found in the cell notes associated with each item. These changes are intended to make the CEA easier to engage with.

Cash parameters

  • Percent of investment returned when benefits end [20%]



Charity
Median [Charity]
vs. cash before
Median [Charity]
vs. cash after
Percent
change
Against Malaria Foundation 6.0x 6.1x 0.8%
Malaria Consortium 6.9x 6.9x 0.6%
Helen Keller International 8.9x 8.9x 0.2%


Migration subsidies parameters
  • Internal validity adjustment — Migration subsidies [80%]
  • External validity adjustment — Migration subsidies [80%]
  • Further adjustment for uncertainty of evidence for benefits in the second year of remigration [Removed]
  • Adjustment for uncertainty of evidence regarding benefits in lesser lean seasons [Removed]
  • Adjustment to the utility of migration, migrants' nonmigrating household members [100%]



Charity
Median [Charity]
vs. cash before
Median [Charity]
vs. cash after
Percent
change
No Lean Season 4.9x 5.3x 8.2%


VAS parameters
  • Relative risk of all-cause mortality for children aged 6- to 59-months participating in VAS programs [0.76]
  • Internal validity adjustment — VAS [95%]



Charity
Median [Charity]
vs. cash before
Median [Charity]
vs. cash after
Percent
change
Helen Keller International 8.9x 8.8x -0.5%


SMC parameters
  • Internal validity adjustment — SMC [95%]
  • External validity adjustment — SMC [100%]
  • Ratio of the reduction in malaria mortality to the reduction in malaria incidence [100%]



Charity
Median [Charity]
vs. cash before
Median [Charity]
vs. cash after
Percent
change
Malaria Consortium 6.9x 7.2x 4.2%

Nets parameters
  • Relative efficacy of ITNs for reducing mortality of individuals age 5 and older [80%]
  • Net use adjustment [90%]
  • Proportion of mortality attributed to malaria in areas AMF works vs. the contexts of trials in Lengeler 2004 [100%]
  • Internal validity adjustment — Nets [95%]



Charity
Median [Charity]
vs. cash before
Median [Charity]
vs. cash after
Percent
change
Deworm the World 12.4x 12.4x 0.0%
Schistosomiasis Control Initiative 9.8 9.8x 0.4%
Sightsavers 4.8x 4.8 0.5%
Against Malaria Foundation 6.1x 5.8x -3.6%
Malaria Consortium 7.2x 7.2x 0.5%
The END Fund 4.2x 4.2x 0.2%


Deworming parameters
  • Treatment effect of deworming on ln(consumption) [0.14]
  • Multiplier for resource sharing within households [2.0]
  • Duration of long-term benefits of deworming (in years) [30]
  • Proportion of dewormed children that benefited from long-term gains in Baird et al. [Removed]
  • Adjustment for varying treatment frequency (all deworming charities) [Removed]

Changes to deworming parameters moved results for some individuals, but did not alter the median CEA result.

Change 3: Added "Inclusion/Exclusion" tab

We added a tab titled "Inclusion/Exclusion" to the CEA. This tab lists different items that we considered accounting for in our cost-effectiveness analysis. Each item is evaluated with a rubric assessing how easy it would to include the item in our model and how much including an item might move our bottom line estimates.

This change did not affect the model's results.

Change 4: Removed leverage/funging adjustments from the "User inputs" tab

This change was intended to make the CEA easier to engage with. The change did not affect the model's results.

Change 5: Added a set of "Conventional" moral weights to the CEA

We added a column labeled "Conventional" to the "Moral weights" tab of the CEA. This set of moral weights is an attempt to represent normative values commonly used in analyses conducted by other organizations in the global health and development field; see more information here. We don't believe there's a single set of normative values that can accurately represent the typical view in the global health and development community, so these moral weights should be interpreted cautiously. The new set of moral weights is combined with the median values for items on the "User inputs" tab to arrive at final cost-effectiveness figures in the "Conventional" column. These final figures were not accounted for when calculating the median results among individuals included in our CEA.

Change 6: Revised content on the "Notes" tab

Content on the "Notes" tab was revised to reflect the changes above. This change did not affect the model's results.

Version 1 — Published January 24, 2018

Link to the cost-effectiveness analysis file: 2018 CEA — Version 1

Change 1: Rolled out a new update process

With this update, we transitioned to a new process for releasing updates to the cost-effectiveness model. The new process involves both internal changes in how GiveWell works on updates and an external change to the structure of release notes. We hope that this change will make updating the CEA easier.

This change did not affect the model's results.

Change 2: Changed the summary effect in the seasonal malaria chemoprevention CEA

We moved the parameter labeled "Relative risk for malaria cases, intention to treat effect" from the "Parameters" tab to the "SMC" tab. The parameter was set to a default value of 0.25, the relative risk suggested by our meta-analysis of seasonal malaria chemoprevention trials.


Charity
Median [Charity]
vs. cash before
Median [Charity]
vs. cash after
Percent
change
Malaria Consortium 6.6x 6.9x 4.2%