<< Back To Home

CSU 86/2010: IMPACT OF CONDITIONAL CASH TRANSFERS IN INDIA

Wednesday, 8th of September 2010 Print

CSU 86/2010:  IMPACT OF CONDITIONAL CASH TRANSFERS IN INDIA

To date, much of the literature on conditional cash transfers has focused on Latin America. This study by Lim and colleagues shows a positive impact of CCT in India.

‘JSY had a significant effect on increasing antenatal care and in-facility births. In the matching analysis, JSY payment was associated with a reduction of 3·7 (95% CI 2·2—5·2) perinatal deaths per 1000 pregnancies and 2·3 (0·9—3·7) neonatal deaths per 1000 livebirths. In the with-versus-without comparison, the reductions were 4·1 (2·5—5·7) perinatal deaths per 1000 pregnancies and 2·4 (0·7—4·1) neonatal deaths per 1000 livebirths.’

Full text is at http://www.thelancet.com/journals/lancet/article/PIIS0140-6736(10)60744-1/fulltext

Good reading.

BD

 

outline goes here

The Lancet, Volume 375, Issue 9730, Pages 2009 - 2023, 5 June 2010

India's Janani Suraksha Yojana, a conditional cash transfer programme to increase births in health facilities: an impact evaluation

Original Text

Stephen S Lim PhD a, Prof Lalit Dandona MD a b, Joseph A Hoisington BS a, Spencer L James BS a, Margaret C Hogan MS a, Dr Emmanuela Gakidou PhD a

Summary

Background

In 2005, with the goal of reducing the numbers of maternal and neonatal deaths, the Government of India launched Janani Suraksha Yojana (JSY), a conditional cash transfer scheme, to incentivise women to give birth in a health facility. We independently assessed the effect of JSY on intervention coverage and health outcomes.

Methods

We used data from the nationwide district-level household surveys done in 2002—04 and 2007—09 to assess receipt of financial assistance from JSY as a function of socioeconomic and demographic characteristics; and used three analytical approaches (matching, with-versus-without comparison, and differences in differences) to assess the effect of JSY on antenatal care, in-facility births, and perinatal, neonatal, and maternal deaths.

Findings

Implementation of JSY in 2007—08 was highly variable by state—from less than 5% to 44% of women giving birth receiving cash payments from JSY. The poorest and least educated women did not always have the highest odds of receiving JSY payments. JSY had a significant effect on increasing antenatal care and in-facility births. In the matching analysis, JSY payment was associated with a reduction of 3·7 (95% CI 2·2—5·2) perinatal deaths per 1000 pregnancies and 2·3 (0·9—3·7) neonatal deaths per 1000 livebirths. In the with-versus-without comparison, the reductions were 4·1 (2·5—5·7) perinatal deaths per 1000 pregnancies and 2·4 (0·7—4·1) neonatal deaths per 1000 livebirths.

Interpretation

The findings of this assessment are encouraging, but they also emphasise the need for improved targeting of the poorest women and attention to quality of obstetric care in health facilities. Continued independent monitoring and evaluations are important to measure the effect of JSY as financial and political commitment to the programme intensifies.

Funding

Bill & Melinda Gates Foundation.

Introduction

The state of maternal, newborn, and child health in India is of global importance; in 2005, more than 78 000 (20%) of 387 200 maternal deaths,1 and more than 1 million (31%) of 3·4 million neonatal deaths occurred in India.2 These estimates represent a steady but gradual improvement in India over the previous 15 years. The maternal mortality ratio declined from about 520 per 100 000 livebirths in 1990 to nearly 290 per 100 000 in 2005;1 and the neonatal mortality rate decreased from 54 per 1000 livebirths in 1990 to 38 per 1000 in 2005.2 Despite this progress, the numbers of maternal and neonatal deaths remained high. The national averages also masked remarkable inequalities in maternal and child health, with the number of child deaths ranging from 16 per 1000 livebirths in the socially advanced Kerala state to 96 per 1000 livebirths in poor states such as Uttar Pradesh.3

In April, 2005, in response to the slow and varied progress in improvement of maternal and neonatal health, the Government of India launched Janani Suraksha Yojana (JSY; translated as safe motherhood scheme)—a national conditional cash transfer scheme—to incentivise women of low socioeconomic status to give birth in a health facility. The ultimate goal of the programme is to reduce the number of maternal and neonatal deaths,4 and the scheme was based on the previous national maternity benefit scheme.5

According to JSY's guidelines,4, 6 after delivery in a government or accredited private health facility, eligible women would receive 600 Indian rupees (US$13·3) in urban areas and 700 rupees ($15·6) in rural areas. In ten high-focus states (Uttar Pradesh, Uttaranchal, Bihar, Jharkhand, Madhya Pradesh, Chhattisgarh, Assam, Rajasthan, Orissa, and Jammu and Kashmir) with low in-facility birth coverage, all women irrespective of socioeconomic status and parity are eligible for the cash benefit. The cash incentive is higher in these states than in the other states: 1000 rupees ($22·2) in urban areas and 1400 rupees ($31·1) in rural areas. In the non-high-focus states, women were eligible for the cash benefit only for their first two livebirths, and only if they had a government-issued below-the-poverty-line card or if they were from a scheduled (low) caste or tribe. Like the national maternity benefit scheme, JSY also continues to provide a small amount of financial assistance—500 rupees ($11)—for births at home for pregnant women (aged 19 years and older) living below the poverty line, and for the first two births.4, 7

JSY is being implemented through community-level health workers (such as accredited social health activists [ASHAs]), who identify pregnant women and help them to get to a health facility. ASHAs receive payments of 200 rupees ($4·4) in urban areas and 600 rupees ($13·3) in rural areas per in-facility delivery assisted by them in high-focus states.4 According to JSY's guidelines, ASHAs or other health workers associated with the scheme should provide or help women to receive at least three antenatal care visits, arrange immunisation of the newborn baby, do a postnatal checkup, and counsel for initiation and continuation of breastfeeding.

JSY is the largest conditional cash transfer programme in the world in terms of the number of beneficiaries, and represents a major Indian health programme. Data from the programme suggest substantial scale-up in the past few years in terms of the number of beneficiaries, and a budget allocation of 15·4 billion rupees ($342 million) in the 2009—10 financial year. This funding is expected to provide cash transfers to about 9·5 million (36%) of 26 million women giving birth in India during this year. Other conditional cash transfer programmes have been implemented to incentivise the use of health services in low-income and-middle-income countries—Latin America, Bangladesh, Indonesia, Nepal, and Malawi.8—12 The little evidence from the assessment of the effects of conditional cash transfers in Mexico,13—16 Colombia,8 Nicaragua,17 and Malawi18 suggests that although these programmes have led to increased health-service use,19 whether they have led to improvements in health outcomes and whether their effects are generalisable across different settings are not known.20

These issues, the importance of India to global maternal and neonatal health, and the magnitude of the continued investment in JSY, draw attention to the important role of the assessment of JSY to our understanding of the contribution of the programme to improvements in maternal and neonatal health in India. Previous assessments of JSY have been descriptive,21 or have been assessments of the process in selected states.6, 7 In this study, we use data from two rounds of the India district-level household surveys (DLHS) to provide an evaluation of the effect of JSY. Specifically, we document the level of implementation of JSY at the district level; investigate whether JSY is reaching its intended beneficiaries; and assess whether the receipt of financial assistance from JSY is associated with increases in antenatal care, the proportion of births in health facilities and with a skilled attendant present, and reductions in the numbers of perinatal, neonatal, and maternal deaths.

Methods

Data

We used data from two rounds of the India DLHS, which are health interview surveys covering family planning, maternal and child health, reproductive health of ever-married women and adolescent girls, and use of maternal and child health-care services at the district level for India. These surveys are done by the International Institute for Population Sciences in Mumbai with funding from the Ministry of Health and Family Welfare, Government of India. DLHS data are made available in the public domain for analysis by researchers. In round two of DLHS (DLHS-2), 620 107 households (about 1000 in each of 593 districts) in India were sampled between 2002 and 2004 by use of multistage stratified sampling. DLHS-2 covered the period before implementation of JSY. In round three of DLHS (DLHS-3), 720 320 households (1000—1500 from each of 611 districts) were sampled between late 2007 and early 2009 with multistage stratified sampling; districts with low coverage of interventions for maternal and child health were oversampled. DLHS-3 covered the period 2—3 years after JSY implementation was started—ie, a reference time of roughly 2007—08.

Both rounds of the DLHS included a household interview in which information was gathered about the demographic composition of the household; socioeconomic characteristics including asset ownership; deaths in the household; and for household deaths in women, whether the death occurred during pregnancy or in the period after delivery. In interviews of ever-married women of reproductive age (15—44 years) in the household, information was gathered about birth history (complete in DLHS-2, truncated in DLHS-3), reproductive health, contraception and fertility, and antenatal care and delivery care for the most recent pregnancy. The outcome of the most recent pregnancy (livebirth, stillbirth, spontaneous or induced abortion) and survival of the child in the case of a livebirth were also recorded. Information about village characteristics, such as distance to the nearest health facility, was recorded in rural areas. In DLHS-3, women were asked whether they received any financial assistance from JSY for delivery care of the most recent pregnancy.

We estimated household wealth with a random-effects probit model for which information about asset ownership for all households in DLHS-2 and DLHS-3 was used to create estimates that were comparable across the two rounds.22—24 The assets available in both rounds of DLHS were type of toilet, type of house, and type of cooking fuel, source of water, and ownership of a fan, television, motorcycle, car, and telephone. Additional assets available only in DLHS-3 were cooker, chair, sofa, computer, fridge, and washing machine, and ownership of animals, specifically, camels, horses, or sheep. After the wealth index was estimated, households were classified into deciles and quintiles of wealth. We also used the wealth index to produce estimates of average wealth for each district.

Since some district boundaries changed between DLHS-2 and DLHS-3, we aggregated some districts to create a set of consistently defined district aggregates, resulting in 580 district aggregates from DLHS-2 to DLHS-3. For all estimates in the analysis, we took into account the sampling design of the survey. No primary data were gathered for this study. We used data that were completely anonymous.

Characteristics of beneficiaries of JSY

We calculated district-level and state-level uptake of JSY by including only births that occurred during the 12 months before the survey to avoid periods of differential implementation of the scheme. In this way, biases in the comparison of low-fertility districts with high-fertility districts were reduced because DLHS recorded responses for the most recent birth only. We assessed uptake of JSY for all women, not just those who were eligible on the basis of the national criteria. In high-focus states, all women were eligible. In non-high-focus states, eligibility criteria varied, and the limitations in the information available in DLHS-3 did not allow us to estimate JSY payment rates among eligible women. For comparison, we used the total number of women as the denominator in our analyses.

We used logistic regression to investigate the association between a mother's report of receipt of financial assistance from JSY for the most recent birth and a range of individual and household characteristics—maternal age in 5-year age groups; number of livebirths (one, two, three or four, and five or more births); maternal education (no education, 1—5 years, 6—11 years, and 12 years or more); caste or tribe (scheduled caste, scheduled tribe, other backward class [standard term used in India], other); religion (Hindu, Muslim, Christian, Sikh, Buddhist, other); location of residence (urban or rural); decile of household wealth; and average household wealth of the district the household resided in.

We tested the sensitivity of our findings to various model specifications. Specifically, we assessed state-fixed effects or a random effect across states. We estimated the regression at the national level and also separately for high-focus states, remote northeast states, and other states. We also estimated state-specific regressions when the sample size was sufficient. Because we noted that our results were not sensitive to model specification, we presented the findings using state-fixed effects.

Measurement of impact of JSY

We used three different analytical methods—exact matching, with versus without, and district-level differences in differences—to assess the effect of JSY on the likelihood that the woman attended at least three antenatal care visits; gave birth in a health facility; and had skilled birth attendance, defined as a birth in a health facility or with a skilled attendant present outside a health facility. We adhered to the recommendations of the 2008 report by WHO about skilled birth attendance, and included doctors, nurses, midwives, and auxiliary midwives in the category of skilled birth attendants.25 We estimated the effect of JSY on three health outcomes: perinatal death (stillbirth after 28 weeks of pregnancy or death of a child within the first week after a livebirth); neonatal death (death of a child within the first month after being born alive); and the maternal mortality ratio. We were only able to estimate the effect of JSY on the maternal mortality ratio at the district level because DLHS-3 did not record whether or not women who died were registered with JSY.

We tested the sensitivity of our findings to various model specifications. Specifically, for the exact-matching and with-versus-without analyses, we used state-fixed effects or a random effect across districts. We estimated the regressions at the national level and also separately for high-focus states, remote northeast states, and other states. We also estimated state-specific regressions when the sample size was sufficient. Because our results were not sensitive to model specification, we presented findings from the regressions with state-fixed effects.

Exact matching

Information about the use of matching for causal inferences is sophisticated and increasing, and includes several applications in global health and assessments of health policies.26—29 Matching provides a way of preprocessing the data so that the treated group is as similar to the control group as possible, thus making the treatment variable (in this case, JSY) as independent of the background characteristics as possible. By breaking or reducing the link between the treatment variable and the control variables, matching makes estimates based on subsequent analyses far less dependent on model specification.27

For the exact-matching analysis, we used data from DLHS-3. Since information about JSY was only gathered for the most recent birth after Jan 1, 2004, the analysis was restricted to those births. We exactly matched births receiving JSY (treated observations) to births that did not receive JSY (untreated observations) using the covariates state of residence, urban or rural residence, below-the-poverty-line card ownership, wealth quintile, caste, education, parity, and maternal age. We implemented the exact-matching procedure using the MatchIt software in R (version 2.4—13).

We then used logistic regression for the matched dataset to provide additional control of potential confounding using the covariates maternal age (in 5-year age groups); number of livebirths (one, two, three or four, five or more); birth interval (<12 months, 12—23 months, ≥24 months, unknown); one or more births; maternal education (no education, 1—5 years, 6—11 years, and 12 years or more); household wealth decile; caste or tribe (scheduled caste, scheduled tribe, other backward class, other); religion (Hindu, Muslim, Christian, Sikh, Buddhist, other); and location of residence with respect to distance to the nearest health facility (urban, and rural and <5 km from a health facility; rural and 5—9 km; rural and 10—19 km; and rural and ≥20 km).

With-versus-without analysis

Data were pooled for the with-versus-without analysis from DLHS-2 and DLHS-3, with every observation representing the most recent birth for an ever-married woman aged 15—44 years. Since DLHS-2 was done just before the implementation of JSY, it provided a suitable baseline. All treated observations, which included all women receiving JSY, were in DLHS-3. By use of logistic regression, we controlled for the same socioeconomic and demographic characteristics as in the matching analysis, and we estimated the effect of JSY on intervention coverage and health outcomes. A variable indicating which round of DLHS the observation was from was included to control for temporal trends.

District-level differences in differences

We assessed the effect of JSY on health-system outputs and outcomes using district-level differences in differences that controlled for differences between treated and untreated observations, and differences in treated observations that might have resulted from underlying changes over time.30, 31 This analysis further reduced potential biases arising from selective individual uptake of financial assistance from JSY that were not accounted for by the socioeconomic and demographic characteristics included in the individual-level analyses. The district-level analysis also allowed us to assess the association between JSY and maternal mortality. With ordinary least-squares regression, we estimated the effect of the fraction of births receiving JSY in the district in the 12 months before the survey, and district-level measures of intervention coverage and health outcomes. We included all maternal deaths in the 3 years before the survey in the calculation of the maternal mortality ratio to reduce the difficulty associated with small numbers. We controlled for district-level variables: average maternal age; proportion of women with no education; proportion of women with 1—5 years of education; proportion of births from urban residences; proportion of births from a rural area and more than or equal to 20 km from a health facility; proportion of births from a scheduled tribe; proportion of births from a scheduled caste; proportion of births that were first births; and proportion of households in the district that were in the lowest national income quintile. We included a variable indicating which round of DLHS the observation was from to control for temporal patterns; a fixed effect by district controlled for baseline differences between districts.

All analyses were done in Stata (version 11.0). The programming code required to reproduce the analysis and results from alternative model specifications that are not shown in the results tables are available from the authors on request.

Role of the funding source

The funders had no role in study design, data gathering and analysis, interpretation of data, decision to publish, or preparation of the report. The corresponding author had full access to all data that were analysed, and had final responsibility for the decision to submit this report for publication.

Results

Figure 1 shows substantial variation in the district-level uptake of JSY (measured as the proportion of births among all women in the 12 months before DLHS-3 who received financial assistance from JSY), from less than 5% of women receiving financial assistance from JSY in 141 districts to more than or equal to 30% in 128 districts. Variation in the uptake of JSY in the states was much higher than between districts within the same state (figure 1). Some high-focus states showed a high uptake of JSY—eg, 44% (95% CI 42—46) of women reported receiving JSY payments in Madhya Pradesh, 42% (40—45) in Orissa, and 32% (29—35) in Assam (figure 2). Other high-focus states had low uptake—eg, 15% (13—16) in Bihar, and 7% (6—7) in the populous state of Uttar Pradesh. Uptake of JSY was also high in some non-high-focus states with traditionally high levels of in-facility delivery—eg, 26% (23—28) of women reported receiving JSY payments for births in Tamil Nadu. In most states, a large amount of financial assistance from JSY was for in-facility births (figure 2). The highest percentages of JSY recipients for births outside of facilities were reported in Sikkim and West Bengal, where 8% (4—11) and 7% (6—9) of women, respectively, reported receiving JSY payments for a birth outside of a facility.

Figure 1 Full-size image (222K) Download to PowerPoint

Percentage of women reporting receipt of financial assistance from Janani Suraksha Yojana among all women who gave birth in past 12 months by district

Data were from the third round of the district-level household survey in 2007—09.

Figure 2 Full-size image (65K) Download to PowerPoint

Percentage of women reporting receipt of financial assistance from Janani Suraksha Yojana (JSY) among all women who gave birth in past 12 months by state and location of birth

Data were from the third round of the district-level household survey in 2007—09. *High-focus state.

At the national level, uptake of JSY was highest in women with 1—5 years or 6—11 years of education (figure 3). Receipt of financial assistance from JSY was highest in women in the middle quintiles of wealth (figure 3). JSY payments seemed to be higher for women in scheduled (low) castes or tribes than in other women. Rates of JSY payments were highest for women who were having their first child, followed by those having their second child. Rates steadily declined with age, with the youngest women (aged 15—19 years) showing the highest uptake (figure 3). JSY uptake did not vary much in urban and rural residences, or with distance to health facilities, although the highest rates of JSY payments were to women living in rural areas, but close to a health facility (figure 3). Overall, the JSY programme achieved some of its stated goals of reaching poor, disadvantaged women, although it did not seem to be reaching the poorest women at the highest rate.

Figure 3 Full-size image (102K) Download to PowerPoint

Percentage of women reporting receipt of financial assistance from Janani Suraksha Yojana (JSY) among all women who gave birth in the past 12 months by individual characteristics

Data were from the third round of the district-level household survey in 2007—09. Error bars represent 95% CIs.

Based on multivariable regression (table 1), at the national level, and in high-focus and non-high-focus states, young mothers giving birth to their first child were most likely to receive JSY payments. In high-focus states only, mothers giving birth to their second child had significantly lower odds of receiving JSY payments than did those having their first birth. Also in high-focus states, urban residence was associated with increased odds of receiving JSY payments, whereas in non-high-focus states urban residence was associated with lower odds.

Table 1Table image

Multivariable logistic regression of association between receipt of financial assistance from Janani Suraksha Yojana by women for their most recent birth and individual characteristics by use of round three of the district-level household survey (2007—09)

Women with 1—5 years and 6—11 years of education had greater odds of receiving JSY payments than did those without any education. In the high-focus states, women in the richest two wealth deciles had the lowest odds of receiving JSY payments, with the sixth and seventh deciles having the highest odds of receiving JSY payments. In the northeast states, the odds of receiving JSY payments increased with wealth. In the other states, however, the low and middle wealth deciles had higher odds of receiving JSY payments than did the other deciles.

Except in the northeast states, women from the socially disadvantaged castes (scheduled caste, scheduled tribe, and other backward class) were significantly more likely than were the other groups to receive JSY payments (table 1). Buddhists were significantly more likely than were Hindus to receive JSY payments in high-focus and northeast states, whereas Muslims in high-focus and non-high-focus states had low odds of receiving JSY payments (table 1).

After we controlled for a range of individual-level and household-level characteristics, large state-level effects on the probability of receiving JSY payments remained (table 1). State-specific regressions showed variation in the association between receipt of JSY payments and the various characteristics of women, with states such as Tamil Nadu and Pondicherry seeming to be better than the other states at targeting women in the poorest decile of household wealth and those with no education (data not shown).

Figures 4 and 5 show that the large increases in the proportion of births occurring in a health facility were seen in the same states that had a large uptake of JSY (figure 1). Results from the exact-matching, with-versus-without, and district-level differences-in-differences analyses consistently showed the same association (table 2). Webappendix (pp 1—7) provides detailed results from these three analyses. Receipt of financial assistance from JSY was associated with a significantly increased probability of receiving antenatal care, giving birth in a health facility, and either giving birth in a facility or having a skilled attendant present at the time of delivery (table 2). For every ten women receiving JSY, an additional woman would receive three antenatal care visits, an additional four or five women would give birth in a facility, and an additional three or four women would give birth either in a facility or with a skilled attendant present outside of a facility (table 2). The results were consistent after we controlled for several socioeconomic and demographic characteristics, and analysed the data using three different techniques and several model specifications.

Figure 4 Full-size image (217K) Download to PowerPoint

Percentage of women reporting delivering in a health facility among all women who gave birth in past 12 months by district

Data were from the second round of the district-level household survey in 2002—04.

Figure 5 Full-size image (215K) Download to PowerPoint

Absolute change in percentage of births delivered in a health facility by district between 2002—04 and 2007—09

Data were from rounds two and three of the district-level household surveys.

Table 2Table image

Analysis of association between receipt of financial assistance from Janani Suraksha Yojana and intervention coverage and health outcomes by use of three analytical approaches at the national level

Generally, the effect of JSY payments on attended deliveries was lower than the effect on in-facility delivery (table 2); we also noted a significant negative association between JSY and skilled birth attendance outside of a health facility (data not shown).

Household wealth and increased maternal education were associated with high odds of receiving at least three antenatal care visits, giving birth in a facility, and having a skilled attendant present at the time of the delivery (webappendix pp 1—6). Young maternal age, high parity, scheduled caste or tribe or other disadvantaged classes, and rural location and distant health facility were all associated with reduced odds of women receiving antenatal care, and in-facility or skilled delivery care (webappendix pp 1—6). Muslims and Christians were less likely to receive care, and Sikhs more likely, than were Hindus (webappendix pp 1—6).

The state-specific regressions showed that the effect of JSY on in-facility delivery and skilled birth attendance varied greatly by state (data not shown). This variation was mostly accounted for by differences between high-focus and non-high-focus states. JSY payments were associated with the largest change in the probability of giving birth in a health facility or with a skilled attendant present in high-focus states, followed by northeast states, and non-high-focus states (table 3).

Table 3Table image

Analysis of association between receipt of financial assistance from Janani Suraksha Yojana and intervention coverage and health outcomes by use of two analytical approaches by high-focus, northeast, and non-high-focus states

After we controlled for socioeconomic and demographic characteristics of mothers, receipt of financial assistance from JSY was associated with a significant reduction in the probability of perinatal and neonatal deaths in both the exact-matching and with-versus-without analyses (table 2; webappendix pp 1—6). On the basis of the predicted probabilities at the national level, with everything else kept constant, JSY payment was associated with a reduction of about four perinatal deaths per 1000 pregnancies in the matching and with-versus-without analyses (table 2). Receipt of financial assistance from JSY was associated with a reduction of about two neonatal deaths per 1000 livebirths in both analyses (table 2).

The analysis of district-level differences in differences did not show a significant association between the proportion of women receiving JSY payments for births and numbers of perinatal or neonatal deaths at the district level (table 2). The coefficients for the effect of JSY on perinatal and neonatal mortality, however, were negative, and the confidence intervals suggested that the district-level analysis was only powered to detect a decrease in perinatal mortality of greater than 31 per 1000 pregnancies, and in neonatal mortality of greater than 20 per 1000 livebirths.

We did not note a significant effect of JSY on maternal mortality at the district level (table 2). The absence of an effect of JSY on the number of maternal deaths might have been attributable to a lack of a programme effect or an insufficient sample size to detect a change in maternal mortality during the period of observation. The confidence intervals around the estimated effect of JSY payments on maternal mortality implied that our analysis was only powered to detect very large changes.

The association between socioeconomic and demographic characteristics and perinatal and neonatal mortality was strong (webappendix pp 1—6). Poor households, low maternal education, increased maternal age, low parity, short birth intervals, and multiple births were significantly associated with increased odds of a birth resulting in a perinatal death in the exact-matching and with-versus-without analyses, but caste or tribe and religion were not significantly associated with the odds of perinatal death (webappendix pp 1—6). The webappendix (p 7) shows that socioeconomic and demographic characteristics in the analysis of district-level differences in differences were mostly not associated with increased perinatal or neonatal mortality.

The effect of financial assistance from JSY on perinatal (and neonatal) deaths was smaller in high-focus states—a reduction of roughly two or three perinatal deaths per 1000 pregnancies—than in non-high-focus states where the reduction was about five or six perinatal deaths per 1000 pregnancies (table 3). The state-specific effects of financial assistance from JSY on health outcomes could not be assessed because of the small sample sizes.

Discussion

Our preliminary evidence shows that the expansion of JSY has led to substantial increases in coverage of antenatal and intrapartum care, and has probably contributed to reductions in the numbers of perinatal and neonatal deaths. We were not able to detect an effect on the number of maternal deaths, but this analysis was only powered to detect a very large reduction in the maternal mortality ratio.

Variation in the extent of implementation was substantial in high-focus and non-high-focus states in India. Receipt of financial assistance from JSY was generally higher in the middle bands of wealth in high-focus states and in those with middle levels of education. Some high-focus states, such as Madhya Pradesh, Orissa, and Rajasthan, were able to achieve high levels of JSY uptake; however, other high-focus states, such as Uttar Pradesh and Jharkhand, were not able to achieve these levels in 2007—08. JSY programme data reported by the states, however, showed that the number of beneficiaries in most high-focus states has risen greatly since DLHS-3.

The results for JSY uptake indicate the central part that state authorities play in the implementation of national health programmes in India. In our analysis, we could not assess the potential contribution of state or district-level governance, or programme implementation and oversight to the overall effect of the programme because data for these indicators were not available. However, these are important to monitor and assess during the expansion of JSY. In previous studies, the state-by-state variation in eligibility guidelines, awareness of the programme, the amount disbursed, documentation requirements, and the payment process, including the role of delays in payments to mothers and ASHAs have been documented.5, 6 Additionally, the district nodal officer for JSY plays a major part in increasing awareness and uptake of this programme. Differential uptake by districts within the same state might also be due to variation in health infrastructure to support births in facilities, and the difficult terrain in some districts that impeded access to health facilities. For example, uptake of JSY was much lower in the western desert part of Rajasthan than in the eastern parts of the state.

The finding that the poorest and the least educated women do not consistently have the highest odds of being JSY recipients indicates that an improvement of the targeting of this programme is required. There are several possible explanations for why JSY uptake was not the highest in the poorest and least educated women. First, a common challenge seen in other large national social programmes that have expanded in a short period is to reach the most disadvantaged population.32, 33 Other approaches to raise awareness and encourage the poorest and least educated women to take advantage of the JSY benefits need to be investigated and implemented, such as communication strategies that are not dependent on literacy. Second, physical access might be a substantial barrier for women in the lowest socioeconomic status groups since JSY payments can only be made in accredited health facilities. Noteworthy is that Madhya Pradesh, which has made special efforts to accredit remote health facilities, also has one of the highest levels of participation in JSY. Third, cultural barriers against in-facility births are also prevalent among women of low socioeconomic status in India, and these barriers must be addressed. We noted lower uptake by Muslims and Christians than by women of other faiths that might suggest poor reach of ASHAs in these communities or poor access of these minorities to accredited health facilities. Finally, the previous national maternity benefit scheme included a payment of 500 rupees ($11) to poor women for deliveries at home. This type of payment continued under the JSY scheme as attempts to exclude this component were met with judicial opposition, but continuation of this payment might be a partial disincentive for giving birth in a health facility.

At the national-level, we noted a large effect of JSY on in-facility birth coverage. The estimated effect of JSY was consistently larger in high-focus than in non-high-focus states. The effect of JSY on skilled birth attendance was smaller than on in-facility births, suggesting that part of the increase in the number of births in facilities through JSY resulted from shifting births that would have otherwise occurred at home with a skilled attendant to a health facility. We also noted a smaller effect of JSY on coverage of antenatal care. Although according to central guidelines, women receiving JSY should also attend at least three antenatal care visits, which should be aided by ASHAs, antenatal care was not explicitly linked to financial assistance from JSY. The link could be created, as suggested previously,34 by division of the cash payment into three parts: the first part given after women attend three antenatal care visits; the second after delivery in a health-care facility; and the third after provision of post-partum care. Such a change in the scheme, however, would greatly increase the administrative burden of JSY.

Although our analysis showed that JSY has led to an increase in intervention coverage, the ultimate goal of the programme is to improve health outcomes. In the exact-matching and with-versus-without analyses we noted reductions in the numbers of perinatal and neonatal deaths associated with JSY. We did not, however, find a significant effect of JSY on the numbers of perinatal or neonatal deaths in the analysis of district-level differences in differences. The reason might be a statistical power issue; perinatal and neonatal deaths occurred at much smaller rates than did our other outcome variables, such as antenatal care and in-facility births. As a result, stochastic variation could be masking the associations between JSY payments and perinatal or neonatal mortality at the district level. Another explanation is that the district-level analysis could be better at controlling for selective individual uptake of JSY that is not accounted for by the socioeconomic and demographic factors controlled for in the individual-level analyses. However, the confidence intervals in the district-level analysis include the effect size implied by the individual-level analyses, the results of the three analytical methods for antenatal care and in-facility birth were consistent, and socioeconomic determinants were largely not significantly associated with perinatal or neonatal mortality in the district-level analysis. We therefore think that the reason a significant effect was not noted on perinatal and neonatal mortality with the district-level analysis is most likely due to inadequate statistical power rather than a lack of an effect.

Our results also suggested a smaller reduction in numbers of perinatal and neonatal mortalities associated with JSY in high-focus than in non-high-focus states. One explanation for this difference might be that in high-focus states all women were eligible for JSY, whereas in non-high-focus states only those living below the poverty line were eligible. As a result, women with low risks might have been included in the high-focus states and so the benefit of the programme, on average, might be smaller. Other explanations might be that the quality of obstetric care was lower in high-focus states or that health facilities were not able to cope with the increased workloads as a result of implementing JSY. Results of previous studies have suggested that JSY led to increased workloads and reduced quality of care in health facilities—eg, early discharge after delivery.7, 34

We were unable to detect a significant effect of JSY on the number of maternal deaths in the district-level analysis. Similar explanations to those proposed for perinatal and neonatal mortalities are plausible, especially since maternal death is much rarer than is perinatal death. Our study has very wide confidence intervals around the effect of JSY on maternal mortality. That such a large survey was underpowered to detect the effect of JSY on one of its main goals emphasises the urgent need for other ways to assess the effect of JSY on the number of maternal deaths—eg, by expanding and improving the data gathering for adult mortality in the DLHS questionnaire or by doing a matched case-control study of maternal deaths. Further investments in monitoring and evaluation—including both impact and process evaluation—are imperative to improve understanding of the association between JSY and health outcomes.

The cash incentive for women to deliver in health facilities in accordance with the nationwide JSY is complemented by another initiative in some parts of India that provides public funds to private service providers in rural areas for in-facility births. This initiative was first tested in the state of Gujarat, as the Chiranjeevi scheme, and the results were encouraging.35 This public—private partnership is now also being attempted in some other states of India to improve maternal and child health outcomes. Continued monitoring and evaluation of the quality of care provided in private facilities, compared with public facilities, will be crucial to ensure a positive effect on maternal and child health outcomes.

As with any non-experimental evaluation of the effect of a programme, this analysis is limited by unobserved confounding and selective uptake of the programme in the matching and with-versus-without analyses, and assumptions about a constant temporal trend for both treated and untreated observations in the differences-in-differences analysis. We have attempted to keep these difficulties to a minimum by using three different analytical approaches for estimating the effect of the JSY programme. For the measures of intervention coverage, we noted consistent effects with all three approaches; for perinatal and neonatal outcomes, we noted consistent effects with two methods.

Our analysis also has other limitations related to the mechanism of data gathering. First, because DLHS-3 covered the period soon after implementation of JSY, the effects that we noted might be different from the current ones. Second, the measure of uptake that we used is whether or not a woman reports receipt of financial assistance from JSY. The DLHS-3 did not gather information about whether a woman was aware of JSY before delivery or whether she had been encouraged to use JSY. Some women might have been incentivised to deliver in a health facility but did not receive the cash payment. An assessment of five high-focus states in India indicated that 7—33% of women who were encouraged to deliver in a facility as part of JSY reported not receiving any money after delivery. The implication of this knowledge for our findings is that we might be underestimating the effect of JSY, since some of the women who are giving birth in a health facility are incorrectly classified as not being exposed to the programme.

Third, the findings of our analysis are dependent on the quality of the DLHS data. We were not able to precisely assess the quality of DLHS since it is the only data source that is representative at the district level. DLHS and the national family health surveys are administered by the International Institute for Population Sciences. We compared estimates for the same year from DLHS-2 and the third national family health surveys for skilled birth attendance and in-facility birth, and noted that the results were highly concordant for the corresponding year at the state-level (concordance correlation coefficient 0·95 for skilled birth attendance and 0·96 for in-facility birth). Estimates of the number of perinatal and neonatal mortalities from the DLHS were about 13% lower than those from the national family health surveys.2 Estimates of the number of maternal deaths show wide variation across sources, and DLHS-3 showed a higher maternal mortality ratio than did other sources.1 Even if data quality varied across districts and between DLHS-2 and DLHS-3, it would not substantively affect our conclusions as long as these differences are not related to JSY uptake. Since we cannot confirm this assumption with the available data, these results must be interpreted with caution and they draw attention to the need for further investigation of discrepancies between the various estimates of perinatal, neonatal, and maternal deaths in India and enhanced effort towards improvement of the data quality.

Assessments of the effects of large-scale conditional cash transfer programmes are rarely possible, mainly because of a lack of data. The Indian Government's investment in DLHS, from which data are made available to researchers for analysis, has allowed an early assessment of the effect of JSY. This analysis has shown that regular and timely data gathering at the district level is essential for the monitoring and evaluation of national health policies. Such examples should encourage further development, investments, and improvements in India's health information system.36 In addition to relying on routine systems, focused and targeted data gathering is needed to assess large-scale programmes conclusively. Investments in monitoring and evaluation would represent only a small fraction of the total cost of the programme and can provide invaluable information about what is and is not working.

For JSY, the findings of this evaluation 2—3 years into the implementation of the programme are encouraging. JSY has greatly increased the proportion of pregnant women delivering in a health facility. Furthermore, the findings suggest that the programme is reducing perinatal and neonatal mortality; however, its effect on maternal mortality remains unknown. With the increased coverage of in-facility delivery and the increased workloads for health personnel, the national and state governments need to intensify efforts to maintain and improve the quality of obstetric care available to women in health facilities to achieve their ultimate goal of reducing the numbers of neonatal and maternal deaths. Continued independent monitoring and evaluation of progress towards these goals is crucial in the coming years as the financial and political commitment to JSY intensifies. Therefore, the Government of India needs to consider investing in the development of appropriate mechanisms of data gathering, as part of the health information system, that will enable conclusive assessment on a continued basis as to whether JSY is resulting in a reduction in the numbers of neonatal and maternal deaths—ie, the ultimate goals of the programme.

Contributors

SSL, LD, and EG conceptualised the study and wrote the report. SSL and EG guided the data analysis; LD contributed to the analysis; MCH produced estimates of maternal mortality by district; JAH and SLJ did all other data analyses. All authors have approved the final version of the report.

Conflicts of interest

We declare that we have no conflicts of interests.

Acknowledgments

This research was supported by funding from the Bill & Melinda Gates Foundation. We thank Heather Bonander and Kelsey Moore for research assistance; and JSY government officials, DLHS investigators, Christopher Murray, Gary King, and Casey Olives for helpful discussions.

WebExtra Content

Supplementary webappendix

PDF (1243K)

References

1 Hogan MC, Foreman KJ, Naghavi M, et al. Maternal mortality for 181 countries, 1980—2008: a systematic analysis of progress towards Millennium Development Goal 5. Lancet 2010; 375: 1609-1623. Summary | Full Text | PDF(1819KB) | CrossRef | PubMed

2 Rajaratnam JK, Marcus JR, Flaxman AD, et al. Neonatal, postneonatal, childhood, and under-5 mortality for 187 countries, 1970—2010: a systematic analysis of progress towards Millennium Development Goal 4. Lancet 201010.1016/S0140-6736(10)60703-9. published online May 24. PubMed

3 IIPS. National Health Family Survey: 2005—2006: India. Mumbai: International Institute for Population Sciences and Macro International. http://www.nfhsindia.org/NFHS-3%20Data/VOL-1/India_volume_I_corrected_17oct08.pdf. (accessed March 10, 2010).

4 Government of India, Ministry of Health and Family Welfare, Maternal Health Division, New Delhi. Janani Suraksha Yojana: features & frequently asked questions and answers. http://mohfw.nic.in/dofw%20website/JSY_features_FAQ_Nov_2006.htm. (accessed March 10, 2010).

5 Vora KS, Mavalankar DV, Ramani KV, et al. Maternal health situation in India: a case study. J Health Popul Nutr 2009; 27: 184-201. PubMed

6 UN Population Fund—India. Concurrent assessment of Janani Suraksha Yojana (JSY) in selected states: Bihar, Madhya Pradesh, Orissa, Rajasthan, Uttar Pradesh. New Delhi: United Nations Population Fund—India, 2009.

7 Devadasan N, Elias MA, John D, Grahacharya S, Ralte L. A conditional cash assistance programme for promoting institutional deliveries among the poor in India: process evaluation results. In: Richard F, Witter S, De Brouwere V, eds. Reducing financial barriers to obstetric care in low-income countries. Antwerp, Belgium: ITG Press, 2008: 257-273.

8 Attanasio O, Fitzsimons E, Gomez A, Lopez D, Meghir C, Mesnard A. The short-term impact of a conditional cash subsidy on child health and nutrition in Colombia. London: Institute of Fiscal Studies, 2005. http://www.ifs.org.uk/wps/wp0613.pdf. (accessed March 10, 2010).

9 Morris SS, Olinto P, Flores R, Nilson EA, Figueiro AC. Conditional cash transfers are associated with a small reduction in the rate of weight gain of preschool children in northeast Brazil. J Nutr 2004; 134: 2336-2341. PubMed

10 Powell-Jackson T, Morrison J, Tiwari S, Neupane B, Costello A. The experiences of districts in implementing a national incentive programme to promote safe delivery in Nepal. BMC Health Services Research 2009; 9: 97. CrossRef | PubMed

11 Government of the People's Republic of Bangladesh. Demand side financing pilot maternal health voucher scheme proposal. Dhaka: Ministry of Health and Family Welfare, Government of the People's Republic of Bangladesh, 2007.

12 Government of Nepal. Operational guidelines on incentives for safe delivery services. Kathmandu: Government of Nepal, Ministry of Health and Population, 2005.

13 Fernald LCH, Gertler PJ, Neufeld LM. Role of cash in conditional cash transfer programmes for child health, growth, and development: an analysis of Mexico's Oportunidades. Lancet 2008; 371: 828-837. Summary | Full Text | PDF(168KB) | CrossRef | PubMed

14 Barber SL, Gertler PJ. Empowering women to obtain high quality care: evidence from an evaluation of Mexico's conditional cash transfer programme. Health Policy Plan 2009; 24: 18-25. CrossRef | PubMed

15 Barber SL. Mexico's conditional cash transfer programme increases cesarean section rates among the rural poor. Eur J Public Health 200910.1093/eurpub/ckp184. published online Nov 23. PubMed

16 Fernald LCH, Gertler PJ, Neufeld LM. 10-year effect of Oportunidades, Mexico's conditional cash transfer programme, on child growth, cognition, language, and behaviour: a longitudinal follow-up study. Lancet 2009; 374: 1997-2005. Summary | Full Text | PDF(238KB) | CrossRef | PubMed

17 Maluccio J, Flores R. Impact evaluation of a conditional cash transfer program: the Nicaraguan Red de Proteccion Social. Washington, DC: International Food Policy Research Institute, 2005.

18 Thornton RL. The Demand for, and Impact of, Learning HIV Status. American Economic Review 2008; 98: 1829-1863. CrossRef | PubMed

19 Lagarde M, Haines A, Palmer N. Conditional cash transfers for improving uptake of health interventions in low- and middle-income countries: a systematic review. JAMA 2007; 298: 1900-1910. CrossRef | PubMed

20 Rawlings LB, Rubio GM. Evaluating the impact of conditional cash transfer programs. World Bank Res Obs 2005; 20: 29-55. PubMed

21 Sharma MP, Soni SC, Bhattacharya M, Datta U, Gupta S, Nandan D. An assessment of institutional deliveries under JSY at different levels of health care in Jaipur District, Rajasthan. Indian J Public Health 2009; 53: 177-182. PubMed

22 Gakidou E, Oza S, Vidal FC, et al. Improving child survival through environmental and nutritional interventions: the importance of targeting interventions toward the poor. JAMA 2007; 298: 1876-1887. CrossRef | PubMed

23 Ferguson B, Tandon A, Gakidou E, Murray CJL. Estimating permanent income using indicator variables. In: Murray CJL, Evans DB, eds. Health systems performance assessment: debates, methods and empiricism. Geneva: World Health Organization, 2003.

24 Vapattanawong P, Hogan MC, Hanvoravongchai P, et al. Reductions in child mortality levels and inequalities in Thailand: analysis of two censuses. Lancet 2007; 369: 850-855. Summary | Full Text | PDF(144KB) | CrossRef | PubMed

25 WHO, Department of Reproductive Health and Research. Proportion of births attended by a skilled health worker 2008 updates. Geneva: World Health Organization, 2008. http://www.searo.who.int/LinkFiles/Publications_skilled_attendant_at_birth_2008.pdf. (accessed March 10, 2010).

26 King G, Gakidou E, Imai K, et al. Public policy for the poor? A randomised assessment of the Mexican universal health insurance programme. Lancet 2009; 373: 1447-1454. Summary | Full Text | PDF(445KB) | CrossRef | PubMed

27 Ho DE, Imai K, King G, Stuart EA. Matching as nonparametric preprocessing for reducing model dependence in parametric causal inference. Polit Anal 2007; 15: 199-236. PubMed

28 Bleich SN, Cutler DM, Adams AS, Lozano R, Murray CJ. Impact of insurance and supply of health professionals on coverage of treatment for hypertension in Mexico: population based study. BMJ 2007; 335: 875. PubMed

29 Sosa-Rubi SG, Galarraga O, Lopez-Ridaura R. Diabetes treatment and control: the effect of public health insurance for the poor in Mexico. Bull World Health Organ 2009; 87: 512-519. CrossRef | PubMed

30 Ashenfelter O, Card D. Using the longitudinal structure of earnings to estimate the effect of training programs. Rev Econ Stat 1985; 67: 648-660. CrossRef | PubMed

31 Shadish WR, Cook TD, Campbell DT. Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton Mifflin, 2002.

32 Gakidou E, Lozano R, Gonzalez-Pier E, et al. Assessing the effect of the 2001—06 Mexican health reform: an interim report card. Lancet 2006; 368: 1920-1935. Summary | Full Text | PDF(418KB) | CrossRef | PubMed

33 Victora CG, Vaughan JP, Barros FC, et al. Explaining trends in inequities: evidence from Brazilian child health studies. Lancet 2000; 356: 1093-1098. Summary | Full Text | PDF(96KB) | CrossRef | PubMed

34 Lahariya C. Cash incentives for institutional delivery: linking with antenatal and post natal care may ensure ‘continuum of care’ in India. Indian J Community Med 2009; 34: 15-18. PubMed

35 Mavalankar D, Singh A, Patel SR, Desai A, Singh PV. Saving mothers and newborns through an innovative partnership with private sector obstetricians: Chiranjeevi scheme of Gujarat, India. Int J Gynaecol Obstet 2009; 107: 271-276. CrossRef | PubMed

36 Raban MZ, Dandona R, Dandona L. Essential health information available for India in the public domain on the internet. BMC Public Health 2009; 9: 208. CrossRef | PubMed

a Institute for Health Metrics and Evaluation, University of Washington, Seattle, WA, USA

b Public Health Foundation of India, New Delhi, India

Correspondence to: Dr Emmanuela Gakidou, Institute for Health Metrics and Evaluation, University of Washington, 2301 5th Avenue, Suite 600, Seattle, WA 98121, USA

Article Options

Summary

Full Text

PDF (3,135 KB)

Cited by in Scopus (2)

Printer Friendly Version

Download images

Request permission

Export Citation

Create Citation Alert

Receive an email when the article is cited

  • ·

Manage all your email alerts

Linked Articles

Comment India: conditional cash transfers for in-facility deliveries Vinod K Paul. The Lancet 5 June 2010; Volume 375, Issue 9730: Page 1943

Other Articles of Interest

Articles Causes of deaths in children younger than 5 years in China in 2008 Igor Rudan,Kit Yee Chan,Jian SF Zhang,Evropi Theodoratou,Xing Lin Feng,Joshua A Salomon,Joy E Lawn,Simon Cousens,Robert E Black,Yan Guo,Harry Campbell,on behalf of WHO/UNICEF's Child Health Epidemiology Reference Group (CHERG). The Lancet 27 March 2010; Volume 375, Issue 9720: Page 1083

Articles Effect of scaling up women's groups on birth outcomes in three rural districts in Bangladesh: a cluster-randomised controlled trial Kishwar Azad,Sarah Barnett,Biplob Banerjee,Sanjit Shaha,Kasmin Khan,Arati Roselyn Rego,Shampa Barua,Dorothy Flatman,Christina Pagel,Audrey Prost,Matthew Ellis,Anthony Costello. The Lancet 3 April 2010; Volume 375, Issue 9721: Page 1193

Articles Maternal mortality for 181 countries, 1980–2008: a systematic analysis of progress towards Millennium Development Goal 5 Margaret C Hogan,Kyle J Foreman,Mohsen Naghavi,Stephanie Y Ahn,Mengru Wang,Susanna M Makela,Alan D Lopez,Rafael Lozano,Christopher JL Murray. The Lancet 8 May 2010; Volume 375, Issue 9726: Page 1609

Articles Effect of the Integrated Management of Childhood Illness strategy on childhood mortality and nutrition in a rural area in Bangladesh: a cluster randomised trial Shams E Arifeen,DM Emdadul Hoque,Tasnima Akter,Muntasirur Rahman,Mohammad Enamul Hoque,Khadija Begum,Enayet K Chowdhury,Rasheda Khan,Lauren S Blum,Shakil Ahmed,M Altaf Hossain,Ashraf Siddik,Nazma Begum,Qazi Sadeq-ur Rahman,Twaha M Haque,Sk Masum Billah,Mainul Islam,Reza Ali Rumi,Erin Law,ZA Motin Al-Helal,Abdullah H Baqui,Joanna Schellenberg,Taghreed Adam,Lawrence H Moulton,Jean-Pierre Habicht,Robert W Scherpbier,Cesar G Victora,Jennifer Bryce,Robert E Black. The Lancet 1 August 2009; Volume 374, Issue 9687: Page 393

Articles 20-year survival of children born with congenital anomalies: a population-based study Peter WG Tennant,Mark S Pearce,Mary Bythell,Judith Rankin. The Lancet 20 February 2010; Volume 375, Issue 9715: Page 649

40762762