Effect of Social Accountability on Improving Service Delivery and Outcomes in the Public Sector in Uttar Pradesh, India

Health Behavior Clinical Trial

Official title:

Effect of Social Accountability on Improving Service Delivery and Outcomes in the Public Sector: a Cluster-Randomized Control Trial in Uttar Pradesh, India

Clinical Trial Details — Status: Completed

Administrative data

• NCT number: NCT02879708
• Other study ID #: D0168
• Secondary ID: IE-P150365
• Status: Completed
• Phase: N/A
• Start date: April 2015
• Est. completion date: February 2021

Study information

• Verified date: April 2023
• Source: Duke University
• Contact: n/a
• Is FDA regulated: No
• Study type: Interventional

Clinical Trial Summary

In several low and middle-income countries, Social Accountability (SA) interventions have been introduced as an innovative approach to governance, aiming to improve delivery of public services. These interventions typically include information provision to citizens regarding their rights/entitlements and local provider performance, and additionally, facilitation of community engagement with providers and officials.

The state government of Uttar Pradesh (UP) and the Uttar Pradesh Health Systems Strengthening Project (UPHSSP) have identified 12 districts where the social accountability initiative will be introduced on a priority basis. This study focuses on interventions in 2 of these districts (Sultanpur and Fatehpur), to study mechanisms through which information and collective action lead to improved accountability and outcomes. Within the 2 districts, the study is implemented as a cluster randomized evaluation with 120 villages randomized into 2 treatment arms and one control arm.

This study aims to: (a) measure the causal effect of SA interventions on key outcomes (health status, quality of service); (b) test the effectiveness of social networks based strategies to disseminate information for community engagement; and (c) study individuals' decisions to participate in collective action efforts in the context of social networks and information interventions. In addition to evaluating the impact of the SA interventions, the study aims to generate new knowledge on relative strengths of information seeding strategies, identifying those that maximize the spread of information through the village network, and subsequently estimate peer effects on participation decisions.

Description:

The World Bank-supported Uttar Pradesh Health System Strengthening Project (UPHSSP) includes a component that calls for the implementation of social accountability (SA) interventions in UP, which aim to stimulate community action to demand better services, enhance positive health behavior and promote social audits of service delivery and resource allocation. Two key channels through which SA interventions operate are through (a) information provision and (b) fostering community engagement that enables grievance redressal. Prior to the implementation of SA interventions at scale in UP, this study aims to conduct rigorous impact evaluation of key components of SA interventions in order to learn about potential impact in the UP context and to learn about critical implementation issues regarding optimal methods to deliver information in the state with available technology and social networks.

The evaluation's overarching research questions are whether SA interventions in UP improve (1) objective measures of health service quality in practice, (2) village-level satisfaction with health services, and (3) village-level health outcomes. Importantly, the evaluation will seek to identify whether the information provision that is a standard part of social accountability interventions has an independent effect on outcomes that is comparable to the effect of the combined information and community engagement components. The investigators also test the effectiveness of alternative models of delivering information in order to inform implementation of accountability interventions at large scale in public policy settings. Given that the community health workers targeted by the intervention focus on maternal and child health, our measures of health system performance along these three dimensions will also emphasize maternal and child health. Measures of health service quality include availability of services such as immunization and primary care services, distribution of food and nutritional supplementation as recommended in the national nutrition program, and provider absenteeism. Measures of satisfaction with local health services will include process measures including availability of service, waiting time for services and whether or not community members perceive that they are treated by providers with respect as well as general subjective assessments of satisfaction with services. Health outcome measures will include child anthropometrics (weight-for-age and weight-for-height), self-reported morbidity in the preceding two weeks (diarrhea, cough, fever, headache, days of usual activities lost due to illness), and neonatal (0-28 days), infant (under age one), and child (under age five) mortality as well as maternal health indicators such as percentage of facility deliveries among mothers who gave birth in the past year.

Within the 2 study districts (Sultanpur and Fatehpur), in 120 villages that were selected at random, the SA interventions aim to distinguish the effect of provision of information and facilitated engagement of community members, from that of the effect of information alone. The 120 villages are randomized to either a control arm, or one of two treatment arms described below.

TREATMENT ARM 1 - Information & Awareness:

Community members will receive information about their rights, roles and responsibilities of healthcare providers, and also about health-related activities and programs taking place in their village. Importantly, besides assessing the effect of providing information on health service delivery and various health outcomes, our evaluation will also determine how best to provide the information.

Another innovation in this project is to disseminate monthly information about health system related issues using interactive voice response messages (IVRs), phone calls, or home visits to households in the treatment villages. IVRs include a brief message about a health (or health system) indicator, or information regarding upcoming Village Health, Sanitation and Nutrition Committee (VHSNC) meetings or VHNDs, as well as a response option that can be used to collect data on what information households have received and about their participation in VHSNC meetings/VHNDs. These IVRs will be sent out over multiple months to cover approximately 24,000 households in 80 treatment villages each time. During preparatory phase that was conducted in parallel with the baseline survey, detailed data on social networks was collected in each village and identified central individuals in the village.

The investigators will use the data on networks in villages, combined with the information that is disseminated on a monthly basis to econometrically estimate how information dissemination within networks affects awareness and participation in social accountability activities as well as in utilization of health services.

TREATMENT ARM 2 - Information PLUS Community Engagement:

In addition to all the information interventions listed in treatment arm 1, community engagement will be facilitated in Arm 2 villages. The community engagement component aims to enhance the participation of the community in creating social accountability. The intervention will provide trained facilitators to help community members engage in a participatory process with Village Health, Sanitation, and Nutrition Committees (VHSNCs) and identify key deficiencies for improvement in health services that most concern community members. The facilitators are trained to help organize meetings and are provided a detailed checklist of activities that need to be undertaken prior to the day of the meetings such as inviting the block level officers and ensuring that logistics requirements for Village Health and Nutrition Days (VHNDs) are conveyed to VHSNC members in advance of the meetings. The facilitated meetings with healthcare providers and local and block level representatives aim to empower community members to demand better health services and convey these demands more effectively to providers and officials. The three key health workers at the village level (ASHA, ANM, and AWW) report to the local (village level) elected representatives and block level authorities, who receive feedback from the community in the accountability interventions. Moreover, through repeated community meetings village-level health workers are expected to respond to transparency and accountability innovations by improving quality of services delivered to their local constituents resulting in improvements in population health outcomes.

These interventions will focus on services delivered by village-level health workers including those providing primary care and maternal and child health services. The households surveyed in the project will be those with children less than 5 years of age. The interventions will cover and include all population subgroups, castes, and religious minorities in the treatment villages, and also collect data on all of these subgroups.

Recruitment information / eligibility

• Status: Completed
• Enrollment: 105000
• Est. completion date: February 2021
• Est. primary completion date: July 2018
• Accepts healthy volunteers: Accepts Healthy Volunteers
• Gender: All
• Age group: N/A and older

Eligibility

Inclusion Criteria:

• households residing in the villages selected for the evaluation

Exclusion Criteria:

• none

Related Conditions & MeSH terms

• Health Behavior

Intervention

Other:
• Information Only
Households will receive information regarding their rights and entitlements pertaining to healthcare, certain health outcomes specific to their village, as well as health-related activities happening in their village (such as the VHSNC meetings and Village Health and Nutrition Days). Information will be disseminated through an initial visit to all households, and from then on either through (1) broadcast messages sent to households via mobile phone, (2) central individuals in the village social network who will be asked to spread that information, or (3) public officials charged with spreading the information throughout the village.
• Information and Facilitation
In addition to the information interventions described above, this intervention will provide trained facilitators to help community members engage in a participatory process with VHSNCs and identify key deficiencies for improvement in health services that most concern community members. The facilitators are trained to help organize meetings and are provided a detailed checklist of activities to be undertaken prior to the the meetings. The three key health workers at the village level (ASHA, ANM, and AWW) report to the local (village level) elected representatives and block level authorities, who receive feedback from the community in the accountability interventions.

Locations

Country	Name	City	State
India	Uttar Pradesh State Institute of Rural Development	Lucknow	Uttar Pradesh

Sponsors (4)

Lead Sponsor	Collaborator
Duke University	Stanford University, University of North Carolina, Chapel Hill, World Bank

Country where clinical trial is conducted

India, 

References & Publications (1)

Ringold, D., Holla, A., Koziol, M., & Srinivasan, S. (2012).

Outcome

Type	Measure	Description	Time frame	Safety issue
Other	Info spread	proportion of the village that received/retained information spread through the different info dissemination strategies	4 months, measured each month
Primary	Weight-for-height Z scores		12 months after intervention implementation
Secondary	Satisfaction with providers - averaged from a rating index and/or constructed by a PCA on the rating index	Level of satisfaction with local healthcare providers, as estimated by (1) averaging rating scores across a satisfaction index (questions asking the respondent to rate aspects of their last experience with the provider on a scale of 1-5); and/or (2) running a principal components analysis on the same index and taking the first component.	12 months after intervention implementation
Secondary	Participation - as measured from self-report	household participation in VHSNC meetings and attendance at VHNDs, measured by self-report	4 months, measured each month, and at 1 year during endline survey
Secondary	U5 mortality rate	under 5 mortality rates	12 months after intervention implementation
Secondary	incidence of diarrhea		12 months after intervention implementation
Secondary	duration of diarrhea illness		12 months after intervention implementation