Summary of the sample design for PMA2018/Rajasthan-R4:
In India, the PMA2020 survey collects data at the state level to allow for the estimation of key indicators to monitor progress in family planning - both at the population and the service delivery points (SDPs) levels. The survey was conducted in Rajasthan state in 2018.
PMA2018/Rajasthan Round 4 used a two-stage cluster design within the state and urban/rural strata. Primary sampling units were selected using probability proportional to size procedures within the state. The sample was powered to generate state-level estimates of all women mCPR¬ with less than a 2% margin of error and a less than 3% margin of error for urban/rural estimates. To read more details on our survey methodology including the survey tools, training, data processing and response rates, please scroll to the end of the table below.
The SOI table provides a summary of key family planning indicators and their breakdown by respondent background characteristics. Estimates for all indicators are representative for the state.
Round 1 Sample Design
In India, the PMA2020 survey collects data at the state-level to allow for the estimation of key indicators to monitor progress in family planning - both at the population and the service delivery points (SDPs) levels. The resident enumerator (RE) model enables replication of the surveys twice a year for the first two years, and annually each year after that, to track progress.
For this first round of PMA2020 data collection in Rajasthan, India (PMA2016/Rajasthan), the project used a two-stage cluster design within the state and urban/rural strata and drew a sample of 147 enumeration areas (EAs) by the International Institute for Population Sciences from a master sampling frame to achieve a representative sample of Rajasthan state. The master frame of EAs was based on a master sampling frame from the International Institute for Population Sciences.
In each selected EA cluster, households and private health facilities were listed and mapped. Field supervisors randomly selected 35 households from the household listing using a random number generation phone application. A household roster was completed and all eligible women age 15-49 in selected households were approached and asked to provide informed consent to participate in the study. For the SDP survey, up to three private SDPs, including pharmacies, within each sampled EA cluster boundary were randomly selected from the listing. In addition, three public health SDPs—a health post, a health center, and a district hospital designated to serve the EA population—were selected.
Round 4 Sample Design
The PMA2018/Rajasthan Round 4 survey used the same 147 EAs selected in Round 1 with a new random selection of households. In each EA, all households were listed and mapped, with 35 households randomly selected. Households were surveyed and occupants enumerated. All eligible females age 15 to 49 were contacted and consented for interviews. In each EA and contiguous EA, all private facilities were listed, with a maximum of 3 private facilities selected within each EA.
The final completed sample included 4,933 households (98.3% response rate), 5,832 females (98.4% response rate) and 608 health service delivery points (97.6% response rate). Private service delivery points (SDPs) in contiguous geographic areas to the EA were included in Rounds 2 to 4 to increase the sample size of private SDPs.
Weights were generated to account for oversampling. All estimates are weighted. Data from facility types with sample size less than 10 were calculated but are not presented in this brief. Data collection was conducted between April and May 2018.
PMA2020 uses standardized questionnaires for households, females and SDPs to gather data about households and individual females that are comparable across program countries and consistent with existing national surveys. Prior to launching the survey in each country, local experts review and modify these questionnaires to ensure all questions are appropriate to each setting. All female questionnaires were translated into Hindi, and translations were reviewed for appropriateness. Three questionnaires were used to collect data from the PMA2018/Rajasthan-R4 survey: the household questionnaire, the female questionnaire and the service delivery point (SDP) questionnaire. These questionnaires were based on model questionnaires designed by PMA2020 staff at the Bill & Melinda Gates Institute for Population and Reproductive Health at the Johns Hopkins Bloomberg School of Public Health in Baltimore, Maryland, USA, the Indian Institute of Health Management Research (IIHMR) University in Jaipur, and fieldwork materials of the India National Family Health Survey.
All PMA2020 questionnaires are administered using Open Data Kit (ODK) software and Android smartphones. The questionnaires were in English and Hindi on the phone. The questionnaires were translated using available translations from similar population surveys and experts in translation. The interviews were conducted in the local language, or English in a few cases when the respondent was not comfortable with the local language. Female resident enumerators in each enumeration area (EA) administered the household and female questionnaires in the selected households.
The household questionnaire gathers basic information about the household, such as ownership of livestock and durable goods, as well as characteristics of the dwelling unit, including wall, floor and roof materials, water sources, and sanitation facilities. This information is used to construct a wealth index.
The first section of the household questionnaire, the household roster, lists basic demographic information about all usual members of the household and visitors who stayed with the household the night before the interview. This roster is used to identify eligible respondents for the female questionnaire. In addition to the roster, the household questionnaire also gathers data that are used to measure key water, sanitation, and hygiene (WASH) indicators, including regular sources and uses of water, sanitation facilities used and prevalence of open defecation by household members.
The female questionnaire is used to collect information from all women age 15 to 49 who were listed on the household roster at selected households. The female questionnaire gathers specific information including education; fertility and fertility preferences; family planning access, choice and use; quality of family planning services; exposure to family planning messaging in the media; and the burden of collecting water on women.
The SDP questionnaire collected information about the provision and quality of reproductive health services and products, integration of health services, and water and sanitation within the health facility.
The PMA2018/Rajasthan fieldwork training started with a centralized training of field supervisors and central staff in January 2018 immediately followed by resident enumerator (RE) training. The trainings were led by PMA2020 staff from the Indian Institute of Health Management Research (IIHMR) University in Jaipur, with support from the Bill & Melinda Gates Institute for Population and Reproductive Health of the Johns Hopkins Bloomberg School of Public Health and endorsement and technical support provided by the International Institute for Population Sciences (IIPS) and the Ministry of Health and Family Welfare (MOHFW). Field supervisors, supported by the central team and PMA2020 team, then became the trainers for the subsequent resident enumerator (RE) training sessions that took place before the start of data collection.
Throughout the training, resident enumerators (REs) and supervisors were evaluated based on their performance on phone-based assessments. The RE training was conducted primarily in Hindi, whereas some small group review sessions were conducted in other local languages.
Supervisors received additional training prior to and after the RE training to further strengthen their supervision skills, including instruction on conducting re-interviews, carrying out random spot checks, and dealing with the local/community leaders and engaging the communities.
Data Collection & Processing
Data collection was conducted between April and May 2018. Unlike traditional paper-and-pencil surveys, PMA2020 uses ODK Collect, an open-source software application, to collect data on mobile phones. All the questionnaires were programmed using this software and installed onto all project smartphones. The ODK questionnaire forms are programmed with automatic skip-patterns and built-in response constraints to reduce data entry errors.
The ODK application enabled REs and supervisors to collect and transfer survey data to a central ODK Aggregate cloud server. This instantaneous aggregation of data also allowed for concurrent data processing and course corrections while PMA2020 was still active in the field. Throughout data collection, central staff at IIHMR in Jaipur, Rajasthan and the data manager at the Gates Institute at Johns Hopkins in Baltimore routinely monitored the incoming data and notified field staff of any potential errors, missing data or problems found with form submissions on the central server. The use of mobile phones combined data collection and data entry into one step; therefore, data entry was completed when the last interview form was uploaded at the end of data collection.
Once all data were on the server, data analysts cleaned and de-identified the data, applied survey weights, and prepared the final dataset for analysis using Stata. The findings were shared at the state and national levels with government and community stakeholders.
This table shows response rates for household and female respondents by residence (rural/urban) for PMA2018/Rajasthan-R4. A total of 5,108 households were selected for the Round 4 survey; 5,020 households were found to be occupied at the time of the fieldwork. Of the occupied households, 4,933 (98.3%) consented to a household-level interview. The response rate at the household level was higher in rural (98.6%) than in urban (97.2%) areas.
In the occupied households that provided an interview, a total of 5,924 eligible women age 15 to 49 years were identified. Overall, 98.5% of the eligible women were available and consented to the interview. The female response rate was slightly higher in the urban (98.9%) relative to the rural (98.3%) enumeration areas (EAs). Only de facto females are included in the analyses; the final completed de facto female sample size was 5,832.
During the survey, 623 SDPs were identified of which 608 SDPs completed the survey (97.6% response rate).
Indian Institute of Health Management Research (IIHMR) University in Jaipur and The Bill & Melinda Gates Institute for Population and Reproductive Health at The Johns Hopkins Bloomberg School of Public Health. Performance Monitoring and Accountability 2020 (PMA2020) Survey Round 4, PMA2018/India-R4 (Rajasthan) Snapshot of Indicators. 2018. India and Baltimore, Maryland, USA.