Volume 28, Issue 5
September/October 1996

A Medical Record Linkage Analysis of Abortion Underreporting
J. Richard Udry Monica Gaughan Pamela J. Schwingl Bea J. van den Berg

First published online:

Inaccuracy in women's reports of their abortion histories affects many areas of interest to reproductive health professionals and researchers. The identification of characteristics that affect the accuracy of reporting is essential for the improvement of data collection methods. A comparison of the medical records of 104 American women aged 27-30 in 1990-1991 with their self-reported abortion histories revealed that 19% of these women failed to report one or more abortions. Results of logistic regression analysis indicate that nonwhite women were 3.3 times as likely as whites to underreport. With each additional year that had elapsed since the first recorded abortion, women became somewhat more likely to underreport (odds ratio of 1.3), while each additional year of a woman's education slightly decreased the likelihood of underreporting (odds ratio of 0.7).

(Family Planning Perspectives, 28:228-231, 1996)

Underreporting of abortions is a persistent problem in studies conducted in the United States and elsewhere, irrespective of the research design or study population. Abortions are underreported at different rates both between and within populations, which suggests that underreporting is not simply a function of individual-level behavioral characteristics. Demographic variation suggests that social forces affect underreporting. Furthermore, how questions about abortion are asked appears to be as important as women's behavioral, demographic and social characteristics.

Inaccuracy in self-reported abortion histories affects many areas of interest to demographers and epidemiologists. Estimates of abortion, contraceptive failure,1 miscarriage2 and reproductive histories that rely on self-reports are all subject to bias by abortion underreporting, and the extent of bias in each case is unknown. The determination of the predictors of underreporting is therefore critical to building a body of knowledge that may lead to the development of better data collection methods and more meaningful statistical weights.

Reliability studies have focused chiefly on how different data collection methods affect abortion reporting. Recently, such studies have begun to explore other determinants of underreporting, including social and behavioral variables. Two major approaches have been taken: Many U.S. studies impute underreporting by comparing nationally representative survey self-reports of abortion with expected abortion incidence determined from provider data. Studies mainly in other countries have linked women's responses to interviewer-administered questionnaires with abortions documented in medical records.

The primary limitation of many U.S. studies is that they use data on average characteristics of abortion patients, rather than directly matching records, and they rely on complicated algorithms and corrections that introduce opportunities for measurement error. Their strength, however, is their applicability to the American context. By contrast, the studies in other countries that link women and their abortions provide a direct estimate of underreporting, but their results may be limited in their generalizability to U.S. women.

In this research note, we describe a study undertaken to identify the characteristics that make a woman likely to underreport her abortion history. This study linked U.S. women's self-reports of abortion with medical records and thus overcame the limitations of studies based on national samples. Its design is similar to those of studies conducted in other countries, but it incorporates variables meaningful in an American context.

Earlier Research

Extent of Underreporting

Estimates of abortion underreporting from various nationally representative samples of women tend to be similar. Within studies, however, estimates vary depending on women's characteristics and the survey instrument used. For example, the interviewer-administered National Survey of Family Growth (NSFG) had overall abortion reporting ranges of 35-50% of what is believed to be the actual level of abortion on the 1976, 1982 and 1988 rounds.3 The 1976 and 1979 National Surveys of Young Women and the 1979-1984 waves of the National Longitudinal Survey of Work Experience of Youth (NLSY) had reporting ranges of 38-59%.4

Abortion reporting in these surveys was significantly improved by the use of self-administered questionnaire supplements. For example, overall reporting rates were 65-71% in the self-administered questionnaire that supplemented the 1988 SFG.5 A study comparing responses to interviewers in the 1983 NLSY with self-administered questionnaire responses in 1984 revealed that twice as many women acknowledged having had an abortion when using the self-administered format.6

Studies from Estonia, Korea and Hawaii linking women's self-reports with their medical records suggest that significant cultural, historical and political differences influence the rate and dynamics of underreporting. In the Estonian study, medical records of abortions occurring in 1991 were matched with 1992 interview responses. The women accurately reported 88% of their lifetime abortions, although exact matches within the year were somewhat less likely.7 The Korean study matched abortions reported in 1974 with records dated between 1970 and 1973; only 33% of abortions were reported.8 In the Hawaiian study, 80% of women presenting for a second abortion reported the previous abortion.9 Thus, underreporting appears to be ubiquitous even in cultures with lower levels of stigma attached to abortion, such as Estonia.10

Fertility-Related Factors

In the United States, underreporting rates vary by the contraceptive method used; the lowest rate is among diaphragm users, while the highest is among condom users.11 Furthermore, the number of abortions a woman has had is positively related to abortion underreporting; as the number increases, the opportunity for misreporting also increases.12 By contrast, in Cycle 5 of the NSFG, there was no difference by the number of abortions reported once a woman had reported one.13

In Estonia, women who have an abortion to end a pregnancy that resulted from a contraceptive failure and women who have three or more children are the most likely to underreport. Recall bias is probably not a factor for Estonian women because of the salience of the event: Women having an abortion are hospitalized for three days.14 The explanation that underreporting is related to stigma is compelling because these women obviously place a value on children and motherhood, and they may feel that having an abortion contradicts that status.

Demographic Factors

The most consistently significant indicator of the likelihood of underreporting among U.S. women is being nonwhite.15 According to one estimate, survey data reflect only 20-30% of abortions among black women, but are more accurate for whites.16 In the 1982-1984 NLSY, 45% of abortions among whites were reported, compared with 27% among blacks and 19% among Hispanics.17 The reporting rate in the 1988 NSFG interviews was 46% among white women and 26% among nonwhites; with use of a self-administered questionnaire, the rate increased to 74% and 67%, respectively.18 Indeed, abortion underreporting among minorities is probably part of a larger phenomenon: Members of minority groups overreport voting and underreport substance use, criminal offenses, family background and school performance.19

Marital status also predicts underreporting in the United States. In the 1982 NSFG, 53% of abortions among married women were reported, compared with 46% of those among unmarried women. (This difference was not maintained in the 1988 NSFG.) In the 1982-1984 NLSY, the proportions were 74% and 30%, respectively.20

Similarly, in Estonia, ethnic Estonians have a lower reporting rate than Russians. Married women have a higher reporting rate than unmarried women, but the difference is not statistically significant. Additionally, being older than 40 is a significant predictor of underreporting, and higher education is associated with higher reporting rates.21 (American findings on age effects are inconclusive;22 educational attainment data are not collected by U.S. abortion surveillance systems.)

Survey Implementation Factors

A woman's abortion history is among the most sensitive subjects about which she may be asked; research shows that how a woman is asked strongly determines her likelihood of responding accurately. In the NSFG and NLSY, women who had already underreported to an interviewer improved their reporting on self-administered questionnaires.23 In pretests of the 1995 NSFG, the use of computer-assisted personal interviewing, audio computer-assisted self-interviewing and neutral interview locations improved abortion reporting rates.24 Randomized response technique results in higher reporting rates than either self-administered or interviewer-administered questionnaires.25 Whites, blacks and Hispanics are likely to underreport to an interviewer of another race.26 Finally, the monthly collection of reproductive event information from respondents yields more accurate data than retrospective reporting about periods of longer duration.27

Recall bias is a general problem in retrospective questionnaires and a problem particular to abortion reporting. In the United States, where abortion is much less salient than in systems requiring hospitalization, recall bias may be particularly strong, especially among women who have had several abortions.

Data and Methods

The Sample

Our analysis is based on data for participants in the Child Health and Development Studies (CHDS), prospective studies of child and adolescent health. The studies are a joint venture of the University of California at Berkeley, the Kaiser Foundation Research Institute and the Permanente Medical Group. The original CHDS sample consisted of women who were members of the Kaiser Health Plan; the study gathered baseline data on children born to these women between 1959 and 1969, and conducted periodic follow-ups.28

In 1990-1991, follow-up data on reproductive and demographic variables were collected from 651 of the female children, who were 27-30 years old at the time. The women filled out self-administered questionnaires, which included full reproductive histories.29 CHDS researchers then reviewed the women's 1980-1992 Kaiser Health Plan medical records to identify abortion procedures and other obstetric events. The target period was chosen to include the women's adult reproductive histories, but the records also include abortion data from the 1970s.

In all, 368 of the women had Kaiser medical records for the target period; 236 had Kaiser records of some pregnancy-related event, including 109 who had obtained an abortion through the Kaiser Health Plan. Four of these women were excluded from our study because their abortions had occurred after they had completed the questionnaire; one woman was excluded because of missing data. Therefore, the final sample used in our analysis consisted of 104 women, who as a group had 170 abortions.

Dependent Variable

Operationalizing a variable to measure women's propensity to underreport abortions proved to be more difficult than it initially seemed. The likelihood that medical records and questionnaire data were incorrectly matched by individual is very low. The critical issue, therefore, was how to evaluate the abortion incidence match by woman, particularly when many women had had more than one abortion. Only 19% of the women matched all of their abortions by the exact month and year. By contrast, 90% of women who had at least one abortion in their medical record reported at least one abortion. Only 56% of the women reported all of their abortions within one year of the medical record dates. These proportions show a level of variability similar to that found in a study that compared self-reports of victimization to legal records.30

The most cynical interpretation of these data is that people lie, but a more charitable explanation is that people do not remember the timing or character of important events as accurately as we would like. There are many ways to define underreporting. The question then becomes: What is a meaningful approach to studying these data?

Ultimately, we opted for using no date-matching criterion, since our objective was to identify women who underreport their abortions, and even those who gave an inaccurate date of the event showed a willingness to report it. Therefore, women who reported fewer abortions than were indicated in their medical record were categorized as underreporters. The dependent variable measures whether or not a woman is an abortion underreporter.

The questionnaire asked each woman whether she had ever been pregnant and how many times, and included a table on which the woman was asked to note how each pregnancy ended, the month and year of any pregnancy termination and information about her children, if applicable. The self-reported dates (month and year) of abortions were used to construct an abortion count for each respondent, which was compared with the abortion count constructed from the dates in the Kaiser medical record. Some women may have obtained abortions from facilities outside the plan that they did not report to us. Therefore, our estimate constitutes the lower bound of abortion underreporting in this sample.

Independent Variables

Parity, a woman's self-reported total number of live births, was obtained from the reproductive history table on the questionnaire and is coded as a continuous variable; its range was 0-5.* Race is coded as 0 for white women and 1 for nonwhites. (The sample included 21 black women, four Hispanics and three Asians.) Time is the number of years between the interview date and the woman's first Kaiser record of an abortion; its range is 0-17, with a mean of eight years and a median of nine years. Education denotes the woman's self-report of the number of years of schooling she had completed; this variable ranges from 10 to 20, with a mean and median of 14 years.

We omitted several variables that results of other studies had suggested were important. Age, for example, was not included because its range (27-30) was too small. This omission is supported by a separate analysis of age effect.† Influences of contraceptive use could not be studied: The questionnaire collected data on current use, but contraceptive information for the time of the abortion was not sought in the medical records. Finally, marital status was not included in this analysis because few of the abortions occurred within marriage. An analysis of whether current marital status influences women's reporting of abortions obtained prior to marriage showed no effects.

Results

Altogether, 19% of the women underreported their abortion history; of these, half reported no abortions, and half reported fewer abortions than were in the medical record. Some 46% of the women reported the exact number of abortions reflected in their medical record, and 35% reported more abortions than were in the records.‡ The 81% of women who reported at least the number of abortions indicated in their medical record accounted for 84% of the abortions among study participants.

Results of logistic regression analysis demonstrated that of the variables examined, race was the strongest predictor of abortion underreporting; nonwhite women were 3.3 times as likely as whites to underreport their abortion experience (see Table 1). Women became somewhat more likely to underreport as the time since their first recorded abortion grew; for each year that had elapsed, the odds of underreporting were raised by 26%. Increasing levels of education, on the other hand, slightly lowered the propensity to underreport; every additional year of schooling decreased the odds of underreporting by 30%. Contrary to expectations, parity was not a significant predictor of underreporting.

Discussion

A number of reasons may explain the high rate of abortion reporting in this study. The women in the sample, who were born into a research study and have been studied throughout their lives, have been socialized into the research endeavor as few subjects ever are. Given their continued voluntary participation for up to 30 years, they may be less suspicious and more cooperative research subjects than most. Additionally, almost half of the women completed the questionnaire at Kaiser, which may have caused them to think that their answers could be checked. In fact, the design of this study and implementation of the medical abstraction by CHDS investigators occurred after the questionnaires were collected. Nevertheless, if these women suspected verification, it makes it all the more significant that they continued to underreport.

The effect of the number of years since the first recorded abortion may emphasize the unreliability of memory in reporting distant events: The longer the required length of recall, the more likely it is that one will forget. Another possibility is that women who had their first abortion at a young age find it more difficult to report than those who had an abortion later in life.

To our knowledge, this analysis is the first to reveal a strong effect of education on the propensity to report abortion. This influence may operate in two ways. First, education may tend to improve reporting by increasing accuracy and respondent commitment. Second, education is associated with support for abortion, which may translate into a greater willingness to report it accurately.31

Our findings also confirm results of previous analyses that have shown race to be a significant predictor of reporting behavior. Blacks and Hispanics are significantly less approving of abortion in a variety of circumstances than whites, and these differences may translate into different propensities to report. Furthermore, the composition of abortion beliefs differs for blacks and whites. These differences persist even after demographic variables, religious practices and region of socialization were controlled for.32 On a related theme, women of high socioeconomic status are more supportive of abortion than are women of lower socioeconomic status.33

This study provides evidence for the need to use medical records and surveillance systems to get accurate measures of abortion incidence. Furthermore, it indicates the usefulness of characteristics such as race and education data in the maintenance of medical records, and the need to include these variables in study designs whenever possible. Underreporting of events, including abortion, will persist, and researchers must be sensitive to cultural factors that may influence the perceived threat of different topics. Certainly, qualitative research is warranted to explore some of the influences on how threatening questions are perceived, particularly in reproductive matters, and how research and instruments may better be designed to elicit more accurate information. Finally, researchers must be careful not to impose matching requirements that are so restrictive that they miss substantively valid self-report matches with recorded incidence.

Footnotes

*Parity was also operationalized as a dichotomous variable (0-2 vs. three or higher). This alternative specification resulted in no significant effect on the direction, magnitude or significance of the coefficients.

†Indeed, the time variable is difficult to interpret because while it demonstrates recall bias, it also serves as a proxy for age at first abortion. The effects of age and time are inversely related: As age at time of first abortion increases, time since first abortion decreases. An alternate specification, including age and excluding time, yielded the same results.

‡Many of those who overreported their number of abortions were ineligible for Kaiser Health Plan services for periods of time, and because very few women provided accurate dates for their abortions, it is impossible to determine whether these women obtained abortions outside the plan because they lacked eligibility or for other reasons.

References

1. C.R. Hammerslough, "Correcting Survey-Based Contraceptive Failure Rates for Abortion Under-Reporting," dissertation, Princeton University, Princeton, N.J., 1987.

2. E. Susser, "Spontaneous Abortion and Induced Abortion: An Adjustment for the Presence of Induced Abortion When Estimating the Rate of Spontaneous Abortion from Cross-Sectional Studies," American Journal of Epidemiology, 117:305-308, 1983.

3. J.D. Forrest, "Unintended Pregnancy Among American Women," Family Planning Perspectives, 19:76-77, 1987; and E.F. Jones and J.D. Forrest, "Underreporting of Abortion in Surveys of U.S. Women: 1976-1988," Demography, 29:113-126, 1992.

4. Ibid.; and F.L. Mott, "Evaluation of Fertility Data and Preliminary Analytical Results from the 1983 Survey of the National Longitudinal Surveys of Work Experience of Youth," Center for Human Resources, Ohio State University, Columbus, 1985.

5. E.F. Jones and J.D. Forrest, 1992, op. cit. (see reference 3); and K.A. London and L.B. Williams, "A Comparison of Abortion Underreporting in an In-Person Interview and a Self-Administered Questionnaire," paper presented at the annual meeting of the Population Association of America, Toronto, Canada, May 3-5, 1990.

6. F.L. Mott, 1985, op. cit. (see reference 4).

7. B. Anderson et al., "The Validity of Survey Responses on Abortion: Evidence from Estonia," Demography, 31:115-132, 1994.

8. S.K. Lee, "A Study of the Reliability of Survey Data on Abortion in Korea," Journal of Family Planning Studies, 3:119-134, 1976.

9. P.G. Steinhoff et al., "Women Who Obtain Repeat Abortions: A Study Based on Record Linkage," Family Planning Perspectives, 11:30-38, 1979.

10. B. Anderson at al., 1994, op. cit. (see reference 7).

11. E.F. Jones and J.D. Forrest, "Use of a Supplementary Survey of Abortion Patients to Correct Contraceptive Failure Rates for Underreporting of Abortion," in United Nations, Department of International Economic and Social Affairs, Population Division, Measuring the Dynamics of Contraceptive Use: Proceedings of the United Nations Expert Group Meeting, New York, December 5-7, 1988, New York, 1991, pp. 139-152.

12. B. Anderson et al., 1994, op. cit. (see reference 7).

13. J.T. Lessler, M.F. Weeks and J.M. O'Reilly, "Results from the National Survey of Family Growth Cycle V Pretest," in American Statistical Association, Proceedings of the Section on Survey Research Methods, Vol. 1, Alexandria, Va., 1994, pp. 64-70.

14. B. Anderson et al., 1994, op. cit. (see reference 7).

15. C.R. Hammerslough, 1987, op. cit. (see reference 1).

16. M. Zelnik and J.F. Kantner, "First Pregnancies to Women Aged 15-19 in 1976 and 1971," Family Planning Perspectives, 10:11-20, 1978.

17. E.F. Jones and J.D. Forrest, 1992, op. cit. (see reference 3).

18. Ibid.

19. B.D. Silver, B.A. Anderson and P.R. Abramson, "Who Overreports Voting?" American Political Science Review, 80:613-624, 1986; M. Fendrich and C.M. Vaughn, "Diminished Lifetime Substance Use over Time: An Inquiry into Differential Underreporting," Public Opinion Quarterly, 58:96-123, 1994; B.S. Mensch and D.B. Kandel, "Underreporting of Substance Abuse in a National Longitudinal Youth Cohort: Individual and Interviewer Effects," Public Opinion Quarterly, 52:100-124, 1988; M.J. Hindelang, T. Hirschi and J.G. Weis, Measuring Delinquency, Sage Publications, Beverly Hills, Calif., 1981; D. Huizinga and D.S. Elliott, Self-Report Measures of Delinquency and Crime: Methodological Issues and Comparative Findings, Behavioral Research Institute, Boulder, Colo., 1984; and National Center for Education Statistics, High School and Beyond: Quality of Responses of High School Students to Questionnaire Items, Washington, D.C., 1984.

20. E.F. Jones and J.D. Forrest, 1992, op. cit. (see reference 3).

21. B. Anderson et al., 1994, op. cit. (see reference 7).

22. E.F. Jones and J.D. Forrest, 1992, op. cit. (see reference 3).

23. Ibid.; and F.L. Mott, 1985, op. cit. (see reference 4).

24. J.T. Lessler, M.F. Weeks and J.M. O'Reilly, 1994, op. cit. (see reference 13); and W.D. Mosher, W.F. Pratt and A.P. Duffer, Jr., "CAPI, Event Histories, and Incentives in the NSFG Cycle 5 Pretest," in American Statistical Association, 1994, op. cit. (see reference 13), pp. 59-63.

25. J.R. Abernathy, B.G. Greenberg and D.G. Horvitz, "Estimates of Induced Abortion in Urban North Carolina," Demography, 7:19-29, 1970; K.J. Krotki and S.A. McDaniel, "Three Estimates of Illegal Abortion in Alberta, Canada: Survey, Mail-Back Questionnaire, and Randomized Response Technique," Population Research Laboratory, University of Alberta, Edmonton, Canada, 1977; and S. Tezcan and A.R. Omran, "Prevalence and Reporting of Induced Abortion in Turkey: Two Survey Techniques," Studies in Family Planning, 12:262-271, 1981.

26. K.A. London and L.B. Williams, 1990, op. cit. (see reference 5).

27. B. Santee, "A Comparison of Two Methods of Obtaining Abortion Data from Fertility Surveys," dissertation, Columbia University, New York, 1982.

28. B.J. van den Berg, R.E. Christianson and F.W. Oechsli, "The California Child Health and Development Studies of the School of Public Health, University of California at Berkeley," Paediatric and Perinatal Epidemiology, 2:265-282, 1988.

29. P.J. Schwingl, "Prenatal Smoking Exposure in Relation to Female Adult Fecundability," dissertation, University of North Carolina, Chapel Hill, 1992.

30. P.V. Miller and R.M. Groves, "Matching Survey Responses to Official Records: An Exploration of Validity in Victimization Reporting," Public Opinion Quarterly, 49:366-380, 1985.

31. K. Luker, Abortion and the Politics of Motherhood, University of California Press, Berkeley and Los Angeles, Calif., 1984.

32. M.W. Combs and S. Welch, "Blacks, Whites, and Attitudes Toward Abortion," Public Opinion Quarterly, 46:510-520, 1982; and E.J. Hall and M.M. Ferree, "Race Differences in Abortion Attitudes," Public Opinion Quarterly, 50:193-207, 1986.

33. K. Luker, 1984, op. cit. (see reference 31).

Acknowledgments

J. Richard Udry is Kenan Professor of maternal and child health and of sociology, and Monica Gaughan is a doctoral student, Department of Sociology, University of North Carolina, Chapel Hill. Pamela J. Schwingl is head, Benefit/Risks Unit, Contraceptive Use and Epidemiology, Family Health International, Research Triangle Park, N.C. Bea J. van den Berg is director, Child Health and Development Studies, School of Public Health, University of California, Berkeley, Calif. The research on which this article is based was supported by grants R01-HD23454 and P30-HD05798 from the National Institute of Child Health and Human Development, National Research Service Awards 5T32HD07168-12 0081 and 5T32HL07206-05 0071 from the U. S. Public Health Service, Clinical Research Grant 6-588 from the March of Dimes Birth Defects Foundation, and a Grant-in-Aid of Research from Sigma Xi.

Disclaimer

The views expressed in this publication do not necessarily reflect those of the Guttmacher Institute.
2822896.pdf