Skip to main content
Intended for healthcare professionals
Restricted access
Research article
First published May 1975

Estimation of Nonresponse Bias

Abstract

An imputation procedure is used to estimate the effects of nonresponse on issues of substantive interest in a social survey. Using this method, one can determine that nonresponse bias may have differential effects on variable means, depending on the combination of independent variables used in the ensuing substantive analysis of data from the survey.

Get full access to this article

View all access and purchase options for this article.

1. For example, see the American Statistical Association Conference (1974). Participants in the conference reported that response rates of 60% to 65% are average completion rates for current surveys. In the Detroit Area Study from which the data for the current analysis is taken, response rates have dwindled from 85% or more in the 1950s to current rates of near 70% or less.
2. In sampling theory the terms precision and accuracy are used to refer to the effects of bias and variable errors. It can be shown that the total survey error is a function of variable errors due to sampling and the bias due to measurement errors. Total Error = √VE2 + Bias2 High rates of nonresponse will affect the latter term, and consequently increase the total survey error (Kish, 1965: 510). These terms are also roughly synonymous with the terms reliability and validity used in psychology and referred to by Campbell and Stanley (1963).
3. Eight variables chosen for this analysis are standard socioeconomic types (age, sex, race, occupation, family income, education, marital status, and religion). "City of residence" was added to investigate possible Detroit-suburban response differences. "Years in the Detroit Area" was added to check for the effects of geographical mobility and migration patterns. The "housing type" variable was added to investigate respondent accessibility effects.
4. The 2 additional census descriptions already referred to were also used to check on the accuracy of the racial designations for the 76 other blocks.
5. The imputed mean income for these refusals using the mean block income was approximately $11,000. With mean income for their age group, it was lowered to $6,000.
6. Because of the fact that there were 37 refusals with missing data that were not used in the nonresponse analysis, a final check of the racial characteristics of these refusals was made. Using the race imputation procedure outlined above, one finds that 30 of these would have been labeled "white" and 7 "black." If these 37 are then added to the 140 refusals with no missing data, the percentage of blacks in the sample of refusals would increase from 10.7 to 14.1. This small increase would not have seriously affected the results obtained in this analysis.

References

American Statistical Association Conference (1974 ) "Report on the ASA Conference on Surveys of Human Populations ". Amer. Statistician 28, 1 (February) 30-34.
Benson, S., W.P. Booman and K.E. Clark (1951) "A study of interview refusals." J. of Applied Psychology 35 (April): 116-119.
Birnbaum, Z.W. and M.G. Sirken (1950) "Bias due to non-availability in sample surveys ." J. of Amer. Stat. Ass. 45 (March): 98-111.
Campbell, D.T. and J.C. Stanley (1963) Experimental and Quasi-Experimental Designs for Research. Chicago: Rand McNally .
Cochran, W.G. (1963) Sampling Techniques. New York : John Wiley.
Deming, W.E. (1950) Some Theory of Sampling. New York: John Wiley.
Dunkelberg, W.C. and G.S. Day (1973) "Nonresponse bias and callbacks in sample surveys ." J. of Marketing Research 10 (May): 160-168.
Hansen, M.H. and W.H. Hurwitz (1946) "The problem of non-response in sample surveys ." J. of the Amer. Stat. Ass. 41: 517-529.
Hendricks, W.A. (1949) "Adjustment for non-response bias caused by nonresponse in mailed surveys." Agricultural Economics Research 1 (April): 52-56.
Kish, L. (1965) Survey Sampling. New York: John Wiley.
Lagay, B.W. (1969-70) "Assessing bias: a comparison of two methods ." Public Opinion Q. 33 (Winter): 615-618.
Pomeroy, W.B. (1963) "The reluctant respondent." Public Opinion Q. 27 (Summer): 287-293.
Robins, L.N. (1963) "The reluctant respondent." Public Opinion Q. 27 (Summer): 276-286.
Schuman, H. and B. Gruenberg (1970) The Impact of City on Racial Attitudes. Ann Arbor, Mich.: Institute for Social Research.
Schwirian, K.P. and H.R. Blaine (1966-1967) "Questionnaire return bias in the study of blue collar workers." Public Opinion Q. 30 (Winter): 656-663.
Suchman, E.A. (1962) "An analysis of 'bias' in survey research." Public Opinion Q. 26 (Spring): 102-111.
Swindel, B.F. (1974) "Instability of regression coefficients illustrated ." Amer. Statistician 28 (May): 63-65.
U.S. Department of Commerce. Bureau of the Census (1970) Block Statistics Detroit, Michigan Urbanized Area. 1970 Census of Housing HC (3)-120.

Cite article

Cite article

Cite article

OR

Download to reference manager

If you have citation software installed, you can download article citation data to the citation manager of your choice

Share options

Share

Share this article

Share with email
EMAIL ARTICLE LINK
Share on social media

Share access to this article

Sharing links are not relevant where the article is open access and not available if you do not have a subscription.

For more information view the Sage Journals article sharing page.

Information, rights and permissions

Information

Published In

Article first published: May 1975
Issue published: May 1975

Rights and permissions

Request permissions for this article.

Authors

Affiliations

Darnell F. Hawkins
University of Michigan

Metrics and citations

Metrics

Journals metrics

This article was published in Sociological Methods & Research.

VIEW ALL JOURNAL METRICS

Article usage*

Total views and downloads: 165

*Article usage tracking started in December 2016


Articles citing this one

Receive email alerts when this article is cited

Web of Science: 88 view articles Opens in new tab

Crossref: 0

  1. Algorithmic fairness in pandemic forecasting: lessons from COVID-19
    Go to citation Crossref Google Scholar
  2. Paranormal beliefs and cognitive function: A systematic review and ass...
    Go to citation Crossref Google Scholar
  3. Journey to a fond memory: How memorability mediates a dynamic customer...
    Go to citation Crossref Google Scholar
  4. Public Attitudes towards Cow Welfare and Cow Shelters (Gaushalas) in I...
    Go to citation Crossref Google Scholar
  5. 2 An Examination of the Perceptions of Auditors and Chief Financial Of...
    Go to citation Crossref Google Scholar
  6. An Examination of the Perceptions of Auditors and Chief Financial Offi...
    Go to citation Crossref Google Scholar
  7. INTERROGATING RACE, CRIME, AND JUSTICE IN A TIME OF UNEASE AND RACIAL ...
    Go to citation Crossref Google Scholar
  8. The Relationship Between Managerial Characteristics and Exporting Beha...
    Go to citation Crossref Google Scholar
  9. Export barriers in a changing institutional environment: A quasi-longi...
    Go to citation Crossref Google Scholar
  10. Export performance: multiple predictors and multiple measures approach
    Go to citation Crossref Google Scholar
  11. An examination of the perceptions of auditors and chief financial offi...
    Go to citation Crossref Google Scholar
  12. Recruiting Women for a Study on Perceived Risk of Cancer: Influence of...
    Go to citation Crossref Google Scholar
  13. Análise da não resposta em surveys políticos
    Go to citation Crossref Google Scholar
  14. Explaining Unit Nonresponse in Online Panel Surveys: An Application of...
    Go to citation Crossref Google Scholar
  15. The book–tax divide: Perceptions from the field
    Go to citation Crossref Google Scholar
  16. Corporate environmental responsibility and audit risk
    Go to citation Crossref Google Scholar
  17. The impact of socio-economic factors and incentives on farmers’ invest...
    Go to citation Crossref Google Scholar
  18. To Participate or Not to Participate: Decision Processes Related to Su...
    Go to citation Crossref Google Scholar
  19. Individual investors’ attitudes toward the acceptance of International...
    Go to citation Crossref Google Scholar
  20. Correcting for Survey Nonresponse Using Variable Response Propensity
    Go to citation Crossref Google Scholar
  21. The effects of interviewer, respondent and area characteristics on coo...
    Go to citation Crossref Google Scholar
  22. Non-response bias in alcohol and drug population surveys
    Go to citation Crossref Google Scholar
  23. CFOs’ and public accountants’ perceptions of material weaknesses in in...
    Go to citation Crossref Google Scholar
  24. Questionnaire SDIALOR : instrument de mesure de la satisfaction des pa...
    Go to citation Crossref Google Scholar
  25. A successful conversion or double refusal: A study of the process of r...
    Go to citation Crossref Google Scholar
  26. An analysis of how nonresponse error is assessed in academic marketing...
    Go to citation Crossref Google Scholar
  27. Perceptions of the Effect of Sarbanes-Oxley on Earnings Management Pra...
    Go to citation Crossref Google Scholar
  28. Self-reports of Police Speeding Stops by Race: Results from the North ...
    Go to citation Crossref Google Scholar
  29. Integrating Exchange and Heuristic Theories of Survey Nonresponse
    Go to citation Crossref Google Scholar
  30. Individual investors’ attitudes towards listing requirements for forei...
    Go to citation Crossref Google Scholar
  31. Satisfaction des patients hospitalisés à Hô Chi Minh-Ville, Viet Nam
    Go to citation Crossref Google Scholar
  32. Auditors' and Investors' Perceptions of the “Expectation Gap”
    Go to citation Crossref Google Scholar
  33. Characteristics of People Lost to Attrition in Psychiatric Follow-up S...
    Go to citation Crossref Google Scholar
  34. The use of refusal postcards in recruiting older adults
    Go to citation Crossref Google Scholar
  35. A Discussion of Traditional and Computerized Survey Techniques to Reac...
    Go to citation Crossref Google Scholar
  36. Alternative Corrections for Sample Truncation: Applications to the 198...
    Go to citation Crossref Google Scholar
  37. References
    Go to citation Crossref Google Scholar
  38. Nonresponse to Mailed Surveys: A Review and Guide
    Go to citation Crossref Google Scholar
  39. The effect of nonresponse on estimation of relative risk in a case-con...
    Go to citation Crossref Google Scholar
  40. The effect of nonresponse on prevalence estimates for a referent popul...
    Go to citation Crossref Google Scholar
  41. Household‐level determinants of survey nonresponse
    Go to citation Crossref Google Scholar
  42. Electronic bulletin board distributed questionnaires for exploratory r...
    Go to citation Crossref Google Scholar
  43. Sociodemographic factors and mail survey response
    Go to citation Crossref Google Scholar
  44. An examination of attitudes involving cash flow accounting: Implicatio...
    Go to citation Crossref Google Scholar
  45. Ageing Anglican Clergy and Performance Indicators in the Rural Church,...
    Go to citation Crossref Google Scholar
  46. Nonparticipation of Older Adults in a Heart Disease Self-Management Pr...
    Go to citation Crossref Google Scholar
  47. Methodological review of ‘the incidence and prevalence of woman abuse ...
    Go to citation Crossref Google Scholar
  48. Nonrespondents in Communication Network Studies...
    Go to citation Crossref Google Scholar
  49. Investigating non-response bias in a survey of disablement in the comm...
    Go to citation Crossref Google Scholar
  50. Classification of exporting firms according to sales and growth into a...
    Go to citation Crossref Google Scholar
  51. Attitudes Towards the Term ‘Generally Accepted Accounting Principles’
    Go to citation Crossref Google Scholar
  52. CLERGY RESPONSE RATES TO WORK-RELATED QUESTIONNAIRES: A RELATIONSHIP B...
    Go to citation Crossref Google Scholar
  53. Physician Responses to Multiple Questionnaire Mailings
    Go to citation Crossref Google Scholar
  54. Response
    Go to citation Crossref Google Scholar
  55. Differences between nonrespondents and refusers in market surveys usin...
    Go to citation Crossref Google Scholar
  56. Nonresponse On the Center for Epidemiological Studies-Depression Scale...
    Go to citation Crossref Google ScholarPub Med
  57. The Effects of Multi-Wave Mailings on the External Validity of Mail Su...
    Go to citation Crossref Google Scholar
  58. Hidden Bias in the Use of Archival Data
    Go to citation Crossref Google ScholarPub Med
  59. Magazine‐distributed questionnaires for exploratory research: Advantag...
    Go to citation Crossref Google Scholar
  60. The Decline in Survey Response: A Social Values Interpretation
    Go to citation Crossref Google Scholar
  61. Estimating Nonresponse Bias with Temporary Refusals
    Go to citation Crossref Google Scholar
  62. Faculty Response Rates to a Request for Information for a Study of Sal...
    Go to citation Crossref Google Scholar
  63. An investigation of nonresponse bias in medical student assessment of ...
    Go to citation Crossref Google Scholar
  64. IMPACT OF EXPORT GROWTH EXPECTATIONS ON SMALLER FIRMS
    Go to citation Crossref Google Scholar
  65. Characteristics of dropouts in longitudinal research on aging: A study...
    Go to citation Crossref Google Scholar
  66. I Hear You Knocking But You Can't Come In...
    Go to citation Crossref Google Scholar
  67. The uncooperative interviewee
    Go to citation Crossref Google Scholar
  68. An Adjustment for Nonresponse in Sample Surveys
    Go to citation Crossref Google Scholar
  69. Industrial survey sampling
    Go to citation Crossref Google Scholar
  70. Demographic Determinants of Mailed Survey Response Rates of Urban Scho...
    Go to citation Crossref Google Scholar
  71. Fear Appeal Effects in the Field: A Segmentation Approach
    Go to citation Crossref Google Scholar
  72. Interim Response to a Mail Questionnaire: Impacts on Variable Relation...
    Go to citation Crossref Google Scholar
  73. The Interaction of Refusal and Not-at-Home Sources of Nonresponse Bias
    Go to citation Crossref Google Scholar
  74. Making Errors in Surveys: An Overview
    Go to citation Crossref Google Scholar
  75. A new look at auditors' reactions toward substance versus form in fina...
    Go to citation Crossref Google Scholar
  76. Individual Investors’ Perceptions Involving the Quality and Usefulness...
    Go to citation Crossref Google Scholar

Figures and tables

Figures & Media

Tables

View Options

Get access

Access options

If you have access to journal content via a personal subscription, university, library, employer or society, select from the options below:

AERA members can access this journal content using society membership credentials.

AERA members can access this journal content using society membership credentials.


Alternatively, view purchase options below:

Purchase 24 hour online access to view and download content.

Access journal content via a DeepDyve subscription or find out more about this option.

View options

PDF/ePub

View PDF/ePub