Appendix 1: Survey Methodology

Results for the survey are based on telephone interviews conducted October 7-27, 2013 among a national sample of 2,002 adults 18 years of age or older living in the United States (a total of 479 respondents were interviewed on a landline telephone, and 1,523 were interviewed on a cell phone, including 929 who had no landline telephone). The survey was conducted by interviewers at Princeton Data Source under the direction of Princeton Survey Research Associates International (PSRAI). Interviews were conducted in English and Spanish. A combination of landline and cell phone random digit dial (RDD) samples were used; both samples were provided by Survey Sampling International. The landline RDD sample was drawn using traditional list-assisted methods where telephone numbers were drawn with equal probabilities from all active blocks in the U.S. The cell sample was drawn through a systematic sampling from dedicated wireless 100-blocks and shared service 100-blocks with no directory-listed landline numbers.

In order to increase the number of 25 to 34 year-old respondents in the sample additional interviews were conducted with that cohort by screening RDD cell sample and by calling back 25 to 34 year-olds from recent PSRAI surveys.

Both the landline and cell samples were released for interviewing in replicates, which are small random samples of each larger sample. Using replicates to control the release of telephone numbers ensures that the complete call procedures are followed for all numbers dialed. As many as 7 attempts were made to contact every sampled telephone number. The calls are staggered over times of day and days of the week (including at least one daytime call) to maximize the chances of making contact with a potential respondent. An effort is made to recontact most interview breakoffs and refusals to attempt to convert them to completed interviews.

Respondents in the landline sample were selected by randomly asking for the youngest adult male or female who is now at home. Interviews in the cell sample were conducted with the person who answered the phone, if that person was an adult 18 years of age or older. The additional interviews with 25- to 34-year-olds from the cell sample were administered an age screener; those who were in the target age range completed the interview. For the landline callback sample, interviewers asked to speak with the person based on age and gender who participated in an earlier survey. For the cellular callback sample, interviews were conducted with the person who answered the phone once it was confirmed that they were in the target age range.

Weighting is generally used in survey analysis to adjust for effects of sample design and to compensate for patterns of nonresponse that might bias results. The weighting was accomplished in multiple stages to account for the different sample frames as well as the oversampling of 25-34 year-olds. Weighting also balances sample demographic distributions to match known population parameters.

In the final stage of weighting, the combined sample was weighted using an iterative technique that matches gender, age, education, race, Hispanic origin, and region to parameters from the U.S. Census Bureau’s 2011 American Community Survey data. The population density parameter is county based and was derived from the Decennial Census. The sample also is weighted to match current patterns of telephone status and relative usage of landline and cell phones (for those with both), based on extrapolations from the July-December 2012 National Health Interview Survey.

The survey’s margin of error is the largest 95% confidence interval for any estimated proportion based on the total sample – the one around 50%. For example, the margin of error for the entire sample is plus or minus 2.7 percentage points. This means that in 95 out of every 100 samples drawn using the same methods, estimated proportions based on the entire sample will be no more than 2.7 percentage points away from their true values in the population. Sampling errors and statistical tests of significance take into account the effect of weighting. The following table shows the sample sizes and the error attributable to sampling that would be expected at the 95% level of confidence for different groups in the survey:

In addition to sampling error, one should bear in mind that question wording and practical difficulties in conducting surveys can introduce error or bias into the findings of opinion polls.