| LimitationsDue to the voluntary nature of the elicitation process and to the lack of
  definition of the group from which volunteers were selected, the results from
  this survey can not be used to conduct power analysis in preparation for
  larger surveys. Also, inferences concerning larger groups and sub-populations
  can not be supported. For example, within the population of respondees, we
  have designations for denominational affiliation; for example, Roman Catholic
  or Presbyterian. It might be tempting to think that we can say something
  significant about people's attitudes toward evolution and Christianity from
  these groups based on the results of this survey. This is not warranted,
  however. To illustrate this point, say that we want to run some t tests to
  look for significant differences in the means between sub-populations
  designated by religious denomination, age, or education level. We can run
  t-tests on the entire data set or on a fraction of the data set restricted to
  one or two modes of collection. Data for the survey was collected in four
  different manners: direct elicitation from some SPU students; email to
  associates; email to science-religion interest groups; and elicitation from
  the counterbalance web-site. Looking at t-tests run on the entire data set as
  opposed to a partial data set which removes most responses from the
  counterbalance web-site shows so much variability that it appears that the
  methods of collecting data are biasing our observations in ways that we are
  not in a position to understand relative to the categories of interest. 
    
      
        | alpha values from t tests |  
        | Q | Part. | Full | Method |  
        | <!g>Q5 | 0.1166 | 0.7703 | 0.039** |  
        | <!g>Q8 | 0.0099* | 0.0052* | 0.230 |  
        | <!g>Q9 | 0.6415 | 0.1845 | 0.028** |  
        | <!g>Q11a | 0.3222 | 0.1384 | 0.140 |  
        | <!g>Q11b | 0.3603 | 0.5547 | 0.330 |  
        | <!g>Q11e | 0.1438 | 0.1333 | 0.360 |  
        | <!g>Q11i | 0.6462 | 0.5377 | 0.300 |  
        | <!g>Q11l | 0.4089 | 0.9423 | 0.990** |  * significant for test of inequality for  alpha = .05 ** significant for test of inequality for  alpha = .1. Column 1 gives the question from the survey which is being considered.
  Columns 2 and 3 test for significant differences in means between responses,
  to various questions, from Catholics or Presbyterians. Column 2 is based on
  data primarily from email and SPU sources, while column 3 also includes data
  from the <!g>Counterbalance web-site. Column 4 gives significance results from
  Catholics who participated via Counterbalance versus Catholics who
  participated through one of the other elicitation channels. For what it is worth, within the population of respondees, there is a
  significant difference in the means of people's attitudes toward the
  compatibility of evolutionary theory and Christian theology depending on
  whether they identify as Roman Catholic or as Presbyterian. Email
link | Printer-friendly | Feedback
| Contributed by: David Caccia |