1. Appendix B
SUMMARY OF EVIDENCE IN THE LITERATURE
Detailed information on Internet survey studies that we cite in this
report is presented in Table B.1. 1 Some of the studies have multiple
study arms, each of which is listed in a separate row in the table.
Each study arm corresponds to a different experimental setting. For
example, one arm of a study might use postal mail exclusively for
contacting individuals, while another might use e-mail to invite
individuals to participate in a survey that is done on the Web.
We classified the survey samples into census, random (or probabil-
ity), and convenience samples. Depending on who the target popu-
lation is, a sample may be classified as either random or conve-
nience. For example, a random sample of participants in an Internet
newsgroup for dentists would count as a convenience sample if the
population of inference is all dentists in the United States (including
those who do not participate in the Internet newsgroup).
Contact modes are classified as mail, phone, e-mail, newsgroup
postings, traditional advertising (such as through newspapers or
magazines), Web site advertising (such as hyperlinks in prominent
Web sites), or Web.
______________
1Some unpublished studies that we cited are omitted from the table because of lim-
ited information.
95
2. 96
Table B.1
Evidence Table for Survey Studies Cited in This Report
Primary Sample Type of Contact Response Follow-up Response
Year Author Survey Topic Target Population Size Sample Mode Mode Mode Rate (%)
2001 Couper Drug and University of 3,500 Random Mail Mail Mail 41
alcohol use Michigan students
2001 Couper Drug and University of 3,500 Random E-mail Web E-mail 62
alcohol use Michigan students
2001 Berrens Attitudes on U.S. adults a E-mail Web — N/A
13,034 Convenience
the environ-
ment
2001 Berrens Attitudes on U.S. adults a Random Phone Phone Phone 45.6
1,699
the environ-
ment
2001 Asch Enlistment College students and 14,150 Random Mail Mail + Mail 20.8
propensity in college-bound Web
the military students
Conducting Research Surveys via E-Mail and the Web
under
different
scenarios
2001 Everingham Balancing RAND employees 1,298 Census E-mail Web E-Mail 44
work and
personal life
2000 Paolo Curriculum Fourth-year medical 61 Census E-mail E-mail — 24
evaluation students
Utopia R ✺❁❐❆
3. Table B.1—Continued
Primary Sample Type of Contact Response Follow-up Response
Year Author Survey Topic Target Population Size Sample Mode Mode Mode Rate (%)
2000 Paolo Curriculum Fourth-year medical 83 Census Mail Mail Mail 41
evaluation students
2000 Quigley N/A Active-duty 7,209 Random Mail Mail + Mail 37
personnel, military Web
spouses, civilians,
reserve members
2000 Quigley N/A Active-duty 21,805 Random Mail Mail + Mail 42
personnel, military Web
spouses, civilians,
reserve members
2000 Quigley N/A Active-duty 7,279 Random Mail Mail Mail 40
personnel, military
spouses, civilians,
reserve members
2000 Schleyer Clinical Dentists 438 Convenience E-mail Web + E-mail 74.2
practice e-mail +
fax
2000 Taylor Political U.S. population N/A Convenience E-mail Web — N/A
approval
2000 Taylor 1998 U.S U.S. population N/A Convenience E-mail Web — N/A
election for
23 governors
Summary of Evidence in the Literature
and 14
senators
97
Utopia R ✺❁❐❆
4. 98
Table B.1—Continued
Primary Sample Type of Contact Response Follow-up Response
Year Author Survey Topic Target Population Size Sample Mode Mode Mode Rate (%)
2000 Witte Social science: U.S. adults age 16 32,688 Convenience Webb Web — N/A
geographic and over
mobility,
community
1999 Couper Organiza- Employees of five 4,187 Census Mail Mail Mixed 70.7
tional U.S. federal
climate agencies
1999 Couper Organiza- Employees of five 4,066 Census E-mail E-mail Mixed 42.6
tional U.S. federal
climate agencies
1999 Flemming Election Anyone visiting the N/A Convenience E-mail Web — N/A
PEW Web site
1999 Flemming Election Anyone in prior PEW N/A Convenience E-mail Web — N/A
phone interview
1999 Jones Health Staff at ten 200 Random E-mail Web — 19
Conducting Research Surveys via E-Mail and the Web
universities
1999 Jones Health Staff at ten 100 Random Mail Mail — 72
universities
1999 Jones Health Staff at ten 200 Random E-mail E-mail — 34
universities
1999 Kaye Uses of Web Anyone browsing N/A Convenience News- Web —
for political the Web group
information postings
Utopia R ✺❁❐❆
5. Table B.1—Continued
Primary Sample Type of Contact Response Follow-up Response
Year Author Survey Topic Target Population Size Sample Mode Mode Mode Rate (%)
1999 Sheehan Attitudes and Individuals with 5,000 Random E-mail Mail + E-mail 24
behaviors personal e-mail e-mail
associated accounts
with on-line
privacy
1999 Sheehan Health Web Creators of health- 834 Random E-mail Mail + E-mail 47
site purpose related Web sites e-mail
and funding
1999 Sheehan Attitudes University faculty, 580 Random E-mail Mail + e-mail 47
toward on- staff, and students e-mail
line privacy
1999 Shermis Telecommu- Members of the 585 Random Mail Mail — 36
nications National Council
needs of on Measurement in
educators Education
1999 Shermis Telecommu- Members of the 585 Random E-mail E-mail — 30
nications National Council
needs of on Measurement in
educators Education
1999 Vehovar Electronic All Internet users in N/A Convenience E-mail Web — N/A
commerce Slovenia
1999 Vehovar Electronic All Internet users in N/A Random Phone Phone — N/A
Summary of Evidence in the Literature
commerce Slovenia
99
Utopia R ✺❁❐❆
6. Table B.1—Continued
100
Primary Sample Type of Contact Response Follow-up Response
Year Author Survey Topic Target Population Size Sample Mode Mode Mode Rate (%)
1999 Zhang Scholarly Researchers with in- 201 Census E-mail Mail + Mixed 77.6
paper press papers to be Web + fax
submissions published in eight
library science
journals
1998 Dillman Past Web sites Purchasers of 9,522 Random Phone Web E-mail 41.1
visited, computer products
lifestyles,
behavior
(“plain” Web
page design)
1998 Dillman Past Web sites Purchasers of 2,466 Random Phone Web E-mail 36.3
visited, computer products
lifestyles,
behavior
(“fancy” Web
Conducting Research Surveys via E-Mail and the Web
page design)
1998 Nichols Economic Large commercial 50 Convenience Mail Mail + Mixed 94
data of large U.S. companies Web
commercial
firms
1998 Nichols Economic Large commercial 2,552 Census Mail Mail Mixed 84
data of large U.S. companies
commercial
firms
Utopia R ✺❁❐❆
7. Table B.1—Continued
Primary Sample Type of Contact Response Follow-up Response
Year Author Survey Topic Target Population Size Sample Mode Mode Mode Rate (%)
1998 Schaefer N/A Permanent faculty of 226 Census E-mail Mail + E-mail 58
Washington State e-mail
University
1998 Schaefer N/A Permanent faculty of N/A Census E-mail E-mail E-mail 48
Washington State
University
1998 Schaefer N/A Permanent faculty of N/A Census E-mail E-mail Mail 54
Washington State
University
1998 Schaefer N/A Permanent faculty of 226 Census Mail Mail Mail 57.5
Washington State
University
1998 Schillewaert Attitudes Flemish Web users a Convenience Traditional Web — 0.18
110
toward the advertising
Web
1998 Schillewaert Attitudes Flemish Web users a Convenience News- Web — 1.68
67
toward the group
Web postings
1998 Schillewaert Attitudes Flemish Web users a Convenience Web site Web — 0.68
51
toward the advertising
Web
Summary of Evidence in the Literature
101
Utopia R ✺❁❐❆
8. Table B.1—Continued
102
Primary Sample Type of Contact Response Follow-up Response
Year Author Survey Topic Target Population Size Sample Mode Mode Mode Rate (%)
1998 Schillewaert Attitudes Flemish Web users a Convenience E-mail Web — 31
125
toward the
Web
1997 Coomber Drug dealer Drug dealers a Convenience Mixed Web — N/A
80
practices worldwide
1997 Kittleson Health Health educators 276 Census E-mail Fax E-mail N/A
educator
certification
1997 Swoboda Future risks Internet users 8,859 Convenience E-mail Web — 25
for the planet
and mankind
1996 Bachman Total quality Business school 244 Random Mail Mail — 65.6
management deans and
in higher chairpersons
education
1996 Bachman Total quality Business school 244 Census E-mail E-mail — 52.5
Conducting Research Surveys via E-Mail and the Web
management deans and
in higher chairpersons
education
1996 Comley Early adopters 3,700 names and 1,221 Convenience E-mail E-mail E-mail 9
of technology addresses
purchased from
Internet magazine
in the UK
Utopia R ✺❁❐❆
9. Table B.1—Continued
Primary Sample Type of Contact Response Follow-up Response
Year Author Survey Topic Target Population Size Sample Mode Mode Mode Rate (%)
1996 Comley Early adopters 3,700 names and 1,779 Convenience Mail Mail — 18
of technology addresses
purchased from
Internet magazine
in the UK
1995 Kittleson Trivial Health educators in 153 Census Mail Mail — 76.5
questions for a small professional
health association
educators
1995 Kittleson Trivial Health educators 153 Census E-mail E-mail — 28.1
questions for listed in an e-mail
health directory
educators
1995 Mehta Internet Active U.S. users of 60 Random E-mail E-mail — 40
communi- BBS newsgroups
cation
1995 Mehta Internet Active U.S. users of 202 Random Mail E-mail — 45
communi- BBS newsgroups
cation
1995 Mehta Internet Active U.S. users of 107 Random Mail Mail Mail 83
communi- BBS newsgroups
cation
Summary of Evidence in the Literature
103
Utopia R ✺❁❐❆
10. Table B.1—Continued
104
Primary Sample Type of Contact Response Follow-up Response
Year Author Survey Topic Target Population Size Sample Mode Mode Mode Rate (%)
1995 Mehta Internet International users 172 Random E-mail Mail + E-mail 64
communi- of BBS newsgroups e-mail +
cation fax
1995 Mehta Internet Active U.S. users of 122 Random E-mail Mail + E-mail 63
communi- BBS newsgroups e-mail +
cation fax
1995 Tse Business Administrative and 200 Census Mail Mail Mail 27
ethics teaching staff at
Chinese University
of Hong Kong with
listed e-mail
addresses
1995 Tse Business Administrative and 200 Census E-mail E-mail — 6
ethics teaching staff at
Chinese University
of Hong Kong with
Conducting Research Surveys via E-Mail and the Web
listed e-mail
addresses
1995 Werner Presidential General population 1,200 Random E-mail E-mail — N/A
approval in the U.S.
rating
1994 Schuldt Attitudes MIS and marketing 200 Census Mail Mail — 19.3
toward faculty in
shareware membership
directories
Utopia R ✺❁❐❆
11. Table B.1—Continued
Primary Sample Type of Contact Response Follow-up Response
Year Author Survey Topic Target Population Size Sample Mode Mode Mode Rate (%)
1994 Schuldt Attitudes MIS and marketing 218 Census E-mail E-mail — 56.5
toward faculty in
shareware membership
directories
1992 Parker Expatriation Former AT&T 40 Census E-mail Mail — 38
and employees
repatriation
1992 Parker Expatriation Former AT&T 100 Census E-mail E-mail — 68
and employees
repatriation
1992 Walsh Scientific Subscribers to the 300 Random E-mail Mail + E-mail 76
activities Ocean Division of e-mail
with SCIENCEnet
computer
networks
Summary of Evidence in the Literature
105
Utopia R ✺❁❐❆
12. Table B.1—Continued
106
Primary Sample Type of Contact Response Follow-up Response
Year Author Survey Topic Target Population Size Sample Mode Mode Mode Rate (%)
1992 Walsh Scientific Subscribers to the 104 Convenience Mixed Mail + — N/A
activities Ocean Division of e-mail
with SCIENCEnet
computer
networks
1986 Kiesler Health and Recently active 75 Random E-mail E-mail Phone 67
personal computer mail
character- users at Carnegie
istics Mellon University
1986 Kiesler Health and Recently active 75 Random Mail Mail Phone 75
personal computer mail
character- users at Carnegie
istics Mellon University
aNumber of responses.
bTraditional and Web site advertising.
Conducting Research Surveys via E-Mail and the Web
N/A = Not available.
— = Not applicable.
Utopia R ✺❁❐❆