Outcomes Measurement
Evaluation
Plan Part II | Technical
Assistance Survey Template
Getting the Best Results from
Surveys and Interviews
Adapted from the Survey Workbook,
The Evaluation Forum, Seattle, WA, 2002
| Purpose |
 |
Do you know
what you want to learn from
the survey or interview? |
 |
Have you thought
about why you need the information? |
 |
Have you identified
who you need to ask to get the
information? |
 |
Have you thought
about the different audiences
for the information |
 |
Have you thought
about how you will use the information? |
 |
Have you identified
the objectives of your data collection
and/or research questions? |
|
| Design
and Method |
| Reasons
for using written surveys: |
 |
Are resources or volunteer
time limited? |
 |
Do you need to collect
data from a sizable number of people? |
 |
Is interviewer bias a
concern? |
 |
Is privacy necessary? |
 |
Are quantifiable rankings
or priorities necessary? |
 |
If it is to be done through
email or the Internet, do respondents have
access to those technologies? |
| |
| Reasons
for using interviews: |
 |
Do you have the time necessary
to conduct interviews? |
 |
Can you find and train
the interviewers? |
 |
Is education or literacy
an issue for participants that make interviews
more appropriate? |
 |
Are questions likely to
be complex? |
 |
Will you need visual aids?
Is it important that every question be answered?
|
 |
Is it difficult to know
what the range of responses might be? |
 |
Do you have the resources
necessary to conduct interviews? |
|
|
| Language |
 |
Is each question
meaningful? |
 |
Is the language simple,
clear and concrete? |
 |
Does it use language
familiar to the participants? |
 |
Are the instructions
understandable? |
 |
Are checklist choices
relevant? |
 |
Are the scales simple
and understandable? |
 |
Do the scale choices
have clear distinctions between them?
|
 |
Do the scales have
a clear mid-point, if appropriate?
|
 |
Is any of the wording
judgmental or leading to a desired
answer? |
 |
Are timeframes specific? |
 |
Does each question include
just one thought? |
|
| Format |
 |
Is it easy to read
and follow? |
 |
Is it as short as
possible? |
 |
Are the checklist
boxes easy to select? |
 |
Are the scales easy
to read and apply? |
 |
Do participants prefer
numeric scales or wording scales?
|
 |
Do the contingency
questions guide the reader appropriately?
|
 |
Is the typeface large
enough for participants to read? |
|
| Cultural
Appropriateness |
 |
Is the method you
have chosen appropriate for your client
group?
|
 |
Are the types of
questions appropriate for your client
group?
|
 |
Is the content of
the questions acceptable?
|
 |
Can the questions
be translated easily, if needed?
|
 |
How does the meaning
of questions change in translation? |
|
| Pre-Test |
 |
Has the instrument
been pre-tested? |
 |
Did participants
interpret the meaning of the questions
correctly?
|
 |
Were participants
able to follow the format?
|
 |
Did any questions
appear to make respondents uncomfortable?
|
 |
Did any questions
consistently go unanswered?
|
 |
Did the instrument
appear appropriate for the client
group?
|
 |
Did you get back
the information you thought you should? |
|
| Response
Rates |
 |
Will the survey be
announced ahead of time?
|
 |
Will a cover letter
be included with the mailing?
|
 |
Are respondent addresses
up-to-date and accurate?
|
 |
Is the return address
included on the survey?
|
 |
Have you provided
a stamped and addressed return envelope?
|
 |
Can you do multiple
mailings?
|
 |
For phone interviews,
has a concise introduction been written?
|
 |
Are phone lists up-to-date
and accurate?
|
 |
Are several phone
attempts made on different days and
times?
|
 |
Are holidays and
other events avoided? |
|
|
Evaluation
Plan Part II | Technical
Assistance Survey Template