![]() |
![]() |
PROGRAM EVALUATION GUIDE The Saguaro Seminar has developed a 5-10 minute social capital module that asks key social capital questions and key demographic questions. You can access that survey here.
The following are the 10 dimensions of social capital:
For a description of each of these 10 dimensions and the recommended social capital questions associated with these questions click here. [Note: if you chose all of the recommended questions from these 10 dimensions there would be 23 questions plus 5 questions that have multiple subparts. This would probably take up 10-15 minutes of interview time and not leave a lot of time for other questions. That is why the short form was developed.]
With the remainder of the time on your survey, you should ask about key demographics of respondents, and probe in more depth for how they participated in your program or elements of it, and probe about the specific kind of social ties in which you are most interested.
Note: Unless otherwise indicated, the following recommended questions are written in telephone interview form, and may need to be adapted if you are doing face-to-face interviews or mailed surveys.
Here are questions that you may want to select from concerning probing about the kind of links that your evaluation is attempting to probe. Note: you may want to invent questions that are not listed here. For general instructions on the how-tos of survey construction, click here.
Note: The order of the subcategories is not especially significant; note that we do mix some categories in the agree-disagree question battery.
KEY: 1) INSTRUCTIONS TO INTERVIEWERS ARE IN (CAPITALS).
GENERAL SOCIAL CAPITAL
Community Satisfaction & Tangible Attachment
*Overall, how would you rate the {NAME OF COMMUNITY} area as a place to live? Would you say that it is excellent, very good, good, only fair, or poor?
*Do you or your family own or rent the place where you are living now?
*How many years have you lived in the {NAME OF COMMUNITY} area, either at this address or elsewhere in the community? (IF "ALL MY LIFE": And how old are you now?)
Would you like to be living here five years from now?
When people in the [NAME OF COMMUNITY] area are asked where they live, they often use names like [CITYEXAMPLE1], [CITY EXAMPLE2], or [CITYEXAMPLE3]. If someone asked you where you live, what would you say?
When you think about your neighborhood, do you think of it as: your own block, a few blocks around your house, a section of [CITYNAME], or all of [CITYNAME]? (other answers may be volunteered)
(OPEN ENDED) [What landmarks would you choose to define the boundaries of your neighborhood?]
Neighborliness
Now, let's talk about your neighbors. Think of five neighbors from different households who live closest to you.
How many of these five neighbors have you spoken to in person in the past twelve months?
In the past twelve months, how many of your neighbor's homes have you been in?
Would you recognize a police officer who patrols your neighborhood?
Does your neighborhood have a neighborhood crime watch group?
Does your neighborhood have any other sort of neighborhood association? (Like a block association, or a homeowner or tenant association?)
Neighborhood Cohesion, Norms, And Collective Efficacy
For each of the following statements, please tell me whether you strongly agree, agree somewhat, disagree somewhat, or strongly disagree. The first statement is'
* If there is a problem around here, the neighbors get together to deal with it. (Would you say you strongly agree, agree, disagree, or strongly disagree?)
This is a close-knit neighborhood. (Would you say you strongly agree, agree, disagree, or strongly disagree?)
When you get right down to it, no one in this neighborhood cares much about what happens to me. (Would you say you strongly agree, agree, disagree, or strongly disagree?)
* If I had an emergency, even people I don't know will help me. (Would you say you strongly agree, agree, disagree, or strongly disagree?)
There are adults in this neighborhood that children can look up to. (Would you say you strongly agree, agree, disagree, or strongly disagree?)
People living here are willing to accept people from different racial and ethnic groups as neighbors. (Would you say you strongly agree, agree, disagree, or strongly disagree?)
This is a good neighborhood for raising children. (Would you say you strongly agree, agree, disagree, or strongly disagree?)
People in this neighborhood generally don't get along with each other. (Would you say you strongly agree, agree, disagree, or strongly disagree?)
* People around here are willing to help their neighbors. (Would you say you strongly agree, agree, disagree, or strongly disagree?)
If I called a city/town office with a complaint, I would likely get a quick response. (Would you say you strongly agree, agree, disagree, or strongly disagree?)
* If something happens that affects my community, I usually find out about it right away. (Would you say you strongly agree, agree, disagree, or strongly disagree?)
People in this community can be trusted. (Would you say you strongly agree, agree somewhat, disagree somewhat, or strongly disagree?)
Sense Of Community
I wish I had more contact with people in my community. (Would you say you strongly agree, agree somewhat, disagree somewhat, or strongly disagree?)
I feel I have little or nothing in common with the people in my neighborhood. (Would you say you strongly agree, agree somewhat, disagree somewhat, or strongly disagree?)
It is hard to make good friends here. (Would you say you strongly agree, agree somewhat, disagree somewhat, or strongly disagree?)
Most people here are honest. (Would you say you strongly agree, agree somewhat, disagree somewhat, or strongly disagree?)
I seldom feel lonely here. (Would you say you strongly agree, agree somewhat, disagree somewhat, or strongly disagree?)
* I do not feel safe in this community. (Would you say you strongly agree, agree somewhat, disagree somewhat, or strongly disagree?)
Television is my primary form of entertainment. (Would you say you strongly agree, agree somewhat, disagree somewhat, or strongly disagree?)
I often put on the TV out of habit and don't really watch it. (Would you say you strongly agree, agree somewhat, disagree somewhat, or strongly disagree?)
The people in this community do not have very much in common. (Would you say you strongly agree, agree somewhat, disagree somewhat, or strongly disagree?)
I spend a lot of time visiting with friends. (Would you say you strongly agree, agree somewhat, disagree somewhat, or strongly disagree?)
We have community leaders you can trust. (Would you say you strongly agree, agree somewhat, disagree somewhat, or strongly disagree?)
Neighborhood Efficacy
* The following four-question sequence was part of a long-term study of Chicago neighborhoods led by Dr. Felton Earls and Robert Sampson:
* If a group of neighborhood children were skipping school and hanging out on a street corner, how likely is it that your neighbors would do something about it? (Would you say it is very likely, likely, unlikely, or very unlikely?)
* If a child was showing disrespect for an adult, how likely is it that people in your neighborhood would scold the child? (Would you say it is very likely, likely, unlikely, or very unlikely?)
* Suppose that because of budget cuts the fire station closest to your home was going to be closed down. How likely is it that neighborhood residents would organize to try to do something to keep the fire station open? (Would you say it is very likely, likely, unlikely, or very unlikely?)
* If public officials asked everyone to conserve water because of a water emergency, how likely is it that people in this neighborhood would comply? (Would you say it is very likely, likely, unlikely, or very unlikely?)
Overall, how much impact do you think people like you can have in making your community a better place to live: no impact at all, a small impact, a moderate impact, or a big impact?
All things considered, would you say you were very happy, quite happy, not very happy, or not happy at all?
All in all, how would you describe your state of health these days? (Would you say it is very good, good, fair, poor, or very poor?)
Memberships And Activity In Voluntary Associations: Religion
I want to change subjects now and ask about the groups and organizations you may belong to. First, what is your religious preference? Is it Protestant, Catholic, Jewish, some other religion, or no religion? [This base question is also in the demographics section.]
Apart from weddings, funerals, and christenings, would you say you attend religious services regularly, often, seldom, or almost never? (IF OFTEN/REGULARLY, CONTINUE WITH RELIGION, ELSE SKIP TO NEXT BLOCK)
Are you a member of the choir or take other leading roles in the services?
Aside from attending services, how many hours of work would you say you give to your church/synagogue in an average week?
When you go to services, would you say that you know a great many of the other people there, many of them, some of them, a few of them, or hardly anybody else there?
How many of these people are close friends of yours?
Voluntary Associations
The following question sequence is a relatively complete way to take an inventory of voluntary association. Some inventory is necessary (*) but not necessarily one as complete as this.
Now I'd like to ask about other kinds of groups and organizations. Keep in mind that some of these may be very informal, just a group of people who get together regularly to do an activity or talk. I'm going to read a list. For each item, I want you to answer YES if you are a member of the group, if you participated in some group activity such as a meeting or event, or if you volunteered time or donated money or goods to the organization like this over the past twelve months. READ LIST.
LIST OF GROUPS
(FOR EACH "YES"ASK THE FOLLOWING QUESTIONS:) Are you a member of this kind of group?
(IF A "MEMBER" AND "ATTENDED" MORE THAN ONE ORGANIZATION:) Of the groups that you belong to, which would you say is the most important in your life?
(FOR THOSE WHO ARE A "MEMBER" AND "ATTENDED" ONE ORGANIZATION AND FOR THE MOST IMPORTANT GROUP MEMBERSHIP:)
On average, how many hours a month do you participate in this group's activities?
To what extent would you say you participate in this group's decision making? Would you say to a very large extent, a large extent, a small extent, or a very small extent?
Does this group ever do anything to try to solve local community problems?
Does this group ever do any other charitable work?
Has this group ever taken political stands or engaged in political organizing or campaigning?
Thinking about the members of this group,
Would you say that most of them are from the same neighborhood?
VOLUNTARISM
The sequence on voluntary association captures a great deal of voluntary activity, if voluntarism is measured in this way, then only a few additional questions are needed:*
In the past twelve months have you done any volunteer work that you haven't already told me about?
(IF ANY VOLUNTEER WORK INDICATED ABOVE):
Otherwise a general voluntarism question is needed. Here is an in-person version:
Listed on this card are examples of the many different areas in which people do volunteer activity. By volunteer activity I mean not just belonging to a service organization, but actually working in some way to help others for no monetary pay. In which, if any, of the areas listed on this card have you done some volunteer work in the past twelve months...health organizations, education, religious organizations, human services, environment, public/society benefit, recreation--adults, arts, culture, and humanities, work-related organizations, political organizations/campaigns, youth development, private and community foundations, international/foreign, informal--alone, or other?
Politics
Our next topic is politics.
When you get together with friends, would you say you discuss political matters frequently, occasionally, rarely, or almost never?
Are you currently registered to vote?
Many people aren't able to vote because they're not registered, or they don't have time, or they have difficulty getting to the polls. Think about all the presidential elections since you have been old enough to vote. Have you voted in all of them, in most of them, in some of them, rarely voted in them, or have you never voted in a presidential election?
Did you vote in the most recent local election? (for your city, town, school district, or county)
How much of the time do you think you can trust the national government to do what is right just about always, most of the time, or hardly ever?
How about your local government? How much of the time do you think you can trust the local government to do what is right? (Would you say just about always, most of the time, or hardly ever?)
General Social Capital And Related Value Questions*
* Now, I want to ask you some questions about how you view other people. Generally speaking, would you say that most people can be trusted or that you can't be too careful in dealing with people?
* Would you say that most of the time people try to be helpful or do you think that they are mostly looking out for themselves?
* Do you think that people would try to take advantage of you if they got the chance or would they try to be fair?
* What do you consider to be the most important reason there are people in this country who live in poverty: because they are unlucky, because of laziness and lack of will power, because there is injustice in our society, or because poverty is an inevitable part of progress?
PERSONAL SUPPORT NETWORKS
Household size and Marital Status
* Now I want to ask about your relationships with friends and family. First, I need to know a little bit about your household. How many people do you live with, counting children, roommates, and anyone else who stays with you most of the time? (IF "NO ONE", SKIP TO CHILDREN)
Are you currently married and living with your spouse? [This question is also in the demographics section.]
(IF NO) Are you currently living with someone as if you were married? [This question is also in the demographics section.]
Children [and Social Support]
How many living children do you have? (IF NONE, SKIP TO PARENTS) (You should include adoptive children and any other children you have raised.)
What are their ages, starting with the youngest?
How many of them live with you now? (IF NONE, SKIP NEXT QUESTION) ("NONE" MAY BE INFERRED FROM HOUSEHOLD SIZE)
What are their ages?
(FOR RESPONDENTS WITH ADULT CHILDREN NOT AT HOME)
How many of your (adult) children do you see at least once a week?
How many of your (adult) children do you talk with on the phone or correspond with at least once a week?
How many of your (adult) children do you feel very close to?
(FOR ALL THOSE WITH ADULT CHILDREN)
...Help out with money.
Does your grown child/children help you in any of the following ways? (Go through list.)
...Help out when someone is ill.
Parents
Is one or both of your parents still living? (IF NEITHER ARE, SKIP TO SIBLINGS)
Does your (mother, father, mother or father) live in the {NAME OF COMMUNITY} area?
Do you see your (mother, father, mother or father) at least once a week?
Do you talk on the phone or correspond with your (mother, father, mother or father) at least once a week?
Thinking about your overall relationship with your (mother, father, parents), would you say you are very close, close, less than close, or distant?
Do you help out your parents in any of the following ways? (Go through list.)
...Help out when someone is ill.
Do your parents help you out in any of the following ways? (Go through list.)
...Help out when someone is ill.
Siblings
How many living brothers and sisters do you have? (IF NONE, SKIP TO OTHER RELATIVES)
How many of them (Does he or she) live in the {NAME OF COMMUNITY} area?
How many of them do you feel very close to?
Other Relativews
Besides your parents, siblings and children, how many other relatives do you have that you feel close to? (IF NONE, SKIP TO FRINEDS)
Of these close relatives, how many live in the {NAME OF COMMUNITY} area?
How many of these relatives do you see at least once a month?
How many of these relatives do you correspond with, either by letter or telephone, a few times a year?
Friends
How many close friends do you have? These are people that you feel at ease with, can talk to about private matters, and can call on for help. (IF NONE SKIP SECTION)
How many of these friends live in the {NAME OF COMMUNITY} area?
How many of your close friends do you see at least once a month?
How many of these friends do you exchange letters or telephone calls with a few times per year?
Would you say that all of your friends know each other, that most of them know each other, that some of them know each other, or that few of them do? (Accept "none".)
Do you have any personal friends that you would describe as community leaders?
If you were looking for work, how willing do you think your friends would be to give you job leads? Do you think they would be very willing, somewhat willing, only a little willing, or not willing at all?
FOLLOW-UP: and how helpful do you think these leads from friends would be?
How willing are your friends to give you advise on finances and business? Very willing, somewhat willing, only a little willing, or not willing at all?
FOLLOW-UP: and how helpful is this advice? Very helpful, somewhat helpful, only a little helpful, or not helpful at all?
Race and Friendship
* Of the people you count as good friends -- that is adults that you either get together with frequently or, if they live elsewhere, that you try to keep in close touch with -- how many are a different race than you?
(IF NONE, SKIP FOLLOWUP)
Thinking now of the closest friend you have of a different race, how do you know this person? [Pre-codes: through work, through mutual friends, through family members (including in-laws), through marriage (spouse), as neighbors]
Personal Support Summary Questions*
* Can you count on anyone to provide you with emotional support? (Someone you could talk over problems with or who could help you make a difficult decision.) (IF NO, SKIP NEXT QUESTION)
* In the past twelve months, who has been most helpful in providing you with emotional support? (DO NOT PROMPT) [PRECODES: spouse, daughter, son, sibling, other relative, neighbors, coworkers, church members, clergy, club members, professionals, other friends, no one]
* When you need some extra help financially, can you count on anyone to help you? (To pay a bill or the rent, or to provide clothes or food.)
* In the past twelve months, who has been most helpful in offering you financial assistance? (DO NOT PROMPT) [PRECODES: have not needed help, spouse, daughter, son, sibling, other relative, neighbors, coworkers, church members, clergy, club members, professionals, other friends, no one (SEEK CLARIFICATION)]
School Block [for Respondents with school aged children]
On average, how many nights per week do you have dinner at home with your children?
Let's talk a moment about your child's/children's school. Would you say you know most of your child's/children's teachers by name?
During the past school year [ALTER DEPENDING ON SURVEY TIMING], did you attend any school open houses or meet some of your child's/children's teachers privately?
During the past school year, did you attend any school events, like a play, concert, or sporting event?
During the past school year, did you go to any other school-related public meetings?
Overall, how much impact do you think people like you can have in making the schools better: no impact at all, a small impact, a moderate impact, or a big impact?
Sociability, neighborhood, and other civic activities
This next sequence of questions gets at a variety of civic and social activities with a repetitive format question. (It is drawn from a commercial survey.) Some version of this question form drawing on various sub-elements asked is highly recommended.*
Now, I'm going to ask you some questions about things you may have done in the past twelve months. For each of these items, I want you just to give me your best guess, don't worry that you might be off a little.
How many times in the past twelve months have you gone to the movies?
(How many times in the past twelve months have you) attended any public meeting at which a local issue was discussed? [in civic leadership dimension - see 10 dimensions of social capital]
| ||||