UNSTRUCTURED INDIVIDUAL INTERVIEWING

Anitra Rustemeyer Streett, U.S. Department of Energy

Introduction were they covered by insurance, other family members, charity, etc.? Sometimes a designer is required to develop a questionnaire on a Since household fires are fairly rare topic which he knows little about, and events in the general population, some about which little information related of the households selected for the to questionnaire design exists from unstructured were chosen from previous surveys. In this situation, fire department records, so that between the development of a questionnaire can one-third and one-half were known to benefit from the use of "unstructured" have reported a fire within the pre- interviews with members of the intended ceding 6 to 9 months. The other respondent universe. The term households were selected from "unstructured " is used here to address lists; to reduce the amount of describe a discussion of the proposed driving done by interviewers, addresses topics between a member of the were chosen that were within 2 or 3 target survey population and the blocks of the households identified questionnaire designer, which is guided in the records of a fire department. by a topic outline rather than a set of Interviewers were not told which specific questions. When sufficient households had reported a fire to the numbers of such interviews are conducted fire department. with a set of respondents who are fairly representative of the target population, The team leader was a senior member the technique can provide ideas and of the survey methods group; insights about how best to structure the others on the interviewing team were questionnaire before the first draft is junior professionals from the research written. and operations offices who would work on the final survey. The team of 5 worked The following example provides an singly and in pairs and, with permission overview of the technique. In 1973 the of the respondents, tape recorded some Bureau of the Census (where the author interviews. was then employed) was asked to deter- mine the incidence and characteristics The team began with a list of topics of household fires in the United States. to be covered and a thorough briefing on It was decided that a few "screener" and discussion of the survey objectives. questions should be added to the They met daily to share with each other (monthly) Current Population Survey to what they had learned. Each interviewer determine if a fire had occurred in the conducted about 4 interviews per day for household within the preceding few 5 days. They met together with the team months. If a fire had occurred, a leader each morning to discuss new separate questionnaire would be ideas. administered to gather more detailed information, including extent of damage, After 3 days patterns of questioning death or injury to household members, respondents had developed and these were and financial loss attributable to the discussed. At the end of 5 days of fire. unstructured interviewing it was fiarly easy to draft a questionnaire that could The study directors and sponsors be endorsed by all team members as agreed to unstructured field inter- suitable to meet the study objectives views as a means of drafting a ques- and workable with respondents. A tionnaire, because they needed definition of a fire was developed which answers to several questions, includ- included short lists of things to ing what definition of fire should be include and exclude. The questionnaire used, and whether or not people would developed in this process was used later call things like the following a fire: in an informal test and was judged to a grease fire while cooking, a smolder- work very well. ing mattress caused by a cigarette, a small fire ignited by a child, a fire in Personnel and Skill Requirements an automobile engine, and a chimney fire. They also wanted to know if it would be A key concept in the successful use feasible to ask questions about injuries, of unstructured interviewing is flexi- loss of life, and whether or not the fire bility. The questionnaire designer was caused by carelessness. Another area functions as a researcher during this of uncertainty dealt with economic loss process, and must keep the objectives of and who paid to restore the damage: did the study firmly in mind, while dis- people know the dollar value of the missing any fixed ideas about how to losses due to fire and to what extent structure the questionnaire.

661 Best results are achieved when rather than systematic . several people work together as a team. Although rigorous scientific selection The team should include interviewers as procedures are not necessary, respon- well as data processing and subject dents should be members of the popula- matter specialists. This allows diverse tion to be surveyed and should be fairly ideas and insights to be used in the representative of that population. refinement of the survey instrument. The characteristics of people asked to Persons selected to conduct be respondents for unstructured unstructured interviews should have interviews may depend on the survey interviewing experience and be capable topic. For example, in developing a of understanding the broad perspective questionnaire dealing with saving habits of the research project for which the to be administered to a national cross- questionnaire will be designed. This sectional , the initial round of type of interviewing requires skills developmental work may include inter- different from those for structured views with people from a variety of interviewing (i.e., interviewing in demographic population subgroups. which questions are read verbatim from a During additional interviews, however, questionnaire), and only some inter- different classifications of savings viewers on a regular field staff are habits may emerge, and it may be likely to possess those skills. necessary to locate and interview persons who are members of specific Interviewers selected for this type categories. Thus, the "sampling" of of assignment should feel comfortable respondents is an iterative process "thinking on their feet" as they will too--as is the questioning of those not have a questionnaire script to use respondents. In some cases, respondents as a crutch; if they are easily may be located by contacting community flustered or confused, they may give or business organizations, or by respondents the impression that they are selecting residential areas. incompetent or that the study is unimportant. Members of the inter- The Interviewing Process viewing team need sufficient experience in unsturctured interviewing to be Interviewers may begin each interview sensitive to the effects of wording by explaining that they are working on a changesand to recognize responses that very early phase of preparing a new indicate potential problems with survey. They should emphasize the question wording or order. In addition, reasons for and importance of talking to interviewers should be able to tolerate people before a questionnaire is long pauses while the respondent thinks prepared. or looks for answers, have the ability to probe nondirectively in order to get In unstructured interviewing, the the respondent's ideas, and have a interviewer should follow up on answers thorough understanding of potential or comments that seem to have a bearing problems in questionnaire design which on how a concept is interpreted by the can affect the achievement of the survey respondent or how a sequence of ques- objectives. tions should be ordered. The interview should have a conversational flavor Unstructured interviewing is actually rather than the question-and-answer a combined and analysis format of a formal interview. Inter- process. In addition to the inter- viewers should understand that their viewing skill necessary for successful objective is not to collect data in the results, a "coder," who is capable of usual sense--rather it is to become making independent judgments, is an aware of any difficulties that are essential part of the process. This likely to arise when the survey is person should be able to analyze and conducted. tabulate results of the previous day's work while the interviewers are in the During each unstructured interview, field conducting additional interviews the interviewer should record how each and then meet with them to explain how key inquiry was phrased, as well as the they are failing to meet survey objec- wording used by the repondent in tives. The simultaneous conduct of answering the question. The interviewer these two tasks speeds up the question- should record what effect topic order naire development process. Subject had on the flow of the interview, the matter specialists can provide valuable respondent's reaction to specific insights at the frequent meetings of the questions of interest, and the apparent team. level of difficulty of the inquiry for the respondent. Selection of Respondents Tape recording, with the respondent's Respondent selection for unstructured permission, can be useful as long as interviews generally involves purposive

662 time is available to listen to the tapes otherwise be the case, because the and to extract information from them. knowledge gained from the unstructured interviews can be quickly incorporated As experience using the topic outline into the questionnaire. is gained, interviewers will develop their preferred question wording for Cost Requirements topics. They should exchange those wordings during their meetings and then The monetary costs associated with try the wordings used by others in the use of unstructured interviews are successive iterations of interviewing. essentially limited to the salaries of the personnel who are members of the The input of the coder is beneficial team. Depending on the number of people in noting ambiguities or superficiality involved as team members, the number of in the responses obtained in previous interviews conducted, and the amount of interviews which require further time spent in analyzing the interviews, clarification before the response can be these costs could vary considerably. In coded. Also, the relative frequency of addition, other expenditures may be responses to open-ended questions, the necessary for travels if the inter- range of conditions imposed by respon- viewing site is not located near the dents on their answers (e.g., "it duty station of the people working on depends on . . ."), and potential the project. response sets can be obtained from the coder's tallies. The coder's analyses One other cost should be mentioned and the interviewers' annotated here. The "burden on the public" in transcripts are discussed among team terms of interviewing time may be members, patterns are identified, and greater than if no field work is done suggestions are made concerning prior to drafting the questionnaire. potential question formatting, However, this investment of time during sequencing, etc. the development phase may be more than repaid later if the unstructured inter- There is no set number of unstruc- viewing results in a more efficient tured interviews that is best, nor does questionnaire. 5 days of unstructured interviewing guarantee a good questionnaire. Perhaps Uses of Unstructured Interviewing the best indicator that enough unstruc- tured interviewing has been done is the Regardless of whether the final lack of new insights and ideas on survey will be conducted face-to-face, question order and wording by team on the telephone, or by mail, the use of members. unstructured face-to-face interviewing can provide valuable insights on how Time Requirements people respond to the topics of the survey. Benefits accruing from estab- The process outlined here may take lishing the relevance of specific topics longer to complete than will drafting a to the survey objectives, defining key questionnaire without any field work. concepts, and identifying words which On the other hand, to the extent that it have similar meaning for all types of reduces bickering among participating respondents will be equally pertinent interests or groups, it may shorten the for surveys conducted through any time spent on questionnaire design. The method. exact amount of time involved depends on the amount of personnel who are avail- Some of the other insights gained able to conduct interviews, and the through use of this technique, such as number of iterations of the topic the specification of question order, may outline, question wordings, etc., which be unique to the mode in which the data are required before members of the are collected. If the final survey is questionnaire design team are confident intended to be conducted exclusively on to go on and construct a questionnaire. the telephone, unstructured telephone interviewing could conceivably be In general, when the use of unstruc- conducted. tured interviews is incorporated into the development process of a question- Several questionnaire design issues naire, 2 to 8 weeks should be allowed in can be addressed through the employment the time schedule. This includes the of this technique. The specific uses of preparation time for the team leader as unstructured interviewing include the well as the interviewing time itself. following: It does not include completion of the initial questionnaire draft, which would o Topics previously thought to be be required regardless of whether or important for inclusion can be discarded not this technique is used. However, as unnecessary or irrelevant, and topics drafting the questionnaire should be which had previously been neglected can much less time-consuming than would

663 be identified as important in fulfilling range of answer categories for closed- the objectives of the survey. ended questions can be specified.

o A determination can be made of o An identification can be made whether or not the information requested concerning who in a household or in the survey is readily available to business is typically in a position to respondents, and whether or not respond most accurately to questions on particular kinds of questions can be the survey topics. asked. o Suggestions can be made concerning o An evaluation can be made of which the optimal order of survey topics and topics might be especially sensitive to questions. respondents. Conclusion o Assistance can be provided in determining how to word particular Although this description of unstruc- questions so that the vocabulary is tured interviewing has been in the familiar to respondents and the words context of developing a questionnaire, mean the same thing to all respondents. it can also be a useful tool in evaluating a questionnaire. It has o Decisions can be made to determine several features in common with whether it is preferable to use open- or frame-of-reference probing which is closed-ended questions to obtain described in another paper presented in particular types of information, and a this session.

664