问卷法 Questionnaire ppt

1、2021/3/91QuestionnaireDuan LifuDuan Lifu2013.12.162013.12.162021/3/92Content:1. Definition2. A brief description3. The main parts of a questionnaire4. The design of questionnaire5. Scaling techniques6. Selecting subjects7. Administering the questionnaire2021/3/931. DefinitionQuestionnaires are any w

2、ritten instruments that present respondents with a series of questions or statements to which they are to react either by writing or their answers or selecting from among existing answers. Brown, 2001:6 2021/3/94The term “questionnaire” refers to an instrument for the collection of data, usually in

3、written form, consisting of open/closed questions and other probes requiring a response from subjects. Nunan, 2002: 231 2021/3/95 A survey study usually involves a relatively large sample and is descriptive in nature. It either describes the features of a few variables or the relation between two or

4、 more variables.A survey study may be cross-sectional, when data are collected from different people at the same point in time; it may be longitudinal , when data are collected from the same group of people at different points over a period of time.2. A brief description2. A brief description2021/3/

5、963. The main parts of a questionnaireTitleInstruction : Instructions are of two types: - general instruction at the beginning of the questionnaire - specific instructions introducing each new task(3) Questionnaire items(4) Additional information(5) Final “thank you”2021/3/974. The design of questio

6、nnaireThe design of questionnaire4.1 Criteria for a good questionnaire:(1) Having high internal validityBy saying a questionnaire should have high internal validity means that items in the questionnaire must measure the variables you really want to investigate. But some researchers might fail to mee

7、t the criteria because of lack of skills or experience. Actually, having low internal validity is a common flaw occurring in a questionnaire constructed by a novice researcher2021/3/98A MA student wanted to investigate students degree of anxiety in speaking L2, the following three items were part of

8、 her questionnaire:I try to avoid answering questions in class.I try sit in the corner of the classroom so that I will not be asked questions frequently by the teacher.(1) I do not like to speak in the public.2021/3/994.2 Taking a professional outlookHow a questionnaire looks can affect the attitude

9、 of the respondents which in turn influence the quality of their response.You should avoid clipping or stating papers together if a questionnaire contains more than 5 pages.One question should not be printed across two page.You should avoid crowing questions together to make the questionnaire looks

10、shorter.(1) The paper for printing should be of high quality and the printing itself must be clear and easy to read.2021/3/9104.3 The process of designing a questionnaireSelecting the mode of administration.Specifying what kind of data you intend to collect.Determining the way you process the questi

11、onnaire data. Deciding on the content of individual item. Choosing questions structure.Determining the order of questions.Deciding the format of the questionnaire.Conducting a pilot study to test the questionnaire.(1) 2021/3/911(1) Selecting the mode of administration. Two common models:By person: A

12、 group of subjects usually answer the same questionnaire together. The organizer gives the respondents instructions on how to respond to the questionnaire and clarifications if there are any ambiguous items. The organizer can also check whether the respondents has responded to all the items and thus

13、 the rate of data can be greatly reduced.2021/3/912By mail:If the respondents are spread out in different cities or even in different countries what you can do is to mail the questionnaire to the target people.Researchers cannot control the overall response rate of missing items. Even if a questionn

14、aire is returned ,s/he cannot be sure that questionnaire is filled out by the people s/he expected and under which circumstances the questionnaire is completed.2021/3/913(2) Specifying what kind of data you intend to collect.At this stage, you have to understand what kind of data you really want to

15、collect. There are five type of information.Experience/behaviour (what a respondent does)Opinion (what a respondent thinks)Feeling (what a respondent feels)Knowledge/abilities (what a respondent knows and what is he able to do)Background (such as date of birth, age, gender, martial status)2021/3/914

16、Novice researchers cannot clearly differentiate belief items from behavior items.The structure of belief item is “I think/ believe that”I think learning an L2 well requires painstaking effort is to find out the respondents opinion or view rather than behavior.I put a lot of effort into learning an L

17、2 is to investigate students behavior rather than the view.2021/3/915(3) Determining the way you process the questionnaire data. Individual- item-based (单个题目问卷)If the basic unit in the data analysis is an individual item, such as describing frequency and the mean of one isolate item, then such a que

18、stionnaire is called individual- item-based.The construction of such a questionnaire is comparatively simple and easy because it does not involve setting up conceptual categories. However, this kind of questionnaire has very limited value because its results are less generalizable.2021/3/916If the d

19、ata-analysis is to be on categories , each of which contains a few questionnaire items, you must established either by a top-down approach or by a bottom-up approach.By top-down approach you construct conceptual categories based on logical arguments or exsisting theories theories before you design s

20、pecific items.By bottom-up approach, you simply write down whatever items occur in your mind. You then classify these items into categories.2021/3/917(4) Deciding on the content of individual item. If a questionnaire is intended to contain several categories , you have to consider whether the items

21、designed cover all the categories and whether each categories contains an adequate number of items. For example:Categories nameItem No.Form-focused belief2,4,5,7,9Meaning-focused belief1,3,6,8,10Form-focused strategies11,13,16,18,20Meaning-focused strategies12,14,15,17,192021/3/918To avoid poorly- w

22、orded questions, the following are some of the suggestions made by Malhotra(1993) and Bernard(1994).Use ordinary wordsAvoid leading questionsUsing dual statements: positive and negativeBeing caution in translation2021/3/9192021/3/920(5) Choosing questions structure.There are two types of questions:

23、open-ended questions or unstructured questions.Open-ended questions refers to those whose answers are in the respondents own words and are difficult to predict. And these questions are always begin with “wh-”. In fact, this type of question is typically used to collect qualitative data.2021/3/921In

24、closed-questions or structured questions, the researcher provides respondents with a set of response alternatives. In other words, the respondents have to select one response out of the alternatives provided. They do not have the freedom to use their own words to express their response. The closed-q

25、uestions may be multiple-choice, dichotomous or a scale.2021/3/922a. Multiple-choice: the researchers offers a set of answers and respondents is expected to choose one or more alternatives given.b. Dichotomous questions: it has only two alternatives to choose.c. Scales: a scale is continuum upon whi

26、ch a set of alternative choices are placed. For example:Do you guess the meaning of the new words when reading English novels for pleasure?Never Occasionally sometimes often very often 1 2 3 4 52021/3/923(6) Determining the order of questions.Background information firstGeneral questions before spec

27、ific questions(7) Deciding the format of the questionnaire.Before you print out questionnaire, you need to decide the format ,space and the position of the question. Research find that questions place at the top receive more attention than the bottom.(8) Conducting a pilot study to test the question

28、naire.A pilot study is one in which a questionnaire is tested on a small sample of respondents to detect and overcome potential problems.2021/3/9245. Scaling techniquesScaling techniquesComparativeNoncomparativePaired comparisonRank orderSemanticdifferentialLikert2021/3/925Paired comparison scaling:

29、 as its name suggests, only offers two choices to be the respondent who is asked to compare them according to some criterion.When you speak English, which of the following two aspects do you pay more attention to?(1) Accuracy (2) Fluency2021/3/926Rank order scalingDifferent from paired comparison, r

30、ank order scaling expects respondents to order or rank more than two choices with the reference to some certain criterion.When do you want to pay more efforts into learning English?When I get higher scores on the English test.When I was praised by my English teacher in class.(1) When I obtain a priz

31、e in an English speaking competion.2021/3/927Semantic differential scaleThe semantic differential scale is a five-point or seven-point rating scale with end points associated with bipolar labels that have the opposite semantic meaning. The subject mark the blank that best indicates their views or be

32、haviors.(1) How much do your parents encourage you to study English?Not at all _ ; _ ; _ ; _ ; _ ; _ ; _ ; Very much(2) How do you think of Enngish?Interesting _ ;_ : _ ; _ : _ ; _ ; _ ; Boring 2021/3/928One things that has to be emphasized here is that the negative adjectives or phrases sometimes a

33、ppear at the left side of the scale and sometimes at the right. This controls the tendency of some subjects particularly those with very positive or very negative attitudes, making the right- or left-hand side without reading the labels.2021/3/929The subjects were asked to evaluate their reasons for

34、 learning English on a four point-scale.1 = not important2 = somewhat important3 = important4 = very importantIt is called a Likert scale and it was first introduced by Rensis Likert.2021/3/930To conduct the analysis, each response is assigned a numerical score, ranging from 1 to 4. When we use this

35、 approach to determine the total score for each subject, it is important to use a consistent scoring procedure so that a high (or low) score consistently reflects a favorable response. This requires that the numerical value assigned to the negative statement by the subjects be scored by reversing th

36、e value. Note for a negative statement, an agreement reflects an unfavorable response, whereas for a positive statement, reflects a favorable response. Accordingly, a “strong disagree” to a negative statement would both receive the same score.2021/3/9316. Selecting subjects6. Selecting subjects“You

37、cannot study everyone anywhere doing everything ” Miles and Huberman,1994: 27The common practice is to select a sample from the population to study, hoping the findings from the sample can be applied to the whole.2021/3/9326.1 Random sampling techniquesThere are three basic random sampling technique

38、s: simple random sampling, systematic random sampling and stratified random sampling. (1) Simple random samplingIt is the basic for the other two. By a Simple random sampling, each unit is numbered from 1 to N (the size of population). Next, a table of random number is used to select n items to the

39、sample.2021/3/9332021/3/934(2) systematic random sampling If the population is large but the intended sample size is small, simple random sampling is not suitable because the sample selected might not be evenly distributed among the population. It can make sure that the subjects selected are evenly

40、spread out among the population, and we need to know the interval. Interval = the total number of the population/the size of the sampleIf the interval happens to be number with a decimal, you need to round it off into a whole number. 29.4-29 29.5-302021/3/935Suppose that the total number of a popula

41、tion consists of 900 students and you would like to select 30 students out of them as a random sample.The interval is 900/30=30The first number is 915900 (No)The second 674 (OK)The third 674+30674,704,734,764,794,824,854,884,914-9002021/3/936(3) Stratified random samplingFor example: 900 students, 30 female.a. You want to get a sample of 30 students in which male and female are balanced. If we use