大学英语教改口语考试课件(课堂PPT)

1、1,大学英语教改口语考试,中国科学技术大学 李萌涛,2,大学英语教改口语考试,一、大学英语教改和口语考试 二、口语考试数据及分析 三、口语试题库 四、口语试题库的信度和效度研究 五、口语评分标准,3,一、大学英语教改和口语考试,大学英语改革 改革的目标是要全面提高大学生的英语综合实用能力，特别是强化听说能力。 利用英语口语考试的反驳效应 ，促进口语教学。 学生基数太大，采用口语考试系统实施大规模的口语测试成为可能。,4,中国科学技术大学04级网络多媒体英语教改试点班英语口语考试现场,5,二、口语考试数据及分析 2004年10月，中国科学技术大学2004级英语教学改革试点班学生英语口语摸底考试，

2、实考517人。 2005年1月，中国科学技术大学2004级全体本科生英语口语期末考试，实考1815人。 2005年6月，中国科学技术大学2004级全体本科生英语口语期末考试，实考1798人。 2005年12月 1813人 2006年6月 1798人 2007年1月 3707人（二个年级）,6,1. 对05、06级学生进行问卷调查 05级90名学生，06级89名学生 各有51.1、77.5的学生选择重视口语机考 各有53.3、49.2的学生支持采用机考 06级学生有67.2的学生认为，机考能体现其口语水平的60-80,7,2. 对教师的问卷调查数据分析,收回14份老师问卷 13位老师支持机考，认

3、为能反映出学生口语水平 92.9%的老师认为，用机考成绩来解释学生口语能力的可信赖程度达到7090% 对照机考口语成绩与期末笔试成绩，有70-80的相关度,8,三、口语试题库,四所院校共同编写： 中国科技大学 复旦大学 苏州大学 西南交通大学,9,多种题型、与教材配套、内容丰富的英语口语试题库 系统支持文本、图形、语音和视频等多种媒体，具有主题和级别等试题指标。 试题由多所高校优秀英语教师和测试专家开发。,10,口语试题库的定位,学业考试(Performance Test), 所测即所学。 主题式(topic-based)，有近似主题，难度、要求不同。 综合听说教材里所涉及的主题。 涵盖全新版

4、和修订版所有主题。 部分题型模拟四、六级口语考试形式。,11,口语考试题型,目前有7个题型，Reading aloud用于Band 1-2。每套题至少要包括以下45个题型。 Reading aloud Listening and speaking Questions and answers Comment on English sayings and quotations Describing pictures Talking about movies Group discussion,12,Group Discussion,Part 4 Discussion 5 minutes, 20 po

5、ints Each group is composed of three students Student A, Student B and Student C. Topic: UFOs are alien spacecraft from outer space,13,The UFO phenomenon may have existed for over a half-century and UFO sightings are becoming more and more frequent around the world. Some people think these objects a

6、re alien spacecraft, although there is no conclusive evidence yet. There is no doubt that unidentified flying objects in the sky do exist. But the question is what are they? Are UFOs alien spacecraft from other planets?,14,You will have about 5 minutes to discuss on this topic. Each person can only

7、talk for one minute at a time. During the discussion, you may voice your opinion, argue with each other, or ask somebody to clarify his or her points. Your performance will be judged according to your contribution to the discussion.,15,Hints: Numerous UFO photos in the world can show UFOs are alien

8、spacecraft. Many planets outside the solar system are similar to the Earth. So there is a possibility that aliens do exist. Nearly all photographs are blurry and many have been proved to be forgeries. There is no evidence of intelligent aliens living anywhere in our solar system or in outer space. 准

9、备时间：20 seconds 答题时间：60 seconds,16,2006.2.完成第一批48套试卷，即每一级配12套试卷，每年淘汰2套，并可升级更新。 2007.2.完成第二批48套试卷，即每一级配12套试卷，每年淘汰2套，并可升级更新。 可以自由组建试题 可以增减考试内容,17,四、口语试题库的信度和效度研究,为什么要口语考试？ Assign grades Improve instruction Motivate students to work Provide feedback to students,18,如何进行口语考试？ Testing Objective Subjective

10、Formative Summative,19,Formative Testing,Using measurement tools to conduct evaluation for the purpose of improving student performance Student receives feedback of results Teacher considers results in planning subsequent instruction Grades are not recorded!,20,Summative Testing,Using measurement to

11、ols to conduct evaluation for the purpose of assigning student grades Student receives feedback of results Teacher considers results in planning subsequent instruction Grades are recorded,21,口语试题库分级,分为四级，对应教学内容 难度控制 参照课本难度 参照国内外口语考试难度 确定难度上限，略高于四、六级口语考试难度 依据教学实践、课堂口语活动,22,合作研究口语试题库和考试系统,与国内大学和机构合作（出

12、版社、讯飞） 与国外大学合作Bath University (UK) 对比研究，机考vs面试 试题库科学分级、信度、效度等研究 人机交互研究，智能（半智能）阅卷 学生在机考时的心理变化研究,23,五、口语评分标准,准则参考性口试（criterion-referenced oral test) 常模参考性口试（norm-referenced oral test),24,Criterion-Referenced Test,Measures student performance against predetermined standards Student meets or does not me

13、et the standard Competition is between the student and the skill, knowledge, or ability Grade is based on accomplishment Everybody can earn a passing grade if they meet the standard,25,Norm Referenced Test,Make test intentionally difficult Average score should be about 50% Strong students should ten

14、d to score high and weak students should tend to score low Award As for highest scores, Fs for lowest scores, Cs for average scores,26,Characteristics of a Test,Validity Reliability Objectivity Discrimination (applies to norm-referenced test only) Comprehensiveness Score-Ability,27,Validity,A valid

15、test measures: what it is intended to measure what the teacher intended for the students to learn what the teacher actually taught A valid test is FAIR,28,Questions about Validity,Does the test actually measure what you intend it to measure? Did you teach the content and skills that are being tested

16、? Does the test require the student to know or do something other than what you intended and/or taught? Does some aspect of the test prevent the student who may know the material from responding correctly?,29,Reliability,A reliable test provides accurate and consistent results Test reliability can b

17、e viewed from two perspectives: Student reliability Scorer reliability,30,Student Reliability,Test items are readable and clear Instructions are simple and unambiguous Responses test only knowledge of the subject matter and not test wiseness, reading ability, or other unrelated trait,31,Scorer Relia

18、bility,Items can be scored consistently Same scorer would produce similar results on repeated evaluations Different scorers would produce similar results if working independently,32,Objectivity,Objectively written items are reliable items are valid Objectively administered Objectively Scored,33,Disc

19、rimination,Important ONLY for norm-referenced testing Test separates more knowledgeable students from less knowledgeable students Discriminating test is intended to reward best students and punish weakest students Ideal for using normal curve to interpret score,34,Normal distribution,On most measures of human behavior, graphing individual results will res