大规模英语考试作文评分信度与网上阅卷实证研究

图书标准信息

• 作者 王跃武 著
• 出版社 上海外语教育出版社
• 出版时间 2015-07
• 版次 1
• ISBN 9787544639842
• 定价 37.00元
• 装帧 平装
• 开本 32开
• 纸张 胶版纸
• 页数 359页
• 字数 354千字
• 正文语种 简体中文，英语
• 丛书 外教社博学文库

【内容简介】

　　《大规模英语考试作文评分信度与网上阅卷实证研究》绍有关大规模英语考试作文网上阅卷的研究成果，内容涉及作文网上阅卷过程的各个环节、与作文网上阅卷有关的阅卷员心理决策过程、作文评分过程中的认知作用、网上阅卷模型、计算机自动评分以及网上阅卷系统的设计开发与试用。实证研究发现，网上阅卷能确保随机分配作文卷，能加强阅卷过程的质量监控，而且阅卷员之间的评分一致性、阅卷员个人一致性和评分正确性都较高。研究结果证明，网上阅卷有利于提高阅卷信度和阅卷效率。

【目录】

Chapter1Introduction
1.1Rationaleforthestudy
1.2Objectivesofthestudy
1.3Organizationofthethesis
1.4Definitionofterms
1.4.1Online
1.4.2Marking
1.4.3Onlinemarking
1.4.4OnlineMarkingSystem（OMS）
1.4.5LocalAreaNetwork（LAN）

Chapter2ResearchQuestionsandMethodologyoftheStudy
Chapter3IssuesintheDirectTestingofEFL/ESL
WritingAbility
3.1Introduction
3.2Whatisadirectwritingtest?.
3.3EFL/ESLwritingability:Whatshallwetest?
3.4Issuesinvalidity
3.4.1Whatisvalidity?
3.4.2Typesofvalidity
3.5Issuesinreliability
3.5.1Whatisreliability?
3.5.2Methodsofjudgingreliabilityofwritingassessments
3.6Therelationshipbetweenvalidityandreliability
3.7Fourcomponentsofadirectwritingtest
3.7.1Thetask
3.7.2Thewriter
3.7.3Thescoringprocedure
3.7.4Therater
3.8Washback
3.8.1Washbackingeneral
3.8.2Washbackofdirecttestsofwriting
3.9Practicality
3.10Summary

Chapter4TheCETWritingTest
4.1Introduction
4.2ThewritingtestrequiredbytheCET
4.2.1Adirecttest
4.2.2Positivewashback
4.3ThescoringofCETcompositions
4.3.1Thescoringapproachcurrentlyadopted
4.3.2ProceduresinvolvedinscoringCETessays
4.3.2.1ScoringPrinciplesandMarkingScheme
4.3.2.2Range-findersandsampleessays
4.3.2.3Ratertraining
4.3.2.4Ratingprocess
4.3.2.5Monitoringraters'scoringduringthescoringsessions
4.3.2.6Recordingessayscores
4.4Computer-aidedadjustmentofwritingscores
4.5Discussion

Chapter5TheFirstExperimentalStudy
5.1Introduction
5，2Compositions
5.3Participants
5.4Datacollectionprocedure
5.5Theintrospectionandretrospectionstudies
5.5.1Introduction
5.5.2Dataelicitation
5.5.3Tapetranscription
5.5.4Dataanalysis
5.6Thequestionnairestudies
5.6.1Designofthequestionnaires
5.6.2Analysisofquestionnaireresponses
5.7Findingsfromtheintrospection，retrospectionandquestionnairestudies
5.7.1IssuesandproblemsinratingCETessaysonline
5.7.2Decision-makingbehaviorswhileratingCET-4essays.
5.7.3Summaryofcommentsmadebytheratersonessays
5.7.3.1Overallsummary
5.7.3.2Variationsinraters'comments
5.7.4Essayelements'influencesonraters'decision-making.
5.7.5ElementsofgoodCETessaysintheraters'eyes
5.8Analysisofwritingscores
5.9Summaryanddiscussion
5.9.1Abouttheissuesandproblemsinvolved
5.9.2Abouttheraters'scoringdecisions
5.9.3Aboutthewritingscores

Chapter6TheSecondExperimentalStudy
6.1Introduction
6.2Compositions
6.3Participants
6.4Datacollectionprocedure
6.5Problemsencountered
6.6Dataanalysis
6.7Results
6.8Summary

Chapter7DesignoftheOMS
7.1Introduction
7.2Literaturereviewononlinemarkingofcompositions
7.2.1Automatedscoringofessays
7.2.1.lOverviewoffourmajorautomatedscoringmethods
7.2.1.2Analysisofthefourmajorautomatedscoringmethods
7.2.1.3Summary
7.2.2Onlinescoringofessaysbyhumanraters
7.2.2.1Overviewofonlinescoringofessaysbyhumanraters
7.2.2.2Empiricalresearchononlinescoringofessaysbyhumanraters
7.2.2.3Summary
7.3Apreliminarymodelofmarkingessaysonline
7.4OverviewoftheCETOnlineMarkingSystem（OMS）
7.4.1Thedatamanagementmodule
7.4.l.1Basicinformationmanagement
7.4.1.2Essaymanagement
7.4.1.3Searchandreport
7.4.2Thetrainingmodule
7.4.3Theratingmodule
7.4.4Themonitoringmodule
7.5OperationoftheOMSandtheraterinterface
7.5.1OverviewoftheoperationoftheOMS
7.5.2TheOMSraterinterface
7.6MainfeaturesoftheCEI-OMS
7.6.1Randomdistributionofscripts
7.6.2Efficientscorerecording
7.6.3Onlinereal-timemonitoringofscoring
7.6.4Qualitycontrolofraters
7.6.4.1AdherencetotheCETScoringPrinciplesandMarkingScheme
7.6.4.2Ratertraining
7.6.4.2.1Compulsorytraining
7.6.4.2.2Individualrater'sselftraining
7.6.4.2.3Forcedtraining
7.6.4.3Onlinediscussion
7.6.4.4Back-readingandscorerevising
7.6.4.5Timecontrol
7.7AdvantagesoftheCE-IOMS
7.7.1Realandefficientrandomdistributionofscriptsatthenationallevel
7.7.2Real-timeonlinemonitoringofraters
7.7.3Assuredqualitycontrolofscoring
7.7.4Overallefficiency
7.7.5Efficientandeconomicalstorageofscripts
7.7.6Expressretrievalofscriptsandscores
7.7.7Efficientmanagementandpotentialutilizationoftestdataforresearch
7.8Limitationsofonlinescoringandsolutions
7.9Summary

Chapter8TheThirdExperimentalStudy
8.1Contextoftheexperiment
8.2Participants
8.3Compositions
8.4Datacollection
8.4.1Step1:Onlinemarking
8.4.1.lThefirstroundordmemarking
8.4.1.2ThesecondroundonlLnemarkLng
8.4.2Step2:Conferencemarking
8.5Dataanalysis
8.6Results
8.7Summaryanddiscussion

Chapter9DataAnalysisUsingFACETS
9.1FACETSandmethod
9.2Thefirstapproach:comparisonofraterseverityandconsistencyfromtheonlinesettingandtheconferencesetting
9.2.1Raterseverityandconsistency:theonlinesetting
9.2.1.1Raterseverity:theonlinesetting
9.2.1.2Raterconsistency:theonlinesetting
9.2.2Raterseverityandconsistency:theconferencesetting
9.2.2.1Raterseverity:theconferencesetting
9.2.2.2Raterconsistency:theconferencesetting
9.2.3Comparisonofraterseverityandconsistencyintwosettings
9.2.4Comparisonofraterseveritychangebetweentwosettings
9.3Thesecondapproach:biasanalysis
9.3.1Biasanalysis:raterbyessayinteractions
9.3.2Biasanalysis:raterbysettinginteractions
9.4Conclusion
9.5Discussion

Chapter10Summaries，Discussions，ImplicationsandRecommendations
10.1ArefinedmodelofonlinescoringofCETessaysanditsmainfeatures
10.2Benefitsproceedingfromonlinescoring
10.3Practicality
10.4Scoringquality
10.5Raters'comments
10.6SuggestionsfortheimprovementoftheOnlineMarkingSystem
10.7Implicationsforotherwritingtests
10.8Suggestionsandrecommendationsforfutureresearch
10.8.1Suggestionsforfutureresearchinonlinemarkingofcompositions
10.8.2RecommendationsforfutureresearchinEFLwritingassessment
10.9Theoreticalandpracticalsignificanceofthestudy
References
Appendices
后记