英語教育測量與評價-效度

Topic3ValidityValidityDefinition:Atestissaidtobevalidifitmeasuresaccuratelywhatitisintendedtomeasure.Typesofvalidity:

ContentvalidityCriterion-relatedvalidityConstructvalidityFacevalidity3.1Contentvalidity

Atestissaidtohavecontentvalidityifitscontentconstitutesarepresentativesampleofthelanguageskills,

structures,etc.withwhichitismeanttobeconcerned.Inordertojudgewhetherornotthetesthasacontentvalidity,weneedaspecificationoftheskillsorstructures,ect.thatitismeanttocover.AcomparisonoftestspecificationandtestcontentisthebasisforjudgmentsastocontentvalidityTheimportanceofcontentvalidityFirstly,thegreateratest’scontentvalidity,themorelikelytobeanaccuratemeasureofwhatissupposedtomeasure.Secondly,suchatest,atest-specificationsnotrepresentedatall,islikelytohaveaharmfulbackwasheffect.Areaswhicharenottestedarelikelytobecomeignoredinteachingandleaning.3.2

Criterion—relatedvalidity

(效標(biāo)關(guān)聯(lián)效度)

Definition:ClassificationDefinition:

Anotherapproachtotestvalidityistoseehowfarresultsonthetestagreewiththoseprovidedbysomeindependentandhighlydependableassessmentofthecandidatesability.(CET摸擬題與CET實(shí)考題的各項(xiàng)分?jǐn)?shù)的相關(guān)性)效標(biāo)就是考察檢定考試效度的參照標(biāo)準(zhǔn)，效標(biāo)關(guān)聯(lián)效度也就是與該參照標(biāo)準(zhǔn)有關(guān)的效度。效標(biāo)關(guān)聯(lián)效度就是以某一種測驗(yàn)分?jǐn)?shù)與其效標(biāo)分?jǐn)?shù)之間的相關(guān)來表示的效度。換言之，一組考生參加某種考試的分?jǐn)?shù)與同一組考生參加另一公認(rèn)、的有較高效度的測驗(yàn)結(jié)果的一致性程度就是該考試的效標(biāo)效度。Therearetwokindsofcriterion—relatedvalidity:

ConcurrentvalidityConcurrent(共時性)validityisestablishedwhenthetestandcriterionareadministeredataboutthesametime.(例如:設(shè)計(jì)一次口語測試，因?yàn)闆]有充足的時間去測試課程標(biāo)準(zhǔn)要求的全部語言功能，所以，對每位測試者進(jìn)行10鐘的口試。但我們不能確定10分鐘的口試能否反映被試著的實(shí)際口語能力。我們先設(shè)計(jì)了一次考試，考試時間45分鐘，并覆蓋較多的語言功能，以此，建立了一個口試標(biāo)準(zhǔn)；再將著10分鐘的口語考試結(jié)果與這個標(biāo)準(zhǔn)作相關(guān)分析，然后確定這十分鐘的效度。）Anoralachievementtest

Courseobjectives

Alargenumberof‘functions’

45minutes10minutes?FulltestscoresshortenedtestscoresEvidenceforconcurrentvalidity:Degreeofagreementcalculationofdegreeofagreement:

correlationcoefficient(possiblevalue:-1~1,thehigherthebetter)1:perfect(positive)agreement0:zeroagreement-1:negativeagreementAtestoforalabilityforahighleveldiplomaticpostNotrationaltoruntheriskofappointingsomeonewithinsufficientoralabilityLoweragreementNOTallowedAbriefinterviewformingpartofaplacementtestLoweragreementallowedCalculatingcorrelationcoefficientinSPSS.PredictiveValidityThisconcernsthedegreetowhichatestcanpredictcandidates’futureperformance.e.g.Couldaproficiencytestpredictastudent’sabilitytocopewithagraduatecourseataBritishuniversity.Discussion:Validatingaplacementtest.How?3.3ConstructValidity(結(jié)構(gòu)效度):Atest,partofatest,oratestingtechniqueissaidtohaveconstructvalidityifitcanbedemonstratedthatitmeasuresjusttheabilitywhichitissupposedtomeasure.Theword‘construct’referstoanyunderlyingability(ortrait)whichishypothesizedinatheoryoflanguageability.Forexample,whentestingreadingability,wehypothesizethattheabilitytoreadinvolvesasetofsub-abilities,suchasguessingunknownwordmeaningsfromthecontext.Thenweshouldrefertoresearchliteraturetoestablishwhetherornotsuchanabilityexistedandcouldbemeasuredinapartofthetest.

Ifwewereabletodemonstratethatwewereindeedmeasuringthatability,thenwesaythetesthasconstructvalidity.結(jié)構(gòu)效度研究是一個搜集證據(jù)證實(shí)某一考試的確在測試我們想測試的那種心理屬性的過程。一個考試如果被證實(shí)是在測量我們想測量的那種能力，那么這個考試就具有較好的結(jié)構(gòu)效度，它是一個編制假設(shè)再證實(shí)假設(shè)的過程。Howdoweknowthatthetestismeasuringwritingability?

Hypothesis:Ourtheoryofwritingtellsusthatunderlyingwritingabilityareanumberofsub-abilities:controlofpunctuationsensitivitytostylesstructurescoherenceandcohesion….Inordertomeasurethesesub-abilities,weadministerapilottestwhichinvolvestwosteps:用選擇題測試寫作能力（間接考試）步驟：找一組被試（第一次參加考試），對他們的寫作能力全面抽樣（讓他們做包含標(biāo)點(diǎn)、語法、體裁等的選擇題）；把測試結(jié)果與范文相比較：如果結(jié)果與范文相關(guān)系數(shù)高，說明可以用選擇題測試寫作能力1.Weobtainextensivesamplesofthewritingabilityofthegrouptowhomtestisfirstadministered,andhavethesereliablyscored.2.Wethencomparescoresonthepilottestwiththescoresgivenforthesamplesofwriting.Iftheagreementishigh,wearemeasuringwritingabilitywiththetest.按照假設(shè)分別測量各項(xiàng)能力：假設(shè)：標(biāo)點(diǎn)語法體裁寫作能力↙↓↘／∣﹨／∣﹨／∣﹨單選填空改錯單選填空改錯單選填空改錯7066685560628580823.4FaceValiditye.g.Anoraltestdoesn’trequirecandidatestospeakwouldnothavefacevalidity.Atestissaidtohavefacevalidityifitlook