No.042

Assessment Literacy

Was it the learners, or the question?

AssessmentFoundation2 min read
In one line

Assessment literacy is the knowledge, skills and principles people need to design, choose, interpret and use assessments well, and to judge whether the scores and the decisions based on them can be trusted.

A teacher writes a ten-question reading quiz, and nearly the whole class gets question 7 wrong. Is that a gap in their reading, or a badly written question? Answering well, and deciding what to do next, takes assessment literacy: the know-how to build, choose, interpret and use assessments soundly.

Rick Stiggins popularised the term in 1991. He argued that many educators had never been trained to tell a sound assessment from a weak one. In language education the idea became language assessment literacy (LAL). Alan Davies divided it into skills (writing, scoring and analysing tests), knowledge (how measurement and language work) and principles (fairness, ethics and the effects of tests on people). Glenn Fulcher added the wider picture: the history, politics and social uses of testing, which explain why practices exist at all.

Not everyone needs the same depth. Lynda Taylor sketched different profiles: professional test developers need deep technical knowledge, while the classroom teacher’s profile puts knowledge of language teaching highest. Researchers still debate what belongs in the core, and a large international survey by Benjamin Kremmel and Luke Harding found that different groups rate its parts differently.

For teachers it matters every week. A teacher who can spot a flawed item or a vague rubric makes better decisions, from feedback on a draft to placing a learner in a class. They can also see when a high-stakes test pushes teaching in a harmful direction, a form of washback, and argue for something better.

In actionAn item that tests the wrong thing

Question 4. What is the main idea of the text? (a) Bees (b) Honey (c) Bees matter to farmers because they pollinate many of the crops we eat. (d) Farms

A learner can pick (c) without reading the text, because it is the longest and most complete-looking option. The score then shows test-taking skill, not reading, which weakens its validity.

In the classroom

  1. 1

    Check each quiz item before you use it: could a learner get it right without the skill it targets, or wrong despite having it? Rewrite any item that fails.

  2. 2

    List the questions most learners missed after marking, then decide for each one whether to reteach the point or rewrite the question.

  3. 3

    Score three essays separately with a colleague using your rubric, compare marks, agree what each band means, and share those criteria with learners before the next task.

Myth and reality

The myth

Assessment literacy means statistics, and only professional test designers really need it.

What the evidence says

Statistics are one part. For teachers the core is practical: writing fair tasks, reading scores sensibly, giving useful feedback and weighing a test’s consequences for learners.

Reflect

Think of the last test score that changed a decision about one of your learners: how sure are you that it measured what you thought it measured?

Worth a minute before your next lesson, or a conversation in the staffroom.

SourcesChecked against Crossref and library records

Where it comes from

Stiggins is usually credited with the term, writing for general education. Inbar-Lourie, Davies and Fulcher later shaped language assessment literacy (LAL) as an area of its own within language testing.

Stiggins, R. J. (1991). Assessment literacy. Phi Delta Kappan, 72(7), 534–539.

Key readings
  1. Davies, A. (2008). Textbook trends in teaching language testing. Language Testing, 25(3), 327–347.

    Traces how language testing textbooks moved from technical skills to knowledge and then to principles such as fairness and ethics.

  2. Fulcher, G. (2012). Assessment literacy for the language classroom. Language Assessment Quarterly, 9(2), 113–132.

    Surveys language teachers about their assessment training needs and builds a working definition of assessment literacy from the results.

  3. Taylor, L. (2013). Communicating the theory, practice and principles of language testing to test stakeholders: Some reflections. Language Testing, 30(3), 403–412.

    Argues that teachers, test writers and administrators need different profiles of assessment literacy, not one standard dose.

  4. Kremmel, B., & Harding, L. (2020). Towards a comprehensive, empirical model of language assessment literacy across stakeholder groups: Developing the Language Assessment Literacy Survey. Language Assessment Quarterly, 17(1), 100–120.

    Puts stakeholder profiles to an empirical test with a large international survey of what different groups think they need to know.

  5. Popham, W. J. (2009). Assessment literacy for teachers: Faddish or fundamental?. Theory Into Practice, 48(1), 4–11.

    A short, readable case for why every teacher, not just specialists, needs assessment knowledge for both classroom and accountability tests.

ConnectionsSee it in the graph

Know a teacher who’d like this?

Send them the card. It’s made for Facebook, Zalo, LinkedIn and Instagram, and links back here.

Concepts
Criterion-Referenced and Norm-Referenced TestingNo. 060 · Assessment
Lexical DensityNo. 059 · SFL
Presentation–Practice–ProductionNo. 058 · Pedagogy
The Academic Word ListNo. 057 · Corpus
Postmethod PedagogyNo. 056 · Teacher Dev.
Code-SwitchingNo. 055 · Socioling.
Negotiation of MeaningNo. 054 · SLA
Dialogic TeachingNo. 053 · Discourse
Linguistic RelativityNo. 052 · Cognitive
Consequential ValidityNo. 051 · Assessment
Appraisal TheoryNo. 050 · SFL
The Lexical ApproachNo. 049 · Pedagogy
Lexical BundlesNo. 048 · Corpus
Action ResearchNo. 047 · Teacher Dev.
Linguistic ImperialismNo. 046 · Socioling.
The Interaction HypothesisNo. 045 · SLA
Display and Referential QuestionsNo. 044 · Discourse
Image SchemasNo. 043 · Cognitive
Assessment LiteracyNo. 042 · Assessment
Genre PedagogyNo. 041 · SFL
Communicative Language TeachingNo. 040 · Pedagogy
ConcordanceNo. 039 · Corpus
English as a Lingua FrancaNo. 038 · Socioling.
Comprehensible InputNo. 037 · SLA
Wait TimeNo. 036 · Discourse
Exploratory PracticeNo. 035 · Teacher Dev.
Thinking for SpeakingNo. 034 · Cognitive
The Validity ArgumentNo. 033 · Assessment
Grammatical MetaphorNo. 032 · SFL
The Involvement Load HypothesisNo. 031 · Pedagogy
Semantic ProsodyNo. 030 · Corpus
Native-SpeakerismNo. 029 · Socioling.
Processability TheoryNo. 028 · SLA
Epistemic Status and Epistemic StanceNo. 027 · Discourse
Teacher CognitionNo. 026 · Teacher Dev.
Construction GrammarNo. 025 · Cognitive
Data-Driven LearningNo. 024 · Corpus
The Teaching–Learning CycleNo. 023 · SFL
InvestmentNo. 022 · Socioling.
Dynamic AssessmentNo. 021 · Assessment
Focus on FormNo. 020 · Pedagogy
The Output HypothesisNo. 019 · SLA
The Apprenticeship of ObservationNo. 018 · Teacher Dev.
Prototype TheoryNo. 017 · Cognitive
The Idiom PrincipleNo. 016 · Corpus
Theme and RhemeNo. 015 · SFL
TranslanguagingNo. 014 · Socioling.
RecastsNo. 013 · Discourse
Formative AssessmentNo. 012 · Assessment
Task-Based Language TeachingNo. 011 · Pedagogy
The Noticing HypothesisNo. 010 · SLA
Reflective PracticeNo. 009 · Teacher Dev.
Conceptual MetaphorNo. 008 · Cognitive
CollocationNo. 007 · Corpus
Register: Field, Tenor and ModeNo. 006 · SFL
Communicative CompetenceNo. 005 · Socioling.
IRF / IRE SequenceNo. 004 · Discourse
WashbackNo. 003 · Assessment
ScaffoldingNo. 002 · Pedagogy
InterlanguageNo. 001 · SLA