Assessment Literacy
Was it the learners, or the question?
Assessment literacy is the knowledge, skills and principles people need to design, choose, interpret and use assessments well, and to judge whether the scores and the decisions based on them can be trusted.
A teacher writes a ten-question reading quiz, and nearly the whole class gets question 7 wrong. Is that a gap in their reading, or a badly written question? Answering well, and deciding what to do next, takes assessment literacy: the know-how to build, choose, interpret and use assessments soundly.
Rick Stiggins popularised the term in 1991. He argued that many educators had never been trained to tell a sound assessment from a weak one. In language education the idea became language assessment literacy (LAL). Alan Davies divided it into skills (writing, scoring and analysing tests), knowledge (how measurement and language work) and principles (fairness, ethics and the effects of tests on people). Glenn Fulcher added the wider picture: the history, politics and social uses of testing, which explain why practices exist at all.
Not everyone needs the same depth. Lynda Taylor sketched different profiles: professional test developers need deep technical knowledge, while the classroom teacher’s profile puts knowledge of language teaching highest. Researchers still debate what belongs in the core, and a large international survey by Benjamin Kremmel and Luke Harding found that different groups rate its parts differently.
For teachers it matters every week. A teacher who can spot a flawed item or a vague rubric makes better decisions, from feedback on a draft to placing a learner in a class. They can also see when a high-stakes test pushes teaching in a harmful direction, a form of washback, and argue for something better.
In actionAn item that tests the wrong thing
Question 4. What is the main idea of the text? (a) Bees (b) Honey (c) Bees matter to farmers because they pollinate many of the crops we eat. (d) Farms
A learner can pick (c) without reading the text, because it is the longest and most complete-looking option. The score then shows test-taking skill, not reading, which weakens its validity.
In the classroom
- 1
Check each quiz item before you use it: could a learner get it right without the skill it targets, or wrong despite having it? Rewrite any item that fails.
- 2
List the questions most learners missed after marking, then decide for each one whether to reteach the point or rewrite the question.
- 3
Score three essays separately with a colleague using your rubric, compare marks, agree what each band means, and share those criteria with learners before the next task.
Myth and reality
Assessment literacy means statistics, and only professional test designers really need it.
Statistics are one part. For teachers the core is practical: writing fair tasks, reading scores sensibly, giving useful feedback and weighing a test’s consequences for learners.
Reflect
Think of the last test score that changed a decision about one of your learners: how sure are you that it measured what you thought it measured?
Worth a minute before your next lesson, or a conversation in the staffroom.
SourcesChecked against Crossref and library records
Stiggins is usually credited with the term, writing for general education. Inbar-Lourie, Davies and Fulcher later shaped language assessment literacy (LAL) as an area of its own within language testing.
Stiggins, R. J. (1991). Assessment literacy. Phi Delta Kappan, 72(7), 534–539.
Davies, A. (2008). Textbook trends in teaching language testing. Language Testing, 25(3), 327–347.
Traces how language testing textbooks moved from technical skills to knowledge and then to principles such as fairness and ethics.
Fulcher, G. (2012). Assessment literacy for the language classroom. Language Assessment Quarterly, 9(2), 113–132.
Surveys language teachers about their assessment training needs and builds a working definition of assessment literacy from the results.
Taylor, L. (2013). Communicating the theory, practice and principles of language testing to test stakeholders: Some reflections. Language Testing, 30(3), 403–412.
Argues that teachers, test writers and administrators need different profiles of assessment literacy, not one standard dose.
Kremmel, B., & Harding, L. (2020). Towards a comprehensive, empirical model of language assessment literacy across stakeholder groups: Developing the Language Assessment Literacy Survey. Language Assessment Quarterly, 17(1), 100–120.
Puts stakeholder profiles to an empirical test with a large international survey of what different groups think they need to know.
Popham, W. J. (2009). Assessment literacy for teachers: Faddish or fundamental?. Theory Into Practice, 48(1), 4–11.
A short, readable case for why every teacher, not just specialists, needs assessment knowledge for both classroom and accountability tests.
ConnectionsSee it in the graph
- WashbackAssessment-literate teachers can recognise and respond to a test’s effects on teaching.
- Consequential ValidityWeighing a test’s consequences is one of the principles assessment literacy includes.
- Teacher CognitionWhat teachers believe about testing shapes how they assess, alongside formal knowledge.
Know a teacher who’d like this?
Send them the card. It’s made for Facebook, Zalo, LinkedIn and Instagram, and links back here.