Implementing Assessment Without Levels

I have blogged twice before about assessment in the new national curriculum (here and here) and looking back at those two posts now it seems high time for an update. We’ve moved on quite some way and we are now implementing our assessment without levels system (or AWOL, as our Head of Science seems intent on calling it) across the school.

Context

We haven’t been using National Curriculum levels for a year or so now, but instead we have been using a system of “Chew Valley Levels” linked to GCSE grades as follows:

levelsgradesnewgcseThis was only ever going to be a stop-gap measure, providing some continuity for students and their families whilst we explored the alternatives. In reality, in the world of comparable cohort outcomes we are not able to say with any certainty what a “C” grade at GCSE is, only what it was last year, and thus tying our levels to this moveable feast rendered them no more reliable than the preceding National Curriculum levels. We have even less idea what students will have to know or be able to do to be awarded the new GCSE 1-9 grades, though Ofqual have published this:

ofqual gradesWhat we know, then, is that roughly the same proportion of students as currently achieve grades A*-C in existing GCSEs will achieve grades 9-4 in the new GCSEs, but that the threshold standard is being raised to grade 5 against international benchmarks. But we still don’t know what students will have to know or be able to do for that grade 5 in any given subject, nor are we likely to as the boundaries will shift year on year, especially in the infancy of the qualifications I suspect.

All of this means two things:

  1. We need to aim higher if we are to get as many students as possible to grade 5 and above – it will be tougher than C and above.
  2. Linking our assessment system to GCSE grades (as was our original plan) is not going to work.

The Threshold Model

Both Shaun Allison and Dan Brinton have been instrumental in clarifying my thinking about the threshold model of assessment. I highly recommend you read Shaun’s Assessment without levels – an opportunity for growth and Dan’s Designing a new post-levels curriculum and assessment model from scratch as they are both superb and you will see that a lot of the ideas in this post are not, in fact, mine, but theirs!

Essentially, in a threshold model, you set up your curriculum with an expectation in terms of content and skills within each unit, year, or key stage – the “threshold”. At each point, you assess students to see the extent to which they have met, exceeded or fallen short of this threshold. The model has the advantage of letting teachers decide the expectations (thus allowing challenge to be built-in) and providing ready-made opportunities for formative assessment and feedback in relation to the threshold expectations. As implied by the title of Shaun’s blogpost, it’s also a system that is compatible with our growth mindset ethos – more of which later.

What to call the threshold? 

This was a tricky point. Initially we considered the Durrington School model using four noun descriptors:

Thresholds from Durrington High School (from http://classteaching.wordpress.com/)

We were then quite taken with the Belmont School model using verbs to describe the thresholds:

Example assessment scheme from Belmont School Science (from http://belmontteach.wordpress.com/)

However, we couldn’t quite agree on language that would fit different subjects appropriately. We considered with the idea of using new GCSE grades 1-9, but they sounded too like the old levels and, in any case, we would have to guess at the standard they represent which is not a sound basis for a new assessment system.

In the end, we decided to use existing letter grades A*-G on the basis that students and their families understand them, and they have a well-understood threshold built in to them at the C grade boundary. Thus students meeting the threshold expectations of our curriculum at each point will be assessed at grade C. Those who exceed it can be graded A*, A or B; those who fall short can be graded D, E, F or G. Each year’s threshold directly correlates to the next year as illustrated in the following table:

AWOL Mapping

In other words, if a student can demonstrate they have met the demands of the Year 8 curriculum by the end of Year 7, they would be graded as B in Year 7. An A* student in Year 7 would be demonstrating the knowledge, skills and processes required of a Key Stage 4 student who had met the C grade threshold.

Mapping the threshold standard onto the curriculum

In our system, for students to have achieved the threshold on entry to the school, they will have to demonstrate that they have met the requirements of the Key Stage 2 National Curriculum in each subject. In time, we will receive this information (at least for English and Maths) from the new Key Stage 2 assessments, but this will not happen until 2016. Therefore we will baseline all students (as we do currently) to assess the extent to which they have met those requirements at the start of Year 7. Any gaps or shortfall will need to be addressed early.

The threshold standard in each year will be decided by the teaching teams within school. It will be informed – but not limited – by the relevant national curriculum requirements, of course, but the guiding principle is that if we are going to value what we assess then we must assess what we value. Therefore the new curriculum that is being designed is based on the key ideas, concepts, knowledge and skills within each subject, informed by the national curriculum, but decided by teachers. At Key Stage 4 the curriculum will, of course, incorporate the examined elements of the KS4 programme of study or examination specification but will not be limited by that. Our best students go beyond and around the specifications anyway – and so should we. If we are going to prepare our students to do well at GCSE we should be teaching them beyond GCSE in Year 11, so the terminal exams they sit seem like a walk in the park in comparison to what they have been doing in the classroom.

Tracking progress in the new assessment system

We already use a flight paths model to track progress in all subjects. Within the new system, tracking progress is even easier.

AWOL Progress

In the example above, a student is assessed at C on baseline and maintains that performance through Year 7 and 8 (the green highlighting). We should expect all students to maintain their performance through the curriculum, but challenge them to improve it. In Year 9, the table above illustrates what happens if a students improves their performance (the orange highlighting), leading to better than expected GCSE outcomes, and what happens if they do not make progress through the year (the red highlighting), leading to an under-performance at GCSE.

At this stage it’s important to be clear about the expectations of this system. No matter where students are on their baseline assessment, it is the job of the curriculum to ensure that as many of them as possible end up above the threshold by the end of each unit, year, or key stage. If a student is a D or an E at the baseline, that is not an excuse to stay on a D or E for the whole of their school career. Rather, it is a challenge to the teacher and the curriculum to fill in the gaps from the previous year as well as teaching the content, skills and processes of the current year. This is the gap that must be closed.

Terminal Assessment

One important element of this system is the introduction of a terminal assessment in each year of the curriculum. This assessment will be in the same style as the GCSE assessment in the relevant subject, and should assess the knowledge, skills and processes of the entire year’s curriculum. Students will have to revise for it, thus preparing them earlier for the demands of the two-year linear assessments in Year 11. We also intend that this approach will improve retention and recall, as curriculum design will be interleaved to incorporate regular revisiting of the key knowledge, skills and processes.

The end of targets? 

Finally, this model moves away from giving each student a target to aim for based on FFT D, CATs predictors, teacher assessment plus some magic dust and a following wind (as described in this early post on my blog – see, David Didau doesn’t have the monopoly on changing his mind!). When I launched our growth mindset ethos, one of the first responses I had was our Head of Geography asking if this was the end of Challenge Grades (our term for student targets). If potential is unknowable, why are we selecting an arbitrary grade and pretending to know it? She was (and is) right, of course. So we will now be judging progress based on where students start and how far they’ve come from that known point, rather than how far they’ve got to go to a point which we cannot and should not pretend to know.

So what now? 

  1. Faculties are meeting on Monday to begin the process of deciding the threshold standard for each year within the curriculum. Some are already there, having piloted systems through last academic year. Others will need to move this year.
  2. We need to finalise what reports to parents will look like in the new system – we have a draft, but it needs thinking through.
  3. We need to troubleshoot the progress measures – if a student moves up a grade in Year 8, does the higher grade become their new baseline or do we continue to measure progress from the start of Year 7 baseline point? What if they drop a grade?
  4. We need to decide when we move over from the legacy system to the new. We only get one chance to get this right – so we need to be sure we have it sorted.

These are the practicalities – but the principles I am certain are right and the system I am sure is workable. I’ll keep you posted!

UPDATE: we are holding an open meeting in January 2015 to share our approach with colleagues. Details here: https://echewcation.wordpress.com/assessment-without-levels/

Advertisements

18 thoughts on “Implementing Assessment Without Levels

    • Thanks for the tip – that was new to me and very interesting reading. Lots in common with our approach; though we are labelling out thresholds with letter grades the concept of threshold assessment is, I’m sure, the way to go.

  1. Hi Chris, a few questions, if you don’t mind …

    – What does the Year 7 ‘baseline’ consist of (I’ve not been conscious of it happening, which may be a good thing as you’re obviously not making it feel high pressure). 🙂

    – How do you figure out what children know ‘beyond’ the confines of the curriculum, e.g. the science that is being done at the moment, we know all about already, and in fact far beyond it from reading done at home (the teacher won’t necessarily be aware of this in lessons). How do you ensure that a child’s assessed level is accurate, if the test only tests what has been covered in class/the NC requirements and not the higher level stuff that they might know as well from learning done outside school?

    – Does the yearly terminal exam model carry along with it some of the dangers of the terminal exam at GCSE? (e.g. not necessarily demonstrating what a child knows, if they are not particularly great at doing timed exams, or if they have a ‘bad day’, suffer from hay fever, etc. etc.)?

    Thanks.

    • Hi Sue
      The baseline is different in each subject. In some subjects it’s a holistic assessment of all the first term’s work. In others it’s based more firmly on a specific test (or tests) which the students sit. We’re definitely not about high pressure assessments in the first term of secondary!
      Your second question is a million-dollar question and the unfortunate answer is that we don’t always get this accurately from the assessments done in school. What we do is assess the curriculum we deliver to see to what extent the students have grasped, understood and retained what they’ve been taught. As you might expect, it’s very difficult for us to assess the stuff they also know which we haven’t taught them! Over time, however, this will come to bear as students make connections between aspects of the curriculum and their wider knowledge. Another point I would make is that most teaching of “new” concepts or topics will begin with establishing the prior knowledge of students in order to pitch the lessons effectively. This is a normal approach to teaching and learning and I would hope that this would pick up a student who was already familiar with the material and needed stretch and challenge.
      Finally, the terminal exam is a high-stakes assessment but it isn’t an all-or-nothing assessment. The end-of-year assessment will be informed by the examination result, but in most subjects the student’s wider attainment would be taken into account. If, as you suggest, a student had a bad day in their Year 8 exam, the teacher would already have a wealth of in-class assessment to measure that exam against and arrive at a fair assessment of the student’s knowledge overall.
      Hope that helps!

  2. Pingback: The Secret Diary of a Teenage Brain – my #TLT14 session in blog form | What do I stand for?

  3. Pingback: #TLT14 – a tale of two conferences | Teaching: Leading Learning

  4. Pingback: Assessment | PGCEPhysicalEducation

  5. I am incredibly interested in this idea of thresholds as it seems the best way of making the new system actually workable! In addition to the fine work that has been done through the blog entries listed here, is there likely to be an Ofqual/Gov/Whoever ‘suggested approach’ to implementing the new grade systems? My fear is that it’s very quiet at the moment regarding direction and implementation advice and as soon as a system comes along that ‘they’ like THAT system will be rolled out, regardless of however other institutions have interpreted the changes. Being proactive is clearly more beneficial regarding preparation, but it all gets nullified when someone provides more ‘clarity’.

    I, not for the first time admittedly, feel very ill at ease with the distinct lack of information being supplied to help support these changes and give education establishments the opportunity to at least attempt to deal with yet another change. Who loses most in the process? The students. Again.

    I would really love to hear more about progress being made on this at other schools as my own is very much in the infancy of implementing changes. I would dearly love for us to get it right and avoid pitfalls so any information is greatly appreciated!

  6. Pingback: Assessment after levels- In search of the holy grail…. | From the Sandpit....

  7. Pingback: 2014 in review: my second year of edublogging | Teaching: Leading Learning

  8. Pingback: The nonsense of the grade descriptors | Teaching: Leading Learning

  9. Pingback: Implementing Assessment Without Levels | rwaringatl

  10. Pingback: Doing NPQH as a member of SLT | Teaching: Leading Learning

  11. Pingback: Assessment without levels… | allthingsteachingandlearning

  12. Pingback: Refining assessment without levels | Teaching: Leading Learning

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s