Category Archives: Ofsted

What did OFSTED teach me?

When I started teaching, back in 2000, OFSTED was rarely mentioned. As a trainee teacher, I was aware of teacher standards and observation grades as it was part of my assessment. We had essays on the SEN code of practice and were regularly assessed on our subject knowledge, but nothing specific on OFSTED.

In my first teaching job, as an NQT, I was observed a few times for the forms for my induction. Training was generally focused around new technology or, in department, on exam specifications and developing schemes of work. OFSTED was in the background (They might visit), but were barely mentioned.

About 7 or 8 years ago that started to change. There were occasional INSET sessions about preparing for OFSTED, a particular lesson structure was suggested as something that OFSTED wanted. But still, most of the time, they were barely mentioned.

The most dramatic change happened in the past 5 years or so. Suddenly OFSTED was mentioned regularly – in lesson observations, in INSET, in staff meetings. We became bombarded with information regarding OFSTED and what they wanted. There was a, not so subtle, shift from teaching to the best of your ability, challenging and stretching the pupils to being a ‘Good’ or ‘Outstanding’ teacher. Everything shifted. Suddenly it was not about what the pupils needed, or what you as a teacher needed, it was all about what OFSTED wanted.

OFSTED became a big stick, which in many schools has stilted the focus on teaching and learning. You must all have x, y and z in your lesson, your lesson plan should look like this, hour after hour of INSET on lesson grading. Observations being about judging teachers and giving them a number, rather than being a discussion about their teaching and what each party could learn. (One teacher told me that, after being observed by SMT and given a ‘Good’, she asked which member of SMT she could observe teaching an ‘Outstanding’ lesson – the response? No one!).

The school year for many has become a round of learning walks, graded observations, book checks, mocksteds. Boxes being ticked, reams of paperwork being completed. This can lead to fear: fear of innovation in case it fails, fear of teaching the way you know works because OFSTED might not like it, fear of allowing staff to use their judgement. The end result is often all teachers being treated as though they were incompetent or lazy, rather than the occasional teacher who actually is. If Michael Wilshaw wants to know why so many teachers leave it is this (and schools with poor SMT who don’t support staff with behaviour).

After years of dodging the OFSTED bullet, I was visited a few years ago. It was brief, I got little feedback and the process had no impact on improving my future teaching. I suspect that, for most teachers and most schools, improvement is despite OFSTED rather than because of them. It makes me sad, because, alongside this bloody minded focus on OFSTED, there has been a real change in teaching – the joy is being sucked out of it. Teaching is becoming more and more about targets, data, results and paperwork rather than the joy and excitement of learning. If you want excellent teachers, let them teach, trust them as educated professionals. And if OFSTED visit they will see what they should have been looking for all along – hardworking teachers teaching well and pupils learning.

So, what did OFSTED teach me?

  • Fearing OFSTED is an unhealthy waste of time. 12 years, 195 days a year, I worked as a teacher, that is 2340 days. One OFSTED inspection in all that time which lasted 2 days – that is 0.085% of my teaching career to date. Now obviously, OFSTED did not spend those two days with me, they actually spent 30 minutes. So, 5 possible teaching hours a day for 2340 days is 11700 hours – a massive total of 0.004% of my teaching time. To get worked up over something which takes up so minimal amount of your actual teaching time is pointless, akin to worrying and attending training to deal with a wasp in your classroom.
  • SMTs interpretation of OFSTED guidance is not always accurate. OFSTED is about schools rather than individual teachers, and as such, there is a lot of pressure on SMT and particularly the Head. It is hardly surprising that this pressure can turn into an almost obsessive focus, skewing what should be the core focus of the school and teaching. Heads worry, so they often pass this down to their staff, and in their panic they interpret and misinterpret what the OFSTED documents ask for. This is never more true than when they are applying gradings to lessons. Comments on twitter like this:
    TeacherToolkit (@TeacherToolkit)
    I received an email last night from a teacher; informing me that their line-manger expected to see progress within 10 mins in a Food lesson!

    Teachers being told that a single mistake will lead to an inadequate grading and capability. The problem here is not OFSTED, but SMT’s misinterpretation and using it as a big stick.

  • Beware consultants selling fear. I have always had an issue with consultants, especially those who work for OFSTED, don’t teach and have a side line as a consultant. Realistically, it is not in their interest to say to a school ‘Just do what you’re doing, there is nothing specific OFSTED is looking for’, they would do themselves out of a lucrative job (unless they are doing this free out of the goodness of their heart). If you pay for someone to deliver INSET, you expect them to deliver something, a checklist or key messages – it doesn’t follow that, just because you pay them, they are any good. I have been told about a recent INSET with an ‘OFSTED consultant’ telling staff that they would be fools not to have a lesson plan (despite this line from the School Inspection Handbook ‘Inspectors will not expect teachers to prepare lesson plans for the inspection.’), that they must show progress in the lesson observation and differentiation for each pupil, that they need an ‘OFSTED file’ containing student data and seating plans. My particular favourite was that if a single child is late to your lesson it is a) your fault for not engaging them (how can you engage them if they are not there?) b) lateness is the teacher’s issue (not SMT, whole school or the pupil themselves?) and c) if that happens your lesson is inadequate.
  • Luck has a lot to do with it. Any observation, and OFSTED in particular, is a snapshot – one tiny moment in time (0.05% of a school year, if you are observed for about 30 minutes). That observation is subject to a range of influences: is it last thing on a windy Wednesday with 11v27 after their half day at college? Has a giant wasp invaded your class room? Is the start or end of term or the school year? Have you been up all night with a sick relative? You do your best, but sometimes in teaching things don’t go the way you want. One observation does not define you as a person or your teaching – we all know those who are excellent but crumble under the pressure of being observed. Equally, I’m sure we all know those who are half-arsed teachers the bulk of the time but can pull a ‘Good’ or ‘Outstanding’ to of the bag when being observed. The time I was observed by OFSTED, with a Y10 English group, in the first 3 weeks of a new school year, I was lucky. My lesson was pretty much what I would have normally done, the luck was: that I had taught most of the class for the previous year, and in some cases two years (pity those teachers seeing groups for the first or second time), and that two of the boys decided to have a detailed discussion about the character of Mr Darcy in response to my prompt. I was told the lesson was ‘Outstanding’ but I know that it just happened to be one of those days when all my ducks were in a row, I could have been faced with stony silence and a swift shift to a written task.

OFSTED has become an all encompassing focus in many schools, the danger is that it, and the way that schools interpret its advice, will continue to have a negative effect on teaching. Schools and teachers need to choose whether to allow this to happen.

Advertisements

The Problem With Education…

In January, I wrote this post looking at the language applied to education, in particular by the media and the Government. I hoped that the negative language which seemed all pervasive in 2012 would not feature so heavily in 2013 – unfortunately, as we move through the final quarter of 2013, that does not seem to have been the case.

Crisis

Education in the UK seems to be in crisis – it’s a profession which seems to be in constant conflict with the Department for Education, sections of the media and, at times, with itself. This is a toxic situation which cannot continue without causing damage to all involved, in particular the children we teach. Why has the education sector come to this? Is there anything that can be done?

It’s Not Fair

Before we look at what may be at the root of the problem, I think it is important to make a key point about fairness. All may be fair in love and war but it certainly isn’t in education. Harsh it may be, but the brutal truth is that achieving ‘fairness’ for all pupils is a fantasy. The playing field will never be level.

This hit me forcefully when I was watching ‘Harrow: A Very British School’ on Sky 1. I find the program fascinating, a real insight into how a top private school functions – far distant from my own comprehensive school and the schools I have taught at. The grounds, the traditions, the facilities – it looks wonderful, and I am sure it is. What struck me, was the vast differences between the experiences of the Harrow boys at West Acre and some of the children I have encountered in my career.

Obviously, the best facilities that money can buy are part of the disparity, however, it was the little things that really struck me. Having a clean uniform ready for you, eating good quality food three times a day, having somewhere quiet to work, having someone checking that you are doing your homework, having a computer for your personal use – all of those little things that make a big difference to a child and their performance. The Harrow boys (as well as the majority of our  school children)  also don’t have to: care for siblings or parents, work before or after school, travel long distances to get to school, live with parents who are addicts etc. So, realistically, the children for whom these are everyday occurrences are never going to have a similar school experience.

It isn’t fair. Those who are most socially and economically deprived, those who are born with learning difficulties, those who are refugees from war torn countries (and a hundred other misfortunes), will not have the same opportunities as those who do not have these disadvantages. While we can do our best to mitigate against these disadvantages, they exist and we have to accept that, unfortunately, life isn’t fair.

What is Education For?

At the heart of the problem with education lies this question – what is the purpose of education? It seems a straightforward question at first, and I’m sure that most people will come up with a list of purposes which may include: qualifications, becoming a well rounded individual, becoming a useful and productive member of society etc. However, listening to the media and the DfE, the purpose does not seem to be clear:

  • Exams are too easy
  • Children are not achieving good enough exam results
  • Qualifications should reflect the needs of employers
  • Qualifications should enable the ranking of children and schools
  • A robust national curriculum is needed to ensure standards
  • Not all schools need to comply with the national curriculum
  • Teachers are professionals
  • Teachers don’t need to be qualified

the list goes on – contradiction after contradiction.

What Can be Done?

Before making any more statements, or changing any more policies, the Government needs to decide what the purpose of education, and in particular its examination system, is.

If it is important that, where at all possible,  all children should achieve a range of solid qualifications, then the examination system has to make this a possibility. Qualifications should be criterion referenced against a specific and public set of criteria so everyone knows that x grade means a child can do y at z level. If this is the purpose of education in the UK, then there should not be grade quotas or manipulation of results to avoid perceived grade inflation. Any child who achieves the specific criteria gets the grade.

If examinations are about ranking children (obviously taking into account that this will never be entirely fair, as I have discussed above), there needs to be a number of specific changes to the way children are assessed. Firstly, we would need to do away with the multiple exam boards and variety of qualifications in each subject – there should be only one exam in each subject which all children, from all types of school within the UK, take. How can children and their results be compared when the exams they take are different – for example the continuation of coursework for iGCSE? The nationwide results are then ranked and, perhaps a grade allocated according to norm referencing or some other formula. It may even be possible to combine the two – perhaps a grade and a national rank, or a percentage.

At the moment, however, it is not clear what the purpose is, at least from the Government’s perspective. It seems farcical to say that all schools should achieve a specific level of examination results and then make it impossible for all schools to do so. If you want an education system where all schools are ‘good or better’ then it needs to be possible – which means that the way schools are measured needs to change to reflect this. It is this pressure to achieve the impossible that seems to be at the root of many teachers’ arguments.

If Mr Gove and future Education Secretaries want to make a positive impact on education in this country, they need to think long and hard about what education in the UK is for. Then they can start to change the system for the better.

SOLO Research: Conclusions

What have I learnt from my research into the SOLO taxonomy?

Researching and Note Taking

At a personal level, this research has been very useful. I have found out that I really enjoy research and reading academic articles and texts. In particular, writing the literature review was an interesting, challenging and enjoyable part – far more than I had expected it to be. It was like a giant jigsaw which needed to be put together before it would make sense.

notesI tried out a variety of note taking methods for the review, the most effective one turned out to be writing key quotations onto post its which I then sorted into linked areas on large pieces of paper with lines and comments added to show the relationship. This helped organise each part of the review into paragraphs and made the links clearer to see. It was while I was doing this that I realised that this was also a SOLO task – I was moving my knowledge of the literature from the multistructural to the relational level and beyond. Thinking about the process in this way was quite useful as it mitigated some of the frustration I felt at having to go off on tangents in order to understand the bigger picture – it was simply that I didn’t have the knowledge at the multistructural level.

Twitter, the Internet and The Khan Academy

As someone who completed their undergraduate degree in the early 1990s, studying at Masters level was a very different beast. Beyond the level of complexity that obviously exists in the step up, the key difference I noticed was the availability of resources. Now, don’t get me wrong, I love an academic library – the smell of the books, the chance finds in the stacks, the quiet you only get in the obscure corner of the Old English section on floor 10 – but, as a distance learner, the internet has been invaluable to me.

Twitter has been a fantastic source of ideas, suggestions for academic reports and texts as well as a source of data. Without this community of educators, I think my study would have been a sad shadow, and I would have been a very lonely researcher.

One of the challenges I faced was gaining an understanding of descriptive and comparative statistics. As far as I can remember (and it was a very long time ago, so I may be wrong), this was not covered in much detail in my GCSE Maths course. Although I have used maths on a day to day basis in work and as a teacher, this was something I needed to brush up on – that is where The Khan Academy came in. One weekend watching their statistics videos and trying out a few problems, and I had a good understanding of what I needed.

Is the SOLO Taxonomy Effective?

Based on my limited research, it does appear that the SOLO taxonomy can be a useful tool in a teacher’s arsenal. The use of rubrics to identify the knowledge (both declarative and functioning) and stages of learning were particularly useful for making this explicit both for me and the students. The emphasis on looping back through the multistructural-relational-extended abstract levels in order to develop a more detailed and sophisticated understanding helped scaffold the most able and encouraged them to view learning as open-ended.

Knowledge is vital – without relevant knowledge, students cannot progress through the SOLO levels. Direct instruction, whether it is through teacher talk, rubrics or any other direct method, help to provide the  knowledge needed by the student. The rubric can keep this instruction at the forefront while students complete independent tasks – the two do not have to be mutually exclusive.

A key benefit of the SOLO taxonomy is creating a common language for discussion of knowledge and feedback – used by the teacher and in self and peer assessment it can help to ensure the quality and focus of feedback.

Of the SOLO techniques I trialled with my classes, I felt that the use of rubrics, hexagons and SOLO stations were the most useful. The weaker students found the hexagons helpful to pull together their knowledge of a text and bridge the gap between knowing the text and being able to write a clear paragraph about it. SOLO Stations allowed for differentiation, student choice and teacher guidance while giving me the time to work individually with students. The HOT maps were rather hit or miss depending on which type was used – the Part/Whole Analysis was a useful structure for discussing and revising a text in detail.

Given the recent reports from Sir Michael Wilshaw, regarding the brightest students in schools failing to achieve the highest grades, it is certainly interesting that in this small scale study Level 5 students and males taught using SOLO methods did considerably better than their non-SOLO counterparts. Ev ex 2Although it is impossible to know whether SOLO was the key factor in this difference, it suggests that this may be a possibility and would warrant further investigation.Ev ex 4

 

Taken as a whole, based on my personal observations, surveys of teachers and students, a lesson observation and exam data analysis, it appears that the SOLO taxonomy may be effective. As with any teaching technique, it is not a panacea – however, it is certainly worth trying.

SOLO Research Project – Findings Part 1

Overview of the Project

As the project was to investigate an aspect of my teaching practice, I chose to use an action research approach. Alongside this, and the literature review, I also carried out a small scale survey of students involved and a slightly larger scale survey of teachers. The final part of the project was an analysis of exam results (I will go through the findings of the exam analysis in another post).

Throughout the action research I completed a series of blog posts outlining my experiments with three separate SOLO techniques: use of hexagons, use of HOT maps and the use of rubrics and SOLO stations. Within each entry I tried to outline the techniques used and comment on my perception of their effectiveness. Newbury (2001:3) describes the ‘research diary’ as:

A form through which the interaction of subjective and objective aspects of doing research can be openly acknowledged and brought into a productive relationship.

I felt that, as one of the criticisms of the action research model was that results were often restricted to the teacher carrying out the research, it would be helpful if I shared my experiences with other teachers via a blog. As Weston (2012) states in his blog post:

Researchers need to develop a culture where findings are not simply broadcast to schools, but where they engage with increasing numbers of schools to find out how to successfully adapt the approach in different contexts, how to overcome different challenges, and how to successfully combine the idea with other priorities in the classroom.

My observations focused mostly on Year 10 classes, although I also trialled SOLO based activities with Year 11 and Year 12. Classes were chosen using convenience sampling.

Any personal commentary, especially reflecting on one’s own teaching, is subject to bias, as Gavron (1996:159, cited in Biggam, 2011) notes:

It is difficult to see how this can be avoided completely, but awareness of the problem plus constant self-control can help.

 I have endeavoured to keep this in mind through my analysis, and chosen to use data from a range of different sources to mitigate any unconscious bias. In addition, although convenience sampling is not ideal, as the sample size is relatively small and the groups were not chosen at random, this is acceptable for action research.

My Observations

The blog posts on each of the techniques can be found here:
Hexagons – 1, 2, 3, 4
HOT Maps – 1, 2,

SOLO Stations – 1, 2, 3,4

Overall, I felt that the techniques had been useful in conjunction with existing teaching methods. The use of the rubric to specify key elements of the knowledge being taught was particularly helpful for structuring feedback with clear next steps. I will expand on this in my final post (Conclusions).

Student and Teacher Surveys

Unfortunately, the number of students who took part in the survey was small (partly as my time ended up being rather cut short due to my relocation). However, on the whole, the students found the SOLO lessons useful and felt that they had helped them develop their knowledge of the text and how to present their responses more clearly.

In March, I asked for volunteers to complete a short questionnaire about using the SOLO taxonomy in lessons as part of my MA. I was overwhelmed that so many readers took the time to complete the survey – 60 of you in total! Thank you so much for your help.

Evidence 1aThe majority of teachers who responded felt that SOLO techniques were effective and based this belief on a range of indicators, not simply personal observation.

Evidence 1The most popular techniques were, perhaps unsurprisingly, those which have had the most coverage in blogs and are the most straightforward to implement.

Evidence 2My final questions asked which subject the teachers taught and how long they had been teaching. Teachers from a wide range of subjects took part, from science to history, from PE to English – suggesting that SOLO techniques have the potential to be used effectively across the curriculum.

Evidence 3 The findings of this survey certainly suggest that teachers with 6 or more years teaching experience are using social networking and experimenting with new techniques. Now I am not saying that those who have been teaching longer are ‘better’ than those just entering the profession. This is more to do with – the difference between ‘experienced’ and ‘expert’ teachers. Effective, expert teachers are prepared to experiment, and adapt their teaching, not because Ofsted or SMT want it, but because they have decided that it would be beneficial to their students.

SOLO, Learning and Teaching

For educators, there is a need to identify how they can best help students to achieve their potential. School makes up a significant part of students’ young lives, so it is unsurprising that:

Schools shape and change beliefs, both as purveyors of knowledge and as epistemological training grounds for developing students. (Schraw, 2001:406)

The challenge is to balance the imparting of knowledge with providing students with opportunities to develop positive epistemological beliefs. New initiatives often focus on the former, specifically teaching methods, possibly because this is an easier area to demonstrate impact. As Hattie (2012) notes, most of what we do as teachers will have some effect on the students we teach.

OfSTED’s (2012/13b:32) definition of an ‘Outstanding’ school highlights the importance of students ‘making and exceeding expected progress’, whatever their starting point. To achieve this, schools need to know what causes variance between students, both between schools and between students in the same school. Hattie (2003) identifies several elements which are responsible for potential variance in achievement. The most significant factor identified was the student themselves, being responsible for 50% of variance. Student engagement, beliefs and motivation is at the heart of the matter.

Levin (2010:89) explains that:

Schools with higher levels of engagement are more successful with students from all kinds of backgrounds.

This supports Hattie’s (2003) findings that home is less significant an influence than perhaps we might expect.

The second most significant influence was the teacher (30%):

It is what teachers know, do and care about which is very powerful in this learning equation. (Hattie, 2003:2)

However, Schraw (2001:406 summarises a key difficulty with addressing the issue:

The existing research invites the conclusion that schools should make the effort to change beliefs in positive ways, although it is less clear how those changes should occur.

Hattie’s work (2003, 2012) may give us an indication of how these changes should be approached; if both students and teachers are responsible for 80% of the variance between student outcomes, it is here that the focus needs to be. Ideally, a focus on techniques and strategies which encourage teachers to teach in the most effective manner, while encouraging students to learn and develop positive epistemological beliefs.

Students’ Learning

To understand how students learn effectively, it is useful to be aware of a number of key areas. Firstly, how do epistemological beliefs affect learning? And secondly, which specific traits does an effective learner have?

 Hofer & Pintrich (1997:88) define personal epistemology as:

How individuals come to know, the theories and beliefs they hold about knowing, and the manner in which such epistemological premises are a part of and an influence on the cognitive processes of thinking and reasoning.

Resent research into students’ beliefs about learning (Pintrich, 2002; Cano & Cardelle-Elawar, 2004; Dweck, 2006; Barnard et al., 2008; Afflerbach et al., 2013) have highlighted the link between how students view learning and their academic performance. Cano & Cardelle-Elawar (2004:182) suggesting that:

The evidence that secondary school students hold immature beliefs…might go some way to explaining the poor academic achievement of many students.

As teachers, we often see this manifested as a willingness to give up when challenged, reluctance to work hard for results and the belief that they are either ‘good’ or ‘bad’ at a particular subject. I know that, in the past, I have been guilty of this, especially with Maths – in reality, I’m not actually bad at Maths, I just find it harder.

However, Louca et al. (2004:58) assert, in their study of teaching science to 3rd grade students, that students are not aware of these ‘beliefs of theories’, but instead ‘have a range of cognitive resources for understanding knowledge’. With many schools implementing ‘learning to learn’ schemes, students are now more likely to have an awareness of how they learn. At the heart of this awareness, there needs to be the belief that learning is complex and requires effort.

An effective student needs to develop a wide range of skills and attributes:

Learning at school requires students to pay attention, to observe, to memorize, to understand, to set goals and to assume responsibility for their own learning. These cognitive activities are not possible without the active involvement and engagement of the learner. (Vosniadou, 2001:8)

The emphasis, for effective learning and progress to take place, is on the need for students to be self-regulated (Barnard et al., 2008; Nückles et al., 2009; Afflerbach et al., 2013) and for students to have some control over their learning (Skinner et al., 1998, cited in Yeh, 2010; Vosniadou, 2001; Zull, 2002).

What Makes a Teacher Effective?

Researchers and policymakers have often tried to define what makes an effective teacher; however arriving at a definition can be fraught with difficulties. Shulman (1987:6) notes that these definitions often ‘became items on tests or on classroom-observation scales’ which ultimately end up as a restrictive check-list. Levin (2010:90) points out that, proposals for improving teaching ‘have been made many times before’ and that merely listing suggestions is not enough – we need concrete examples of how this might be achieved.

Although our knowledge of how the brain works has developed over the past century, the topic can be a contentious one. Information processing, ‘the mental operations that come between a stimulus and response’ (Malim & Birch, 2005:25), is at the centre of discussion between cognitive psychologists, especially when related to student learning (Vygotsky, 1978 cited in Vosniadou, 2001; Kolb, 1984; Baddeley, 1999; Bischoff & Anderson, 2001; Tsai & Huang, 2001). Kirschner et al. (2006:77) highlight the importance of an understanding of the brain’s processes:

Any instructional theory that ignores the limits of working memory when dealing with novel information, or ignores the disappearance of those limits when dealing with familiar information, is unlikely to be effective.

 As a result of the complexities, and lack of a definitive explanation of how the brain works, there have been disagreements between academics as to the best mode of instruction, in particular between project based learning and direct instruction (Bishoff & Anderson, 2001; Wallace & Louden, 2003; Gauthier & Dembélé, 2004; Zull, 2002; Wu & Tsai, 2005; Kirschner et al., 2006; Hmelo-Silver et al., 2007; Granger et al., 2012; Hodges, 2012). These discussions can become polarised, while the most effective teaching is likely to judiciously use elements from both modes.

However, there also appear to be several areas of agreement; Hattie (2012:16) states that:

The act of teaching requires deliberate interventions to ensure that there is cognitive change in the student; thus the key ingredients are being aware of the learning intentions, knowing when a student is successful in attaining those intentions, having sufficient understanding of the student’s prior understanding as he or she comes to the task and knowing enough about the content to provide meaningful and challenging experiences so that there is some sort of progressive development.

This suggests that an in depth knowledge of the students is one of the hallmarks of an effective teacher. In addition, we can add: high expectations (Levin, 2010; OfSTED, 2012), formative assessment (Black & Wiliam, 2006), differentiation (Hattie, 2003; Yeh, 2010; Hook & Mills, 2012; OfSTED, 2012) and feedback (Hattie, 2003, 2012; Black & Wiliam, 2006; OfSTED, 2012). The SOLO taxonomy can offer teachers a structure for implementing these skills in conjunction with the teacher’s existing strategies.

References:

Afflerbach, P., Cho, B-Y., Kim, J-Y., Crassas, M., & Doyle, B. (2013) ‘Reading: What else matters besides strategies and skills?’ The Reading Teacher, 66 (6), pp. 440–448. Available at: http://doi.wiley.com/10.1002/TRTR.1146 [Accessed March 2, 2013].

Baddeley, A. D. (1999) Essentials of Human Memory. Hove: Psychology Press

Barnard, L., Lan, W., Crooks, S., & Paton, V. (2008) ‘The relationship between epistemological beliefs and self-regulated learning skills in the online course environment’. MERLOT Journal of Online Learning and Teaching 4 (3) pp. 261-266

Bischoff, P.J. & Anderson, O.R. (2001) ‘Development of knowledge frameworks and higher order cognitive operations among secondary school students who studied a unit on ecology’. Journal of Biological Education 35 (2), pp. 81-88.

Black, P. & Wiliam, D., 2009 ‘Developing the theory of formative assessment’ J. Gardiner, ed. Educational Assessment Evaluation and Accountability, 1 (1), pp. 5–31. Available at: http://eprints.ioe.ac.uk/1119/. [accessed 23 August 2012]

Cano, F. & Cardelle-Elawar, M. (2004) ‘An integrated analysis of secondary school student’s conceptions and beliefs about learning’. European Journal of Psychology of Education 19 (2) pp. 167-187.

Dweck, C. (2006) Mindset: The New Psychology of Success. New York: Random House.

Gauthier, C. & Dembélé, M. (2004) ‘Quality of teaching and quality of education: a review of research findings. UNESCO. Education for All Global Monitoring Report. 2005/ED/EFA/MRT/PI/18

Granger, E. M., Bevis, T. H., Saka, Y., Southerland, S. A., Sampson, V., & Tate, R. L. (2012) ‘The efficacy of student-centered instruction in supporting science learning’. Science (New York, N.Y.), 338 (6103), pp. 105–8. Available at: http://www.ncbi.nlm.nih.gov/pubmed/23042893 [Accessed March 11, 2013].

Hattie, J. (2003) Teachers make a difference: what is the research evidence? Melbourne: Australian Council for Educational Research

Hattie, J. (2012) Visible Learning for Teachers: Maximizing Impact on Learning. Abingdon: Routledge

Hmelo-Silver, C. E., Duncan, R.G. & Chinn, C. A. (2007) ‘Scaffolding and Achievement in Problem-Based and Inquiry Learning: A Response to Kirschner, Sweller, and Clark (2006)’. Educational Psychologist  42 (2) pp. 99–107. Available at: http://www.tandfonline.com/doi/abs/10.1080/00461520701263368.

Hodges, G. C., (2012) ‘Research and the teaching of English: Spaces where reading histories meet’. English Teaching: Practice and Critique 11 (1), pp. 7–25.

Hofer, B., & Pintrich, P. (1997) ‘The development of epistemological theories: Beliefs about knowledge and knowing and their relation to learning’. Review of Educational Research 67 (1) pp. 88-140.

Hook, P. & Mills, J. (2012) SOLO Taxonomy: A Guide for Schools Book 2: Planning for differentiation. Laughton, UK: Essential Resources Educational Publishers

Kirschner, P.A., Sweller, J. & Clark, R.E. (2006) ‘Work : An analysis of the failure of constructivist, discovery, problem-based, experiential, and inquiry-based teaching’. Learning  41 (2), pp. 75–86. Available at: http://www.informaworld.com/openurl?genre=article&doi=10.1207/s15326985ep4102_1&magic=crossref.

Kolb, D. A. (1984) Experiential Learning: experience as the source of learning and development. New Jersey: Prentice-Hall

Levin, B. (2010) ‘What did you do at school today?’ Kappan. 91 (5) pp. 89-90. http://www.education.auckland.ac.nz/webdav/site/education/shared/about/centres/uacel/docs/InCanadaWDYDIST1002lev.pdf [accessed 8 April 2012]

 Louca, L., Elby, A., Hammer, D., & Kagey, T. (2004) ‘Epistemological resources: Applying a new epistemological framework to science instruction’. Educational Psychologist 39 (1) pp. 57-68.

Malim, T., & Birch, A. (2005) Introductory Psychology. Baisingstoke: Palgrave Macmillan

OfSTED (2012/13a) The framework for school inspection. HMI 120100. London: OfSTED publications.  http://www.ofsted.gov.uk/resources/framework-for-school-inspection [accessed 15 April 2013]

OfSTED (2012/13b) School Inspection Handbook. HMI 120101. London: OfSTED publications.  http://www.ofsted.gov.uk/resources/school-inspection-handbook  [accessed 15 April 2013]

Pintrich, P. (2002) Future challenges and directions for theory and research on personal epistemology. In B. Hofer and P. Pintrich (Eds.), Personal epistemology: The psychology of beliefs about knowledge and knowing (pp.389-414). Mahwah, New Jersey: Lawrence Erlbaum Associates.

Schraw, G. (2001) ‘Current themes and future directions in epistemological research: A commentary.’ Educational Psychology Review. 13 (4) pp. 451-464.

Shulman, L.S., (1987) ‘Knowledge and Teaching: Foundations of the New Reform’. Harvard Educational Review, 57 (1), pp. 1–21.

Tsai, C-C. and Huang, C-M. (2001) ‘Development of cognitive structures and information processing strategies of elementary school students learning about biological reproduction’. Journal of Biological Education 36 (1) pp. 21-26.

Vosniadou, S. (2001) How Children Learn. UNESCO. Educational Practices Series 7. http://www.ibe.unesco.org/fileadmin/user_upload/archive/publications/EducationalPracticesSeriesPdf/prac07e.pdf [accessed 12 December 2012]

Wallace, J. & Louden, W. (2003) ‘What we don’t understand about teaching for understanding: questions from science education’, Journal of Curriculum Studies, 35, 5 pp. 545-566

Wu, Y-T. and Tsai, C-C. (2005) ‘Effect of Constructivist Oriented Instruction on Elementary School Students’ Cognitive Structures’. Journal of Biological Education 39 (3), pp. 113-119.

Yeh, S. (2010) ‘Understanding and addressing the achievement gap through individualized instruction and formative assessment.’ Assessment in Education: Principles, Policy & Practice 17 (2) pp. 169-182

Zull, J. (2002). The Art of Changing the Brain: Enriching the Practice of Teaching by Exploring the Biology of Learning. USA: Stylus Publishing.

Why Research SOLO Taxonomy?

This is the first in a series of blog posts based on my MA research into the use of the SOLO (Structure of Observed Learning Outcomes) taxonomy in English. I hope that  what I write proves useful and not just for English teachers.

A reasonably obvious starting point is: why did I choose to research the SOLO taxonomy?

A quick glance at the TES or Twitter will reveal that teachers are under pressure. The need to achieve year on year improvements in results, as well as a dearth of time available, means that it is not surprising that many teachers are looking for a ‘magic bullet’– something that is effective and involves little additional work. The danger is that schools and teachers are not appropriately critical when selecting and promoting techniques in the rush to achieve the desired results.

Over the past few years a range of different ideas (e.g. Brain Gym, VAK, de Bono’s Thinking Hats) have been promoted in schools, often supported by ‘a thriving commercial industry’ (Coffield et al., 2004:118). While some of these offer useful techniques which can easily be incorporated into the teachers’ everyday lesson, others can become overly burdensome without empirical evidence that the technique actually works (Harrison et al., 2003; Krätzig & Arbuthnott, 2006). Key here is the fact that, while scientific research may indicate a result as suggestive, all too often the results are distorted or overstated (Swaffield, 2009).

How many of us have sat through a CPD session run by an expensive expert, or an enthusiastic member of SLT, and questioned whether it is actually worthwhile? How many have spoken up to challenge ideas that we know are not proven, or (often more likely) sat squirming and wishing that we had the nerve to speak up? In budget conscious and results-driven schools, staff buying into ineffective techniques and strategies (physically and metaphorically) can drain money from where it is most needed.

It is, however, important that teachers are proactive in trialling and using techniques which they believe may be of benefit. Levin (2010:90) explains:

If data from students could be linked to changes known to be effective – for example, improved assessment practices or greater student choice in assignments – we might start to see some lasting and worthwhile changes in the way students experience our high schools.

It was with this in mind that I became cautiously interested when discussions  on Twitter mentioned something called the SOLO (Structure of Observed Learning Outcomes) Taxonomy. Initially, it was mentioned by a small number of UK based teachers who provided more detailed examples on their blogs (Tait Coles, David Didau, Lisa Ashes).

While willing to try new teaching ideas, the key question for me is: what evidence is there that this works? A brief search of academic journals (via the wonderful Google Scholar) identified a number of articles, mostly focusing on the use of the SOLO taxonomy in geography, science or at university level (Munowenyu, 2007; Biggs & Tang, 2009; Brabrand & Dahl, 2009; Prakash et al., 2010).

I was also aware that the use of the SOLO taxonomy was widespread in New Zealand (Hattie & Brown, 2004), being linked to assessment and curriculum models, and through a number of New Zealand Tweachers’ contributions to Twitter discussions. However, it became clear that there was very little research on its use in the UK education system, and little available on its use in teaching English literature beyond blog posts and anecdotes. I therefore decided to try a relatively simple technique – the use of hexagons to link ideas. The results from this initial foray were genuinely surprising, however, could easily have been a fortuitous coincidence. Therefore, I decided to base my study on the effectiveness of the SOLO taxonomy in GCSE English Literature. I hoped to be able to demonstrate whether or not the SOLO taxonomy was effective in improving student results and clarify whether this technique was worth adopting at departmental level and beyond.

References:

Biggs, J. & Tang, C. (2009) ‘Applying constructive alignment to outcomes-based teaching and learning.’ Training Material. “Quality Teaching for Learning in Higher Education” Workshop for Master Trainers.  Ministry of Higher Education. Kuala Lumpur. 2010. http://drjj.uitm.edu.my/DRJJ/MQAGGPAS-Apr2011/What-is-CA-biggs-tang.pdf [accessed 19 August 2012]

Brabrand, C. & Dahl, B., (2009) ‘Using the SOLO taxonomy to analyze competence progression of university science curricula.’ Higher Education, 58 (4) pp. 531–549.

Coffield, F., Moseley, D., Hall, E., & Ecclestone, K. (2004) ‘Learning  styles and pedagogy in post-16 learning: A systematic and critical review.’ Learning and Skills Research Centre. Report No. 041543.

Harrison, G., Andrews, J., & Saklofske, D. (2003) ‘Current perspectives on cognitive learning styles.’ Education Canada. 43 (2) pp. 44-47

Hattie, J. & Brown, G. (2004) ‘Cognitive processes in asTTle: The SOLO taxonomy.’ University of Auckland/Ministry of Education. asTTle Technical Report 43. http://e-asttle.tki.org.nz/content/download/1499/6030/version/1/file/43.+The+SOLO+taxonomy+2004.pdf [accessed 6 March 2013]

Krätzig, G. & Arbuthnott, K. (2006) ‘Perceptual learning style and learning proficiency: a test of the hypothesis.’  Journal of Educational Psychology. 98 (1) pp. 238-246.

Levin, B. (2010) ‘What did you do at school today?’ Kappan. 91 (5) pp. 89-90. http://www.education.auckland.ac.nz/webdav/site/education/shared/about/centres/uacel/docs/InCanadaWDYDIST1002lev.pdf [accessed 8 April 2012]

Munowenyu, E. (2007) ‘Assessing the Quality of Essays Using the SOLO Taxonomy: Effects of Field and Classroom-based Experiences by “A” Level Geography Students.’ International Research in Geographical and Environmental Education. 16 (1) pp. 21–43.

Prakash, E. S., Narayan, K. A., & Sethuraman, K. R. (2010) ‘Student perceptions regarding the usefulness of explicit discussion of “Structure of the Observed Learning Outcome” taxonomy.’ Advances in physiology education. 34 (3) pp.145–9. http://www.ncbi.nlm.nih.gov/pubmed/20826769 [accessed 6 March 2013]

Swaffield, S. (2009) ‘The misrepresentation of Assessment for Learning – and the woeful waste of a wonderful opportunity.’ Work in progress paper. AAIA National Conference. Bournemouth. 16-18 September. http://www.educ.cam.ac.uk/centres/lfl/current/papers/swaffield_aaia09.pdf [accessed 30 March 2013]

CPD and Randomized Controlled Trials

Evidence based ideas in education has been a hot topic over the past week or so – and not before time, in my opinion.

Whenever new ideas are brought forward, some teachers will always refer to the ‘tried and tested’ methods they prefer (some of which are actually just tried rather than ‘tested’). Equally, there is the counter issue where some teachers, or school leaders, come up with some new idea and proceed to insist that everyone else jumps onto their bandwagon. Both situations are less than ideal and, believe it or not, Michael Wilshaw appears to agree:

We, and in that word “we” I include OFSTED, should be wary of trying to prescribe a particular style of teaching, whether it be a three part lesson; an insistence that there should be a balance between teacher led activities and independent learning, or that the lesson should start with aims and objectives with a plenary at the end and so on and so forth. We should be wary of too much prescription. In my experience a formulaic approach pushed out by a school or rigidly prescribed in an inspection evaluation schedule traps too many teachers into a stultifying and stifling mould which doesn’t demand that they use their imagination, initiative and common sense.

Michael Wilshaw’s speech – via @oldandrew teachingbattleground.wordpress.com

It should be the teacher’s decision which methods they use in their classroom, based on their professional judgement and available evidence. The availability of this evidence is, in itself, an issue – one which I will look at in a little more detail below.

However, sadly, this freedom to teach, according to our own professional judgement, does not seem to be the reality of OfSTED or of many schools. Schools seem to be obsessed with OfSTED these days. What data does OfSTED want to see/expect you to know? What sort of lesson do they want to see? Which teaching methods? Sometimes this obsession seems to be almost to the exclusion of whether this actually helps the students who are in front of us for the 180-odd days that OfSTED are NOT in school. The Telegraph’s article about ‘mock’  inspections highlights my point. Surely the focus should be on improving teaching and learning, rather than identifying which hoops a possible inspector may want us to jump through? In any case, as highlighted in this blog post, how does OfSTED help schools improve the actual teaching and learning?

We, as teachers, need to return the focus in our schools to our core purpose, to teach our subjects to the best of our ability and prepare young people for life beyond school. One area we could start with is CPD.

We could use CPD time to enable teachers in school, or across a local area, to collaborate on research projects, work on randomized trials and present the findings  for other teachers.  Ben Goldacre‘s (@bengoldacre) recent report suggests that:

By collecting better evidence about what works best, and establishing a culture where this evidence is used as a matter of routine, we can improve outcomes for children, and increase professional independence.

But no! CPD tends to pander to the latest perceived OfSTED desire, or fads supported by colourful brochures and expensive external speakers. It is strange that, in a profession full of postgraduates, our in-school CPD so rarely takes that into account. Instead, we are given watered down ideas, gimmicks without solid evidence, or worse: we are expected to relive a lesson through card sorts and role play. Stay in teaching any length of time and it is likely that you will sit through similar presentations without new input – not exactly differentiating for your audience.

When I started teaching, about 12 years ago, we had a departmental day at the start of the term, no agenda from above, no mention of OfSTED, no death by PowerPoint – we were trusted, as professionals, to know what needed to be done. One of the sad things is that, as accountability and OfSTED come to the fore they are accompanied by, what could be called, a ‘dumbing down’ of the profession. We can’t be trusted to work on our own on projects, almost as if we were a naughty bunch of year 10s who will nick off to the toilets for a fag as soon as the teacher’s back is turned.

The opportunity to make informed decisions about what works best, using good quality evidence, represents a truer form of professional independence than any senior figure barking out their opinions.  A coherent set of systems for evidence based practice listens to people on the front line, to find out where the uncertainties are, and decide which ideas are worth testing.

Ben Goldacre

To raise the profile of the profession externally, and encourage a sense of this professionalism within schools, we need to be more aware of evidence and research – if school leaders want teachers to use a particular strategy, give us evidence as to its effectiveness, suggestions for further reading, or a chance to be part of a randomized trial perhaps.
For a profession that exists under almost constant change, education can be very resistant to change and the idea of randomized trials can cause tension, as Goldacre says:
most people start to become nervous: surely it’s wrong, for example, to decide what kind of education a child gets, simply at random?
This may certainly explain some of the negative reactions that Ben’s  Guardian article received. But if we are honest, this happens all the time: the make up of a class, timetabling that creates split classes, a new syllabus, the new idea you choose to use, a teacher on long term sick leave, a PGCE student on a placement. We are not talking about throwing out everything we do to replace it with something else. Instead, the idea is to “decide which ideas are worth testing” and start there.
I have found Twitter an excellent starting point for this type of discussion, the sharing of ideas and sources of information with teachers across the globe is fantastic. I would hope that some of this turns into concrete academic research.

Teaching and education are emotive subjects – we all remember the teacher who inspired us, just as we remember the one who did not. In our rush to do the best we can for the young people in front of us, we need to take a little time to reflect, and question, whether what we are doing really allows us all to reach our potential.