“It’s all evidence-based” is an increasingly common mantra and, at face value, a welcome trend. But do the claims always stand up?
It is fashionable now for TV news, radio debates and government initiatives to lace their pronouncements with this reassuring phrase. The problem is that interests remain: commercial, political and lobbyist. In a competitive media world, companies, parties and organisations now use evidence claims to attract attention.
There are countless ways to dress up research results to add unjustifiable weight to a weak claim. Single studies can be cherry-picked, even though they diverge from the general trend of results. Conclusions from some studies might fail to disclose their limitations. Graphical information can be manipulated to emphasise favourable trends.
Such distortions can have serious effects in fields such as medicine, environmental science and civil engineering. In education they can also prove damaging, as the consequences of selective education, for example, show.
Fortunately a new tool from the Coalition for Evidence-Based Education (CEBE) aims to help practitioners, leaders and the general public combat this tendency. A website, ‘Assessing Claims in Education’, offers advice on how to judge a claim, using some 40 nuggets of information. Is correlation masquerading as causation? Are comparisons fair? Are results transferable?
What do confidence intervals and statistical significance tell us? The website is part of a broad international initiative, launched in healthcare and now spanning fields as diverse as agriculture, environment and social welfare. Many aspects of bad evidence claims are common to all fields, so experience elsewhere has enabled the CEBE team to adapt a large body of evidence about evidence for the benefit of education.
The tool has been designed for use in professional development sessions as well as for the individual. It is useful for curriculum leaders as well as research champions. The team is keen to refine the tool in response to user feedback, so please let us have your views.
Andrew Morris is an honorary senior lecturer at the UCL Institute of Education and a member of the national planning group of the Learning and Skills Research Network. Andrew is president of the education section of the British Science Association.
Watch the SET webinar recording with Charlotte Bonner, National Head of Education for Sustainable Development at the Education and Training Foundation (ETF), to get insights into experiences and opinions of FE professionals relating to sustainability.
In the latest episode from the Education and Training Foundation (ETF) podcast, Paul Tully, Strategic Researcher at the ETF, is joined by training expert, Joanne Miles, to discuss how teacher research in the form of supported experiments can strengthen professionalism and raise standards in teaching and training.
Resilience. Recovery. Building back better. Reconnection and Re-engaging: These are common words in the current landscape of education and workplaces and was the topic of a recent SET Special Interest Group event I was invited to attend, writes Georgie Ford, Advanced Practitioner in Mental Health and Wellbeing at Weston College.