Monday, September 12, 2022

Teaching students to assess the credibility of claims.

 Teach them to think?

Wise owl teachers used to suggest that the fundamental purpose of schooling is to teach young people to think.  For some reason, that priority never quite made it to the curriculum, at least, not in any classroom I was seated in.  Previously I have praised the National Curriculum for bringing a step change in the quality of the educational experience, an opinion I strongly maintain, as it specifies core areas of knowledge and understanding and also attempts a balance between knowledge content and skills acquisition, in Science and other subjects.  The first (1990) NC for Science had seventeen attainment targets, the first of which was specifically about the nature and processes of Science. ('Exploration of Science' was its title.) The perhaps inevitable slimming down that followed unfortunately led to not only the distillation of 17 attainment targets into a more manageable programme that respected workload concerns, but also a severe pruning of AT1.  The ambitions that had been nurtured in the design of the Science Curriculum were not preserved in the modified version.  In particular, the directions to show students how science skills could be demonstrated in connection with historical developments in science, such as our developing understanding of the nature of the solar system, were removed.   Such narratives and investigations could perhaps have been reintegrated into other sections of the repackaged curriculum, but textbook writers and exam specification authors generally did not value this priority.  I rather wonder how many of them realised how important it was.

In more recent years, the DFE under ministers such as Michael Gove directed a particular refocusing of the delivery of the National Curriculum which had implications for the way the balance of skills and knowledge would be addressed.  The EBacc (English Baccalaureate) statistical performance measure became a hoop through which schools, and therefore students, would be forced to jump. Slimming down administration and cost cutting became excuses to remove coursework, and therefore, skills development, from the curriculum.  This need not be the case, it could be objected, but this would be naïve.  If it isn't going to be examined, then schools won't teach it.  The 'National Curriculum' is not the sole basis for shaping the educational journeys that students might undertake.  The nature of the final examination syllabus and the assessment regime in which that journey is completed are also key shapers of the wider unwritten curriculum that students experience.

Less admin, more teaching.  Quite so.  Focus finances on teachers and the classroom and laboratory experience.  Absolutely.  Avoid burdening 15-16 year old students with punishing exam and coursework schedules.  Well indeed.  But the management of time, money and bureaucracy are not educationally neutral activities.  Are we now better positioned to teach Science and grow new scientists, as well as a generation of students who understand what Science is and its ongoing contribution to society?  

Many of us are not convinced that we are.  We fear that we have rather gone full circle, and post-Gove's reforms, are back in a distinctly Dickensian situation.  In the opening lines of 'Hard Times' (Charles Dickens, 1854) the teacher's manager put it like this:


Critical Thinking 

A few years into my career there was a small victory for those wise owl teachers I reminisced about.  A one year AS level course (half an A level) was developed that proved popular with sixth forms who wanted to broaden their students' experience without adding to the content burden they faced.  It was a requirement in my school for students taking two A levels, and an option for those following three- typical flexibilities in the non-National Curriculum years after GCSE.  The course taught students the formal nature of an argument, being the making of a claim with some evidence.  Through a sequence of case studies, in which class discussion was the default activity, we would attempt to get better at thinking.  Some studies would look at topics that are easy to critique, such as recent product advertising media, while others would engage more challenging topics such as Nazi anti-Semitic propaganda from the late 1930s.  Note that the inception of this course predated the common use of the internet by students.  The only 'content' required in this curriculum were the criteria for evaluating sources of information and the claims based on them, so-called credibility criteria which might be summed up in mnemonics such as RAVEN or CRAVEN, viz



At times it could be challenging to keep students' minds focused (is it ever thus?!) on the skills being developed rather than the content that was in question at any time, since it would only ever be skills rather than content that would determine their examination outcome.  But this rather begs a question.  Is good thinking, so-called critical thinking, only about the process of thinking, or does it matter what is being thought about?  I will come to this below.  But the point in question in the AS course was about the evaluation of sources of so-called evidence, and the basis on which claims are being made.  This is a reasonable enough aim, and further resources have been developed to assist students at all levels post GCSE.  Here is another mnemonic which brings a different focus to the criteria that could be used to evaluate discrete sources of information.  'CARS' is more tailored to the pitfalls of the internet age, where students can so easily be caught out by web sources of dubious academic reputation (if any!).


The cartoon below is a modified version of one that used to amuse my students tremendously- you can see that there is now a computer featured, which did not appear in the original.  As I write, Putin's war against Ukraine is passing into its seventh month; this cartoon offers a deeply cutting analysis of the 'sources' emerging from both sides.


Thinking skills at 11-16


Should we be teaching all students to think about these, or other things? Surely these skills do belong in the KS3 and 4 curriculum, not just as an option for post-GCSE students following an academic learning route? The cautious might reply that we ought not overburden the younger and less able students whose requirement for a basic set of GCSE results is a higher priority.  This debate is ongoing, but I will observe here that some younger students are being introduced to critical thinking skills and familiarity with credibility criteria under the heading of 'Gifted and Talented', or 'Higher Ability Pupils' as they are latterly described.  Schools are developing bespoke in-house extra-curricular programmes to assist those so identified (and it is entirely up to each school how they do that) to reach their full potential.  In principle it is recognised that students who do well in the standard curriculum don't need or appreciate more of the same, but rather something different.  So I find myself delivering a speed course to a few 13 year olds on credibility criteria and critical thinking skills.  For some reason, they are much amused by this alternative mnemonic, which I've given out at the end of the course as a plenary.


Teaching about the credibility of claims in Science and Religion studies

If you are a teacher or student who is unfamiliar with the resources I have referred to above, then I hope that you will be much helped by this discovery.  There is a reference to a full slide deck below on Critical Thinking that will repay further study. Whether offered as a discrete section of the curriculum at any key stage or not, your teaching and learning will certainly benefit from the strategic perspectives deployment of these perspectives, not least at a time when 'fake news' is a phrase that has entered students' everyday vocabulary.  However, this is all preamble to my intentions in this blogpost.  As I hinted above, there is a bigger question at issue.  

The first drafts for Critical Thinking adopted the mnemonic RAVEN, but many took to adding a 'C' for Context (or Circumstantial matters).  What may be considered a reasonable and uncontroversial claim in one context is not (necessarily) in another context.  Meeting the other RAVEN criteria then becomes insufficient.  
The 'C' in CARS stands for credibility, which chiefly refers to the academic credentials of the author(s) in question, and this is an important point to emphasise with students.  But this higher level language (tier 3?) perhaps hides that credibility is fundamentally about whether a particular claim, and the person making it, are believable.  We are being asked to show faith in the overall claims of the author, based on their training and expertise, speaking as we hope they are on behalf of their wider academic community.  'Facts' are only presented as factual in that field because there is general agreement that such-and-such things are indeed the case, as best as they can tell. 
So this also overlaps with the 'A' in CRAVEN; whether the so-called experts, with their prior training and qualifications, are indeed able to see/perceive as would be required to give a valid basis to their claims to adjudicate that certain things are facts.
In CARS, the 'R' is for reasonableness, which is to say, is there discernible bias, or unprofessional motivation, or an important flaw in the consideration of alternate possibilities?  It is one thing to examine these matters as they apply within a specific subject area, but quite another when the question is interdisciplinary in nature.
The 'P' for purpose in CRAAP is helpful in this regard.  This heading helps us to grapple with the reality that information/ knowledge, or claimed facts, are not necessarily to be considered objective statements that simply exist.  They must have a foundation, and this can be very secure for certain purposes (and so treated as factual), but if deployed for other purposes, then this does not apply. 




All this is not to argue for some post-modern denial of any kind of objective truth or our ability to know about the world with reliable accuracy, but rather to argue for the necessity for some appreciation of philosophy, especially our philosophy of how we know anything, which is called epistemology.  We are thus faced simultaneously with three challenges if we are to apply all this to interdisciplinary questions in science and religion studies.

1.  What is religious knowledge? ( I felt like putting that first...)
2. What is scientific knowledge?  (Does it even matter what order they go in?)
3. How could we relate 1 and 2 together?  (and what about others...  ?)

I visited the Natural History Museum in South Kensington recently, and noticed some folk wearing T-shirts adorned with the Neil deGrasse Tyson quote above.  It's a good basis to start from, given the enthusiasm for anti-scientific conspiracy theories and COVID denialism that is going around at the moment.  I hope to teach my students to place a great deal of trust / faith/ credulity in the claims of Science to show us what the world is like and how we can interact with it appropriately.  

But if the purpose behind the pronouncements of a scientist is to wield the valid findings of science as knock-down evidence in a boundary question, or across the border of boundary questions in another discipline where the rules of science cannot apply, then they lose credibility as a reliable and qualified speaker, no longer being an expert, and now only giving an opinion.
It is regrettable that the extensive scientific training most scientists and science teachers have received lacks the philosophical insights that would safeguard them all from making simplistic and invalid generalisations about the powers of Science, without regard for its limitations, as though admitting such limits would undermine Science in any material way.  Perhaps it suits those with atheistic and humanistic commitments to have it so.
It is regrettable that too many with proper and respectable commitments to theism in one form or another (but certainly including a significant number of so-called evangelical Christians) lack the philosophical insights that would safeguard them from making simplistic and invalid critiques of Science, suggesting, for example, that the nature of Science being such that it holds even its strongest theories in an open hand, constantly open to review and modification as and when new evidence comes to light, therefore stands as a fundamental flaw to the whole discipline, undermining the whole of Science. 'You admit that you are never totally sure- so you have nothing certain to say!'  Perhaps it has suited them to have it so.
What we lack in our society is a general appreciation of what Science and those who are engaged in it are really able to see and perceive. (Elsewhere I have commented on the phenomena which show that the cosmos is both regular and very surprising) An education that facilitated this outcome would ground a proper appreciation of what scientists can properly claim to be facts, both by scientists and the public at large. If such activities were a universal feature of the religious education of all our students, not merely those who opt for a sufficiently advanced qualification as at present, then future generations can be enabled to respect the particular assumptions of believers and non-believers of various sorts, and evaluating which sorts of claims can be considered truth claims because there is some sort of validated evidence to back them up, and which are not, though can perhaps be respected for other reasons.  It is proper that we should be teaching students to understand what the purpose is behind all the subject disciplines, therefore giving them a sense of the extent to which balance and the consideration of alternative perspectives is valid, and indeed, vital.  Let's be clear, as I give some guidance on (3) above: we should all be affirming that Science is a powerful way of knowing about the cosmos and it offers us much knowledge that we should rightly consider in the category of facts, even if certain matters are subject to revision.  Yet there is a great deal that we now know we do not know, and this does indeed include matters on which various people hold what we can respectfully categorise as religious views.  Faith of a rather more active sort applies to them, and Science might offer assistance in sorting between those that are more or less reasonable.  However, since Science itself now shows us that the cosmos is less predictable and more surprising than was predicted/ expected one hundred or so years ago, Science certainly has no authority to adjudicate on which (religious) beliefs are more or less likely to be true by itself.  We may find other grounds for that. {But we might not, which is what is meant by the 'theory laden-ness of facts'} If there is to be better thinking in the future, of a critical and rigorous kind that assesses claims against credibility criteria, then this will be informed by all the subject disciplines, not solely by science.  Might Charles Dickens still say that we will likely need to engage in more philosophical exercises with teachers and students, and especially those who direct them? 

Notes, links and references

http://www.online-literature.com/dickens/hardtimes/2/

My claim is that there has been untoward interference in the reshaping of the curriculum by a number of non-educational agents, including government ministers, especially Michael Gove.  Others would go further to accuse many before him of also engaging in an overtly 'P'olitical project under the guise of constructing a general curriculum. For example: oai:eprints.ucl.ac.uk.OAI2:10021590  The National Curriculum: the natural evolutionary product of two decades of debate and development? Or a device for keeping the world Tory?  Patrick Trevor Willan  1 January 1995 Institute of Education, University of London.  Perhaps this all goes to show the peril involved in discussions of God, sex and politics- especially all three at once.

https://slideplayer.com/slide/243756/  Unit 501 'Critical Thinking'
https://lewisuwritingcenter.files.wordpress.com/2014/02/cars-checklist-for-evaluating-sources1.pdf
https://twitter.com/BlissfulBunbun/status/1474833698453278721/photo/1 ALSO at https://9gag.com/gag/abGgQ1B 
Similar CC4 source at https://libguides.cwc.edu/bias AND https://www.oercommons.org/authoring/54677-media-bias-handout/view MODIFYING THE ORIGINAL AT https://library.csuchico.edu/sites/default/files/craap-test.pdf  OR https://www.facebook.com/UWStoutLibrary/photos/a.10150674191761280/10158515308611280/?type=3 
https://twitter.com/neiltyson/status/1381197292728942595
https://www.rit.edu/cla/philosophy/quine/theory_ladenness.html



Monday, September 5, 2022

Conspiracy theories, stress testing credulity and Bertrand Russell's atheism.

Some science lessons happen outside of the regular classroom or science laboratory.  I was at the barbershop the other day getting smartened up for the new school year.  My eastern European barber didn't take very long to work out that I am a science teacher, or he may have remembered that from a previous visit.  'I have one question,' he told me.  I made a bet with myself that there would be more than one.
 

"How were the pyramids built?  Surely it was aliens, as they are just too good?" 

Now I've not had this come up in class, but I have heard this sort of thing before.  As there were no other colleagues or customers, I was up for both fun and some gentle exploration.  I also realised I was already back in my day job, as his English was good enough to ask the question, but not to cope with me throwing fancy words at him.  

"Why would you think such a thing?" I asked.  Sure, the Great Pyramid is a big pile of stones, some over 50 tons in mass, though most of the 2.3 million stones are 'only' 2.5 tons.  I boosted his ego by saying that he'd fit right in with the Egyptian workers with their big muscles and big brains, to work out how to cut and carry those stones in a logical order from quarry to rock pile using rollers and ropes and machines they could make from timber, stone and perhaps copper or alloy tools.  The most important point is that the fertility of the Nile delta was so extraordinary that the farming population are thought to have had nothing much to do for six months of every year for under three decades, so they talked themselves into building a monstrous construction of limestone and granite.  These days there's Lego.  Historical researchers seem to think that as few as 10 000 men could have done this work and finished the largest pyramid within their lifetimes.  But the construction was nothing to do with Charlton Heston or Israelite slaves, or slaves of any other sort.  Skilled work isn't done by slaves.


While admitting that this is still a highly demanding undertaking, with significant costs to human health and wellbeing, it was not at all beyond possibility or reasonable belief.  A simple channel dug around the site can provide a water trough that acts as a very precise level for the measurements that were required.  There are further mysteries to solve in our understanding of exactly how this mammoth task was carried out, but it was not a superhuman accomplishment.

There was a short pause as my busy friend pivoted to work at the other side of my head.

"OK- another question."

I knew there would be more.

"Is the earth flat or ... round?"  We progressed from 'ball' to 'sphere' in raising the vocabulary to an analytical level.

We were still alone, so I went for his funny bone.  "Have you been watching the cable channels at 2am after too many beers?  Is this just barber shop banter, or are you for real?"  Now I can only take what he said in reply at face value.  Though he chuckled at the imagery, he gave me to understand that he was serious, though he had been watching some such programme.



The Artemis 1 manned moon test was aborted last week, and the second was also unsuccessful, showing that the propellant leaks weren't fixed, but I went back to Apollo. "Do you think that 12 men went to the moon when I was a boy in the 1970s, or do you think that was that made up in film studios in Hollywood?"  "I don't know," he began but after some consideration, he conceded that these journeys were real, so I didn't need to point out that the Soviets would have called it out if the Americans had faked it.  Perhaps he was just going along with me, though I continued to be a little nervous about my powers of argument as he was holding those sharp clippers very close to my ear.  "What shape did they see the Earth was?" "Can you see all the countries around the world as it turns?"  He agreed that our planet does indeed appear to be round, and that this is not a flat disc, but a spinning ball.  My strategy of taking a distant and more objective view, to see that the moon is not just round but spherical, and that this viewpoint makes it possible to see the spinning and very spherical Earth unsupported in space, seemed to have paid off.


I made a little effort to say that this understanding of the true nature of the shape of the Earth, its rotation and our grasp of the insights of Isaac Newton made this sort of extra-terrestrial travel possible, with Space X recently placing a Tesla car into orbit beyond Mars, but he wasn't done.



In halting English he did his best to explain, waving his empty hand in the air.  "What about the ships that sail away over the edge?  Why can't you see them tilted?"  A reasonable enough question- because it is indeed hard for us to get to grips with just how large the Earth is.  Sure, it curves over toward the horizon, but the distant boat doesn't tilt, as far as we can see, as the planet is so large.  I'd like to have had this picture to hand to show him.


We'd got as far as this conversation was going that afternoon.  My haircut was done, and further customers had arrived. I managed to squeeze in a plenary- which can be tricky to do even at school- drawing this comparison, as I paid up my fee.  "This has been great.  When I walked in today you thought that the pyramids were too hard for the Egyptians to build, not having access to our modern technology, so aliens must have done it.  But those old guys were smarter than people say.  Then you tried to tell me that even though we now have modern technology, to build rockets and planes and phones, we couldn't trust people who tell us that the Earth really is a sphere. (Though I did think I'd convinced him by this time.) Don't throw your brains away!"  

I could be a bit blunter now, as he had put his clippers down.  He nodded, seeming sufficiently convinced.

Since this really is a true story, you will imagine that I was pretty happy with how this conversation went, and not at all surprised to hear that I anticipated writing this blog post as soon as possible.  Nevertheless, there is more to say here, because while the matter of credulity is relevant to a discussion of the limits of science, my barber shop student didn't get to grill me about my interest in science and religion.  I wonder if I would have found words for that just then.  Where might we go?

When I tell my older students about Russell's teapot I deliberately mix it up with the quip about the usefulness of a chocolate teapot.  The outspoken atheist simply invoked a regular china teapot in his analogy, as summarised above.  So I ought to quote him accurately.  But the key point is this.  I do not believe there were any stray kitchen utensils orbiting in the solar system in 1952 when Russell wrote his article, though there is plenty of space junk up there now.  Nevertheless, I do support and promote that there is a particular God who is supernatural and transcendent, and also immanent in nature, both sustaining the cosmos and capable of exercising agency within it.  Such activity would generate evidence, some of which should be discernible, and some of that within the boundaries of science, at least in principle.

However, Russell was mistaken.  Firstly, he implies that belief in a supernatural deity is of the same sort as accepting the hypothesis of a very small (and therefore, for us, invisible) teapot in orbit around the sun between the orbits of Earth and Mars.  Why is this an error?  Simply because it limits the conception of deity to that of an object within this universe, and one that is necessarily visible in some quality and dimension observable by means of science.  


Secondly, Russell's argument also rests on the assertion that all rational 'science' is the product of verifiable observation.  This blog has rehearsed two important flaws in that view of science.  Firstly, we now accept that there are many aspects of our universe that are considered real even though they are invisible, including so-called Dark Matter and the temporary products of the quantum vacuum.  Further, we have established that the laws of science are descriptions of what generally happens, but these descriptions of regularity are not a barrier to other phenomena.  Indeed, we are still none the wiser about what the laws actually consist of.  What makes them work, what breathes fire into the equations? (Stephen Hawking, A Brief History of Time.)

In intent, of course, Russell's argument stems from his belief that the very idea of a Deity in communication with our cosmos, exercising agency over it, is simply fanciful, and not at all to be taken seriously as it has no basis in reality or human experience of any kind.  Some will agree with Russell in this regard.  We can and should introduce our students to Bertrand Russell and his point of view.  Perhaps there is a God; perhaps there is not.  It remains logically possible that the existence of a regular law-ful universe is the free product of a supernatural Creator Who sustains it, and us within it, or not.  But neither option is made more or less likely as a result of stepping outside the spaceship to Mars to take tea with Bertrand Russell.

As is commonly the case in debates between atheism and theism, the straw man argument is at work.  As a Christian, I am happy to affirm that I don't believe in the 'God' that Russell wants to say he does not believe in.  Put simply, his straw God is too small.

I wonder what Russell would have made of this:


There is a webpage given below that makes useful comments, highlighting the risk of misinterpreting Russell's argument.  I agree that the issue is NOT about the assertion of an actual teapot in space, but rather the challenge of disproving a negative.  But I think this humorous caption hints at a deeper truth that isn't noted in the webpage.  God's agency is sovereign, requiring nothing for its basis and depending on nothing for its freedom.  Or more crudely, God launches Godself.


References and notes.

Science lessons at the barbers:  Stress testing credulity while he's holding the clippers.

Alien pyramid image: https://pxhere.com/en/photo/1213368
Giza pyramid: https://commons.wikimedia.org/wiki/File:Giza_Pyramid.jpg
https://upload.wikimedia.org/wikipedia/commons/thumb/8/81/Flatearthfalsification.svg/613px-Flatearthfalsification.svg.png
Apollo 17 photo: https://upload.wikimedia.org/wikipedia/commons/thumb/6/60/Earth_over_Moon_-_Apollo_17.png/854px-Earth_over_Moon_-_Apollo_17.png
https://www.flickr.com/photos/spacex/40143096241
Two ships near the horizon: https://www.ucl.ac.uk/culture-online/ask-expert/your-questions-answered/earth-flat-or-circle
Russell's teapot slide: https://i.pinimg.com/originals/05/5b/51/055b51c34bff889dc0332e327febc22e.jpg
Wiki article: https://www.tau.ac.il/~tsirel/dump/Static/knowino.org/wiki/Russell's_teapot.html
Solar system graphic with hypothetical teapot: https://en.wikipedia.org/wiki/Russell%27s_teapot#/media/File:Russell_teapot.png
Fuller debunking of Russell's 'inept' argument at (three free articles per month access) https://medium.com/@jrcii/debunking-russells-teapot-aa06417c0137 
Cartoon and explanatory commentary: https://www.explainxkcd.com/wiki/index.php/1866:_Russell%27s_Teapot

“Even if there is only one possible unified theory, it is just a set of rules and equations. What is it that breathes fire into the equations and makes a universe for them to describe? The usual approach of science of constructing a mathematical model cannot answer the questions of why there should be a universe for the model to describe. Why does the universe go to all the bother of existing?”


― Stephen Hawking, A Brief History of Time

Teaching students to assess the credibility of claims.

 Teach them to think? Wise owl teachers used to suggest that the fundamental purpose of schooling is to teach young people to think.  For so...