4 critical thinking mental models to use when exploring research

In a few recent weekly newsletters I have been exploring some mental models for interrogating  research. These mental models are a handy set of structures and ideas to apply to any research you might be exploring.

With growing access to research in education we need to be better equipped to think in a critical and creative way about what is shared. The emphasis on evidence informed decisions means there is a need for more critical thinking tools or models like I share below.

Correlation does not imply causation

The example of research that started me down this path was some of the emerging research findings into learning spaces from Melbourne University led by Dr. Wesley Imms.

In particular how they have been reported – take this quote from Dr Imms:

we’ve found a very strong correlation between innovative learning environments, high levels of deep learning and high-quality teaching.

The first mental model we might use is: ‘Correlation does not imply causation.’ This is directly related to the quote from Dr. Wesley Imms. We might safely assume his words were chosen carefully.

What does ‘Correlation does not imply causation‘ mean? Well just because we have innovative learning environments and we have observable high levels of deep learning and high quality teaching, it does not necessarily mean these positive outcomes were caused by the innovative learning environments.

Cause and effect is much harder to capture and that is why research continues.

Check out these Spurious Correlations for a more alternative explanation of this mental model.

The Hawthorne Effect

Some other related mental models we can deploy here are things like the Hawthorne Effect. This explains that sometimes the effect of an intervention is because observation (paying attention to people) alters behaviour positively. An ongoing research challenge I imagine.

Gambler’s Fallacy

Gambler’s Fallacy, also related to statistics, is the belief that future probabilities are influenced by past events. “Although this has not worked in the past I am sure it is bound to work this time around.” This is similar to the model of Path Dependency.

Randomness

One final one is the mental model of Randomness as explained by Farnam Street: “much of the world is composed of random, non-sequential, non-ordered events. We are “fooled” by random effects when we attribute causality to things that are actually outside of our control.”

Remember the idea with all of these mental models is to build up a bank that we can draw from at any time to help interrogate and explain situations we are in.

There are plenty more to use – feel free to share any other thinking tools and mental models to use when exploring research in the comments below.

I use these types of mental models all the time when I am working with leadership teams on development projects. I hope you have found these four a useful addition to your critical thinking toolkit.

#28daysofwriting

Photo by Clem Onojeghuo on Unsplash

Up and Down the Ladder of Abstraction

A mental model that I frequently use is the Ladder of Abstraction. It was developed by the American linguist S. I. Hayakawa in his 1939 book Language in Action.

The model describes varying levels of abstraction (up) and concreteness (down) and helps describe our language and thoughts.

The higher up the ladder you are the more abstract the idea, language or thought is. The lower you are on the ladder the more concrete the idea, language or thought is.

You can also think about the ladder as scaling out (abstracting) and scaling back in (concrete). I often use the language:

Let’s zoom out for second. Why is this connected to other projects?

OR

What does this look like in the classroom? Zoom back into the day to day experience for me.

And of course there is a parallel to the ideas of theory Vs experience.

It is helpful to note that different types of questions or interactions move dialogue up or down the ladder.

Screenshot 2018 02 03 at 4.08.31 PM

Let’s look at some simple examples based on developmental work in schools. The first few illustrate how you can use the ladder as a way to think about problem solving. You can also use the 5 Whys mental model here.

*Remember that the ideas illustrated on the ladders below would each emerge during discussion and dialogue. Each idea might unfold as different questions are posed and pondered on.

The blue example below is simple enough to see it is a not a behaviour issue but a communication issue perhaps.

PGS Inspiring Me 1

The green example suggests the link between report writing and staff wellbeing. It not just an assessment issue but something that might have a negative impact on health.

PGS Inspiring Me 2

Yellow and purple below are slightly different as they might illustrate a more general use of the ladder. Not necessarily to understand the problem, as above, but to broaden our understanding of an idea.

When we ladder down into the concrete and back up into the abstract concept we have a much more rounded sense of the idea. This makes communication much more successful as you work both ends of the ladder.

Be mindful of which end you spend time in the most when working with your ideas or with your teams. Try and strike a balance.

PGS Inspiring Me 3

PGS Inspiring Me 4

The Ladder of Abstraction is commonly used as a model for interviewing and I have used this many times  during the design thinking process. As this piece from the dschool illustrates.

Often times abstract statements are more meaningful but not as directly actionable, and the opposite is true of more specific statements. That is why you ask ‘why?’ often during interviews – in order to get toward more meaningful feelings from users rather than specific likes and dislikes, and surface layer answers.

So it is great model for your design toolkit.

Take a look at these further thinking prompts to help you move in an agile way on the ladder, by Andrew Dlugan on the Six Minutes site. A great post that is well worth a read.

Moving Down the Ladder

  1. Embrace the phrase “For example…” .
    Provide real-world tangible examples for your theories and ideas.
  2. Use sensory language.
    Help your audience see, touch, hear, taste, and smell.
  3. Be specific.
    Provide ample details.
  4. Tell stories and anecdotes.
    Stories add emotion and realism to any theory.
  5. Cite datastatistics, and case studies.
    They offer support for your theories.
  6. Feature photographs and props.
    Remember that all words are a higher level of abstraction compared to the real thing. Use the real thing.
  7. Have a strong call-to-action.
    Show your audience how to put your message into practice.
  8. Answer “How?” questions.
    Questions like “How does this work?” force you to more concrete explanations.

Moving Up the Ladder

  1. Answer “Why is this important?
    Give the deeper meaning behind the concrete facts and data.
  2. Provide the big picture.
    Explain the context and orient your audience.
  3. Reveal patterns and relationships.
    Help your audience see how the ideas connect — both to other ideas and their lives.
  4. Draw diagrams.
    Help your audience form mental models of processes, objects, etc.
  5. Use appropriate charts.
    Go beyond pure data to show trends.
  6. Reveal the lesson.
    Follow every story or case study with the key insights.
  7. Draw inferences.
    Apply sound logic to generalize from particular cases.
  8. Summarize into principles and guidelines.
    Help the audience learn from your experience by providing principles they can use.
  9. Appeal to shared ideals.
    Draw connections between your message and the ideals held by your audience, such as justice, truth, liberty, or freedom.

Let me know how you get on with this little model, a worthy addition to your toolkit. This is a core activity for me, something I keep coming back to again and again.

Emerging leaders often find this difficult as they have to step out of just thinking about their own classroom.

I firmly believe that the capacity to move up and down the Ladder of Abstraction is a key skill for any leader.

Some further reading:

Method 19 of 100: Laddering Questions | Designing the User Experience as Autodesk

How/Why Laddering | The K12 Lab Wiki | dschool 

Abstraction Laddering: Clearly Define the Problem | Autodesk 

The Ladder of Abstraction and the Public Speaker | Six Minutes 

Writing as a way to process our experience

Despite over a decade of enthusiasm for blogging I realise that writing is not for everyone – but reflecting on our craft should be.

Writing about my reflections forces me to make sense of my ideas. When writing with an audience in mind I have to communicate my thinking in a cogent way.

Writing is a reflective catharsis.

Developing a blog post quickly became a key method for processing my classroom and leadership experience. It filters ideas and tensions, encourages critical thinking and archives my experiences. Despite writing less these days on my blog, writing is still a vital part of the way I reflect on my professional experience and adopt the attitude of dialogue.

Every week I share a little email newsletter with 3 paragraphs about ideas I am exploring or experiences in schools I have had. With over 50 issues now and hundreds of subscribers it has been another successful medium for my thinking.

Sharing reflections on a blog or in a newsletter is not just about the end result. It is not just about the published piece or the ensuing reactions and conversations. The true value is in process it takes to allow people to catch a glimpse of your thinking.

Photo by Park Troopers

Responsive Leadership – leading from the back to the front

 

I recently stumbled upon a new label for the behaviours we associate with leadership. In this short clip Nipun Mehta explains a “different paradigm of leadership, which he calls “laddership””.

After rolling the idea around a little I thought I would share some thoughts on how it relates to my experience of leadership and development in schools and beyond.

Laddership refers to the role of the leader. The ladder being like the leader. So that others may climb rungs we might create and reach new heights above us. It reminds me of servant leadership.

This way of thinking is placed in contrast to the “lead from the front” type of ideology, that some might consider to be a traditional leadership paradigm.

In education we can be lulled into thinking that leadership only occurs at the upper echelons of a school administration or in those roles with “leader” in them. The career path is set out in front of many aspiring young leaders and it often only looks like a pyramid. This reflects the typical paradigm of a hierarchy in schools and school systems.

My teaching experience was similar. I was tapped on the shoulder for middle leadership within my first year out of university and the steps up were pretty clear. Maybe you have been presented with a similar direction: “If you want to be a leader follow this traditional path.”

The idea of a ladder for others to progress sits well with me. I now know that such an idea is relevant to anyone aspiring to lead. There are different ways to lead, and many different paths to help others rise above you. Education needs to offer more paths through leadership and not just those that point upwards.

Ultimately we need to put energy into redefining leadership in schools so that more educators understand the impact they can have on others.

I started a blog that shared my ideas, my thinking and my classroom experiences. That helped me understand the impact I could have on others. I realised I could lead in a different way – fast forward a decade and I still keep that idea at the heart of my work. I am leading by creating the conditions for others to progress and develop. It might not say Principal or Headteacher on the office door (I don’t actually have an office door) but I know my work is leadership.

Leadership can be defined in multiple ways depending on the sector or domain it sits within. But also defining leadership within a sector has great contextual dependency too. Education is no different.

The leadership that needs to be shown in the emergency services during the bushfire seasons, here in Australia, is very different to the leadership needed at a K-12 school to develop an innovative culture.

In our attempts to seek out the fundemental truths about leadership perhaps we polarise our thinking too much. We might covet the entrepreneurial mindset in schools and look to business for ideas on development, but we should never forego the intimate understanding of the educational context we work in. Cookie cutters are not a leadership tool.

When we setup Laddership Vs Leadership and suggest a shifting of paradigms, or systems of thought, we create these false dichotomies. So although the idea of creating ladders resonates, I think it is unrealistic to set up competing concepts in this way – a choice we have to make, a move we have to make.

In the Design of Business Roger Martin explains a series of ideas related to design thinking and leadership, for example: exploration Vs exploitation; analysis Vs intuition; originality Vs mastery. You can see the others in the image I have added. But the choice is not “either or”. Creative problem solving requires a range and mixture of different thinking modes at different times. It reminds me to consider the balance of different types of thinking rather than such polarised choices.

Design Thinking.005

Adaptive and responsive leadership perhaps describes this best. In certain situations in schools a “lead from the front” style of leadership is the most appropriate. When there is high urgency for change or important processes that need to be modelled and established. Or when we are attempting to shift ingrained habits and behaviours to something different, maybe “follow me” works best.

That same leadership approach should adapt and respond to the context it is in. As Nipun Mehta explains, shifting to the back and allowing others to push ahead and lead the way. Developmental work in schools often needs people to buy in and have ownership. These are good opportunities for intentional and thoughtful design leadership. The best possible conditions for progress and development are (co)created.

When I am working with teams I am attempting to create these conditions. I use a range of protocols that help establish the expectations for the time together. One of them is about how we each need to take responsibility to balance our participation in the session.

Step up and step back is a protocol about session participation but it also has a strong likeness to the idea of responsive leadership. You don’t have to make a solitary choice, you don’t need to operate under a fixed ideaology. Adapt, change and respond to what is in front of you. Increase your awareness of this balancing act.

Nelson Mandela refers to a balance:

It is better to lead from behind and to put others in front, especially when you celebrate victory when nice things occur. You take the front line when there is danger. Then people will appreciate your leadership.

I have presented similar ideas in the past about teaching and learning. Perhaps the true art of leadership is in the complex balancing act between these paradigms. It is not in the extremes.

  • Strike a balance
  • Respond and adapt to what is in front of you
  • Step up and step back
  • Leverage your empathy

The leaders I work with every week wrestle with the tension and complexity of real situations. These constantly demand both the subtle art of nudging others to move ahead, with pointing the direction and inviting others to follow.

In my experience leadership is as much about creating the conditions for others to develop as it is helping to direct that progress.

Photo by Daryan Shamkhali

Change your thinking, change your mindset

A maxim that I have been testing, applying and thinking about a great deal over the last few years is that “nothing changes unless mindset changes.” On reflection, admittedly it is a little extreme, however it does present an urgent (and often much needed) provocation regarding the way we are thinking about learning in schools and other organisations.

Einstein has become a veritable one man maxim generator as people mine his missives and printed articles for quotable quotes. His reference (in the image) to the need for changing our thinking, altering the routines and habits of thinking that were present in creating the problem, to perhaps solve it, makes a lot of sense to me.

Thinking Wild and Free

In fact it gives us license. Changing mindset takes time, for many it is a long process of practice change coupled with ongoing coaching and reflection binding it all together. We don’t just wake up in the morning with a new mindset. Those habits and dispositions are baked in. I read today how long it takes to create new learning habits, on average at least two months for new habits to become automatic behaviours.

Thinking routines and activities can be picked up and used more flexibly. Although someone may have a particular mindset or disposition, thinking routines can still be practised and activities used. Rinsed and repeated.

Changing our thinking might just change our mindset.

To underline the importance of mindset or disposition on the work we embark upon and the relationships we have Bill O’Brien, the late CEO of Hanover Insurance pointed out:

The success of an intervention depends on the interior condition of the intervenor.

Perhaps he is referring to the disposition or thinking condition of those present, their mindset. We can have all the plans or ideas we like, but unless the mindset is synchronised, nothing changes, or we are at least limiting our chances of success.

Otto Scharmer refers to the lack of awareness of this interior condition (mindset) as a leadership blindspot. Something to explore further, not simply how reflective we are as leaders, but also how well we know the influence of our own disposition, and those of others around us, on our projects and ideas,

Get Out of the Swamp

Another logical and confronting part of Albert Einstein’s challenge is the conclusion that we know more now than we did when the problem was generated. We need to change our thinking to adapt to this new information. Dr Terry Cutler piqued my interest with a reference to conventional wisdom being the enemy of an innovative culture:

William Blake reminded us – in chilling words – that the person who does not alter their opinion in the face of new knowledge is like a “stagnant pool which breeds reptiles of the mind”

So if times have changed, we need to ask ourselves some key questions:

pablo (3)

I recently asked my newsletter subscribers about their biggest challenges in changing other people’s thinking habits. One of the biggest obstacles was resistance to change, people actively choosing not to engage in new thinking routines, persisting in defence of a particular problem generating mindset.

Let’s not beat around the bush, these ‘reptiles of the mind” are very much part of the problem itself. This touches on some of the intricacies of the work of culture change and relationship centred development. Learning is a complex and wonderful thing and sometimes it is hard to discern how much influence people have on the conditions for learning (+/-).

Don’t Expect A Paradigm Shift

An example, just as a thought experiment, might be that a class of Year 6 children are poorly behaved during lessons with a particular teacher. The behaviour has formed a discernible pattern and seems to be associated with, and in reaction to a highly prescriptive and didactic approach to teaching from the teacher. There is a mindset at play here. The notion of planing creative learning activities, and spending less time talking at the kids is an alien one for the teacher. Something to be guarded against. “Why change?” comes the defensive play. What would you do to help the teacher and the class?

Start with empathy.

  • How much do we understand the mindset of those in this situation?
  • How can we move to a closer appreciation of the truth of this experience for those involved?
  • What situations are similar to this and how might we draw on those experiences to inform our decisions here?

Dig deeper. Complex problems like this one are rarely anything to do with the surface signals. 5 Whys is a great activity to explore to help dig deeper when used in support of other data gathering.

  1. Why are children behaving poorly? They are not engaged in the lessons.
  2. Why are they not engaged in the lessons? They are not doing enough thinking for themselves.
  3. Why are they not thinking for themselves? There is too much teacher talk.
  4. Why is there too much teacher talk? Lessons are imbalanced towards lots of a didactic teaching method and this is poorly differentiated
  5. Why is there this imbalance and poor differentiation? The teacher has been designing learning on their own for a long time and has not had the same chance to work collaboratively with others, and have their work critiqued and reviewed.

A couple of things to share about this scenario. First of all the disposition (of the teacher) is not suddenly going to change, we don’t get out of bed and suddenly all is reversed remember. So maybe we need to defer the paradigm shift expectation for one associated with the way we are thinking about the design of learning. Sure these overlap, but by changing the thinking routine, in this case through more collaborative planning, perhaps the situation will change.

Intentionally Creating Problems

My son pointed out that maybe when you create maths problems it is an exception to what Einstein is saying. This was affirmed by fully grown adults too on Twitter who shared a similar opinion. I wonder if it is something to do with how intentional the genesis of the problem was, along with the level of complexity the problem has.

Complex or wicked problems rarely involve single answers and are the product of a similarly complex, turbulent crucible of conditions. This would be true for coral bleaching as it is for poor collaboration in an organisation. In my book what Albert, let’s call him Albie, is referring to is the level of thinking needed for complex problem solving. Problems that are created in conditions defined by disparate and multiple dispositions pulling in different directions perhaps.

I wonder how much our intentions play a role here as well. We rarely intentionally create problems at work and at home (hopefully) and so it is with a lack of awareness that problem conditions set in. An increased awareness would be a good example of a change in thinking that might lead to a solution. For the teacher example above this may also be true, just increasing awareness of too much teacher talk may help to resolve things (in the short term at least).

Intentionally creating problems suggests a level of awareness of choice, causality and consequence. You might expect this awareness when solving such problems too. So maybe we need different types of thinking when we didn’t intend for the problem to occur.

If I return to my original reference, “nothing changes unless mindset changes”, through writing this post it has helped me explore the notion that changing our thinking in aggregate might change our mindset. It has been good to define those key questions for unpacking problem conditions which I hope you find useful.