I came across this fascinating article from the The New Yorker that really speaks volumes about how careful we have to be when it comes to using and visualizing data. Whenever you try to force the real world to do something that can be counted, unintended consequences abound. The COVID pandemic demonstrated just how vulnerable the world can be when you don’t have good statistics, and the US Presidential election filled our newspapers with polls and projections, all meant to slake our thirst for insight. The same applies to education where knowing what to measure, but also why you want to measure it, is the primary hurdle to tackle. We all have a tendency to naturally trust data as it aims to represent something we are observing. However there are times when simply even solid data is not enough for decision making. That’s why the context, the aim, and the balance between quantitative and qualitative data is so important. As the article states: “The great psychologist Daniel Kahneman, who, in his book “Thinking Fast and Slow,” explained that, when faced with a difficult question, we have a habit of swapping it for an easy one, often without noticing that we’ve done so. There are echoes of this in the questions that society aims to answer using data, with a well-known example concerning schools. We might be interested in whether our children are getting a good education, but it’s very hard to pin down exactly what we mean by “good.” Instead, we tend to ask a related and easier question: How well do students perform when examined on some corpus of fact? And so we get the much lamented “teach to the test” syndrome.” You can read this fascinating article in full here.
“Should we meet with primary and secondary leadership teams separately or together?” This question came up during a recent chat with Joe Barder, IT Director at AIS Lagos, when we were figuring out a strategy for building their data culture. A simple question, but it got me thinking a lot about the difference between organizational culture and organizational practices, and how we need to consider both when fostering change. At AIS Lagos, everyone is eager to dive in and start analysing data. However I also sensed some hesitation from Joe about jumping in without first establishing norms and shared practices. The question of whether to have data discussions at a whole school or division level is really about whether we want to start with targeted, relevant, and actionable sessions tailored for each group, or if we take the time to develop a whole-school shared understanding of what it means to be data-informed. In other words, do we focus on the culture or the practice? On on...
Comments
Post a Comment