Skip to main content

What Data Can’t Do

I came across this fascinating article from the The New Yorker that really speaks volumes about how careful we have to be when it comes to using and visualizing data. Whenever you try to force the real world to do something that can be counted, unintended consequences abound. The COVID pandemic demonstrated just how vulnerable the world can be when you don’t have good statistics, and the US Presidential election filled our newspapers with polls and projections, all meant to slake our thirst for insight. The same applies to education where knowing what to measure, but also why you want to measure it, is the primary hurdle to tackle. We all have a tendency to naturally trust data as it aims to represent something we are observing. However there are times when simply even solid data is not enough for decision making. That’s why the context, the aim, and the balance between quantitative and qualitative data is so important. As the article states: “The great psychologist Daniel Kahneman, who, in his book “Thinking Fast and Slow,” explained that, when faced with a difficult question, we have a habit of swapping it for an easy one, often without noticing that we’ve done so. There are echoes of this in the questions that society aims to answer using data, with a well-known example concerning schools. We might be interested in whether our children are getting a good education, but it’s very hard to pin down exactly what we mean by “good.” Instead, we tend to ask a related and easier question: How well do students perform when examined on some corpus of fact? And so we get the much lamented “teach to the test” syndrome.” You can read this fascinating article in full here. 


Comments

Popular posts from this blog

From Mission to Metrics

Last week a new LAC school presented me with an interesting question: “ How do we know we’re meeting our mission? ”. It’s the kind of question that we often ask ourselves at accreditation season, but how many schools can truly answer with confidence and evidence? The more I thought about it, the more I realised that unpacking this question is no different to any other data dive we might do. It requires us to understand what we’re measuring, to find a range of data to analyse, and then to use all that evidence to gain a deeper and more holistic understanding of our current situation and future goals.    Step 1: Translating values into visible behaviours What does our mission look like in action? When we are living our mission, our values align with our actions. Let’s take “lifelong learning” as an example phrase we often see in mission statements. Schools that value lifelong learning will likely have administrators that promote and encourage staff professional development...

Using Social and Emotional Data to Promote a Positive School Culture

I came across this great article on Edutopia by Victoria Curry and Mike Setaro on how school leaders can combine traditional data with social and emotional data to get a full picture of the school experience of students and staff. It’s centered around Warm data that gives both dimension and measure to an individual’s and group’s social and emotional status. Opposite to Cool data points, that are a series of structural data sets such as enrollment, attendance, and academic proficiency that typically are the bedrock of school-based analytics. They talk about various examples of Warm data points among them on a matrix with different degrees of pleasantness and energy before engaging in learning (inspired by Mark Brackett’s work). These points can and should be captured, measured and visualized. The insights from this data should be of utmost importance for leaders to find strategies that capture and leverage information related to SEL and interpersonal skills. Harnessing this level of und...

Nurturing Holistic Growth: The Role of Data Analytics in International Schools with a Focus on Social-Emotional Wellbeing

In the dynamic realm of education, international schools are increasingly leveraging data analytics not only to optimize academic outcomes but also to enhance the social-emotional wellbeing of their students. The integration of data analytics into educational frameworks enables institutions to glean insights that extend beyond traditional academic performance, fostering a holistic approach to student development. One of the pivotal aspects of data analytics in international schools is its application in the analysis of social-emotional wellbeing data. By examining factors such as student engagement, behavioral patterns, and emotional states, schools can gain a deeper understanding of the non-academic aspects of student life. This information is instrumental in tailoring support mechanisms to address the unique socio-emotional needs of each student, ultimately contributing to a more nurturing and inclusive learning environment. Data analytics proves particularly beneficial in identifyin...