Skip to main content

What Data Can’t Do

I came across this fascinating article from the The New Yorker that really speaks volumes about how careful we have to be when it comes to using and visualizing data. Whenever you try to force the real world to do something that can be counted, unintended consequences abound. The COVID pandemic demonstrated just how vulnerable the world can be when you don’t have good statistics, and the US Presidential election filled our newspapers with polls and projections, all meant to slake our thirst for insight. The same applies to education where knowing what to measure, but also why you want to measure it, is the primary hurdle to tackle. We all have a tendency to naturally trust data as it aims to represent something we are observing. However there are times when simply even solid data is not enough for decision making. That’s why the context, the aim, and the balance between quantitative and qualitative data is so important. As the article states: “The great psychologist Daniel Kahneman, who, in his book “Thinking Fast and Slow,” explained that, when faced with a difficult question, we have a habit of swapping it for an easy one, often without noticing that we’ve done so. There are echoes of this in the questions that society aims to answer using data, with a well-known example concerning schools. We might be interested in whether our children are getting a good education, but it’s very hard to pin down exactly what we mean by “good.” Instead, we tend to ask a related and easier question: How well do students perform when examined on some corpus of fact? And so we get the much lamented “teach to the test” syndrome.” You can read this fascinating article in full here. 


Popular posts from this blog

Building and Leading a School Culture that Values Data Informed Dialogue to Improve Student Learning

(This post is by Megan Brazil, Elementary School Principal, United Nations International School, Hanoi. The post was first published online in 2016.) In a ‘silo schools’ approach, teachers have generally been left to work independently on collecting, understanding and using their own classroom data to make decisions about instruction, planning and assessment. Many schools have not yet made the successful transition from individual to collaborative: to enable teams of teachers to collectively analyze  learning data in order to improve learning outcomes for all students. What we know to be true in many schools is that teachers still spend a disproportionate amount of time planning instruction, but don’t place the same emphasis or effort on finding out if the instruction really worked. Perhaps then, less importance has been placed on finding time for teams of teachers, coaches and administrators to take a look at the ‘back end’ — the learning that has taken place as a result of the planni

Designing Best-Fit Classes with the Class Placement Engine

(This post is by Ben Hacking , Deputy Principal at the Vienna International School ) Established in 1978, the Vienna International School (VIS) is a CIS accredited, IB World School situated in Vienna, Austria.   The School serves students from kindergarten to grade 12 who come mostly from the diplomatic corps and international businesses based in Vienna.   Diversity is one of VIS’s greatest strengths and the School is proud that of the 1368 students attending, approximately 112 nationalities are represented around 85 native languages are spoken altogether.   This diversity is also represented amongst our approximately 270 faculty members, leadership teams and administrative staff.   VIS joined the Learning Analytics Collaborative (LAC) in 2017-18 after an extensive internal review of, and reflection on, our own data for learning practices.  Over time, we have worked with the LAC to develop a number of engines to support and empower our faculty with the data tools and inquiry processes

LAC School Spotlight - American School of Bucharest

American School of Bucharest (by Andrew Pontius, IB MYP Coordinator, and Fiona Moss, Secondary Vice Principal at AISB) THE SCHOOL Number of students: Approx 950 Grades: EC2 - Grade 12 Number of faculty: 180+ Curriculum: IB (PYP, MYP, DP) Accredited by: NEASC, CIS, IB Joined LAC in the 2017-18 School Year  THE CHALLENGE What was the challenge the school was facing?   The original challenge was just visualizing data. We looked at IB DP Scores, but very little other data was consulted on a regular basis, and the few spreadsheets that were created were looked at only by the leadership teams. Why was LAC chosen?  Andrew had used LAC at his previous school (ISPP), and found that it had helped build some productive conversations in a multitude of ways. When shown to the then Director, the ideas of what else could be implemented grew, and we began working with LAC.  HOW IS THE LAC PLATFORM BEING USED NOW Who uses the platform at the school? Mainly used in Secondary by a range of people. It is