Lea Gaslowitz: How to spot a misleading graph

Recorded atJuly 06, 2017
EventTED-Ed
Duration (min:sec)03:46
Video TypeTED-Ed Original
Words per minute190.76 fast
Readability (FK)53.81 medium
SpeakerLea Gaslowitz

Official TED page for this talk

Synopsis

When they're used well, graphs can help us intuitively grasp complex data. But as visual software has enabled more usage of graphs throughout all media, it has also made them easier to use in a careless or dishonest way — and as it turns out, there are plenty of ways graphs can mislead and outright manipulate. Lea Gaslowitz shares some things to look out for. [Directed by Mark Phillips, narrated by Pen-Pen Chen].

Text Highlight (experimental)
     
100:07 A toothpaste brand claims their product will destroy more plaque
200:10 than any product ever made.
300:12 A politician tells you their plan will create the most jobs.
400:16 We're so used to hearing these kinds of exaggerations
500:18 in advertising and politics
600:20 that we might not even bat an eye.
700:23 But what about when the claim is accompanied by a graph?
800:26 Afterall, a graph isn't an opinion.
900:28 It represents cold, hard numbers, and who can argue with those?
1000:32 Yet, as it turns out, there are plenty of ways graphs can mislead
1100:36 and outright manipulate.
1200:38 Here are some things to look out for.
1300:40 In this 1992 ad, Chevy claimed to make the most reliable trucks in America
1400:45 using this graph.
1500:47 Not only does it show that 98% of all Chevy trucks sold in the last ten years
1600:51 are still on the road,
1700:53 but it looks like they're twice as dependable as Toyota trucks.
1800:57 That is, until you take a closer look at the numbers on the left
1901:00 and see that the figure for Toyota is about 96.5%.
2001:05 The scale only goes between 95 and 100%.
2101:09 If it went from 0 to 100, it would look like this.
2201:12 This is one of the most common ways graphs misrepresent data,
2301:16 by distorting the scale.
2401:18 Zooming in on a small portion of the y-axis
2501:20 exaggerates a barely detectable difference between the things being compared.
2601:25 And it's especially misleading with bar graphs
2701:27 since we assume the difference in the size of the bars
2801:31 is proportional to the values.
2901:33 But the scale can also be distorted along the x-axis,
3001:36 usually in line graphs showing something changing over time.
3101:40 This chart showing the rise in American unemployment from 2008 to 2010
3201:44 manipulates the x-axis in two ways.
3301:47 First of all, the scale is inconsistent,
3401:50 compressing the 15-month span after March 2009
3501:53 to look shorter than the preceding six months.
3601:56 Using more consistent data points gives a different picture
3702:00 with job losses tapering off by the end of 2009.
3802:03 And if you wonder why they were increasing in the first place,
3902:06 the timeline starts immediately after the U.S.'s biggest financial collapse
4002:10 since the Great Depression.
4102:12 These techniques are known as cherry picking.
4202:15 A time range can be carefully chosen to exclude the impact of a major event
4302:18 right outside it.
4402:20 And picking specific data points can hide important changes in between.
4502:24 Even when there's nothing wrong with the graph itself,
4602:27 leaving out relevant data can give a misleading impression.
4702:30 This chart of how many people watch the Super Bowl each year
4802:33 makes it look like the event's popularity is exploding.
4902:37 But it's not accounting for population growth.
5002:40 The ratings have actually held steady
5102:41 because while the number of football fans has increased,
5202:45 their share of overall viewership has not.
5302:47 Finally, a graph can't tell you much
5402:49 if you don't know the full significance of what's being presented.
5502:53 Both of the following graphs use the same ocean temperature data
5602:56 from the National Centers for Environmental Information.
5702:59 So why do they seem to give opposite impressions?
5803:02 The first graph plots the average annual ocean temperature
5903:05 from 1880 to 2016,
6003:07 making the change look insignificant.
6103:10 But in fact, a rise of even half a degree Celsius
6203:12 can cause massive ecological disruption.
6303:15 This is why the second graph,
6403:17 which show the average temperature variation each year,
6503:19 is far more significant.
6603:22 When they're used well, graphs can help us intuitively grasp complex data.
6703:27 But as visual software has enabled more usage of graphs throughout all media,
6803:31 it's also made them easier to use in a careless or dishonest way.
6903:35 So the next time you see a graph, don't be swayed by the lines and curves.
7003:39 Look at the labels,
7103:40 the numbers,
7203:42 the scale,
7303:43 and the context,
7403:44 and ask what story the picture is trying to tell.
S M L