How Science Fiction Could Save Us From Bad Technology

How Science Fiction Could Save Us From Bad Technology
Ahmet Misirligul/Shutterstock

The short film Slaughterbots depicts a near future in which swarms of micro drones assassinate thousands of people for their political beliefs. Released in November 2017 by academics and activists warning of the dangers of advanced artificial intelligence (AI), it quickly went viral, attracting over 3m views to date. It helped spark a public debate on the future of autonomous weapons and put pressure on diplomats meeting at the United Nations Convention on Conventional Weapons.

But this kind of speculative science fiction storytelling isn’t just useful for attracting attention. The people who design and build advanced technology can use stories to consider the consequences of their work and ensure it is used for good. And we think this kind of “science fiction prototyping” or “design fiction” could help prevent human biases from working their way into new technology, further entrenching society’s prejudices and injustices.

A bias can lead to the arbitrary preference of some categories (of results, people, or ideas) over others. For example, some people may be biased against hiring women for executive jobs, whether they are conscious of it or not.

Technology built around data that records such bias can end up replicating the problem. For instance, recruitment software designed to select the best CVs for a particular job might be programmed to look for characteristics that reflect an unconscious bias towards men. In which case, the algorithm will end up favouring men’s CVs. And this isn’t theoretical – it actually happened to Amazon.

Designing algorithms without considering possible negative implications has been compared to doctors “writing about the benefits of a given treatment and completely ignoring the side effects, no matter how serious they are”.

Some tech firms and researchers are trying to tackle the issue. For example, Google drew up a set of ethical principles to guide its development of AI. And UK academics have launched an initiative called Not-Equal that aims to encourage greater fairness and justice in the design and use of technology.

The problem is that, publicly, companies tend to deliver only a positive vision of the potential consequences of near-future technologies. For example, driverless cars are often portrayed as solving all our transport issues from cost to safety, ignoring the increased dangers of cyberattacks or the fact they could encourage people to walk or cycle less.

The difficulty in understanding how digital technologies work, especially those that are heavily driven by obscure algorithms, also makes it harder for people to have a complex and comprehensive view of the issues. This situation produces a tension between a reassuring positive narrative and the vague suspicion that biases are embedded to some degree in the technologies around us. This is where we think storytelling through design fiction can come in.

Stories are a natural method of thinking about possibilities and complex situations, and we have been hearing them all our lives. Science fiction can help us speculate on the impact of near-future technologies on society, as Slaughterbots does. This can even include issues of social justice, like the way certain groups, such as refugees and migrants, can be excluded from digital innovations.

Revealing the (possible) future

Design fiction stories provide a novel way for designers, engineers and futurists (among others) to think about the impact of technology from a human perspective and link this to possible future needs. With a mixture of logic and imagination, design fiction can reveal aspects of how technology may be adopted and used, starting conversations about its future ramifications.

For example, the short story “Crime-sourcing” explores what might happen if AI was to use crowdsourced information and a criminal database to predict who might commit a murder. The researchers found that because the database was full of people in minority ethnic groups who, for social reasons, were statistically more likely to reoffend, the “crime-sourcing” model was more likely to wrongly suspect minorities than white people.

You don’t have to be a talented writer or make a slick film to produce design fiction. Brainstorming activities involving cards and storyboards have been used to develop design fiction and help develop the storytelling process. Making workshops that used these kinds of tools more common would enable more engineers, entrepreneurs and policymakers to use this method of assessment. And making the resulting work publicly available would help to expose potential biases in technologies before they affect society.

Encouraging designers to create and share more stories in this way would ensure the narrative that underpins new technology wouldn’t just present a positive picture, nor an extremely negative or dystopian one. Instead, people will be able to appreciate both aspects of what is happening around us.The Conversation

About the Authors

Alessio Malizia, Professor of User Experience Design, University of Hertfordshire and Silvio Carta, Head of Art and Design and Chair of the Design Research Group, University of Hertfordshire

This article is republished from The Conversation under a Creative Commons license. Read the original article.

books_culture

enafarzh-CNzh-TWdanltlfifrdeiwhihuiditjakomsnofaplptruesswsvthtrukurvi

follow InnerSelf on

facebook-icontwitter-iconrss-icon

 Get The Latest By Email

{emailcloak=off}

LATEST VIDEOS

The Last Ice Age Tells Us Why We Need To Care About A 2℃ Change In Temperature
The Last Ice Age Tells Us Why We Need To Care About A 2℃ Change In Temperature
by Alan N Williams, et al
The latest report from the Intergovernmental Panel on Climate Change (IPCC) states that without a substantial decrease…
A Georgia Town Gets Half Of Its Electricity From President Jimmy Carter's Solar Farm
A Georgia Town Gets Half Of Its Electricity From President Jimmy Carter's Solar Farm
by Johnna Crider
Plains, Georgia, is a small town that is just south of Columbus, Macon, and Atlanta and north of Albany. It is the…
Majority of US Adults Believe Climate Change Is Most Important Issue Today
by American Psychological Association
As the effects of climate change become more evident, more than half of U.S. adults (56%) say climate change is the…
How These Three Financial Firms Could Change The Direction Of The Climate Crisis
How These Three Financial Firms Could Change The Direction Of The Climate Crisis
by Mangulina Jan Fichtner, et al
A silent revolution is happening in investing. It is a paradigm shift that will have a profound impact on corporations,…
Investing In Climate Change
by Goldman Sachs
“Top of Mind at Goldman Sachs” Podcast – In this episode, we dig into what may be the most important issue of our time:…
Climate Change: Briefings from Southern Africa
by SABC Digital News
Climate change affects us all, but it can be a confusing business. Three leading South African scientists who have…
PBS Nova's Polar Extremes
PBS Nova's Polar Extremes
by PBS
In this two-hour special, renowned paleontologist Kirk Johnson takes us on an epic adventure through time at the polar…
A huge iceberg just broke off West Antarctica’s most endangered glacier
A Huge Iceberg Just Broke Off West Antarctica’s Most Endangered Glacier
by Madeleine Stone
Huge blocks of ice regularly shear away from Antarctica’s ice shelves, but the losses are speeding up.

LATEST ARTICLES

Rising Tides Will Leave No Choice For Us Millions
Rising Tides Will Leave No Choice For US Millions
by Tim Radford
Time and tide wait for no-one. As sea levels rise, the rising tides will become more impatient. Millions of Americans…
We Can't Simply Bet On Renewable Energy To Stop Global Warming
We Can't Simply Bet On Renewable Energy To Stop Global Warming
by Steffen Böhm
Here’s the problem: many climate experts warn that the commitments made at Paris still fall far short of what is…
The Last Ice Age Tells Us Why We Need To Care About A 2℃ Change In Temperature
The Last Ice Age Tells Us Why We Need To Care About A 2℃ Change In Temperature
by Alan N Williams, et al
The latest report from the Intergovernmental Panel on Climate Change (IPCC) states that without a substantial decrease…
A Georgia Town Gets Half Of Its Electricity From President Jimmy Carter's Solar Farm
A Georgia Town Gets Half Of Its Electricity From President Jimmy Carter's Solar Farm
by Johnna Crider
Plains, Georgia, is a small town that is just south of Columbus, Macon, and Atlanta and north of Albany. It is the…
How Changes In Weather Patterns Could Lead To More Insect Invasions
How Changes In Weather Patterns Could Lead To More Insect Invasions
by Esther Ndumi Ngumbi
Outbreaks of insect pests and insect invasions are on the rise on the African continent.
Carbon Pricing Is A Proven Way To Reduce Emissions But Everyone's Too Scared To Mention It
Carbon Pricing Is A Proven Way To Reduce Emissions But Everyone's Too Scared To Mention It
by Tony Wood
Opposition leader Anthony Albanese sought to claim the climate policy high ground last week with his commitment to a…
Majority of US Adults Believe Climate Change Is Most Important Issue Today
by American Psychological Association
As the effects of climate change become more evident, more than half of U.S. adults (56%) say climate change is the…
Why The Whitest Communities Most Benefit From Flood Buyouts
Why The Whitest Communities Most Benefit From Flood Buyouts
by Amy McCaig
The federal flood buyout program disproportionally benefits at-risk homes in the whitest communities of America’s…