Don’t just blame YouTube’s algorithms for ‘radicalisation’. Humans also play a part
By Ariadna Matamoros-Fernández, Lecturer in Digital Media at the School of Communication, Queensland University of Technology and Joanne Gray, Lecturer in Creative Industries, Queensland University of Technology.
YouTube’s video recommendation system, in particular, has been criticised for radicalising young people and steering viewers down rabbit holes of disturbing content.
To retain our initiative towards free spirited and independent journalism we require your support |Pay Now
The company claims it is trying to avoid amplifying problematic content. But research from YouTube’s parent company, Google, indicates this is far from straightforward, given the commercial pressure to keep users engaged via ever more stimulating content.
But how do YouTube’s recommendation algorithms actually work? And how much are they really to blame for the problems of radicalisation?
The fetishisation of algorithms
Almost everything we see online is heavily curated. Algorithms decide what to show us in Google’s search results, Apple News, Twitter trends, Netflix recommendations, Facebook’s newsfeed, and even pre-sorted or spam-filtered emails. And that’s before you get to advertising.
More often than not, these systems decide what to show us based on their idea of what we are like. They also use information such as what our friends are doing and what content is newest, as well as built-in randomness. All this makes it hard to reverse-engineer algorithmic outcomes to see how they came about.
Algorithms take all the relevant data they have and process it to achieve a goal – often one that involves influencing users’ behaviour, such as selling us products or keeping us engaged with an app or website.
At YouTube, the “up next” feature is the one that receives most attention, but other algorithms are just as important, including search result rankings, homepage video recommendations, and trending video lists.
How YouTube recommends content
The main goal of the YouTube recommendation system is to keep us watching. And the system works: it is responsible for more than 70% of the time users spend watching videos.
When a user watches a video on YouTube, the “up next” sidebar shows videos that are related but usually longer and more popular. These videos are ranked according to the user’s history and context, and newer videos are generally preferenced.
This is where we run into trouble. If more watching time is the central objective, the recommendation algorithm will tend to favour videos that are new, engaging and provocative.
Yet algorithms are just pieces of the vast and complex sociotechnical system that is YouTube, and there is so far little empirical evidence on their role in processes of radicalisation.
In fact, recent research suggests that instead of thinking about algorithms alone, we should look at how they interact with community behaviour to determine what users see.
The importance of communities on YouTube
YouTube is a quasi-public space containing all kinds of videos: from musical clips, TV shows and films, to vernacular genres such as “how to” tutorials, parodies, and compilations. User communities that create their own videos and use the site as a social network have played an important role on YouTube since its beginning.
Right-wing content creators also know YouTube’s policies well. Their videos are often “borderline” content: they can be interpreted in different ways by different viewers.
YouTube’s community guidelines restrict blatantly harmful content such as hate speech and violence. But it’s much harder to police content in the grey areas between jokes and bullying, religious doctrine and hate speech, or sarcasm and a call to arms.
Moving forward: a cultural shift
There is no magical technical solution to political radicalisation. YouTube is working to minimise the spread of borderline problematic content (for example, conspiracy theories) by reducing their recommendations of videos that can potentially misinform users.
However, YouTube is a company and it’s out to make a profit. It will always prioritise its commercial interests. We should be wary of relying on technological fixes by private companies to solve society’s problems. Plus, quick responses to “fix” these issues might also introduce harms to politically edgy (activists) and minority (such as sexuality-related or LGBTQ) communities.
When we try to understand YouTube, we should take into account the different factors involved in algorithmic outcomes. This includes systematic, long-term analysis of what algorithms do, but also how they combine with YouTube’s prominent subcultures, their role in political polarisation, and their tactics for managing visibility on the platform.
Before YouTube can implement adequate measures to minimise the spread of harmful content, it must first understand what cultural norms are thriving on their site – and being amplified by their algorithms.
The authors would like to acknowledge that the ideas presented in this article are the result of ongoing collaborative research on YouTube with researchers Jean Burgess, Nicolas Suzor, Bernhard Rieder, and Oscar Coromina.
Now that you are here...
From bottled water to oxygen cans, not even the basics are free in a market-driven world. Why then, do we take free and independent journalism for granted? We find ourselves at a time when more people like you, are reading and coming out in support of The New Leam’s independent, in-depth and throughly issue based journalism than ever before. From grassroot stories and field-reports, to in-depth analysis of the pertinent political issues of our times, to news on gender, culture and educational issues- The New Leam has been dedicated to bringing out stories that speak out the soul of India and take you beyond the propaganda-filled corridors of mainstream journalism in India. We have made an important choice of keeping our journalism free of vested political interests, commercial funding and influence of partisan stakeholders, so that we can bring forward news and stories based on facts and provide a platform where readers can find information with integrity and a journalism premised on honesty.
Your support to The New Leam is your contribution towards giving a voice to the voiceless, going to the depths of issues that others shy away from and rigorously illuminating the flame of criticality and courage in dark times. We hope that you will come forward to support The New Leam today so that we can keep delivering quality-independent journalism to you and inform public opinion in the right direction. No matter how big or small your contribution may be, it is tremendously important. It takes only a moment, Support The New Leam now!