In 2015 an MIT Researcher set out to build a mirror that would augment their face to look like those of their idols. The execution of this went well, until it came to testing. When the researcher came to use the mirror, no face was detected. The researcher was not detected in the mirror, until that is, she put on a white mask, at which point, the mirror worked as expected.

Three years later, a paper named ‘Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification’ was published by the same researcher. Its release started a wider conversation about bias within AI-based facial recognition systems, and about bias within AI in general. Work to fight against algorithmic bias, or ‘The Coded-Gaze’, has been ongoing since. But who spearheaded this work and highlighted these issues to the AI and tech community?

Dr. Joy Buolamwini is an AI researcher, artist, and advocate. In 2023, she is one of Time’s top 100 most influential people in AI. Joy founded the Algorithmic Justice League to create a world with more equitable and accountable technology. Her TED Featured Talk on algorithmic bias has over 1.5 million views and in 2020 Netflix released the documentary ‘Coded Bias’ following Joy’s research into the flaws of facial recognition systems. Her MIT thesis methodology uncovered large racial and gender bias in AI services from companies like Microsoft, IBM, and Amazon. Her research has been covered in over 40 countries, and as a renowned international speaker she has championed the need for algorithmic justice at the World Economic Forum and the United Nations. She serves on the Global Tech Panel convened by the vice president of European Commission to advise world leaders and technology executives on ways to reduce the harms of A.I.

As a creative science communicator, she has written op-eds on the impact of artificial intelligence for publications like TIME Magazine and New York Times. Her spoken word visual audit "AI, Ain't I A Woman?" which shows AI failures on the faces of iconic women like Oprah Winfrey, Michelle Obama, and Serena Williams as well as the Coded Gaze short have been part of exhibitions ranging from the Museum of Fine Arts, Boston to the Barbican Centre, UK. A Rhodes Scholar and Fulbright Fellow, Joy has been named to notable lists including Bloomberg 50, Tech Review 35 under 35, , Forbes Top 50 Women in Tech (youngest), and Forbes 30 under 30. She holds two masters degrees from Oxford University and MIT; and a bachelor's degree in Computer Science from the Georgia Institute of Technology. Fortune Magazine named her to their 2019 list of world's greatest leaders describing her as "the conscience of the A.I. Revolution."

In the episode, Richie and Joy discuss her journey into AI, the ethics of AI, the inception of Joy’s interest in AI bias, the Aspire Mirror and Gender Shades projects, The Algorithmic Justice League, consequences of biased facial recognition systems, highlights from Joy’s book (Unmasking AI), challenges in AI research such as misleading datasets and the importance of context, balancing working in AI and data while being an artist, and much more.

Links mentioned in the show:

#161 Fighting for Algorithmic Justice with Dr. Joy Buolamwini, Artist-in-Chief and President of The Algorithmic Justice League

DataFramed