Published Oct 31, 2023

727: Unmasking A.I. Injustice — with Dr. Joy Buolamwini

Dr. Joy Buolamwini of the Algorithmic Justice League exposes the profound impacts of algorithmic bias in AI, highlighting the urgent need for intersectional ethics and accountability in technology to combat systemic inequalities and promote inclusive, fair data practices.
Episode Highlights
Super Data Science: ML & AI Podcast with Jon Krohn logo

Popular Clips

Episode Highlights

  • Ethical Dilemmas

    Ethical dilemmas in AI development are multifaceted, involving issues like data privacy and the moral obligations of developers. highlights the risks of AI voice clones being used in scams, exploiting vulnerabilities by mimicking loved ones' voices 1. She also questions the ethicality of using publicly available biometric data without consent, reflecting on her own experiences in computer vision research 2.

    I want a term for AI that's like blood diamonds. That gives you a sense. The way in which it was produced is problematic, to say the least.

    ---

    These ethical challenges necessitate a reevaluation of research practices to ensure they align with evolving ethical standards.

       

    Accountability

    Algorithmic accountability is crucial in addressing AI biases and harms. points out that outdated algorithms can lead to false arrests, emphasizing the need for transparency and corrective measures 3. She also discusses the impact of AI in surveillance, particularly in educational settings where students are wrongfully accused of cheating due to biased AI systems 4.

    It could be the case that algorithms developed in 2015 are what's powering what's leading to someone's false arrest in 2023.

    ---

    These issues highlight the socio-technical challenges in implementing AI responsibly.

       

    Data Privacy

    Data privacy in AI involves handling sensitive information responsibly. shares insights from her Pilot Parliaments Benchmark project, which opted to release metadata instead of original images to comply with GDPR and protect privacy 5. This decision underscores the importance of considering legal and ethical standards in data collection and usage.

    We decided not to release the photos of the actual parliament members, especially with the passage of GDPR.

    ---

    Such measures are vital to safeguarding individual privacy in the age of AI.

Related Episodes