Red Teaming AI Without Code: UNESCO's Free Playbook to Expose Hidden Bias

Red teaming — deliberately probing AI models to expose their flaws — has always lived behind the closed doors of major AI labs. That means the people most affected by AI's failures rarely get a voice in testing it. UNESCO and Humane Intelligence just changed that: their playbook, Red Teaming AI for Social Good, authored by Dr. Rumman Chowdhury's team, is a step-by-step guide for running your own AI red teaming exercise — and it requires zero coding skills. Here is what's inside, and why it matters even if you're building AI products rather than regulating them.

Why This Playbook Exists

The numbers are hard to ignore. In one survey of 1,000 machine learning engineers, 89% reported encountering vulnerabilities in Gen AI models — errors, biases, or harmful content. Meanwhile, the harms aren't distributed evenly: 58% of young women and girls have experienced online harassment, one study found 96% of deepfake videos were non-consensual intimate content, and women make up only 30% of AI professionals — the very people building these systems.

The core argument: when only the model builders test the models, verification is defined by the creators, not the people who live with the consequences. Red teaming for social good opens that testing to everyone else.

The Two Failure Modes Every AI Test Should Cover

The playbook draws a sharp line between two kinds of risk — and a good red teaming exercise covers both.

1. Unintended consequences (embedded bias)

The model isn't attacked; it simply reproduces biases baked into its training data. The playbook calls this the AI Bias Reinforcement Cycle: biased data → unequal outputs → reinforced stereotypes → AI recycles its own outputs → the bias gets deeper with every generation.

2. Intended malicious attacks

Here, a bad actor deliberately manipulates the model — and Gen AI gives them automation and scale that photoshopping never could. The playbook focuses on technology-facilitated gender-based violence (TFGBV): deepfakes, automated smear campaigns, and harassment content produced with minimal technical skill.