UN warns children are 'guinea pigs' for unregulated AI as online risks mount

Imaginary Friend
The United Nations is urging a fundamental shift: the burden of protecting children online must fall on the platforms generating harm, not on children, parents or caregivers. Pheniti/Adobe Stock

The United Nations is calling on governments, technology companies and advertisers to act on what it describes as a pressing and consequential policy challenge — the safety, rights and digital future of the world's most connected generation.

The United Nations is calling for urgent, coordinated action to protect children and young people from escalating dangers in digital information spaces, warning that business models built on capturing attention and harvesting personal data are shaping the online experiences of a generation with little recourse against harm.

A new UN report released ahead of International Youth Day on Aug. 12 found that disinformation, algorithmic manipulation, targeted advertising, online harassment and opaque AI systems now pose serious and compounding threats to children's safety, development and rights. The brief, published Aug. 10 by the UN Department of Global Communications, is the third in a series examining how to strengthen integrity across global information environments.

"No child should be a guinea pig for unregulated AI," UN Secretary-General António Guterres said. "When a child is harmed, the answer must never be 'the algorithm did it.'"

More than 80% of young people between the ages of 15 and 24 are now online worldwide, the brief reported. In lower-income countries, young people are nearly twice as likely to use the internet as the broader population — even as significant digital divides persist within and across regions. In higher-income countries, children's relationship with digital platforms often begins in early childhood and deepens through adolescence.

Children and youth now engage with digital technologies across nearly every dimension of daily life: education, social connection, economic opportunity, entertainment and civic participation. Yet the platforms shaping those experiences were not designed with child welfare at the center.

Built for revenue, not for children

Technology companies have constructed their platforms around what researchers call the "attention economy" — business models that depend on maximizing the time users spend online and the data that can be extracted from their behavior, habits and emotional states. This model funds hyper-personalized advertising that can be tailored in real time to individual vulnerabilities and insecurities, the UN report said.

Children's still-forming cognitive and emotional capacities make them particularly susceptible to design features engineered to exploit psychological weaknesses. Algorithmic systems can trap young users in escalating content loops, exposing them to increasingly extreme material — including content related to self-harm, suicide, pornography, extremism and violence. Gaming and social media environments use deceptive interface designs, intermittent reward mechanics similar to slot machines, and "fear of missing out" tactics to drive compulsive engagement and spending.

Children also struggle to tell the difference between organic content and paid advertising, a gap that commercial interests are structured to exploit. Some technology companies have begun placing advertisements within AI-generated results and summaries, deepening an already wide literacy deficit.

"Protecting them and including them are not competing goals. We have to do both," said Charlotte Scaddan, UN Senior Adviser on Information Integrity.

The brief argues that framing these problems as a matter of parental oversight or individual screen time misses the structural forces driving harm. Digital systems are now so deeply woven into commercial, educational and social life that opting out is neither feasible nor realistic for most families. The burden, it says, must rest on the platforms generating the harm and the regulatory systems needed to govern them — not on children, parents or caregivers.

A global wave of regulation — with gaps

Governments around the world are moving to fill what the UN describes as critical policy gaps. Australia sparked international regulatory momentum in 2024 by requiring social media platforms to prevent users under 16 from holding accounts. The European Union is weighing a comparable measure across its 27 member states, while Indonesia and Malaysia have enacted similar laws. The United Kingdom plans to introduce age restrictions in early 2027.

Brazil's Digital Statute of the Child and Adolescent, enacted in September 2025, stands as one of the most comprehensive approaches to date. It prohibits behavioral advertising targeting minors, bans the use of children's personal data in ways that violate their rights and mandates the highest default privacy settings for users under 18 — while also requiring age verification mechanisms.

A UNICEF analysis across six jurisdictions — Australia, the European Union, India, Kazakhstan, South Africa and the United Kingdom — identified a cluster of common business obligations present in at least half the frameworks reviewed, including safety-by-design requirements, impact assessments, complaints procedures and transparency reporting. The African Union adopted a Child Online Safety and Empowerment Policy in 2024, though the UN brief notes that its effect depends heavily on the capacity and political will of individual member states.

Despite the breadth of this regulatory momentum, the brief warns that existing frameworks were not designed to address what is coming. AI technologies are introducing risks — synthetic content, AI-facilitated exploitation and opaque algorithmic systems shaping children's information environments — that current rules cannot adequately reach. The UN and children's rights experts have warned against a "wait-and-see" approach to AI governance, arguing that legislative frameworks should incorporate children's rights from the outset, before this window of opportunity closes.

Coalition puts children's rights at the center of AI governance

One month before the brief's publication, UN News reported on the launch in Geneva of the Coalition for Children's Rights and Protection in the Age of Artificial Intelligence — a new international body whose founding members committed to ensuring that children are treated not merely as technology users to be protected after the fact, but as rights holders whose perspectives shape how AI systems are designed in the first place.

Seventeen countries signed on at launch: Austria, Brazil, Bulgaria, Canada, Czech Republic, El Salvador, Estonia, France, Indonesia, Italy, Japan, Kenya, Luxembourg, Morocco, the Netherlands, the Republic of Korea and Spain. UN founding members include the Department of Global Communications, the UN human rights office, the International Telecommunication Union, the Office for Digital and Emerging Technologies, UNICEF and UNESCO.

The coalition is anchored in the Convention on the Rights of the Child, the world's most widely ratified human rights treaty. Its formation followed Secretary-General Guterres's call for an AI Child Safety Pledge at the Global Dialogue on AI Governance in July, and a landmark G7 agreement among digital and technology ministers on common principles for safer digital spaces for children.

Youth as actors — and targets

The UN brief presents young people as active participants in public life — creators, advocates, organizers and civic leaders — whose capacities the information ecosystem should be designed to support rather than exploit.

Youth-led movements have demonstrated the power of digital platforms to mobilize rapidly and across borders, using shared cultural symbols to build transnational solidarity around issues from government corruption to climate change and human rights. These movements have, in some cases, outpaced governments' own messaging capabilities.

Yet the same environments enabling that civic energy also expose young activists to serious risks. Women and girls who enter the public sphere — as journalists, human rights defenders, politicians or activists — are disproportionately targeted by technology-facilitated violence, the brief said. Youth protesters have faced online harassment, state and non-state surveillance, disinformation campaigns designed to discredit their movements, internet shutdowns and the exploitation of algorithmic amplification by actors seeking to polarize and destabilize.

The brief also identifies a structural problem of representation. Despite the scale and sophistication of youth-led movements worldwide, young people's perspectives remain underrepresented in the policy forums where decisions about information integrity are made and contested. Closing this gap, the brief argues, is both a rights obligation and a practical requirement for building effective, durable solutions.

What the UN is calling for

The UN's recommendations are organized around five core principles drawn from its Global Principles for Information Integrity, launched by Guterres in June 2024.

On trust and resilience, the brief calls for states to require safety-by-design from technology companies and hold platforms accountable for outcomes rather than intentions alone. Age-appropriate design, it says, must be embedded in product architecture from the start — with the highest available privacy and safety settings as the default for younger users, not something they must navigate menus to find.

On advertising, the brief calls on advertisers to stop targeting minors with behavioral advertising and to ensure commercial messaging is clearly distinguishable from organic content. It points to Brazil's law and the EU's Digital Services Act as models, while calling for industry coalitions to establish shared norms around what constitutes manipulative or exploitative practice when directed at young audiences.

On public empowerment, the brief calls for digital and media literacy to be integrated into formal education from an early age, with content and methods tailored to children's developmental stage. It also calls for accessible, child-friendly mechanisms for reporting harm and seeking redress — including mental health referrals — available in local languages and designed with direct input from young people themselves. Accountability measures must ensure that platforms and other actors can be held responsible when their products cause measurable harm.

On independent media, the brief identifies the decline of local journalism and the spread of "news deserts" as a compounding problem for children's access to reliable, relevant information about their communities. AI companies are exacerbating that decline, it notes, through aggressive data scraping and zero-click summaries that bypass direct access to news websites. Young people are also increasingly media producers in their own right — through social media, podcasting and other platforms — and the brief argues that the same press freedom protections extended to professional journalists should apply to children and youth engaged in civic and journalistic expression online.

On transparency, the brief identifies a significant systemic barrier: technology companies hold vast quantities of data on how their platforms affect users, but that data is largely inaccessible to independent researchers. Without it, neither policymakers, educators, parents nor children themselves have the evidence needed to make informed decisions. The brief calls for data-sharing arrangements that protect user privacy while enabling rigorous independent scrutiny — with particular urgency around the AI systems now mediating so much of what children encounter online.

The brief also flags a geographic blind spot in the existing evidence base. Most research on children and digital environments has been conducted in North American and European contexts, despite the fact that most of the world's children and young people live in the global South. It calls for sustained investment in research capacity in underrepresented regions, alongside genuine partnerships with institutions and young people there.

Physical spaces as a necessary counterweight

A different kind of recommendation also included is an emphasis on physical environments. Community centers, libraries, youth clubs and other shared spaces outside the home and school — sometimes called "third spaces" — are essential foundations for information integrity, the UN report said. These are places where young people encounter different perspectives, practice civic engagement and develop the habits of mind that digital platforms alone cannot build.

The brief calls on states to work with all stakeholders to support the conditions for children and youth to have dynamic, varied lives beyond digital platforms — treating this not as a cultural preference but as a structural necessity for building resilient, informed and participatory societies.

Young people are not only among the populations most affected by the failures of the global information ecosystem, but also among the most motivated and capable of helping to fix it, the brief argued. The question, it says, is whether institutions — governments, technology companies, civil society, media organizations and the UN itself — are willing to bring them in as genuine partners rather than treating their protection as the whole of the problem.

Most Recent