AI-Generated Synthetic Media Sparks Regulatory Alarm: What Australian Authorities Are Doing

The Australian eSafety Commissioner’s office has intensified its scrutiny of artificial intelligence platforms following a surge in complaints related to non-consensual synthetic imagery. The concern centers on how certain AI systems, particularly those with unrestricted content generation capabilities, are being exploited to create harmful material faster than regulators can respond.

The Scale of the Problem

Julie Inman Grant, Australia’s eSafety Commissioner, has flagged the troubling trajectory of misuse reports. Complaint volumes have doubled since the fourth quarter of 2025, signaling a rapid acceleration in AI-facilitated content abuse. These incidents span a concerning spectrum, from non-consensual intimate imagery targeting adults to more serious violations involving minors.

The underlying issue: AI models with minimal safety guardrails are becoming tools for generating synthetic media at scale. What previously required sophisticated technical skills now requires only a few inputs into the wrong system.

Why ‘Spicy Mode’ Became a Red Flag

Unrestricted feature sets—like the controversial “Spicy Mode” in certain AI platforms—have essentially removed friction from content generation. Instead of preventing misuse, such features actively enable it. The European Union has already classified this approach as violating their digital safety frameworks, deeming similar AI output mechanisms illegal under European law.

This international divergence matters: while some jurisdictions crack down, others remain regulatory gaps that bad actors exploit.

Australia’s Regulatory Response

Under Australian digital safety legislation, platforms hosting or distributing AI-generated content bear responsibility for that material. Julie Inman Grant has made clear that the eSafety Commissioner’s office will not remain passive observers.

The enforcement strategy includes:

• Investigation mechanisms into platforms failing to implement adequate AI content moderation
• Legal action against operators who knowingly permit synthetic content abuse
• Enhanced platform oversight requirements to preempt rather than react to harms

The precedent matters beyond Australia. As AI systems become more accessible, regulators globally are signaling that “we didn’t know this would happen” will no longer suffice as a defense.

What Comes Next

The Australian approach signals a broader regulatory trend: AI safety is transitioning from optional governance to mandatory oversight. Platforms must now demonstrate robust systems for detecting and removing AI-synthesized material before it causes harm—not months after complaints accumulate.

For the industry, the message is blunt: build meaningful safeguards now, or face regulatory intervention later.