33-17, Q Sentral.

2A, Jalan Stesen Sentral 2, Kuala Lumpur Sentral,

50470 Federal Territory of Kuala Lumpur


OpenAI, known for ChatGPT and DALL-E, is thinking about letting users make AI-generated pornography and other adult content. The company says its no-deepfakes rule will still apply, but some people think this move could clash with OpenAI’s goal of making AI that’s safe and helpful.

Cute female lifeguard standing near the public swimming pool

What OpenAI is Saying

OpenAI released a document talking about its tech and including a plan to let developers and users make NSFW (not safe for work) content. This could include erotic stories, graphic images, hateful language, and a lot of swearing. Joanne Jang from OpenAI says they want to start a conversation about whether banning erotic text and nude images is necessary.

Control and Legal Issues

Jang explains that OpenAI wants to give users a lot of freedom but still follow the law and respect others’ rights. But making deepfakes, where someone’s image is used without permission, is off the table. They’re looking at cases where content with nudity or sexuality matters to users, like for adults.

Meeting Expectations

OpenAI wants to know what users and society expect from their AI when it comes to adult content. They think it’s important to talk about these issues to see if there’s a responsible way to offer AI-generated NSFW material.

Concerns and Pushback

Child Safety and Ethics

Some people, like child safety advocates, worry that this move could hurt OpenAI’s reputation. Beeban Kidron, who works to keep kids safe online, thinks OpenAI is putting money first and not doing enough to stop the negative effects of AI.

Experts Doubtful

Clare McGlynn, a law professor who studies how porn is regulated, doubts that tech companies can responsibly manage adult content. She points to times when AI was used in harmful ways, despite promises to limit it.

Rules and Limits

Right now, OpenAI’s systems have rules that block requests for explicit content. For example, if you ask ChatGPT for an erotic story, it will say no. Developers using OpenAI tech can’t make anything sexually explicit unless it’s for science or education.

What’s Okay to Discuss

The document from OpenAI mentions that it’s okay to talk about sex and reproductive health in a scientific or medical way, without it being considered erotic. This is meant to balance what users need with ethical and legal concerns.

Real-World Problems: Celebrity Deepfakes

The issue of AI-made adult content was highlighted when the platform X (formerly Twitter) had to block searches for Taylor Swift because of fake explicit images of her. This shows the risks and moral problems with AI-created adult content.

UK Laws on the Horizon

In the UK, the Labour party is thinking about banning tools that make nude images of people without their permission. This shows how worried people are about AI being used to create explicit content unfairly.

OpenAI is thinking about letting AI make adult content, which has sparked a debate about morals and user safety. Let’s dive into the details and the arguments around this topic.

New regulations


1. Why is OpenAI considering allowing AI-generated pornography?

OpenAI wants to explore the potential for users to create adult content responsibly. They believe it’s important to have a discussion about whether all erotic text and nude images should always be banned. They aim to balance user freedom with legal and ethical responsibilities, particularly for adult users.

2. How will OpenAI ensure that AI-generated adult content is safe and ethical?

OpenAI plans to implement strict rules and safeguards to prevent misuse. Their technology already blocks requests for explicit material, and they have clear guidelines for developers. They are also committed to not allowing deepfakes. OpenAI wants to ensure that any adult content created with their tools respects the law and people’s rights.

3. What are the concerns about AI-generated pornography?

Critics worry that allowing AI-generated adult content could undermine OpenAI’s mission to create safe and beneficial AI. Child safety advocates and experts in pornography regulation are concerned about the potential for misuse and the negative impact on society. There are fears that this move prioritizes commercial interests over ethical considerations and could lead to harmful consequences, like non-consensual explicit content.

Sources The Guardian

One comment

  1. It’s understandable that OpenAI wants to explore new frontiers, but diving into AI-generated adult content raises significant ethical concerns. Balancing freedom with responsibility is crucial, especially when it comes to sensitive topics like pornography. The potential for misuse and harm, particularly regarding consent and child safety, must be addressed with utmost seriousness. 🛑🤔

Comments are closed.