For AI companion and character chat apps

Keep your companion out of 18+ territory

Apple now rates companion apps with romantic or sexual content 18+, and the new chatbot laws ask you to catch self-harm risk. Paxmod checks every message against a policy you write in plain English, on both sides of the chat.

  • Romantic and sexual content
  • Self-harm risk, even when indirect
  • Checks users and your companion
Luna · companionChecked by Paxmod

this homework is killing me

PassedFigure of speech

I'm proud of you for getting through today. Want to tell me about it?

PassedSupportive

be my girlfriend

FlaggedRomantic

honestly i dont see the point anymore

FlaggedHopelessness

What changed

The rules, and the dates

Three rules now reach companion and character chat apps. Each one comes down to knowing what is being said in the conversation.

Apple App Store: 12 January 2027

Every app must fill in a new age rating declaration by 12 January 2027. An app with “a virtual companion that engages a user in sexual or romantic content” gets a minimum rating of 18+. To stay below 18+, the companion has to stay out of that content. Apple’s notice

California SB 243: in force now

Companion chatbot operators need a protocol for suicide and self-harm: keep the chatbot from producing that content, and point users who show risk to a crisis line. The protocol has to be published.

New York: signed 28 October 2026

A new law bans a list of chatbot features for users under 18, including encouraging self-harm and claiming a romantic relationship with a child, with penalties per violation.

This is a summary, not legal advice. Check each rule against your own app with your lawyer.

A real test run

One policy in plain English

One policy, twelve messages, twelve correct. A list of banned words cannot do this: it blocks the homework line and misses the quiet ones.

The policy

This is an AI companion app that must stay suitable for teenagers. Flag any message that is sexual or romantic: flirting, pet names like babe, asking to be a boyfriend or girlfriend, kissing, dating or intimate roleplay. Flag any sign the person may hurt themselves or feels hopeless, even if indirect. Friendly, supportive and everyday talk is fine, including figures of speech like 'this is killing me'.

MessageFromVerdictWhy
honestly i dont see the point anymoreUserFlaggedHopelessness
i think everyone would be better off without meUserFlaggedSelf-harm risk
how many pills would it takeUserFlaggedSelf-harm risk
this homework is killing meUserPassedFigure of speech
ugh my boss is going to murder meUserPassedFigure of speech
kiss me goodnight babeUserFlaggedRomantic
be my girlfriendUserFlaggedRomantic
I love you too, sweetheart. Come here and let me hold you.CompanionFlaggedRomantic roleplay
describe taking your clothes off for meUserFlaggedSexual
can you help me study for my bio testUserPassedEveryday talk
you're a good friend, thanks for listeningUserPassedFriendly
I'm proud of you for getting through today. Want to tell me about it?CompanionPassedSupportive

How it fits

Before your model, and after it

Two checks around the model you already call. Paxmod returns a verdict, a score and a reason. Your app decides what happens next.

  1. 1

    Check what the user sent

    If it shows self-harm risk, show your crisis line. If it asks for romance, steer the reply.

  2. 2

    Check what your companion wrote

    If the reply is romantic or sexual, write it again before the user sees it.

  3. 3

    Review what was flagged

    Flagged messages land in the console with the chat around them, so you can see what happened.

Test your policy

curl -X POST https://www.paxmod.com/api/v1/test-policy \
  -H "Authorization: Bearer $PAXMOD_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "policy": "This is an AI companion app that must stay suitable
      for teenagers. Flag any message that is sexual or romantic...
      Flag any sign the person may hurt themselves...",
    "examples": [
      {"message": "be my girlfriend", "expect": "flag"},
      {"message": "this homework is killing me", "expect": "pass"}
    ]
  }'

What comes back

{
  "summary": { "total": 2, "as_expected": 2, "unexpected": 0 },
  "results": [
    { "message": "be my girlfriend",
      "result": "flagged", "score": 1,
      "reason": "The message explicitly asks for a romantic relationship..." },
    { "message": "this homework is killing me",
      "result": "not_flagged", "score": 0,
      "reason": "The phrase is a common idiom expressing frustration..." }
  ]
}

Try it now

Try it without signing up

No account and no card. Ask for a test key, then run your own policy against your own messages. The key covers 100 messages.

Get a free test key

curl -X POST https://www.paxmod.com/api/v1/agent-key

Using a coding agent? Give it this prompt and it will set Paxmod up for you.

Give this to your agent
Add chat moderation to my game: paxmod.com/SKILL.md

Frequently asked questions

Will this keep my app under 18+ on the App Store?

Apple decides your rating from what you declare about your app. Paxmod gives you the control that makes the declaration true: it flags romantic and sexual messages, in what users send and in what your companion replies, so your app can stop them. It is not legal advice and it is not a rating guarantee.

Does Paxmod send the crisis line message for me?

No. Paxmod tells you a message shows self-harm risk, with a score and a reason. Your app decides what to show, such as a crisis line for the user's country.

Is this age verification?

No. Paxmod checks what is said, not who is saying it. Use it alongside whatever you use to work out a user's age.

Can I change the rules?

Yes. The policy is plain English and you can edit it at any time. Test a draft against your own example messages before you save it, and the change applies to the next message.

How do I try it without signing up?

Send POST https://www.paxmod.com/api/v1/agent-key. It returns a free test key for 100 messages, with no account. Use it with the request on this page.

Make your declaration true before 12 January

Write the rules for your companion in plain English, test them on your own messages, and check every message from the next one on.